Data is scattered across the organization in multiple silos and modern applications are changing the way data is used. Public and private entities need to consume data to create new revenue opportunities and improve efficiency.
However, there is no platform that can enable organizations to make data available in real time while taking into account the imperatives of data confidentiality, enforcement and traceability of data assets. IZAC gives organizations the power to build their own unified private data exchange platform, enabling them to effectively store and exchange information both within and outside their organization.
- User Access and Role Management
- You can define the roles of access for the data exchange system.
IZAC helps you to map the organizational hierarchy for the approval process of data assets.
An administrator can create and define new roles like data producer, data developer, data consumer and others.
An administrator can add users to specific roles, restrict and validate user access.
- Data Extraction
- Users can define specific connectors for their diverse set of structured, semi-structured and unstructured data sources.
Users can preview data structures at the sources and publish data independently.
Data is stored in a persistent, immutable manner within the platform and hence, can be used anytime in the future with proper data lineage, without depending on the source system.
IZAC has the capability to capture change data from a source (insert/delete/update).
Deletion of data at source does not lead to deletion within IZAC.
Data extraction is continuous and real-time, and the results can be viewed and analyzed in real-time.
There is no restriction on the number of data pipelines for data extraction; related statistics are available in real-time.
Statistics like null counts, min, sum, max, etc. are visible in real-time.
Data deletion can be timed.
- Data Transformation
- Users can define data transformation workflows in real-time. Users can perform transformations using a web-based drag and drop tool, without any complex scripting, and publish the enriched data sets.
IZAC supports transformations including data preparation, data cleansing and filtering.
Data transformations are independent of source and destination systems.
All transformed data is stored within IZAC.
- Data Sharing
- IZAC supports data sharing with different members of the same organization.
IZAC can restrict access to data assets to particular users within the platform.
Users can review data assets before sharing, users can use data assets published by other users and users can push data to the database of their choice.
Data once shared can be made immutable.
- Data Quality
- IZAC uses the open-source framework Deequ for verifying the quality of many large production datasets.
Dataset producers can add and edit data quality constraints.
The system computes data quality metrics on a regular basis (with every new version of a dataset), verifies constraints defined by dataset producers, and publishes datasets to consumers in case of success.
In error cases, dataset publication can be stopped, and producers are notified to take action.
Data quality issues do not propagate to consumer data pipelines, reducing their blast radius.
