Data lineage tools for Azure Synapse
Data lineage tools are software that allows to extract, view and analyze data lineage. Data lineage is the process of understanding and visualizing data flow from the source to different destinations. It allows to create a map of the data journey through the entire ecosystem.
Dataedo
Dataedo allows you to extract lineage automatically or design flows manually and visualize how data moves through the system with interactive diagrams. Dataedo supports object and column-level data lineage. It improves transparency, supports impact analysis, and ensures data integrity across an organization.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Keboola
Keboola is a cloud-based data integration platform that helps clients combine, enhance, and publish crucial information for their internal analytics projects and data products in a quick and easy fashion. It collects all kinds of operational metadata, describing user activity, job activity, data flow, schema evolution, data pipeline performance, compliance with a client’s security rules, etc. Based on the metadata, we are able to build data lineage on the fly and automatically. This makes it possible to understand where the data is coming from and how it is used, both for analytical and regulatory purposes.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Collibra Data Lineage
Collibra Data Lineage automatically maps relationships between data to show how data flows from system to system and how data sets are built, aggregated, sourced and used, providing complete, end-to-end lineage visualization.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Informatica Metadata Management
Informatica Metadata Manager is a web-based metadata management tool. You can view data lineage for objects in the Metadata Manager warehouse. Data lineage shows the origin of the data, describes the path, and shows how it arrives at the target. Use data lineage to analyze data flow and troubleshoot data transformation errors.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
IBM Watson Knowledge Catalog
IBM Watson Knowledge Catalog is an open and intelligent data catalog for managing enterprise data that also lets you ensure well-structured and maintained data lineage. It lets you track where data originated and how it’s consumed, increasing trust when accessing data across many sources and destinations
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Secoda
Secoda is a data discovery tool that offers an intuitive, collaborative, and easy to implement data discovery built. It automatically extracts queries to generate data lineage. Currently, it is supporting table lineage for Snowflake, dbt, Redshift, and BigQuery, with support for Postgres, MySQL, and Microsoft SQL Server coming soon. Secoda data lineage can help data teams identify the downstream and upstream dependencies of a table easily. On each dependency, you will be able to see how many levels away a particular table is, with the ability to view the data in a visual form coming soon.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Alation Data Catalog
Alation is a powerful data lineage tool that helps organizations visualize and understand the flow of data across various systems and processes. It automatically captures metadata, tracks how data moves and transforms from source to destination, and offers intuitive visualizations that make it easier for users to trace data origins, transformations, and usage.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Talend Data Catalog
Talend Data Catalog gives your organization a single, secure point of control for your data. Its data flow lineage feature allows you to narrow in on specific objects and shows you how these objects are related to each other, within a model, an external metadata repository, or a configuration. The data flow lineage is based upon connection definitions to data stores and physical transformation rules which transform and move the data.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Atlan
Atlan provides effortless data lineage & governance by letting you auto-construct data lineage & deploy best-in-class data access governance without compromising on data democratization. It automatically parses through your SQL query logs in your data warehouses and BI tools to create a visual view of data lineage.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
erwin Data Catalog
erwin Data Catalog automates enterprise metadata management, data mapping, code generation, and data lineage for faster time to value and greater accuracy for data movement and deployment projects. It lets you generate on-demand lineage down to the column level and visualize data flows from source systems all the way to the reporting layers, including all transformations. Fully configurable and navigable lineage diagrams provide high-level business views as well as detailed technical depictions.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Octopai
Octopai Data Lineage XD is a complete, in-depth, and trustworthy automated lineage tool. With 3 different types of lineage, you’ll find everything you need in one easy-to-use platform. The 3 linage types include Cross-System Lineage (provides end-to-end lineage at the system level from the entry point into the BI landscape, all the way to reporting and analytics),
End-to-End Column Lineage (view column to column-level lineage between systems from the entry point into the BI landscape, all the way through to reporting and analytics), and Inner-System Lineage (details the column-level lineage within an ETL process, report, or database object).
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Global IDs
Global IDs Data Lineage provides automated analysis of the actual flow of data through your enterprise, enabling you to understand – in real-time – where data originates, how it flows through the ecosystem, and how it is transformed en route.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Cloudera Navigator
Cloudera Navigator is the complete data governance solution for Hadoop. Cloudera Navigator automatically collects audit logs from across the entire platform and maintains a full history, with a unified, searchable audit dashboard for simple, point-in-time visibility. With automatic collection and visualization of column-level lineage, users can also quickly identify the origin, usage, and impact of a dataset.
BI Tools lineage: |
|
---|---|
Commercial: | Commercial |
Data migration tools lineage: |
|
Data warehouses lineage: |
|
ETLs: |
|
Free edition: |
|
Hadoop: |
|
NoSQL: |
|
Pipelines lineage: |
|
RDBMS: |
|
Data lineage forms the foundation for accurate data analytics and management. The core features of data lineage focuses on:
• Identifying data quality issues.
• Performing root cause analysis.
• Enabling to understand which data sources are outdated or which datasets are relevant.
• Minimizing the risk of migration projects.
• Providing transparency over the life cycle of data.
Data lineage tools map the data flow and help you understand where the data originated, how it flows and transforms. To help you find the right tool for your company, we prepared a list that includes some of the best data lineage tools.