SQL Server
Oracle
MySQL
PostgreSQL
Amazon Redshift
Azure SQL Database
DBT
Google Big Query
IBM DB2
MariaDB
SAP HANA
Snowflake
SQLite
Teradata
Vertica
Data lineage tools
Data lineage tools are software that allows to extract, view and analyze data lineage. Data lineage is the process of understanding and visualizing data flow from the source to different destinations. It allows to create a map of the data journey through the entire ecosystem.
Dremio
Dremio is a SQL Lakehouse Platform built from the ground up to deliver high-performing BI dashboards and interactive analytics directly on the data lake. It offers effective data lineage support, as the relationships between your data sources, virtual datasets, and all your queries are maintained in Dremio’s data graph, telling you exactly where each dataset came from.
| BI Tools lineage: |
|
|---|---|
| Commercial: | Free |
| Data migration tools lineage: |
|
| Data warehouses lineage: |
|
| ETLs: |
|
| Free edition: |
|
| Hadoop: |
|
| NoSQL: |
|
| Pipelines lineage: |
|
| RDBMS: |
|
IBM InfoSphere Information Governance Catalog
IBM InfoSphere Information Governance Catalog is a web-based tool that allows you to explore, understand, and analyze information. It lets you run data lineage to create trusted information that supports data governance and compliance efforts. You can perform lineage analysis to understand where data comes from or goes to by using shared table information, job design information, or operational metadata from job runs.
| BI Tools lineage: |
|
|---|---|
| Commercial: | Commercial |
| Data migration tools lineage: |
|
| Data warehouses lineage: |
|
| ETLs: |
|
| Free edition: |
|
| Hadoop: |
|
| NoSQL: |
|
| Pipelines lineage: |
|
| RDBMS: |
|
Kylo
Kylo is an open source enterprise-ready data lake management software platform. It lets you search and explore data and metadata, view lineage, and profile statistics. Visual process lineage and provenance provide confidence in the origin of data. Automatic data profiling provides capabilities for data scientists and assurance in data quality.
| BI Tools lineage: |
|
|---|---|
| Commercial: | Free |
| Data migration tools lineage: |
|
| Data warehouses lineage: |
|
| ETLs: |
|
| Free edition: |
|
| Hadoop: |
|
| NoSQL: |
|
| Pipelines lineage: |
|
| RDBMS: |
|
Keboola
Keboola is a cloud-based data integration platform that helps clients combine, enhance, and publish crucial information for their internal analytics projects and data products in a quick and easy fashion. It collects all kinds of operational metadata, describing user activity, job activity, data flow, schema evolution, data pipeline performance, compliance with a client’s security rules, etc. Based on the metadata, we are able to build data lineage on the fly and automatically. This makes it possible to understand where the data is coming from and how it is used, both for analytical and regulatory purposes.
| BI Tools lineage: |
|
|---|---|
| Commercial: | Commercial |
| Data migration tools lineage: |
|
| Data warehouses lineage: |
|
| ETLs: |
|
| Free edition: |
|
| Hadoop: |
|
| NoSQL: |
|
| Pipelines lineage: |
|
| RDBMS: |
|
Data lineage forms the foundation for accurate data analytics and management. The core features of data lineage focuses on:
• Identifying data quality issues.
• Performing root cause analysis.
• Enabling to understand which data sources are outdated or which datasets are relevant.
• Minimizing the risk of migration projects.
• Providing transparency over the life cycle of data.
Data lineage tools map the data flow and help you understand where the data originated, how it flows and transforms. To help you find the right tool for your company, we prepared a list that includes some of the best data lineage tools.