SQL Lineage Tools for Apache Hive
Dataedo
Dataedo allows you to extract lineage automatically or design flows manually and visualize how data moves through the system with interactive diagrams.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | On-premises |
Free edition: | |
Metadata management: | |
Version control integration: |
SQLFlow
SQLFlow is an online SQL data lineage tool that visually represents the overall flow of data. It offers automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud, and Hadoop environments by parsing SQL Script and stored procedure. It enables impact analysis at a granular level, drilling down into table, column, and query-level lineage.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
Alvin
Alvin provides column-level highly accurate lineage and usage data across your entire data stack, and a host of features that help your team deliver measurable business impact. It lets you search and filter your assets by usage, last used, tags, data sensitivity, parent, platform, type, any pretty much anything else you can think of.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
OpenMetadata
OpenMetadata is a single place to discover, collaborate and get your data right. It supports a comprehensive lineage for all data assets by capturing the relation between entities. It traces the path of data across tables, pipelines, and dashboards, while the manual lineage helps augment the lineage captured from machine metadata with user knowledge.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
Monte Carlo
Monte Carlo is a data observability platform that offers field-level data lineage functionality, making it faster and easier to conduct root cause and impact analysis for critical data issues. With field-level lineage fully automated, data engineers and analysts can confidently make changes to tables without losing trust and visibility in their data at each stage of its life cycle.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
Engrafo
Engrafo automatically creates data catalogs, data flow diagrams, and data lineage. It can extract data lineage from all common SQL dialects and generate flow charts to create overview and information about critical ETL flows. Moreover, it extracts metadata from your BI Tools and automatically creates data lineage back to the data catalogs.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
Secoda
Secoda provides end-to-end data lineage across your entire data stack. It automates column and table level data lineage. In additional, Secoda also brings in tests, events, and ETL into data lineage. All of Secoda's lineage is automated, but users can also manually contribute to lineage using Secoda's API.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
Dremio
Dremio is a SQL Lakehouse Platform that offers effective data lineage support, as the relationships between your data sources, virtual datasets, and all your queries are maintained in Dremio’s data graph, telling you exactly where each dataset came from. It provides self-service analytics with unified data access, modern and intuitive U/I, semantic layer, and built for SQL.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
MANTA
Manta offers a powerful scanner for the Microsoft SQL Server technology. Once configured, Manta can automatically connect to the MS SQL resource for extracting and analyzing the pertinent metadata within the selected databases. This metadata includes but is not limited to tables, views, indexes, SQL procedures, schemas, databases, columns, and triggers. Then, Manta can parse all the SQL programming code and logic stored within. This allows Manta to generate lineage down to the column level while showing all transformation logic associated with individual column elements.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | On-premises |
Free edition: | |
Metadata management: | |
Version control integration: |
Azure Purview
Microsoft Purview provides a unified data governance solution that offers many capabilities, one of which is showing lineage between datasets created by data processes. It supports automated asset-level lineage for the datasets and processes, while manual lineage allows you to document lineage metadata for sources where automation isn't yet supported without using any code.
Metadata collected in Microsoft Purview from enterprise data systems are stitched across to show an end-to-end data lineage.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
Informatica Data Lineage
Informatica Data Lineage tool provides automated end-to-end data lineage with detailed and summary views of data movement across data pipelines. With Informatica, you can derive lineage from code in SQL scripts, stored procedures and AI/ML code. It streamlines tracking data flow from system- to column-level for detailed impact analysis.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | Online |
Free edition: | |
Metadata management: | |
Version control integration: |
OpenLineage
OpenLineage is an open platform for collection and analysis of data lineage. It tracks metadata about datasets, jobs, and runs. Pipeline components - like schedulers, warehouses, analysis tools, and SQL engines - can use a standard API for capturing lineage events to send data about runs, jobs, and datasets to a compatible OpenLineage backend for further study.
Automatic discovery: | |
---|---|
Data flow visualization: | |
Environment: | On-premises |
Free edition: | |
Metadata management: | |
Version control integration: |