Data lineage tools for Apache Hive

Data lineage tools are software that allows to extract, view and analyze data lineage. Data lineage is the process of understanding and visualizing data flow from the source to different destinations. It allows to create a map of the data journey through the entire ecosystem.

Dataedo

Dataedo allows you to extract lineage automatically or design flows manually and visualize how data moves through the system with interactive diagrams. Dataedo supports object and column-level data lineage.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: Yes
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: Yes
Pipelines lineage: Yes
RDBMS: No
Dataedo Data Lineage
Dataedo Data Lineage PowerBI
Dataedo Data Lineage Snowflake
Dataedo Data Lineage Tableau 2
Dataedo Data Lineage Tableau

MANTA

MANTA is a data lineage platform that automatically scans your data environment to build a powerful map of all data flows and deliver it through a native UI and other channels to both technical and non-technical users. It automatically scans every nook and cranny to get immediate, accurate, and up-to-date lineage.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: Yes
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: No
Pipelines lineage: Yes
RDBMS: Yes

SolarWinds Database Mapper

SolarWinds Database Mapper (formerly SentryOne Document) delivers powerful documentation and data lineage analysis capabilities in a cloud or software solution. With Database Mapper, you can track data lineage with a visual display that clearly shows data dependencies across your environment

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: No
Data warehouses lineage: No
ETLs: No
Free edition: No
Hadoop: No
NoSQL: No
Pipelines lineage: No
RDBMS: Yes

SQLFlow

SQLFlow is an online SQL data lineage tool that visually represents the overall flow of data. It offers automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud, and Hadoop environments by parsing SQL Script and stored procedure. It enables impact analysis at a granular level, drilling down into table, column, and query-level lineage.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: No
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: No
Pipelines lineage: No
RDBMS: Yes

ASG Data Intelligence

ASG Data Intelligence (ASG DI) is the solution for data distrust. It is a metadata-driven platform that makes technical data “smarter” with end-to-end views of the data and its movements (data lineage) combined with business meaning and usage guardrails. It lets you visualize data flows mapped to business context, and it uniquely traces lineage by parsing code from data sources, applications, tools, and source code.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: No
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: Yes
Pipelines lineage: No
RDBMS: Yes

Global IDs

Global IDs Data Lineage provides automated analysis of the actual flow of data through your enterprise, enabling you to understand – in real-time – where data originates, how it flows through the ecosystem, and how it is transformed en route.

BI Tools lineage: No
Commercial: Commercial
Data migration tools lineage: Yes
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: Yes
Pipelines lineage: No
RDBMS: Yes

Atlan

Atlan provides effortless data lineage & governance by letting you auto-construct data lineage & deploy best-in-class data access governance without compromising on data democratization. It automatically parses through your SQL query logs in your data warehouses and BI tools to create a visual view of data lineage.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: No
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: No
Pipelines lineage: Yes
RDBMS: Yes

Alteryx Connect

Alteryx Connect uses powerful search capabilities to find and reuse information contained in data files, databases, visualizations, dashboards, workflows, analytic apps, and more. It lets you automatically capture and visualize data lineage between assets, improving the overall quality and reliability of shared information between data, process, and people. You can get technical data lineage by loading metadata from source and target systems and interpreting Alteryx workflows.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: No
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: Yes
Pipelines lineage: No
RDBMS: Yes

Apache Atlas

Apache Atlas provides open metadata management and governance capabilities for organizations. It offers intuitive UI to view lineage of data as it moves through various processes. It equips one with an intuitive UI to engage in pre-defined and ad-hoc exploration of data types by type, classification, attribute value or free-text It also maintains a history of how a data source or explicit data was constructed, and how it has evolved over time. It’s also possible to access and update lineages via rest APIs.

BI Tools lineage: No
Commercial: Free
Data migration tools lineage: No
Data warehouses lineage: Yes
ETLs: Yes
Free edition: Yes
Hadoop: Yes
NoSQL: No
Pipelines lineage: No
RDBMS: No

Informatica Metadata Management

Informatica Metadata Manager is a web-based metadata management tool. You can view data lineage for objects in the Metadata Manager warehouse. Data lineage shows the origin of the data, describes the path, and shows how it arrives at the target. Use data lineage to analyze data flow and troubleshoot data transformation errors.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: Yes
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: Yes
Pipelines lineage: No
RDBMS: Yes

IBM Watson Knowledge Catalog

IBM Watson Knowledge Catalog is an open and intelligent data catalog for managing enterprise data that also lets you ensure well-structured and maintained data lineage. It lets you track where data originated and how it’s consumed, increasing trust when accessing data across many sources and destinations

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: No
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: Yes
Pipelines lineage: Yes
RDBMS: Yes

Azure Purview

Microsoft Purview, or Azure Purview, is a unified data governance solution that offers automated data discovery, lineage identification, and data classification. It lets you understand the origin of your data with interactive data lineage visualization.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: No
Data warehouses lineage: No
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: Yes
Pipelines lineage: Yes
RDBMS: Yes

OpenLineage

OpenLineage is an open platform for collection and analysis of data lineage. It tracks metadata about datasets, jobs, and runs, giving users the information required to identify the root cause of complex issues and understand the impact of changes. OpenLineage contains an open standard for lineage data collection, a metadata repository reference implementation (Marquez), libraries for common languages, and integrations with data pipeline tools.

BI Tools lineage: No
Commercial: Free
Data migration tools lineage: No
Data warehouses lineage: Yes
ETLs: No
Free edition: Yes
Hadoop: No
NoSQL: No
Pipelines lineage: Yes
RDBMS: Yes

Truedat

Truedat is an open source data governance business solution tool that lets you have an end to end vision of your data from a business and technical point of view. Truedat data lineage module allows the visualization of the information life cycle, as well as the interconnection between each system of the organization, which allows to have a complete traceability of the data, as well as impact analysis in the event of possible changes in data structures or processes.

BI Tools lineage: Yes
Commercial: Free
Data migration tools lineage: No
Data warehouses lineage: No
ETLs: No
Free edition: Yes
Hadoop: Yes
NoSQL: No
Pipelines lineage: No
RDBMS: Yes

ER/Studio

ER/Studio is an enterprise data modeling, architecture, and governance tool. It comes with a data lineage tab which is used to primarily document ETL processes from scratch. With visual data lineage support, you can visually document source/target mapping and sourcing rules for data movement across systems.

BI Tools lineage: Yes
Commercial: Commercial
Data migration tools lineage: No
Data warehouses lineage: Yes
ETLs: Yes
Free edition: No
Hadoop: Yes
NoSQL: Yes
Pipelines lineage: No
RDBMS: Yes

Data lineage forms the foundation for accurate data analytics and management. The core features of data lineage focuses on:

• Identifying data quality issues.
• Performing root cause analysis.
• Enabling to understand which data sources are outdated or which datasets are relevant.
• Minimizing the risk of migration projects.
• Providing transparency over the life cycle of data.

Data lineage tools map the data flow and help you understand where the data originated, how it flows and transforms. To help you find the right tool for your company, we prepared a list that includes some of the best data lineage tools.