Data lineage tools for Google Big Query
Data lineage tools are software that allows to extract, view and analyze data lineage. Data lineage is the process of understanding and visualizing data flow from the source to different destinations. It allows to create a map of the data journey through the entire ecosystem.
Truedat
Truedat is an open source data governance business solution tool that lets you have an end to end vision of your data from a business and technical point of view. Truedat data lineage module allows the visualization of the information life cycle, as well as the interconnection between each system of the organization, which allows to have a complete traceability of the data, as well as impact analysis in the event of possible changes in data structures or processes.
BI Tools lineage: | |
---|---|
Commercial: | Free |
Data migration tools lineage: | |
Data warehouses lineage: | |
ETLs: | |
Free edition: | |
Hadoop: | |
NoSQL: | |
Pipelines lineage: | |
RDBMS: |
Secoda
Secoda is a data discovery tool that offers an intuitive, collaborative, and easy to implement data discovery built. It automatically extracts queries to generate data lineage. Currently, it is supporting table lineage for Snowflake, dbt, Redshift, and BigQuery, with support for Postgres, MySQL, and Microsoft SQL Server coming soon. Secoda data lineage can help data teams identify the downstream and upstream dependencies of a table easily. On each dependency, you will be able to see how many levels away a particular table is, with the ability to view the data in a visual form coming soon.
BI Tools lineage: | |
---|---|
Commercial: | Commercial |
Data migration tools lineage: | |
Data warehouses lineage: | |
ETLs: | |
Free edition: | |
Hadoop: | |
NoSQL: | |
Pipelines lineage: | |
RDBMS: |
Keboola
Keboola is a cloud-based data integration platform that helps clients combine, enhance, and publish crucial information for their internal analytics projects and data products in a quick and easy fashion. It collects all kinds of operational metadata, describing user activity, job activity, data flow, schema evolution, data pipeline performance, compliance with a client’s security rules, etc. Based on the metadata, we are able to build data lineage on the fly and automatically. This makes it possible to understand where the data is coming from and how it is used, both for analytical and regulatory purposes.
BI Tools lineage: | |
---|---|
Commercial: | Commercial |
Data migration tools lineage: | |
Data warehouses lineage: | |
ETLs: | |
Free edition: | |
Hadoop: | |
NoSQL: | |
Pipelines lineage: | |
RDBMS: |
Data lineage forms the foundation for accurate data analytics and management. The core features of data lineage focuses on:
• Identifying data quality issues.
• Performing root cause analysis.
• Enabling to understand which data sources are outdated or which datasets are relevant.
• Minimizing the risk of migration projects.
• Providing transparency over the life cycle of data.
Data lineage tools map the data flow and help you understand where the data originated, how it flows and transforms. To help you find the right tool for your company, we prepared a list that includes some of the best data lineage tools.