SQL Server
Oracle
MySQL
PostgreSQL
Amazon Redshift
Azure SQL Database
DBT
Google Big Query
IBM DB2
MariaDB
SAP HANA
Snowflake
SQLite
Teradata
Vertica
Data profiling tools for Apache Iceberg
Data Profiling tools allow analyzing, monitoring, and reviewing data from existing databases in order to provide critical insights. Data profiling can help organizations improve data quality and decision-making process by identifying problems and addressing them before they arise.
Atlan
Atlan automatically profiles your data to identify missing values, outliers & other data anomalies. Data profiles are fully configurable, and admins can schedule data profile updates, run profiles on random/stratified samples or custom filters. Atlan's data profile is an open ecosystem, allowing teams to import data quality metrics from external ecosystems like data pipeline tools for key metrics, such as timeliness, or other internal tools or frameworks.
| Access control: |
|
|---|---|
| Commercial: | Commercial |
| Desktop/Cloud: | Cloud |
| Excel workbooks: |
|
| Flat files: |
|
| Free edition: |
|
| Metadata identification: |
|
| NoSQL sources: |
|
| Runs on: (for desktop): | - |
| Sensitive data discovery: |
|
| SQL sources: |
|
| Statistics of data: | Avg,Stdev |
| Tagging data: |
|
The use of data profiling tools can lead to higher-quality, more reliable data or eliminating errors that add costs to data-driven projects. Eliminating these costly errors involve processes such as:
• Collecting descriptive statistics.
• Collecting data types, length and recurring patterns.
• Tagging data with keywords, descriptions or categories.
• Performing data quality assessment.
• Discovering metadata and assessing its accuracy.
The most efficient way of handling the data profiling process is to automate it with a data management solution. We prepared a list of open-source data profiling tools that help you carry out the analysis of your data and identify the issues.