Data Profiling is an analytical technique that uses statistical processing to help discover the structure, content and relationships in a data source. These findings can then be used to identify useful insights as well as potential inaccuracies within the data. Rules can then be set up accordingly to deal with these insights/issues. An example of this could be:
Data Profiling is a vital activity in the data quality lifecycle because it is essential for understanding what the correct data quality rules should be for a given attribute or relationship.
By creating stringent data quality rules you can reduce the amount of incorrect data entering the database and easier identify the incorrect data already inside the database. These rules accelerate and improve the effectiveness of root-cause analysis. By tracing to their source, organisations can begin to understand the original cause of a data quality defect and implement long-term solutions for greater cost benefit.
Data Profiling is typically executed using data profiling software as they can analyse large volumes of data and create meaningful reports to help the user understand their data more readily and take appropriate action such as ongoing data quality improvement and control.
The benefits of using dedicated profiling software are: