Tuesday, December 10, 2013

Introduction to Data Quality Checks (DQ’s) in OFSAA

Leave a Comment

OFSAA performs calculations on the data present in the Stage tables. Initially, data sourced to Stage table contains raw data which may contain various anomalies. Data Quality checks in OFSAA is required to remove the expected anomalies. 

As per calculation perspective, business defines valid data values column-wise that will be used for calculations. However, data present in stage tables may have deviations from valid values. As such, we define data quality checks for such columns and check it for data consistency as per business.

Data Quality Check Flow:
Raw Data in Stage Tables-->DQ’s Executed in OFSAA-->Valid Data in Stage Tables

Data Quality Checks in OFSAA have three severity levels:
1.       Error: The DQ’s with severity defined as Error excludes the column value and does not persist it in stage tables.

2.       Warning: The DQ’s with severity defined as ‘Warning’ either defaults the column value to a particular value (as per business) or retains the same value.

3.       Information: The DQ’s with severity defined as ‘Information’ is just a message and retains the same value.
In order to create/view/execute the Data Quality checks in OFSAA navigate to the following tabs:

DQ Creation in OFSAA - Data Quality Framework\Data Quality Check Library

View/Search DQ in OFSAA - Data Quality Framework\Data Quality Check Definition

 DQ Execution in OFSAA  - Data Quality Framework\Data Quality Check Summary

0 comments:

Post a Comment