We have a large GreenPlum data warehouse that has billions of rows per table with type-2 inactive and active records.
While running profiling on the JDBC resource, we like to understand if there is any way we can filter out the historical records from the run based on a table column filter condition like Record_Active = 'Y'. As the historical records are just older copies we don't really want the profiling results to consider the history records and only consider the active records.
Kindly respond if there is any solution to this.
Profiling in EDC does not offer this capabilities.
If you have profiling run as part of IDQ, there you can add filter to the profile. In addition with EDC 10.2.2 HF1, you can run your profile job in IDQ and load the results in EDC with the Profile Warehouse Scanner.