We are currently working on a requirement to implement real time integration in IDQ 10.2 ( later to be upgraded to 10.4). We also have some DQ rules to be implemented on the source data including Address doctor and a few others on electronic data. DB is oracle.
For real time integration, source for IDQ would be kafka with around 1700 msgs/sec (peak load).
We need help with the below:
1. With this frequency of kafka msgs, can real time integration be achieved?
2. To understand how event based trigger works in achieving real time integration?