0 Replies Latest reply on Aug 5, 2020 11:53 PM by niti rawat

    Real Time integration with IDQ with kafka topics/msgs as source

    niti rawat Seasoned Veteran



      We are currently working on a requirement to implement real time integration in IDQ 10.2 ( later to be upgraded to 10.4). We also have some DQ rules to be implemented on the source data including Address doctor and a few others on electronic data. DB is oracle.

      For real time integration, source for IDQ would be kafka with around 1700 msgs/sec (peak load).

      We need help with the below:


      1. With this frequency of kafka msgs, can real time integration be achieved?

      2. To understand how event based trigger works in achieving real time integration?


      Any use case and information is appreciated.