10 Replies Latest reply on May 12, 2021 4:07 AM by Prakash Jain

    Integration of Salesforce CDC events with Informatica (CAI)

    Mangesh Joshi Active Member

      Hi Informatica CAI team,

       

      I have few question regarding  Salesforce CDC events with Informatica cloud applicaton integration.

       

      1) as per informatica documentation , informatica   CAI supports :

      Dated: 2 Aug 2019 Summary: The Cloud Application Integration Summer 2019 release offers support for the following Salesforce event types. • Platform Event • Push Topic

       

      Question :

      1)Does  Salesforce change data capture events (CDC) supported by Informatica Cloud Application integration

       

      2) If it is not supported by Informatica cloud application integration , Is there any other Informatica tool/process

       

      where  Salesforce  CDC events can be published  and subscribed in Informatica  Env .

       

      Our requirement to implement  have two aspects

       

      1)  Use Salesforce Change data capture events  and load this events into  one of Database (sql server , postgresql on aws rds ) 

       

      2)  Need to explore mechanism in   Database (postgre sql , sql server ) where changes happens to rdbms tables (insert , delete , update ) and such changes capture through  Informatica cloud tool (cai / cloud data integration or any other informatica process ) and once such changes captures through Informatica , then these changes should be loaded into  Salesforce Tables.

      3) How can we achieved it through  Salesforce CDC events  and Informatica cloud

      4)  We need to implement Bi-directional flow of data movement from SFDC to any  database and vice versa.

       

      i have checked , but i did not find any literature where  Informatica cloud application integration interacting with

      Salesforec CDC events , Salesforce CDC events  concepts worked on Pub/Sub model.

       

      Let us know if anyone share some thoughts.

       

      FYI : i have referred below link

       

      https://developer.salesforce.com/blogs/developer-relations/2017/05/first-impressions-platform-events-salesforce-enterprise-messaging-platform.html

       

      https://mulesy.com/synchronize-data-from-salesforce-to-external-system/

       

      Regards,

      Mangesh

        • 1. Re: Integration of Salesforce CDC events with Informatica (CAI)
          Prakash Jain Guru

          Hi Mangesh,

           

           

          We have Salesforce CDC connector in Cloud Application Integration. Please find the link of the documentation here https://network.informatica.com/onlinehelp/IICS/prod/CAI/en/index.htm#page/icrt-salesforce-connector-guide/Salesforce_ev…

           

          You can use Salesforce CDC / Platform event or OBM to create your flow from Salesforce to Database. Alternatively, you can write triggers on DB side to invoke the HTTP request to invoke CAI process and flow from database to Salesforce.

           

           

           

           

          Thanks,

          Prakash Jain

          • 2. Re: Integration of Salesforce CDC events with Informatica (CAI)
            Jharana Patra Guru

            Hi Mangesh,

             

            You can also  use Data integration where you can also use CDC options.

            Please refer the below articles if that helps on how to use it and the advanced properties:

             

            https://knowledge.informatica.com/s/article/450137?language=en_US

             

            https://knowledge.informatica.com/s/article/561626?language=en_US

             

            https://knowledge.informatica.com/s/article/566278?language=en_US

            • 3. Re: Integration of Salesforce CDC events with Informatica (CAI)
              Mangesh Joshi Active Member

              Hi Jharana,

               

              thanks for your inputs ,  Actually we donot need   Record leve Change data capture which usually happens in source system and then it process through informatica.

               

              Here question is  :    

               

              1) Assuming some  Salesforce Platform events (for account , case object)  is already created in Salesforce

              with API name  , now we want to consume this salesforce events in Informatica Application Integration ,

              so publishing (event source) and subscribing events (event targets) can be done in Informatica cloud application integration , but i am not sure  How such  salesforce events which is consumed by informatica (CAI)  would be loaded into any other database (e.g. postgre sql)

               

              2) As event messaging works on Pub/Sub model ,  it gets published by one system and subscribe by another system  , so  events are  interacting with Web Apps   (SFDC events ---> Web Apps  or Web Apps events ---> SFDC)  but i am not sure how these events loaded/inserted into any database  . i think , events cannot be mapped to target table in DB .

               

              if you know any other mechanism or tools or any work around

               

              our idea is to  consume these events into Database tables.

               

              Regards,

               

              Mangesh

              • 4. Re: Integration of Salesforce CDC events with Informatica (CAI)
                Mangesh Joshi Active Member

                Hi Prakash ,

                 

                Thanks for your input . Actually we donot have direct access to Salesforce Sandbox where salesforce platform events are created .

                 

                actulally , salesforece platform events are setup for one salesforce object , and that needs to be consumed

                in Informatica Application Integration , and later on  events needs to load into  some database table , so loading into some table is consuming for me.  As this is Pub/Sub model ,  events gets publish in one system and other system can subscribe it .  But i am not sure how salesforce events gets loaded into database table . I did not see any literature on this .

                 

                one more question  as you said :

                You can use Salesforce CDC / Platform event or OBM to create your flow from Salesforce to Database. Alternatively, you can write triggers on DB side to invoke the HTTP request to invoke CAI process and flow from database to Salesforce.

                 

                what is OBM here 

                 

                 

                you can write triggers on DB side to invoke the HTTP request to invoke CAI process and flow from database to Salesforce.   ----- if you provide some info on this part , our database is Postgre SQL and we have Informatica cloud application integration tool and Salesforce env .

                 

                Regards,

                Mangesh

                 

                • 5. Re: Integration of Salesforce CDC events with Informatica (CAI)
                  Prakash Jain Guru

                  Hi Mangesh,

                   

                  You need to write the logic in the process that gets invoked on SFDC event(OBM or CDC / Platform event) to create / update the record to the Database. We have JDBC connector in CAI to connect to any database(s).

                   

                  OBM - Outbound message is a Salesforce concept and triggers whenever your workflow rule is evaluated.

                   

                   

                  Thanks,

                  Prakash Jain

                  • 6. Re: Integration of Salesforce CDC events with Informatica (CAI)
                    Mangesh Joshi Active Member

                    Hi Prakash ,

                     

                    Need some help here .  Here our business team wants to use Informatica cloud application integration tool

                     

                    and they want to  sent salesforce platform events  to  Informatica cloud application integration and once

                     

                    it is consumed in Informatica application integration , it needs to load into one of Postgre sql table .

                     

                    according to me , this is not straight forward  in informatica cloud application integration because  informatica

                     

                    cloud application integration  is known for integration of multiple application  through service and application integration  by creating web service .

                     

                    i am not sure about  how salesforce platform events can be consumed in informatica cai and exposed to another web application .  because platform events works on Pub / Sub Model .   and Informatica CAI has made for different purpose .

                     

                    can you  add your thoughts   if  Pub / Sub model can be supported fully by Informatica cloud application integration.

                     

                    Regards,

                     

                    Mangesh

                    • 7. Re: Integration of Salesforce CDC events with Informatica (CAI)
                      Prakash Jain Guru

                      Hi Mangesh,

                       

                      This is straightforward, you can associate the connection to process and within the process have a create step to write the record into the DB.

                       

                      Pub / Sub is supported by informatica Cloud application integration.

                       

                      Thanks,

                      Prakash Jain

                      • 8. Re: Integration of Salesforce CDC events with Informatica (CAI)
                        Mangesh Joshi Active Member

                        Thanks Prakash

                         

                        How the Salesforce Platform events from salesforce env can be passed on to a Postgres DB using JDBC connctor. or what is the process  in informatica cloud application integration  , how we can  use components in informatica CAI 

                         

                        we have seen video   - like https://network.informatica.com/docs/DOC-18224

                         

                        but it shows how to published and consume salesforce platform events in  Informatica CAI env .

                         

                        in above vido  -  At 4.04 min , it shows salesforce platform events are consumed in the format like

                         

                        Input  fields (left side )                                                sf event with two values passed from sf workbench

                                              

                                                                                                                        Test2

                                                                      event                                   000056977784

                         

                         

                        but i am not sure sure next steps how to propogate above event fields to DB table  , not sure sure whehter any api / web service call .

                         

                        let me know i am missing here

                         

                        Regards,

                         

                        Mangesh

                        • 9. Re: Integration of Salesforce CDC events with Informatica (CAI)
                          Mangesh Joshi Active Member

                          Hi all,

                           

                          I am not able to figure out , if salesforce platform events can be loaded into Postgre table using Informatica cloud application integration .

                           

                          Note :  we are not creating any API / Web service/ data service  here ,

                           

                          As i know , Informatica cloud application integration talks about  , integration between multiple applications through REST/SOAP api calls / web service ,  and Informatica CAI used to implement Business functions/ process  .

                           

                          for e.g.

                          it shows salesforce platform events are consumed in the format like

                           

                          Input  fields (left side )                                                sf event with two values passed from sf workbench

                                               

                                                                                                                          Test2

                                                                        event                                   000056977784

                                                             --------------------------------------------------------------------------------------

                           

                          Not sure , how events data can be  mapped/load to database tables without using any data service .

                           

                          if anyone can add input

                           

                          Regards,

                           

                          Mangesh

                          • 10. Re: Integration of Salesforce CDC events with Informatica (CAI)
                            Prakash Jain Guru

                            Hi Mangesh,

                             

                            Can you please create a Process Object with the required field and use an assignment step to parse the input request XML(using XPATH/ XQuery) expression  to populate these process object field and then map these fields to the Create step of the process to create the record into Postgresql Table.

                             

                             

                            Thanks,

                            Prakash Jain