-
1. Re: Multidomain MDM (onPremise) to AZURE CosmosDB (Cloud) data replication
kunal pandit Sep 28, 2020 2:25 PM (in response to Anil Kumar)You may want to pose this question in DQ or PowerCenter discussion threads. From an MDM perspective, there will be no functionality needed in this regard and is only providing the data.
-
2. Re: Multidomain MDM (onPremise) to AZURE CosmosDB (Cloud) data replication
Subbu K Nov 27, 2020 8:44 PM (in response to kunal pandit)You can try to replicate the entire database instance as a whole rather than one record at a time. You can use Azure APIs to do the replication.
Migrate data from Oracle to Azure Cosmos DB Cassandra API using Blitzz | Microsoft Docs
Note: I haven't used the Blitzz API, but potentially you can use the snapshot migration of the database to replicate a snapshot of the Oracle data in Azure.
-
3. Re: Multidomain MDM (onPremise) to AZURE CosmosDB (Cloud) data replication
Sathiesh M Nov 30, 2020 11:38 PM (in response to Anil Kumar)1 of 1 people found this helpfulFrom what i could gather, Cosmos DB is a JSON document based storage, so if trying to replicate MDM datamodel if may need quite some design and effort on the backup storage, which is unwarranted.
instead you could leverage the BE apis and GET the json documents out of MDM and store it as-is in Cosmos DB.
Only problem remains on what basis the BEs can be synched to backup and how?
There are many ways you can try to publish the changes for ongoing basis
- One could be reuse existing Message trigger setup to generate C_REPOS_MQ_DATACHANGE table entry and instead of sending XMLs, create a ETL/ESB process that reads this table and fire a GET bes call for that ROWID
- Or if you dont have batch loads and simply rely on E360/BES calls, then use External calls like WriteBE, MergeBE and UnmergeBE to publish the BE json docs outside of MDM
-Sathiesh
-
4. Re: Multidomain MDM (onPremise) to AZURE CosmosDB (Cloud) data replication
Anil Kumar Jan 12, 2021 6:36 PM (in response to Sathiesh M)1 of 1 people found this helpfulDear Satiesh,
Our requirement is replicate few attributes of few table based on condition (ex: specific customer types and their roles) to Azure CosmosDB. We are using both Realtime and batch methodologies to replicate the data.
Real time: MDM Trigger + JMS Bridge to place the message in Azure JMS Queue + Azure API to convert into CosmosDB Document structure
Batch Mode: Data Feed to Azure + Azure Data Factory to read and convert into CosmosDB Document structure
-
5. Re: Multidomain MDM (onPremise) to AZURE CosmosDB (Cloud) data replication
Anil Kumar Jan 12, 2021 6:37 PM (in response to Sathiesh M)Kindly advise if there are any better alternative
-
6. Re: Multidomain MDM (onPremise) to AZURE CosmosDB (Cloud) data replication
Anil Kumar Jan 12, 2021 6:39 PM (in response to Subbu K)Our requirement is replicate few attributes of few table based on condition (ex: specific customer types and their roles) to Azure CosmosDB. We are using both Realtime and batch methodologies to replicate the data.
I dont think, Capability of Blitzz helps us to replicate the data for customized requirements and realtime.
Real time: MDM Trigger + JMS Bridge to place the message in Azure JMS Queue + Azure API to convert into CosmosDB Document structure
Batch Mode: Data Feed to Azure + Azure Data Factory to read and convert into CosmosDB Document structure
Kindly advise know if there are any better alternatives
-
7. Re: Multidomain MDM (onPremise) to AZURE CosmosDB (Cloud) data replication
Sathiesh M Jan 13, 2021 12:48 PM (in response to Anil Kumar)I like to reiterate from my prev reply
- Message trigger setup to generate C_REPOS_MQ_DATACHANGE table entry and instead of sending XMLs, create a ETL/ESB process that reads this table and fire a GET bes call for that ROWID
This will address both Batch and Realtime scenarios.
In my above suggestion pls feel free to replace ETL/ESB with Azure API/Data Factory whichever fits your needs