-
1. Re: Error while running match job
Anuvinda Kulkarni Feb 4, 2020 12:20 PM (in response to Rahul Yadav)How many records are participating in match and merge? It could be that the process is creating large tmp files under /hub/cleanse/tmp (on all nodes, if this is a clustered env). Even though you remove them, it still creates those files when you rerun the job and that may be eating up disk space.
Setting this to DELETE might work:
cmx.server.datalayer.cleanse.working_files=DELETE
Also, you might want to monitor total disk space utilization when job is running and after it has failed.
-
2. Re: Error while running match job
Rahul Yadav Feb 4, 2020 12:55 PM (in response to Rahul Yadav)Hello Anuvinda
Thank you for input. We monitored the disc space. It is getting full whenever we run match and merge job. For now, we set below property to avoid file creation and started job again. It is working fine now.
cmx.server.datalayer.cleanse.working_files=FALSE
Just would like to investigate why these large files are getting created.
-
3. Re: Error while running match job
Rahul Yadav Feb 4, 2020 12:56 PM (in response to Rahul Yadav)Hello Anuvinda
What below property does? cmx.server.datalayer.cleanse.working_files=DELETE
-
4. Re: Error while running match job
Anuvinda Kulkarni Feb 4, 2020 1:50 PM (in response to Rahul Yadav)This property controls whether tmp files should be deleted or retained.
These tmp files can be considered as logs; temporary working files that MDM processes use: typically stage, tokenization, and match. MDM creates these intermediate temporary files for internal processing before moving/inserting records to database. These files can grow in size depending the amount of data processed by these jobs. The property lets you keep these files for debugging/troubleshooting purposes.
-
5. Re: Error while running match job
Rahul Yadav Feb 5, 2020 9:51 AM (in response to Rahul Yadav)Hello Anuvinda
Thank you for your response. Seems that tmp files are not getting deleted even we set the property to DELETE or FALSE. Seems some issue with configuration
-
6. Re: Error while running match job
Anuvinda Kulkarni Feb 5, 2020 2:59 PM (in response to Rahul Yadav)This could be one of the reasons why all files are not deleted:
KB 515965
Are you still running into the match error?
-
7. Re: Error while running match job
Piyush Paras Feb 11, 2020 5:53 AM (in response to Anuvinda Kulkarni)How how many records you are running for M&M.
Please share the complete stack trace if you are still facing the issue.
-
8. Re: Error while running match job
Prabakar Shanmugam Feb 28, 2020 2:03 PM (in response to Rahul Yadav)We need to see complete log to get the exact root cause.
-
9. Re: Error while running match job
kunal pandit Mar 14, 2020 3:37 PM (in response to Rahul Yadav)You can try to limit the number of records in the match cycle using "Number of rows per match job batch cycle" to reduce the size of the files as a workaround.