Under the Admin Console --> Monitor --> DIS --> Adhoc jobs you could find the long running profile/mapping jobs.
You could export the log for the object from the same pane.
Could you please export the same and share it here
Thanks Srinivas for the quick turnaround.
Unfortunately, we can't even view the DIS log file for the current running scanner in Admin console.
When we looked at log from server, earlier we found one of the thread in a pool had the below error. But remaining threads were complete without any issue.
Caused by: java.lang.OutOfMemoryError: Java heap space
I am suspecting this would be causing the thread to go to an Orphan state ?
Where do you see the OOM error.
Could you restart increase the heap size of the DIS service and restart the services and check the Profile run again
We saw the OOM error in DIS log, and the OOM issue occurred for only one thread in a pool. I suspect the OOM issue received when the profiling started for a large set of tables of the pool.
Yes, we plan to increase the heap size after we test the performance one more time, as we completed the scanner run(1st time) in batches. The big chunk of tables also divided into multiple groups based on certain format to consider while profiling, so all the bathes were completed without any issue.
Appreciate all your help. Will update the thread, if we find any issues or any other solution used, if other than increase in java heap size.
Please do not forget to mark this thread as answered once your issues are resolved
We have increased the Heap size to 16GB, and the scanner run completed successfully without any issues, under 45 min.
We would like to test for few more rounds and play with heap size to see if there is any impact when all the scanners running.