Introduction/Overview
The BDM Log Collector tool is a Java-based utility that can be used to retrieve all the logs in one go for Hadoop specific issues. The utility can be used to collect the logs for all three execution modes: Spark / Blaze / Hive. This can be used for all Hadoop Distributions that are certified by Informatica and for Kerberized Hadoop clusters as well.
Usage
BDM Log Collector collects the following logs.
Logs collected from the machine where DIS runs (Informatica Server machine):
- Mapping Logs
- Hive Session Log
- Profiling Logs
Logs Collected from the Hadoop Cluster:
- Stderr
- Stdout
- Syslog
- Mapper Logs
- Reducer Logs
- Blaze Logs
- DAG logs
Configuration Files Collected from the Hadoop Cluster:
CCO XML files (For Informatica BDM 10.2)
Supported Informatica products
Informatica 10.1, 10.1.1, 10.1.1 HotFix 1, 10.2
License Info
Free download
Current Version
BDM Log Collector 10.2
Download
BDMLogCollector-bin.tar.gz (See Attachment below)
Please follow the ReadMe packaged under the Binary for complete instructions.
How to Install
- Download the BDMLogCollector-bin.tar.gz from <INFA_HOME>/tools/debugtools.
- Extract the tar. A folder with the name BDMLogCollector will be created under <INFA_HOME>/tools/debugtools.
- In the BDMLogCollector directory, you will find “collect.sh” file.
- Provide 755 permissions on the “collect.sh” file using the command: chmod 755 collect.sh.
- Run “collect.sh” using the command: ./collect.sh.
Input/Output:
1. Inputs required:
- Mapping/Profile name (mandatory)
- Output directory path (mandatory)
- Failure date (Optional)
- Domain Authentication
2. Output file generated after the utility run is a compressed zip file.
The zipped file consists of all the logs in a directory structure.
Support Platforms
Informatica BDM 10.1,10.1.1, 10.1.1.HotFix 1, 10.2
Release History
Serial No. | Version History | Release Date |
---|
1 | 1 | 20/10/2016 |
2 | 2 | 19/9/2017 |
Comments