Amazon S3 V2 Connector > Troubleshooting > Troubleshooting for Amazon S3 V2 Connector
  

Troubleshooting for Amazon S3 V2 Connector

Java heap size configuration

This section describes the errors that you might encounter if the JVM options in the Secure Agent is not configured accordingly to read a large number of files.
"ERROR java.lang.OutOfMemoryError: GC overhead limit exceeded" occurs when you run a Mapping task to write large number of records.
To resolve this issue, perform the following tasks to configure the JVM options in the Secure Agent to increase the memory for the Java heap size:
  1. 1. Select Administrator > Runtime Environments.
  2. 2. On the Runtime Environments page, select the Secure Agent for which you want to increase memory from the list of available Secure Agents.
  3. 3. In the upper-right corner, click Edit.
  4. 4. In the System Configuration Details section, select the Type as DTM for the Data Integration Server.
  5. 5. Edit the JVMOption1 as -Xms2048m.
  6. Note: Specify the maximum and minimum heap size based on the data you want to process.
  7. 6. Restart the Secure Agent manually.
"[ERROR] java.lang.OutOfMemoryError: Java heap space" occurs when you run a mapping to write a file of size 1.4 GB or higher and select Informatica Encryption as the encryption type.
To resolve this issue, perform the following tasks to configure the JVM options in the Secure Agent to increase the memory for the Java heap size:
  1. 1. Select Administrator > Runtime Environments.
  2. 2. On the Runtime Environments page, select the Secure Agent for which you want to increase memory from the list of available Secure Agents.
  3. 3. In the upper-right corner, click Edit.
  4. 4. In the System Configuration Details section, select the Type as DTM for the Data Integration Server.
  5. 5. Edit the JVMOption1 as -Xmx8046m.
  6. 6. Restart the Secure Agent manually.

FFParserRetainNullString custom property

When you read from a csv file that contains a string named null, the task does not write any data to the target. To resolve this issue, perform the following tasks and configure the custom property FFParserRetainNullString:
  1. 1. Select Administrator > Runtime Environments.
  2. 2. On the Runtime Environments page, select the Secure Agent.
  3. 3. In the upper-right corner, click Edit.
  4. 4. In the Custom Configuration Details section, select the Type as Tomcat JRE for the Data Integration Server.
  5. 5. Enter the Name as FFParserRetainNullString and the Value as true.
  6. 6. Click Save.

RedirectToSessionLog custom property

When you select a source or a target Amazon S3 V2 file and configure the Parquet file format option, a large number of log files might be generated. To resolve this issue and disable the logs, perform the following tasks and configure the custom property RedirectToSessionLog:
  1. 1. Select Administrator > Runtime Environments.
  2. 2. On the Runtime Environments page, select the Secure Agent.
  3. 3. In the upper-right corner, click Edit.
  4. 4. In the Custom Configuration Details section, select the Type as DTM for the Data Integration Server.
  5. 5. Enter the Name as RedirectToSessionLog and the Value as No.
  6. 6. Click Save.

JSON file has field with empty struct data

If a JSON file has a field with an empty struct data, the Secure Agent ignores the field and reads the remaining fields during metadata read.
For example, if the JSON file has the following data in the first row: {​"id":123,"address":{​}​}, the address field is ignored and does not appear in the Fields tab. If the JSON file has values for the address field in the consecutive row, you can use the Data elements to sample property to fetch this field.