Amazon S3 V2 Connector > Mappings and mapping tasks with Amazon S3 V2 > Amazon S3 V2 file formatting options
  

Amazon S3 V2 file formatting options

When you select a source or a target Amazon S3 V2 file, you can configure format options.
The following table describes the Amazon S3 V2 file formatting options that you can configure:
Option
Description
Schema Source
The schema of the source or target file. You can select one of the following options to specify a schema:
  • - Read from data file. Imports the schema from the file in Amazon S3.
  • - Import from Schema File. Imports schema from a schema definition file in your local machine.
Read from data file
Imports the schema from the file in Amazon S3.
If you select Read from data file and use the JSON1 file format, you can select one of the following options:
  • - Data elements to sample. The number of rows to read from the metadata.
  • - Memory available to process data. The memory that the parser uses to read the JSON sample schema and process it. You can increase the parser memory. Default is 2 MB.
Import from schema file
Imports schema from a schema definition file in your local machine.
If you select Import from schema file, you can select Schema File to upload a schema file.
You cannot upload a schema file when you select the Create Target option to write data to Amazon S3.
1Applies only to elastic mappings.
The remaining properties are applicable for both mappings and elastic mappings.
The following table describes the file formatting options that you must configure if you select Flat as the Format Type:
Option
Description
Delimiter
Character used to separate columns of data. You can configure parameters such as comma, tab, colon, semicolon, or others. To set a tab as a delimiter, you must type the tab character in any text editor. Then, copy and paste the tab character in the Delimiter field.
If you specify a multibyte character as a delimiter in the source object, the mapping fails.
EscapeChar1
Character immediately preceding a column delimiter character embedded in an unquoted string, or immediately preceding the quote character in a quoted string.
Qualifier1
Quote character that defines the boundaries of data. You can set qualifier as single quote or double quote.
Qualifier Mode1
Specify the qualifier behavior for the target object. You can select one of the following options:
  • - Minimal. Default mode. Applies qualifier to data that have a delimiter value or a special character present in the data. Otherwise, the Secure Agent does not apply the qualifier when writing data to the target.
  • - All. Applies qualifier to all data.
Code Page1
Select the code page that the Secure Agent must use to read or write data.
Amazon S3 V2 Connector supports the following code pages:
  • - MS Windows Latin 1. Select for ISO 8859-1 Western European data.
  • - UTF-8. Select for Unicode and non-Unicode data.
  • - Shift-JIS. Select for double-byte character data.
  • - ISO 8859-15 Latin 9 (Western European).
  • - ISO 8859-2 Eastern European.
  • - ISO 8859-3 Southeast European.
  • - ISO 8859-5 Cyrillic.
  • - ISO 8859-9 Latin 5 (Turkish).
  • - IBM EBCDIC International Latin-1.
Header Line Number1
Specify the line number that you want to use as the header when you read data from Amazon S3. You can also read a file that does not have a header. Default is 1.
To read data from a file with no header, specify the value of the Header Line Number field as 0. To read data from a file with a header, set the value of the Header Line Number field to a value that is greater than or equal to one.
This property is applicable during runtime and data preview to read a file.
First Data Row1
Specify the line number from where you want the Secure Agent to read data. You must enter a value that is greater or equal to one.
To read data from the header, the value of the Header Line Number and the First Data Row fields should be the same. Default is 1.
This property is applicable during runtime and data preview to read a file. This property is applicable during data preview to write a file.
Target Header
Select whether you want to write data to a target that contains a header or without a header in the flat file. You can select With Header or Without Header options.
This property is not applicable when you read data from a Amazon S3 source.
Distribution Column1
Specify the name of the column that is used to create multiple target files during run time.
This property is not applicable when you read data from a Amazon S3 source. For more information about the distribution column, see Distribution column.
escapeCharacterDataRetained
Not applicable to Amazon S3 V2 Connector.
maxRowsToPreview
Not applicable to Amazon S3 V2 Connector.
rowDelimiter
Not applicable to Amazon S3 V2 Connector.
1 Applies only to mappings.
The remaining properties are applicable for both mappings and elastic mappings.

Rules and guidelines for setting formatting options

You must set the appropriate formatting options when you select the Amazon S3 file format types.
Use the following guidelines when you select the format types and set the formatting options: