Microsoft Azure Data Lake Storage Gen1 V2 Connector > Mappings and mapping tasks with Microsoft Azure Data Lake Storage Gen1 V2 Connector > Microsoft Azure Data Lake Storage Gen1 V2 targets in mappings
  

Microsoft Azure Data Lake Storage Gen1 V2 targets in mappings

In a mapping, you can use an Microsoft Azure Data Lake Storage Gen1 V2 object as a target.
When you use Microsoft Azure Data Lake Storage Gen1 V2 target objects, you can select a Microsoft Azure Data Lake Storage Gen1 V2 connection as target. You can configure Microsoft Azure Data Lake Storage Gen1 V2 target properties on the Target page of the Mapping wizard. When you write data to Microsoft Azure Data Lake Storage Gen1, you can use the create target field to create a target at run time. When you create a new target based on the source, you must remove all the binary fields from the field mapping.
The following table describes the Microsoft Azure Data Lake Storage Gen1 V2 target properties that you can configure in a Target transformation:
Property
Description
Connection
Name of the target connection.
Target Type
Select Single Object.
Object
Name of the target object.
Formatting Options
Opens the Formatting Options dialog box to define the format of the file.
Configure the following format options:
  • - Delimiter: Delimiter character. Use comma as delimiter.
  • - Text Qualifier: Character to qualify text. You can configure other parameters such as single quote or double quote.
  • - Escape: Escape character.
Note: The formatting options are ignored if you select Create Table.
Create Target
Creates a target. Enter a name and path for the target object and select the source fields that you want to use. By default, all source fields are used.
For Date data type, use the edit types in the field mapping tab to change the precision to 29 and scale to 0. The task might fail if you do not change the precision and scale value for date data types.
Operation
The target operation.
The following table describes the advanced target properties for Microsoft Azure Data Lake Storage Gen1 V2:
Advanced Target Property
Description
Directory Path Override
The Microsoft Azure Data Lake Storage Gen1 directory that you use to write data. Default is root directory.
The Secure Agent creates the directory if it does not exist. The directory path specified at run time overrides the path specified while creating a connection.
File Name Override
Target object. Select the file from which you want to write data.
The file specified at run time overrides the file specified in Object.
Compress newly created file
Compresses the newly created files in the gzip format when set to True. Applicable to flat files only.
If file exists
If the files exists in Microsoft Azure Data Lake Storage Gen1, you can select to overwrite or append the existing file. You can also select the current task to fail.
Generate Header
Specifies the write behavior for the header row. You can set the parameter to:
  • - Enabled: writes the header row.
  • - Disabled: does not write the header row.
Note: During the metadata import, you must have a header row in the target file.
Distribution Column
NA
Success File Directory
NA
Error File Directory
NA

Specifying a target

You can use an existing target or create a target to hold the results of a mapping. If you choose to create the target, the agent creates the target when you run the task.
To specify the target properties, follow these steps:
    1. Select the Target transformation in the mapping.
    2. On the Incoming Fields tab, configure field rules to specify the fields to include in the target.
    3. To specify the target, click the Target tab.
    4. Select the target connection.
    5. For the target type, choose Single Object or Parameter.
    6. Specify the target object or parameter.
    7. Click Formatting Options if you want to configure the formatting options for the file, and click OK.
    8. Click Select and choose a target object. You can select an existing target object or create a new target object at run time and specify the object name.
    9. Specify Advanced properties for the target, if needed.

Target time stamps

When you create a target at run time, you can append time stamp information to the file name to show when the file is created.
When you specify the file name for the target file, include special characters based on Linux STRFTIME function formats that the mapping task uses to include time stamp information in the file name. The time stamp is based on the organization's time zone.
The following table describes some common STRFTIME function formats that you might use in a mapping or mapping task:
Special Character
Description
%d
Day as a two-decimal number, with a range of 01-31.
%m
Month as a two-decimal number, with a range of 01-12.
%y
Year as a two-decimal number without the century, with range of 00-99.
%Y
Year including the century, for example 2015.
%T
Time in 24-hour notation, equivalent to %H:%:M:%S.
%H
Hour in 24-hour clock notation, with a range of 00-24.
%l
Hour in 12-hour clock notation, with a range of 01-12.
%M
Minute as a decimal, with a range of 00-59.
%S
Second as a decimal, with a range of 00-60.
%p
Either AM or PM.