Mappings > Mappings > Mapping configuration
  

Mapping configuration

Use the Mapping Designer to configure a mapping.
To configure a mapping, perform the following tasks:
  1. 1. Define the mapping.
  2. 2. Configure the source.
  3. 3. Configure the data flow. Add, and configure transformations, and draw links to represent the flow of data.
  4. Tip: You can copy and paste transformations within or between open mappings.
  5. 4. Configure the target.
  6. 5. Optionally, create parameters to be defined in the mapping task.
  7. 6. Save and validate the mapping.

Defining a mapping

    1. Click New > Mappings, and then perform one of the following tasks:
    2. To specify the mapping name and location, in the Mapping Properties panel, enter a name for the mapping and change the location. Or, you can use the default values if desired.
    The default mapping name is Mapping followed by a sequential number.
    Mapping names can contain alphanumeric characters and underscores (_). Maximum length is 100 characters.
    The following reserved words cannot be used:
    If the Explore page is currently active and a project or folder is selected, the default location for the asset is the selected project or folder. Otherwise, the default location is the location of the most recently saved asset.
    You can change the name or location after you save the mapping using the Explore page.
    3. Optionally, enter a description of the mapping.
    Maximum length is 4000 characters.

Configuring the source

To configure the source, edit the Source transformation.
    1. On the mapping canvas, click the Source transformation.
    2. To specify a name and description for the Source transformation, in the Properties panel, click General.
    Transformation names can contain alphanumeric characters and underscores (_). Maximum length is 75 characters.
    The following reserved words cannot be used:
    You can enter a description if desired.
    Maximum length is 4000 characters.
    3. Click the Source tab and configure source details, query options, and advanced properties.
    Source details, query options, and advanced properties vary based on the connection type. For more information, see Transformations.
    In the source details, select the source connection and source object. For some connection types, you can select multiple source objects. If your organization administrator has configured Enterprise Data Catalog integration properties, and you have added objects to the mapping from the Data Catalog page, you can select the source object from the Inventory panel. You can also configure parameters for the source connection and source object.
    If you are configuring an elastic mapping, and you select an Amazon S3 or a Microsoft Azure Data Lake connection, you can add an intelligent structure model to the Source transformation for some source types. You must create the model before you can add it to the mapping. For more information about intelligent structure models, see Components.
    To configure a source filter or sort options, expand Query Options. Click Configure to configure a filter or sort option.
    4. Click the Fields tab to add or remove source fields, to update field metadata, or to synchronize fields with the source.
    5. To save your changes and continue, click Save.

Configuring the data flow

To configure the data flow, optionally add transformations to the mapping.
    1. To add a transformation, perform either of the following actions:
    2. On the General tab, enter a name and description for the transformation.
    3. Link the new transformation to appropriate transformations on the canvas.
    When you link transformations, the downstream transformation inherits the incoming fields from the previous transformation.
    For a Joiner transformation, draw a master link and a detail link.
    4. To preview fields, configure the field rules, or rename fields, click Incoming Fields.
    5. Configure additional transformation properties, as needed.
    The properties that you configure vary based on the type of transformation you create. For more information about transformations and transformation properties, see Transformations.
    6. To save your changes and continue, click Save.
    7. To add another transformation, repeat these steps.

Configuring the target

To configure the target, edit the Target transformation.
    1. On the mapping canvas, click the Target transformation.
    2. Link the Target transformation to the appropriate upstream transformation.
    3. On the General tab, enter the target name and optional description.
    4. Click the Incoming Fields tab to preview incoming fields, configure field rules, or rename fields.
    5. Click the Target tab and configure target details and advanced properties.
    Target details and advanced target properties vary based on the connection type. For more information, see Transformations.
    In the target details, select the target connection, target object, and target operation. If your organization administrator has configured Enterprise Data Catalog integration properties, and you have added objects to the mapping from the Data Catalog page, you can select the target object from the Inventory panel. You can also configure parameters for the target connection and target object.
    6. Click Field Mapping and map the fields that you want to write to the target.

Rules and guidelines for mapping configuration

Use the following rules and guidelines when you configure a mapping:

Rules and guidelines for mappings on GPU-enabled clusters

Use the following rules and guidelines when you configure a mapping that runs on a GPU-enabled elastic cluster:
To learn how to configure a GPU-enabled cluster, refer to Data Integration Elastic Administration in the Administrator help.

Data flow run order

You can specify the order in which Data Integration runs the individual data flows in a mapping. Specify the flow run order when you want Data Integration to load the targets in the mapping in a particular order. For example, you might want to specify the flow run order when inserting, deleting, or updating tables with primary or foreign key constraints.
A flow is all connected sources, targets, and transformations in a mapping. You can have multiple flows in a mapping but not in an elastic mapping.
You can specify the flow run order for data flows with any target type.
You might want to specify the flow run order to maintain referential integrity when updating tables that have primary or foreign key constraints. Or, you might want to specify the flow run order when you are processing staged data.
If a flow contains multiple targets, you cannot configure the load order of the targets within the flow.
The following image shows a mapping with two data flows:
In the this example, the top flow contains two pipelines and the bottom flow contains one pipeline. A pipeline is a source and all the transformations and targets that receive data from that source. When you configure the flow run order, you cannot configure the run order of the pipelines within a data flow.
The following image shows the flow run order for the mapping:
The image shows a table with the sources and targets for two data flows. Source3 and Target3 make up one flow. Source1 and Target1, and Source2 and Target2 make up the second data flow. The arrows at the top right of the able allow you to move a flow up or down.
In this example, Data Integration runs the top flow first, and loads Target3 before running the second flow. When Data Integration runs the second flow, it loads Target1 and Target2 concurrently.
If you add another data flow to the mapping after you configure the flow run order, the new flow is added to the end of the flow run order by default.
If the mapping contains a mapplet, Data Integration uses the data flows in the last version of the mapplet that was synchronized. If you synchronize a mapplet and the new version adds a data flow to the mapping, the new flow is added to the end of the flow run order by default. You cannot specify the flow run order in mapplets.
Note: You can also specify the run order of data flows in separate mapping tasks with taskflows. Configure the taskflow to run the tasks in a specific order. For more information about taskflows, see Taskflows.

Configuring the data flow run order

Configure the order in which Data Integration runs the data flows in a mapping.
    1. In the Mapping Designer, click Actions and select Flow Run Order.
    2. In the Flow Run Order dialog box, select a data flow and use the arrows to move it up or down.
    3. Click Save.