What's New in the Informatica Intelligent Cloud Services July 2021 Release

Version 20

    We are excited to announce the release of Informatica Intelligent Cloud Services (IICS) July ‘21 major release.

     

    What's new in the July ‘21 Major release?

    The Informatica Intelligent Cloud Services (IICS) July major release offers incredible new capabilities that address key data challenges that businesses are facing today across all our different product. You can find select new capabilities described below.

    "What's New Guide" is attached at the bottom.

    Please see our FAQ for other details about the release.

    Integration Cloud

    Data Integration Services

    Data Integration

    • Enhanced synchronization experience:

    o   New data transfer task.

    o   Support expanded connector versions.

    • Dynamic mapping support:

    o   New dynamic mapping task:

    • Parameter set support for parameterized, reusable mappings.
    • Fully UI-driven parameter set management.
    • Easy management of job execution based on job groupings.

    o   Dynamic schema support:

    • Ability to apply schema changes on target on cloud data warehouse and cloud data lake connectors.
    • PAM support

    o   Certification of Microsoft Edge browser.

    • Transformation enhancements:

    o   Support for pass-through ports in SQL transformations.

    o   Query source type support in Lookup transformations.

    o   Support for cloud data warehouse endpoints in SQL transformations.

    • Usability and deployment enhancements:

    o   Preserve advanced attributes and field mapping when switching between different connections of the same type.

    o   Support edit-free deployment of mappings with cloud data warehouse and cloud data lake connection types.

    • Other enhancements:

    o   OAuth client enhancement.

    o   Ability to pass parameter files when running jobs using RunAJobCli.

    o   Support for multi-character delimiters with flat file connections.

    o   Ability to override additional parameter values in mapping tasks.

    • Operational Insights enhancements for Data Integration:

    o   Auto-refresh of Jobs page.

    o   Listing of running jobs on the Jobs page.

    o   Additional Taskflows view on the Jobs page.

    • CLAIRE:

    o   New related object recommendation for source objects based on relationship.

    • Taskflow enhancements

    o   Support for persisting and running Taskflows with inputs using the Run Using option in Taskflow designer

    o   Support for additional functions in Taskflow Expression Editor

    o   Support for passing Connection Name in addition to Connection ID for a parameterized mapping task in a Taskflow

    o   Support for system variables like $PMRootDir, $PMTargetFileDir (or Equivalent) in the Command Task step of a Taskflow

    • Intelligent Structure Discovery

    o   XSD-based models in Structure Parser transformations

    o   Use Intelligent structure models in elastic mappings

    o   Enhancements to support large models

     

    Data Integration Elastic

    • Google Cloud Support

    o   Cloud Data Integration-elastic availability on Google Cloud POD

    o   Cloud Data Integration-elastic cluster support on Google Cloud

    o   Support for Google Cloud Storage connector

    o   Support for Hierarchy data with Google Cloud Storage connector

    o   Support for Google BigQuery connector

    • Cloud Data Integration-elastic

    o   Support for Graviton-enabled clusters on AWS

    o   Support for Key Management Service (KMS) encrypted Elastic Block Store (EBS) volumes on AWS

    o   Support for user provided security groups on AWS

    • Dynamic Mapping

    o   New Dynamic Mapping Task

    o   Dynamic Schema support

    o   Parameterization Enhancements on Cloud Data Warehouse connectors

    • Update Strategy Support
    • In-out parameter support
    • Mid-stream data preview support on AWS
    • Spark optimizations

    o   Enhancements to efficiently handle small files on S3, ADLS and Google Cloud Storage

    o   Job Monitoring Enhancements to handle agent failures

     

    Advanced Serverless

    • Support for command task execution in Serverless mode
    • Performance improvements to linear taskflow execution in Serverless mode

    Application Integration Service

    • Upgrading the PostgreSQL DB of Process Server

    o   Users will have an option to manually upgrade the PostgreSQL database of Process Server from version 9.5.2 or 12.4 to version 12.6. Version 12.6 offers security fixes.

    • Cloud Application Integration Operational Insights Enhancements

    o   Exclusion of suspended processes from Application Integration process metrics

    Mass Ingestion Services

    Mass Ingestion

    • Mass Ingestion integration with Informatica Operational Insights for monitoring
    • Microsoft Edge Browser support

     

    Mass Ingestion Databases

    • Expanded Connectivity

    o   Initial load support for IBM Db2 for z/OS, Db2 LUW, Microsoft Azure SQL Database, and Amazon RDS for PostgreSQL sources

    o   Initial load support for IBM Netezza sources

    o   Incremental CDC load support for PostgreSQL and IBM Db2 for z/OS sources

    o   Ingestion and synchronization support for Amazon Redshift, Google BigQuery, and Databricks Delta targets

    • Enterprise Readiness

    o   Metering service integration to report initial load volumes and CDC rows

    o   Scheduling support for initial load jobs

    o   Ability to specify custom properties in the task wizard at the direction of Informatica Global Customer Support

    o   Avro compression options for output files that are in the Avro format.

    • Ingestion and Monitoring

    o   Automatic schema drift support for Microsoft SQL Server sources

    o   Schema drift and versioning support for data lake targets

    o   Support for persisting CDC transaction data on the Secure Agent host

    o   Support for the combined initial and incremental CDC load type for Db2 for i and Microsoft SQL Server sources

    o   Initial load support for database views as source objects for Microsoft SQL Server and Oracle sources

     

    Mass Ingestion Streaming

    • Support for ingesting streaming data from AMQP- compliant sources
    • Support for streaming sources and targets in the AWS Government cloud

     

    Mass Ingestion Files

    • Support for the use of user-defined parameters and system variables on the source and target properties, such as file name, folder, and schema.
    • Support for passing a list of files for file transfer instead of using a file-name pattern.

    Integration Hub

    • CIH asset Permission (Read/Update/Delete/execute)
    • CIH Zero Downtime
    • API based publish/subscribe Base URL configuration using system property

     

    Data Quality & Governance Cloud

    Data Quality

    • Data Quality on Azureecosystem
    • Data Quality Americas Accelerator

    o   The Data Quality Americas Accelerator is a bundle of rules and associated dictionaries that you can apply to data from Brazil, Canada, and the United States.

    o   You can use the rules in an out-of-the-box manner. Add one or more rules to a mapping to perform deduplication, address verification, and standardization operations on your business data.

    • New Labeler asset to analyze input port fields and write text labels that describe the data in each field
    • Label using reference data/dictionaries and regular expressions.
    • Enhancements

    o   Cleanse transformation can accept more than one input port

    o   Increased input port size for cleanse and parse assets:

    • Increased port size

    o   Common test panel experience extended to the Consolidation tab in the Deduplicate asset

    o   Updated deduplication engine and libraries

     

    Data Profiling

    • Data Profiling on Azureecosystem
    • Profiling of PARQUET and AVRO files stored in Amazon S3 and Azure ADLS (Azure Data Lake Storage) gen 2

    o   Profiling runtime using Elastic/Spark

    o   Supports partitioned files and complex data types, such as arrays and maps

    o   New hierarchical view of profiling results

    o   Integration with Data Quality Assets: Rule Specification, Cleanse, Parser and Verifier

    • Profiling of Snowflake and Amazon Redshift using the native driver instead of ODBC.
    • Enforce auto-rule association of profiling with Data Quality assets for any source type.

    Master Data Management Cloud

    Customer 360

    • Best-in-class matching capabilities.
    • Business events for hierarchies can ensure data governance when you update hierarchies. Also, you can compare the existing hierarchy and the hierarchy with the proposed changes to ensure that the changes are correct.
    • Enhanced Workflow Inbox capabilities. Use multi-step approval workflows to ensure that new and changed data is reviewed and approved by multiple approvers. You can also perform inline editing and send workflow tasks back to a previous step in the workflow.
    • Enhanced application building capabilities.

    o   Configure header for a page.

    o   Validate a custom page for errors.

    o   Create pages to add records.

    • Assign user roles to pages.
    • Enhanced job monitoring capabilities.
    • Migration of assets. You can now export and import Customer 360 assets from one organization to another.
    • Enhanced data model.

    o   Disable optional basic fields, smart fields, and field groups in a business entity.

    o   Manage your reference data assets by adding code values to use in lists. You can also edit and delete the code values.

    • Published Search REST API. Use the Search API to retrieve the records that match your search criteria. You can run a search across all the business entities or within a specific business entity.

    Reference 360

     

    • Enhanced REST API. Use the export resource to export code list at a point in time to CSV format.
    • Enhanced user experience. Use the updated user interfaces to create and manage your reference data.

     

    Shared Services

    IICS Platform

    • Map enterprise groups and roles from SAML Identity Provider to Informatica Intelligent Cloud Services roles. The mappings are updated upon each user authentication event.
    • Automated user and group provisioning and updates from Okta and Azure Active Directory to Informatica Intelligent Cloud Services using SCIM 2.0 standard.
    • When a user or group is deleted, the corresponding asset permissions are also deleted.
    • Update trusted IP ranges using the REST API.

    Ecosystems Connectivity

     

    Note:  (1) Support in CDI, (2) Support in CDI Elastic

     

    AWS

    Amazon Redshift Connector

    • Honor deployment path updates.
    • Retain advanced attribute values and field mappings when the connection is updated from Redshift V1 to Redshift V2.
    • Dynamic schema handling support to apply DDL changes to the target. (1) (2)
    • Parameterization enhancements for the dynamic mapping. (1) (2)
    • SQL Transformation support for stored procedures. (1)

     

    Amazon S3 Connector

    • Honor deployment path updates. (1) (2)
    • Retain advanced attribute values and field mappings when the connection is updated from Amazon S3 V1 to Amazon S3 V2.
    • Parameterization enhancements for dynamic mapping. (1) (2)
    • Read from flat files and complex files selected through wildcard search. (2)
    • Recursive read support for flat files and complex files. (2)
    • Directory partitioning support for the JSON parser. (2)
    • File partitioning support for flat files and complex files. (1)
    • Additional format support for manifest files. (1)

     

    Microsoft Azure

    Microsoft Synapse SQL Connector

    • Retain advanced attribute values and field mappings when the connection is updated from Microsoft SQL Data Warehouse V1 and V2 to Microsoft Synapse SQL. (1)
    • Dynamic schema handling support to apply DDL changes to the target. (1) (2)
    • Parameterization enhancements for dynamic mapping. (1) (2)
    • Support for the following advanced pushdown optimization enhancements. (1)
    • Update, upsert, and delete operations with single and multiple targets
    • Source pushdown
    • Custom query as the source
    • Parameterization
    • Joiner transformation

     

    Microsoft Azure Data Lake Gen2 Connector

    • Honor deployment path updates. (1) (2)
    • Parameterization enhancements for dynamic mapping. (1) (2)
    • Read from flat file and complex files though wildcard card search. (1) (2)
    • Recursive read support for flat file and complex files. (1) (2)
    • Directory partitioning support for the JSON parser. (2)

     

    Microsoft Azure CDM Folders V2 Connector

    • New connector

     

    Snowflake

    • Honor deployment path updates. (1) (2)
    • Stored procedure and ad hoc SQL invocation using SQL transformation. (1)
    • Retain advanced attribute values and field mappings when the source and target objects are changed when connection is changed from Snowflake V1 to Snowflake V2. (1)
    • Dynamic schema handling to apply DDL changes to the target. (1) (2)
    • Parameterization enhancements for dynamic mapping. (1) (2)
    • Write captured data from a CDC source to a Snowflake target. (1)
    • Certification on Google Cloud Platform. (2)
    • Advanced pushdown optimization enhancements include support for: (1)

    o   Partial pushdown.

    o   Source pushdown.

    o   Union, Sorter, and Router transformations.

    o   Microsoft Azure Data Lake Storage Gen2 Connector as a source.

    o   Lookup for Snowflake with file-based sources such as Amazon S3, Google Cloud Storage, and Microsoft Azure Data Lake Storage Gen2 in a mapping.

    o   Additional functions.

     

    Google

    Google Cloud Storage V2 Connector

    • Retain advanced attribute values and field mappings when the connection is updated from Google Cloud Storage V1 to Google Cloud Storage V2. (1)
    • SQL transformation support for stored procedures and ad hoc SQL. (1)
    • Parameterization enhancements for dynamic mapping. (1) (2)
    • Certification on Google Cloud Platform. (2)

     

    Google BigQuery V2 Connector

    • Retain advanced attribute values and field mappings when the connection is updated from Google BigQuery V1 to Google BigQuery V2.
    • Handle dynamic schema to apply DDL changes to the target.
    • Parameterization enhancements for dynamic mapping.
    • Read from multiple objects.  (1)

     

    Databricks Delta Connector

    • Parameterization enhancements for dynamic mapping. (1) (2)
    • Update strategy for the Target transformation.
    • Statistics support for logs to capture the load summary. (1)
    • Read and write data with the Timestamp data type. (1)

     

    Hive Connector

    • Support for elastic mappings

     

    Hadoop Files V2 Connector

    • Recursive read from Avro, Parquet, and JSON complex files from subfolders.

     

    Thank you,

    The IICS Team

     

    2100 Seaport Blvd.

    Redwood City, CA 94063

    Main:  650.385.5000

    Support: 877.INFAHELP

    https://www.informaticacloud.com