Big Data Management : 2019 : July Skip navigation
2019

What are we announcing?

Informatica 10.2.2 HotFix 1

 

Who would benefit from this release?

This release is for all Big Data and Enterprise Data Catalog customers and prospects who want to take advantage of the new capabilities and updated Hadoop distribution support. The release also includes fixes to core platform and connectivity. It includes support for new environments as well as fixes to support stable deployments.

 

What’s in this release?

This release includes Big Data Management, Big Data Quality, Big Data Streaming, Enterprise Data Catalog, and Enterprise Data Preparation capabilities.

  • Big Data PAM Update
    • Distribution Support:
      • Cloudera CDH: 6.2, 6.1, 5.16, 5.15, 5.14, 5.13
      • Hortonworks HDP: 2.6.x, 3.1 (Tech Preview)
      • MapR: 6.0.1 with MEP 5.0, 6.1 with MEP 6.0
      • Azure HDInsight: 3.6.x WASB, ADLS Gen1
      • Amazon EMR: 5.16.x, 5.20
      • Databricks 5.1
    • New Relational Systems:
      • Oracle 18c (Source/Target)
  • Enterprise Data Catalog Updates
    • Scanners
      • SAP HANA (Metadata Only): New scanner for SAP HANA that can extract object and lineage metadata. Lineage metadata includes calculation view to table lineage. Profiling is not supported.
      • ADLS Gen 2(Metadata Only): New scanner for Azure Data Lake Store Gen 2 to extract metadata from files and folders. All formats supported by ADLS Gen 1 scanner are supported for Gen 2. Profiling is not supported.
      • Profiling Warehouse Scanner: Extract profiling and domain discovery statistics from an IDQ or a BDQ profiling warehouse. Users who have already run profiling and enterprise discovery in IDQ/BDQ can now extract these profiling results and visualize them in EDC.
      • SAP PowerDesigner: Extract database model object from physical diagram including internal lineage. Model objects can be linked to physical object from other scanners.
      • (Tech Preview) Lineage Extraction from Stored Procedures: Ability to extract data lineage at the column level for stored procedures in Oracle and SQL Server.
      • (Tech Preview) Oracle Data Integrator: Ability to extract data lineage at the column level with transformation logic from Oracle Data Integration.
      • (Tech Preview) IBM Datastage: Ability to extract data lineage at the column level with transformation logic from IBM Datastage jobs.
      • Enhanced MS SQL Server scanner: support for windows based authentication using the EDC agent
    • Scanner Framework
      • Case insensitive linking: Ability to mark resources as case sensitive/insensitive. A new link ID is now generated for every object based on the above property. Useful for automatic lineage linking where ETL/BI tools refer to the object using a different case compared to the data source.
      • Offline scanner: support added for Sybase, IBM DB2 LUW, IBM DB2 z/OS, Netezza, Mysql, JDBC, PowerCenter, Informatica Platform, File Systems, Tableau, MicroStrategy, Hive, HDFS, Cloudera Navigator, Atlas
      • Custom Scanner Enhancements: The following new features are available for users of custom scanners:
        • Pre-Scripts: Users can now configure pre-scripts that are run before scanner execution. This allows running any custom extraction jobs or setup tasks.
        • File Path: Users can now configure a file path to pick the scanner assets csv, instead of uploading it to the catalog. The file should be either mounted or copied to the Informatica Domain machine with read permissions. This helps with automating and scheduling custom scanner runs.
      • Custom Scanner Framework Enhancements: The following new features are available for the developers of custom scanners:
        • Assign icons:  Ability to assign icons to types in the custom model
        • Detailed Lineage: Custom scanners can now include detailed lineage views which are rendered like transformation lineage from any native scanner.
        • Custom relationships: Ability to add custom relationships to be displayed in the relationship diagrams
      • Business User Experience
        • Search Operators: New search operators - AND, OR, NOT, double quotes, title: and description: for advanced search queries.
        • Search Tabs: Administrators can now create “Search Tabs” designed to personalize search experience by user groups and individual users. These search tabs are created with pre-selected facets that apply to a set of users/groups. EDC creates the following search tabs by default: “All”, “Data Objects”, “Data Elements”, “Business Terms”, “Reports” and “Resources”.
      • EDC Plug-In

        • Enterprise Data Catalog Tableau Extension: Enterprise Data Catalog Extension is a native extension for Tableau dashboard that you can use within Tableau within a Tableau Desktop, Tableau Server, and all the web browsers supported by Tableau version 2018.2.x onwards.
      • Supportability
        • Progress logs for re-index and bulk import/export
        • Utility to collect logs that is now expanded to support Cloudera in 10.2.2 HF1
      • (Tech Preview) Data Provisioning
        • (Tech Preview) Data Provisioning: After discovery, users can now move data to a target where it can be analyzed. EDC works with IICS to provision data for end users. Credentials are supplied by the users for both the source and the target.
          • Supported Sources in this release: Oracle, SQL Server
          • Supported Targets in this release: Amazon S3, Tableau Online, Oracle, Azure SQL DB
        • (Tech Preview) Live Data Preview: Users can now preview source data at the table level by providing source credentials.
      • CLAIRE
        • Intelligent Glossary Associations: The tech preview capability in 10.2.2 for linking glossaries to technical metadata is now GA. Additionally, EDC now supports auto-association of glossaries to objects at the table/file level.
      • PAM
        • Deployment Support
          • Cloudera: CDH 6.2, 6.1, 5.16, 5.15, 5.14
          • Hortonworks: HDP 2.6.x, (Tech Preview) HDP 3.1
        • Source Support
          • Hive, HDFS on CDH 6.1, 6.2
          • Hive, HDFS on HDP 3.1
          • Oracle Data Integrator 11g, 12c
          • Profile Warehouse on Oracle, SQL Server and IBM DB2 for Informatica 10.1.1 HF1, 10.2, 10.2.1, 10.2.2
          • SAP PowerDesigner 7.5.x to 16.x
          • SAP Hana DB 2.0
  • EDP Updates
    • Hadoop distribution support (aligned with Big Data Management)
    • Performance improvement in Preparation
    • Search alignment with Enterprise Data Catalog: Alignment with EDC in terms of search results and user experience (example: search tabs)
  • Connectivity Updates
    • Sqoop mapping with override query using aliases support in Spark mode
    • PAM certification for HBase for ecosystems: Cloudera, Hortonworks, MapR, AWS and Azure.
    • "--boundary-query" for specifying custom SQL query support for Sqoop import
  • Platform PAM Update
    • Oracle 18c - added
    • JVM support update: Azul OpenJDK 1.8.0_212 – updated

 

Release Notes & Product Availability Matrix (PAM)

 

Informatica 10.2.2 HotFix 1 Release Notes: https://docs.informatica.com/big-data-management/shared-content-for-big-data/10-2-2-hotfix-1/big-data-release-notes/abstract.html

 

PowerExchange Adapters 10.2.2 HotFix 1 Release Notes: https://docs.informatica.com/data-integration/powerexchange-adapters-for-informatica/10-2-2-hotfix-1/powerexchange-adapters-for-informatica-release-notes/abstract.html

 

PAM for Informatica 10.2.2 HotFix 1: https://network.informatica.com/docs/DOC-18280

 

You can download the Hotfixes from here.

The Informatica Global Customer Support Team is excited to announce an all-new technical webinar and demo series – Meet the Experts, in partnership with our technical product experts and Product management. These technical sessions are designed to encourage interaction and knowledge gathering around some of our latest innovations and capabilities across Data Integration, Data Quality, Big Data and so on. In these sessions, we will strive to provide you with as many technical details as possible, including new features and functionalities, and where relevant, show you a demo or product walk-through as well.

 

Topic and Agenda

 

 

If you need to integrate and ingest large amounts of data at speed and scale, Informatica has two new big data cloud services to help.

 

Join our complimentary Meet the Experts webinar on July 16 to discover the capabilities of Informatica Intelligent Cloud Services (IICS) Integration at Scale and IICS Ingestion at Scale. You will learn:

  • How to lower overall TCO with CLAIRE-based auto scaling and provisioning of serverless Spark support
  • How to manage streaming and IoT data with real-time monitoring and lifecycle management
  • How to accelerate AI/ML and advanced analytics projects with Informatica Enterprise Data Preparation and DataRobot

 

If you want to create proof of concept for a big data project in just six weeks, turn your data lake into a modern data marketplace, and more, you won't want to miss this deep dive and demo.