0 Replies Latest reply on Jul 11, 2018 9:35 AM by asif ali hirekumbi

    Multiple Output files in Spark Connectivity in IDQ 10.2

    asif ali hirekumbi Active Member

      Hi All,

       

      We have a scenario where we are loading the data from AWS S3 to AWS S3 with business transformation logic using IDQ 10.2. When we are running the mapping in native mode it is generating only one output file. But when we are using Hadoop mode with Spark the output data is splitting in around 99 output files.Can any one help us to generate only one output file using Spark connectivity.

       

      Thanks in advance.

      Asif