6 Replies Latest reply on Mar 25, 2021 7:37 PM by Thiru S

    Running a mapping on a spark cluster with Kerberos Authentication

    John Naiderman Active Member

      Hi,

       

      We are running a simple mapping (source to target with nothing in between) to test our environment. It is running fine on the native execution environment but we are getting the following error when running with Spark on the Hadoop cluster (HDP Cluster v 2.6.5.97):

       

      Caused by: org.apache.hadoop.security.authentication.client.AuthenticationException: Authentication failed, status: 403, message: Forbidden

       

      The keytab is valid because we are running Python code on the same cluster with no problems.

      I couldn't find any useful information  in the documentation about what is the issue but we suspect it is related to the Kerberos authentication between Information and the cluster.

       

      anyone had a similar issue?

       

      thanks,

      John