Query & Insert from Impala with Kerberos

Github Project : kerberos-talend-client

To use the jobs displayed in this article, you have to complete a repository with saagie's platform information (value).

values example :

• kerberos_login=$username
• kerberos_pwd=$userpassword
• kerberos_principal_name="impala/_HOST@<YOUR REALM>"
  • example : "impala/[e-mail]"
• connexion_hote=<full hostname>
  • example : "dn1.p6.saagie.prod.saagie.io"
• connexion_port=21050

Write from Impala

• Create a new job
• Add the component tSystem: Allows the creation of a Kerberos connection.
• Add the component tImpalaConnection : Allows the creation of a Impala connection.
• Add the component tRowGenerator: Allows the generation of data
• Add the component tImpalaOutput: Writes data to Impala.
• Create links:
  • tSystem is connected with tImpalaConnection (through "OnSubjobOk")
  • tImpalaConnection is connected with tRowGenerator (through "OnComponentOk")
  • tRowGenerator is connected with tImpalaOutput (through "Main")

Component tSystem

Component tImpalaConnection

 Component tRowGenerator

Component tImpalaOutput

• Run the job

Read from Impala (In console)

• Create a new job
• Add the component tSystem: Allows the creation of a Kerberos connection.
• Add the component tImpalaConnection : Allows the creation of a Impala connection.
• Add the component tImpalaInput: Read a file in the Impala .
• Add the component tLogRow: Display the result.
• Create links:
  • tSystem is connected with tImpalaConnection (through "OnSubjobOk")
  • tImpalaConnection is connected with tImpalaInput (through "OnComponentOk")
  • tImpalaInput is connected with tLogRun (through "Main")

Component tSystem

 Component tImpalaConnection

 Component tImpalaInput

• Run the job