Write files with HDFS with Kerberos

To use a job displayed in this article, you have to complete a repository with saagie's platform information (value).

values example :

kerberos_login=$username
kerberos_pwd=$userpassword
kerberos_principal_name="hdfs/_HOST@<YOUR REALM>"
- example : "hdfs/_HOST@SAAGIE.PROD.SAAGIE.IO"
uri_path=<full hostname>
- example : "hdfs://192.168.55.10:8020"

Read a file from HDFS (In console)

Create a new job
Add the component tSystem: Allows the creation of a Kerberos connection.
Add the component tHDFSConnection : Allows the creation of a HDFS connection.
Add the component tRowGenerator: Allows the generation of data
Add the component tHDFSOutput: Writes data to HDFS.
Create links:
- tSystem is connected with tHDFSConnection (through "OnSubjobOk")
- tHDFSConnection is connected with tRowGenerator (through "OnComponentOk")
- tRowGenerator is connected with tHDFSOutput (through "Main")