Hadoop (AutoSys)

When selecting Job Properties in AAI, expand the Hadoop node to access the related job types and each of their properties.

In the following lists of properties, the job type properties that are common to all types of Hadoop jobs are marked with an asterisk (*).

HDFS - Hadoop Distributed File System Job

• connectionprofile (*)
• hadoop_hdfs_create_parentdir
• hadoop_hdfs_destination
• hadoop_hdfs_overwrite
• hadoop_hdfs_path
• hadoop_hdfs_preserve_status
• hadoop_hdfs_recursive
• hadoop_hdfs_skiptrash
• hadoop_hdfs_source
• hadoop_hdfs_type
• hadoop_pollinterval (*)
• job_class (*)

Hive - Hadoop Data Query and Analysis Job

• connectionprofile (*)
• hadoop_hive_additional_params
• hadoop_hive_configparams
• hadoop_hive_initfile
• hadoop_pollinterval
• hadoop_hive_scriptfile
• hadoop_hive_user
• hadoop_hive_variables
• hadoop_pollinterval (*)
• job_class (*)

Ooozie - Hadoop Workflow Scheduler System Job

• connectionprofile (*)
• hadoop_oozie_cfgfile
• hadoop_pollinterval (*)
• job_class (*)

Pig - Hadoop Scripting Language Job

• connectionprofile (*)
• hadoop_pig_additional_params
• hadoop_pig_parameterfile
• hadoop_pig_propertyfile
• hadoop_pig_scriptfile
• hadoop_pollinterval (*)
• job_class (*)

Sqoop - Hadoop Data Transfer Tool Job

• connectionprofile (*)
• hadoop_sqoop_additional_params
• hadoop_sqoop_boundary_query
• hadoop_sqoop_clearstagingtable
• hadoop_sqoop_columns
• hadoop_sqoop_destination
• hadoop_sqoop_jdbctable
• hadoop_sqoop_jdbcuser
• hadoop_sqoop_nullnonstring
• hadoop_sqoop_nullstring
• hadoop_pollinterval (*)
• hadoop_sqoop_source
• hadoop_sqoop_stagingtable
• hadoop_sqoop_type
• hadoop_sqoop_whereclause
• job_class (*)