translation missing (wp_translate): key = try_or_buy_html, options = {:scope=>:headings}
translation missing (wp_translate): key = solutions_html, options = {:scope=>:navigation}
translation missing (wp_translate): key = my_account_html, options = {:scope=>:headings}

translation missing: en-US.model_translations.product_module.wps_hadoop.name

translation missing: en-US.model_translations.product_module_group.wps_data_engine.name

translation missing: en-US.model_translations.product_module.wps_hadoop.name

Hadoop Big Data Environments

Hadoop is an ecosystem of storage and processing components that provide a scalable, fault-tolerant, software framework for the distributed storage and processing of very large datasets on computer clusters.

WPS is able to operate with third party Hadoop big data environments including the major distributions Cloudera, Hortonworks, MapR and native Apache Hadoop. WPS is certified for use with Cloudera version 5 and later.

Hadoop Engine

The WPS Engine for Hadoop provides access to Hive and Impala data sources in a Hadoop environment via standard or pass through SQL.

translation missing (wp_translate): key = type_of_access_html, options = {:scope=>[:feature_tables, :headings]} translation missing (wp_translate): key = is_supported_html, options = {:scope=>[:feature_tables, :headings]}
translation missing (wp_translate): key = reading_html, options = {:scope=>:feature_tables} translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = writing_html, options = {:scope=>:feature_tables} translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = updating_html, options = {:scope=>:feature_tables} translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = creating_new_tables_html, options = {:scope=>:feature_tables} translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = implicit_pass_through_support_html, options = {:scope=>:feature_tables} translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = explicit_pass_through_support_html, options = {:scope=>:feature_tables} translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = bulk_loading_html, options = {:scope=>:feature_tables} translation missing (wp_translate): key = no_html, options = {:scope=>:values}

The WPS engine for Hadoop connects to a Hadoop cluster using the JDBC interface.

Interoperating with Hadoop Big Data Environments

The WPS Interop for Hadoop module provides additional language support for interoperating with a Hadoop environment. This includes a FILENAME statement for direct HDFS connections and a HADOOP procedure for executing Pig and MapReduce commands directly within a Hadoop cluster.

Dependencies and Usage

The WPS Engine for Hadoop can only be used on the supported platforms indicated in the table below.

translation missing (wp_translate): key = platform_html, options = {:scope=>[:feature_tables, :headings]} translation missing (wp_translate): key = is_supported_html, options = {:scope=>[:feature_tables, :headings]}
translation missing (wp_translate): key = aix_on_system_p_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = linux_on_arm_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = linux_on_system_p_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = linux_on_x86_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = macos_on_x86_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = solaris_on_sparc_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = solaris_on_x86_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = windows_on_x86_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = linux_on_system_z_html, options = {:scope=>:platforms}translation missing (wp_translate): key = yes_html, options = {:scope=>:values}
translation missing (wp_translate): key = zos_on_system_z_html, options = {:scope=>:platforms}translation missing (wp_translate): key = no_html, options = {:scope=>:values}

translation missing: en-US.model_translations.product_module_group.wps_data_engine.group_name