天天看点

黑猴子的家:Hue 与 YARN 集成

1、配置hue.ini

文件位置:/opt/module/cdh/hue-3.7.0-cdh5.3.6/desktop/conf/hue.ini

找到[[yarn_clusters]]标签,涉及修改配置如下
[[email protected] conf]$ vim hue.ini
[[yarn_clusters]]
    [[[default]]]
      resourcemanager_host=hadoop103
      resourcemanager_port=8032
      submit_to=True
      #logical_name=cluster-yarn1(如果开高可用的话,配置这一行)
      resourcemanager_api_url=http://hadoop103:8088
      proxy_api_url=http://hadoop103:8088
      history_server_api_url=http://hadoop102:19888
           

2、重启HUE测试

[[email protected] hue]$ build/env/bin/supervisor
           

3、测试

[[email protected] hadoop]$ bin/yarn jar \
share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.2.jar \
wordcount /input/ /output102
           
HUE