Hadoop的簡單安裝和配置

·### 1.安裝包的準備：

hadoop-2.6.0-cdh5.14.2.tar.gz

2.解壓安裝包

3.配置檔案

進入hadoop安裝包/etc/hadoop

3.-1 vi hadoop-env.sh

java_home為你本地的jdk目錄

export JAVA_HOME=/opt/soft/jdk180
           

3-2 vi core-site.xml

<configuration>
        <property>
                <name>fs.defaultFS</name>
                <value>hdfs://本地ip:9000</value>
        </property>
        <property>
                <name>hadoop.tmp.dir</name>
                <value>/opt/soft/hadoop260/tmp</value>
        </property>
        <property>
                <name>hadoop.proxyuser.root.hosts</name>
                <value>*</value>
        </property>
        <property>
                <name>hadoop.proxyuser.root.groups</name>
                <value>*</value>
        </property>
</configuration>
           

3-3 vi hdfs-site.xml

<configuration>
        <property>
                <name>dfs.replication</name>
                <value>1</value>
        </property>>
</configuration>
           

3-4 修改mapred-site.xml.template的副本

cp mapred-site.xml.template mapred-site.xml
vi mapred-site.xml
<configuration>
        <property>
                <name>mapreduce.framework.name</name>
                <value>yarn</value>
        </property>
</configuration>
           

3-5 vi yarn-site.xml

<configuration>
        <property>
                <name>yarn.resourcemanager.localhost</name>
                <value>localhost</value>
        </property>
        <property>
                <name>yarn.nodemanager.aux-services</name>
                <value>mapreduce_shuffle</value>
        </property>
</configuration>
           

4 配置環境變量 vi etc/profile

export HADOOP_HOME=你本地hadoop的安裝路徑
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export YARN_HOME=$HADOOP_HOME
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bin
export HADOOP_INSTALL=$HADOOP_HOME
           

激活環境變量

source /etc/profile 
           

磁盤格式化

hapoop namenode -format
           

運作

start-all.sh
           

5.更改host檔案

vi /etc/hosts
在最後添加ip加上計算機名
           

6.驗證

浏覽器：http://本地ip:50070