hadoop伪分布式搭建

上传jdk hadoop 编辑etc/profile export JAVA_HOME=/opt/setup/jdk1.8.0_60 export HADOOP_DEV_HOME=/opt/setup/hadoop-2.7.1 export HADOOP_MAPARED_HOME=${HADOOP_DEV_HOME} export HADOOP_COMMON_HOME=${HADOOP_DEV_HOME} export HADOOP_HDFS_HOME=${HADOOP_DEV_HOME} export YARN_HOME=${HADOOP_DEV_HOME} export HADOOP_CONF_DIR=${HADOOP_DEV_HOME}/etc/hadoop export HDFS_CONF_DIR=${HADOOP_DEV_HOME}/etc/hadoop export YARN_CONF_DIR=${HADOOP_DEV_HOME}/etc/hadoop export ZOOKEEPER_HOME=/opt/setup/zookeeper-3.4.5 export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_DEV_HOME/bin:$HADOOP_DEV_HOME/sbin:$ZOOKEEPER_HOME/bin 编辑etc/hosts 192.168.80.3 hadoop1 设置网编辑 编辑etc/sysconfig/network-scripts/ifcfg-eth0 DEVICE=eth0 HWADDR=00:0C:29:78:9A:82 TYPE=Ethernet UUID=c1020d36-fe91-487b-af49-fdc888394574 ONBOOT=yes NM_CONTROLLED=yes BOOTPROTO=static IPV6INIT=no USERCTL=no IPADDR=192.168.80.3 NETMASK=255.255.255.0 GATEWAY=192.168.80.1 编辑core-site.xml fs.defaultFS hdfs://hadoop1:9000 hadoop.tmp.dir /home/hadoop/tmp 编辑hadoop-env.sh export JAVA_HOME=/opt/setup/jdk1.8.0_60 编辑hdfs-site.xml dfs.replication 1 编辑mapred-site.xml mapreduce.framework.name yarn 编辑yarn-site.xml yarn.resourcemanager.hostname hadoop1 yarn.nodemanager.aux-services mapreduce_shuffle yarn.nodemanager.aux-services.mapreduce_shuffle.class org.apache.hadoop.mapred.ShuffleHandler 关闭防火墙 service iptables stop chkconfig iptables off 配置ssh无密钥登陆 ssh-keygen -t rsa 一路按回车； 执行：cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys 在Eclipse开发，须要在VM arguments里添加 -DHADOOP_USER_NAME=root 启动全部服务 进入/opt/setup/hadoop-2.7.1/sbin目录 ./start-dfs.sh