Hadoop部署方式-本地模式(Local (Standalone) Mode)

　　　　　　　　　　　　Hadoop部署方式-本地模式(Local (Standalone) Mode)

　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　做者：尹正杰

版权声明：原创做品，谢绝转载！不然将追究法律责任。

 

 

　　Hadoop总共有三种运行方式。本地模式（Local (Standalone) Mode），伪分布式（Pseudo-Distributed Mode），分布式（Fully-Distributed Mode）。本篇博客主要讲解第一种运行方式，即本地运行方式，想要查看伪分布式的小伙伴请参考：http://www.javashuo.com/article/p-ugidapgo-cy.html，想要查看彻底分布式的小伙伴请参考：http://www.javashuo.com/article/p-uxdqgqbb-dh.html。

　　须要注意的是，本地运行模式，实际上就是用Linux操做系统，会直接把文件存储在Linux路径上，咱们在上传文件的时候要注意权限哟，好比你在搭建好Hadoop本地模式后，直接就提交一个文件到根下的话，可能会报权限错误哟，可是，若是你是root用户的话就另当别论了。

 

 

一.下载相应的jdk和Hadoop安装包

　　  jdk：http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html

　　Hadoop：http://hadoop.apache.org/releases.html

　　注意，Hadoop官方虽然没有windows版本，可是可用经过“visual studio”编译工具将Linux的运行伪分布式迁移到windows中，建议安装2015版本，网上的教程有不少。遗憾的是，这个工具的使用并非本篇博客的重点。

 

二.安装Java环境

1>.建立软件解压目录并受权给普通用户

[yinzhengjie@yinzhengjie ~]$ ll
total 390268
-rw-rw-r--. 1 yinzhengjie yinzhengjie 214092195 Aug 26 2016 hadoop-2.7.3.tar.gz
-rw-rw-r--. 1 yinzhengjie yinzhengjie 185540433 May 17 2017 jdk-8u131-linux-x64.tar.gz
[yinzhengjie@yinzhengjie ~]$ sudo mkdir /soft
[sudo] password for yinzhengjie: 
[yinzhengjie@yinzhengjie ~]$ sudo chown yinzhengjie:yinzhengjie /soft/
[yinzhengjie@yinzhengjie ~]$ ll /soft/ -d
drwxr-xr-x. 2 yinzhengjie yinzhengjie 6 May 24 02:30 /soft/
[yinzhengjie@yinzhengjie ~]$ 

2>.解压jdk并配置软链接路径

[yinzhengjie@yinzhengjie ~]$ tar zxf jdk-8u131-linux-x64.tar.gz -C /soft/
[yinzhengjie@yinzhengjie ~]$ cd /soft/
[yinzhengjie@yinzhengjie soft]$ ll
total 4
drwxr-xr-x. 8 yinzhengjie yinzhengjie 4096 Mar 15 2017 jdk1.8.0_131
[yinzhengjie@yinzhengjie soft]$ ln -s jdk1.8.0_131/ jdk
[yinzhengjie@yinzhengjie soft]$ ll
total 4
lrwxrwxrwx. 1 yinzhengjie yinzhengjie 13 May 24 02:33 jdk -> jdk1.8.0_131/
drwxr-xr-x. 8 yinzhengjie yinzhengjie 4096 Mar 15 2017 jdk1.8.0_131
[yinzhengjie@yinzhengjie soft]$ 

3>.设置Java环境变量

[yinzhengjie@yinzhengjie soft]$ sudo vi /etc/profile
[yinzhengjie@yinzhengjie soft]$ tail -3 /etc/profile
#Add by yinzhengjie
JAVA_HOME=/soft/jdk/
PATH=$PATH:$JAVA_HOME/bin
[yinzhengjie@yinzhengjie soft]$ . /etc/profile
[yinzhengjie@yinzhengjie soft]$ 
[yinzhengjie@yinzhengjie soft]$ java -version
java version "1.8.0_131"
Java(TM) SE Runtime Environment (build 1.8.0_131-b11)
Java HotSpot(TM) 64-Bit Server VM (build 25.131-b11, mixed mode)
[yinzhengjie@yinzhengjie soft]$ 

 

 

三.安装Hadoop

1>.解压jdk并配置软链接路径

[yinzhengjie@yinzhengjie ~]$ ll
total 390268
-rw-rw-r--. 1 yinzhengjie yinzhengjie 214092195 Aug 26 2016 hadoop-2.7.3.tar.gz
-rw-rw-r--. 1 yinzhengjie yinzhengjie 185540433 May 17 2017 jdk-8u131-linux-x64.tar.gz
[yinzhengjie@yinzhengjie ~]$ tar zxf hadoop-2.7.3.tar.gz -C /soft/
[yinzhengjie@yinzhengjie ~]$ ln -s /soft/hadoop-2.7.3/ /soft/hadoop
[yinzhengjie@yinzhengjie ~]$ ll /soft/
total 8
lrwxrwxrwx. 1 yinzhengjie yinzhengjie 19 May 24 02:40 hadoop -> /soft/hadoop-2.7.3/
drwxr-xr-x. 9 yinzhengjie yinzhengjie 4096 Aug 17 2016 hadoop-2.7.3
lrwxrwxrwx. 1 yinzhengjie yinzhengjie 13 May 24 02:33 jdk -> jdk1.8.0_131/
drwxr-xr-x. 8 yinzhengjie yinzhengjie 4096 Mar 15 2017 jdk1.8.0_131
[yinzhengjie@yinzhengjie ~]$ 

2>.设置Hadoop的环境变量

[yinzhengjie@yinzhengjie ~]$ sudo vi /etc/profile
[sudo] password for yinzhengjie: 
[yinzhengjie@yinzhengjie ~]$ tail -7 /etc/profile
#Add by yinzhengjie
JAVA_HOME=/soft/jdk/
PATH=$PATH:$JAVA_HOME/bin

#Add HADOOP_HOME
HADOOP_HOME=/soft/hadoop/
PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
[yinzhengjie@yinzhengjie ~]$ 
[yinzhengjie@yinzhengjie ~]$ source /etc/profile
[yinzhengjie@yinzhengjie ~]$ grep JAVA_HOME /soft/hadoop/etc/hadoop/hadoop-env.sh | grep -v ^#
export JAVA_HOME=/soft/jdk/
[yinzhengjie@yinzhengjie ~]$ 

3>.验证是否安装完毕（注意，提交的目录当前用户须要有权限，由于本地部署不须要启动服务，它用的就是Linux操做系统，若是普通用户把文件直接提交到根的话确定会报异常的哟！）

[yinzhengjie@yinzhengjie ~]$ ll
total 599344
-rw-rw-r--. 1 yinzhengjie yinzhengjie 214092195 Aug 26 2016 hadoop-2.7.3.tar.gz
-rw-rw-r--. 1 yinzhengjie yinzhengjie 185540433 May 17 2017 jdk-8u131-linux-x64.tar.gz
-rw-r--r--. 1 yinzhengjie yinzhengjie 214092195 May 24 03:24 test
[yinzhengjie@yinzhengjie ~]$ rm -rf test 
[yinzhengjie@yinzhengjie ~]$ 
[yinzhengjie@yinzhengjie ~]$ 
[yinzhengjie@yinzhengjie ~]$ ll
total 390268
-rw-rw-r--. 1 yinzhengjie yinzhengjie 214092195 Aug 26 2016 hadoop-2.7.3.tar.gz
-rw-rw-r--. 1 yinzhengjie yinzhengjie 185540433 May 17 2017 jdk-8u131-linux-x64.tar.gz
[yinzhengjie@yinzhengjie ~]$ 
[yinzhengjie@yinzhengjie ~]$ hdfs dfs -put hadoop-2.7.3.tar.gz /home/yinzhengjie/test
[yinzhengjie@yinzhengjie ~]$ tar zxf test 
[yinzhengjie@yinzhengjie ~]$ ll
total 599348
drwxr-xr-x. 9 yinzhengjie yinzhengjie 4096 Aug 17 2016 hadoop-2.7.3
-rw-rw-r--. 1 yinzhengjie yinzhengjie 214092195 Aug 26 2016 hadoop-2.7.3.tar.gz
-rw-rw-r--. 1 yinzhengjie yinzhengjie 185540433 May 17 2017 jdk-8u131-linux-x64.tar.gz
-rw-r--r--. 1 yinzhengjie yinzhengjie 214092195 May 24 03:24 test
[yinzhengjie@yinzhengjie ~]$