hadoop运行wordcount

hadoop版本为2.7.2html

部署请参考:http://www.javashuo.com/article/p-fpqetctu-ck.htmloop

准备工做须要以下: 1.hadoop环境
2.example.jar
3.指定输入输出目录.net

(一)example.jar位置

hadoop-mapreduce-examples-2.7.2.jar 路径在hadoop安装目录下code

ls -l share/hadoop/mapreduce/ http://7xwsew.com1.z0.glb.clouddn.com/hadoop-002-001.jpghtm

(二)输入输出路径,上传什么文件

1.HDFS建立数据目录blog

建立输入文件位置:hadoop fs -mkdir -p /data/wordcount 建立输出文件位置:hadoop fs -mkdir -p /output/ 查看当前文件列表:hadoop fs -ls / http://7xwsew.com1.z0.glb.clouddn.com/hadoop-002-002.jpghadoop

2.添加输入文件部署

这里构建好文本inputword http://7xwsew.com1.z0.glb.clouddn.com/hadoop-002-003.jpg 将文件上传到HDFS当中并查看
hadoop fs -put ~/inputWord /data/wordcount/ hadoop fs -ls /data/wordcount http://7xwsew.com1.z0.glb.clouddn.com/hadoop-002-004.jpgget

(三)运行wordcount

经过运行jar 并传递执行参数运行wordcount
hadoop jar /usr/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar wordcount /data/wordcount /output/wordcount
http://7xwsew.com1.z0.glb.clouddn.com/hadoop-002-005.jpg http://7xwsew.com1.z0.glb.clouddn.com/hadoop-002-006.jpg
查看结果,执行以下命令,与输入文件吻合
hadoop fs -text /output/wordcount/part-r-00000 http://7xwsew.com1.z0.glb.clouddn.com/hadoop-002-007.jpginput

HDFS命令参考:http://www.cnblogs.com/xd502djj/p/3625799.html 参考:http://www.aboutyun.com/blog-61-148.html

相关文章
相关标签/搜索