hadoop集群（彻底分布式）下hbase的安装和配置

hadoop的安装请看http://www.cnblogs.com/zhangmin1987/p/8808711.html

1、Hbase简介

Apache HBase™是Hadoop数据库，这是一个分布式，可扩展的大数据存储。

当您须要随机，实时读取/写入您的大数据时使用Apache HBase™。该项目的目标是托管很是大的表 - 数十亿行×数百万列 - 在商品硬件集群上。Apache HBase是一个开源的，分布式的，版本化的非关系数据库，其模型是在Chang等人的Google Bigtable：结构化数据分布式存储系统以后创建的。就像Bigtable利用Google文件系统提供的分布式数据存储同样，Apache HBase在Hadoop和HDFS之上提供了相似Bigtable的功能。

截取官网的一些内容以下，官网地址 

Welcome to Apache HBase™

Apache HBase™ is the Hadoop database, a distributed, scalable, big data store.

Use Apache HBase™ when you need random, realtime read/write access to your Big Data. This project's goal is the hosting of very large tables -- billions of rows X millions of columns -- atop clusters of commodity hardware. Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable: A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, Apache HBase provides Bigtable-like capabilities on top of Hadoop and HDFS.

Features-特性

• Linear and modular scalability.
• Strictly consistent reads and writes.
• Automatic and configurable sharding of tables
• Automatic failover support between RegionServers.
• Convenient base classes for backing Hadoop MapReduce jobs with Apache HBase tables.
• Easy to use Java API for client access.
• Block cache and Bloom Filters for real-time queries.
• Query predicate push down via server side Filters
• Thrift gateway and a REST-ful Web service that supports XML, Protobuf, and binary data encoding options
• Extensible jruby-based (JIRB) shell
• Support for exporting metrics via the Hadoop metrics subsystem to files or Ganglia; or via JMX

2、下载

Download-下载地址

Click here to download Apache HBase™.

 

3、Hbase的参考指南

 

Apache HBase™参考指南 

你们能够仔细看下这个指南，包括了安装说明和适配说明以及数据库的模型和具体特性。

贴一下Hbase对JDK的适配性：

 

3、环境准备

三台linux-cent0s6.5机器

机器1 192.168.234.129 master 主机

机器2 192.168.234.130 node1 主机

机器3 192.168.234.131 node2 主机 

 

4、安装

 4.1 下载

下载请看二或者用wget 命令

4.2 安装

[root@master local]# ls /local/hadoop-3.1.0.tar.gz 
/local/hadoop-3.1.0.tar.gz
[root@master local]# tar -zxvf /local/hadoop-3.1.0.tar.gz

将解压后的文件mv到/opt/下。

[root@master hbase]# pwd
/opt/hbase

而后配置/etc/profile

内容以下

#hbase config
export HBASE_HOME=/opt/hbase
export PATH=$HBASE_HOME/bin:$PATH
"/etc/profile" 91L, 2237C written
[root@master ~]# source /etc/profile

 

4.3 habse配置

配置三个文件：

1） 配置hbase-env.sh

默认状况下hbase自带的zookeeper配置是被注释掉的，表明着当启动hbase的时候它会再一次启动hbase自带的zookeeper，这个时候会报错，端口被占用。

因此这里修改为

export HBASE_MANAGES_ZK=false

2）配置/opt/hbase/conf/hbase-site.xml

<configuration>
    <property>
        <name>hbase.rootdir</name>
        <value>hdfs://master:9000/hbase/hbase_db</value>
    </property>
    <property>
        <name>hbase.master</name>
        <value>master</value>
    </property>
    <property>
        <name>hbase.cluster.distributed</name>
        <value>true</value>
    </property>
    <property>
        <name>hbase.zookeeper.quorum</name>
        <value>master,node1,node2</value>
    </property>
    <property>
        <name>zookeeper.session.timeout</name>
        <value>60000000</value>
    </property>
    <property>
        <name>dfs.support.append</name>
        <value>true</value>
    </property>
</configuration>

3） 配置regionservers 

[root@master conf]# cat regionservers 
node1
node2

4）集群安装：

配置完之后将hbase整个目录和/etc/profile所有copy到node1和node2. （略）

和hadoop和zookeeper的复制相似，请参看http://www.cnblogs.com/zhangmin1987/p/8808711.html

复制完之后记得source

 

 4.4 启动

1）启动顺序： zookeeper--hadoop--hbase

启动zookeeper和hadoop请参看前2篇文章 http://www.cnblogs.com/zhangmin1987/p/8808711.html 和 http://www.cnblogs.com/zhangmin1987/p/8818426.html

启动hbase

[root@master bin]# pwd
/opt/hbase/bin
[root@master bin]# ./start-hbase.sh 
starting master, logging to /opt/hbase/logs/hbase-root-master-master.out
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
node2: starting regionserver, logging to /opt/hbase/bin/../logs/hbase-root-regionserver-node2.out
node1: starting regionserver, logging to /opt/hbase/bin/../logs/hbase-root-regionserver-node1.out
node2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
node2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
node1: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
node1: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

 2）jps验证

[root@master bin]# jps
9856 Jps
9584 HMaster
2931 NameNode
3306 ResourceManager
2731 QuorumPeerMain
[root@master bin]#

3）前端验证

hdfs

http://192.168.234.129:50070/dfshealth.html#tab-startup-progress

 

yarn

http://192.168.234.129:8088/cluster/nodes

hbase

http://192.168.234.129:16010/master-status