hbase配置文档.doc

Hbase配置文档
目录
Hbase配置文档 1
1.1. 前言 2
1.2. 编辑环境 2
1.3. 与hadoop同步版本（这里hadoop版本是1.02,hbase支持1.00） 5
1.4. 拷贝到各台服务器 5
1.5. 启动并测试hbase 5
1.6. 监控页面 5

1.1. 前言
此配置文档基于已装hadoop的前提下，因此诸如jdk，hostname设置，机器登入免密码设置将不再重复
jdk的版本 1.7.0_03
hadoop的版本1.02
hbase的版本 0.92.1 （注：这里的hbase仅支持hadoop1.00的版本，需要复制core jar包同步，下文会涉及）

安装目录
Hadoop: /usr/local/webserver/hadoop
Hbase:/usr/local/webserver/hbase

机器信息
机器名
Ip地址
作用
master
192.168.1.1
HMaster、HQuorumPeer、HRegionServer
slave1
192.168.1.2
HQuorumPeer、HRegionServer
slave2
192.168.1.3
HQuorumPeer、HRegionServer

1.2. 编辑环境
编辑hbase-env.sh
[root@master hbase]# vim conf/hbase-env.sh
# Set environment variables here.

# The java implementation to use. Java 1.6 required.
# export JAVA_HOME=/usr/java/jdk1.6.0/
export JAVA_HOME=/usr/java/jdk1.7.0_03

# Extra Java CLASSPATH elements. Optional.
# export HBASE_CLASSPATH=

# The maximum amount of heap to use, in MB. Default is 1000.
# export HBASE_HEAPSIZE=1000

# Extra Java runtime options.
# Below are what we set by default. May only work with SUN JVM.
# For more on why as well as other possible settings,
# see http://wiki.apache.org/hadoop/PerformanceTuning
export HBASE_OPTS="-XX:+UseConcMarkSweepGC"
#开启zookeeper
export HBASE_MANAGES_ZK=true

# Uncomment below to enable java garbage collection logging in the .out file.
# export HBASE_OPTS="$HBASE_OPTS -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps"

# Uncomment below if you intend to use the EXPERIMENTAL off heap cache.
# export HBASE_OPTS="$HBASE_OPTS -XX:MaxDirectMemorySize="
# Set hbase.offheapcache.percentage in hbase-site.xml to a nonzero value.

# Uncomment and adjust to enable JMX exporting
# See jmxremote.password and jmxremote.access in $JRE_HOME/lib/management to configure remote password access.
# More details at:
#
# export HBASE_JMX_BASE="-Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false"
# export HBASE_MASTER_OPTS="$HBASE_JMX_BASE -Dcom.sun.management.jmxremote.port=10101"
# export HBASE_REGIONSERVER_OPTS="$HBASE_JMX_BASE -Dcom.sun.management.jmxremote.port=10102"
# export HBASE_THRIFT_OPTS="$HBASE_JMX_BASE -Dcom.sun.management.jmxremote.port=10103"
# export HBASE_ZOOKEEPER_OPTS="$HBASE_JMX_BASE -Dcom.sun.management.jmxremote.port=10104"

# File naming hosts on which HRegionServers will run. $HBASE_HOME/conf/regionservers by default.
# export HBASE_REGIONSERVERS=${HBASE_HOME}/conf/regionservers

# Extra ssh options. Empty by default.
# export HBASE_SSH_OPTS="-o ConnectTimeout=1 -o SendEnv=HBASE_CONF_DIR"

# Where log files are stored. $HBASE_HOME/logs by default.
# 设定日志路径
export HBASE_LOG_DIR=/data/hadoop/hbase/logs

# A string representing this instance of hbase. $USER by default.
# export HBASE_IDENT_STRING=$USER

# The scheduling priority for daemon processes. See 'man nice'.
# export HBASE_NICENESS=10

# The directory where pid files are stored. /tmp by default.
# export HBASE_PID_DIR=/var/hadoop/pids

# Seconds to sleep between slave commands. Unset by default. This
# can be useful in large clusters, where, e.g., slave rsyncs can
# otherwise arrive faster than the master can service them.
# export HBASE_SLAVE_SLEEP=0.1

# Tell HBase whether it should manage it's own instance of Zookeeper or not.
# export HBASE_MANAGES_ZK=true

编辑hbase-site.xml
[root@master hbase]#vim conf/hbase-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://master:9000/hbase</value>
<description>hadoop master的主机名，必须使用hadoop master的主机名而不是ip地址，如果是ip地址，hbase master启动的时候会报Wrong FS错误</description>
</property>
<property>
<name>hbase.master.port</name>
<value>60000</value>
<description>设置hbase的master主机名和端口</description>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
<description>设置为true，采用完全分布模式</description>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/data/hadoop/zookeeper</value>
<description>使用hbase自带zookeeper的时候，设置zookeeper文件存放的地址</description>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2181</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>master,slave1,slave2</value>
<description>置了管理hbase的zookeeper集群节点的ip地址或主机名或dns映射名，官方建议3,5,7个</description>
</property>
</configuration>

编辑regionservers
[root@master hbase]#vim conf/regionservers
master
slave1
slave2

1.3. 与hadoop同步版本（这里hadoop版本是1.02,hbase支持1.00）
[root@master hbase]#cp /usr/local/webserver/hadoop-core-1.0.2.jar /usr/local/webserver/lib/ hadoop-core-1.0.2.jar

1.4. 拷贝到各台服务器
[root@master hbase]# scp -r /usr/local/webserver/hbase root@192.168.32.211:/usr/local/webserver/hbase
[root@master hbase]# scp -r /usr/local/webserver/hbase root@192.168.32.212:/usr/local/webserver/hbase

1.5. 启动并测试hbase
[root@master hbase]# bin/start-hbase.sh
slave1: starting zookeeper, logging to /usr/local/webserver/hbase/bin/../logs/hbase-root-zookeeper-slave1.out
slave2: starting zookeeper, logging to /usr/local/webserver/hbase/bin/../logs/hbase-root-zookeeper-slave2.out
master: starting zookeeper, logging to /data/hadoop/hbase/logs//hbase-root-zookeeper-master.out
starting master, logging to /data/hadoop/hbase/logs//hbase-root-master-master.out
slave2: starting regionserver, logging to /usr/local/webserver/hbase/bin/../logs/hbase-root-regionserver-slave2.out
slave1: starting regionserver, logging to /usr/local/webserver/hbase/bin/../logs/hbase-root-regionserver-slave1.out
master: starting regionserver, logging to /data/hadoop/hbase/logs//hbase-root-regionserver-master.out
[root@master hbase]# bin/hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.92.1, r1298924, Fri Mar 9 16:58:34 UTC 2012

hbase(main):001:0> create 'test','data'
0 row(s) in 1.9310 seconds

1.6. 监控页面
http://master:60010/master-status
http://master:60030/rs-status
http://master:60010/zk.jsp
http://master:50070 的Browse the filesystem会多出个hbase目录

参考博文