Hbase 单机安装配置 及 phoenix 安装配置搭配使用
先安装配置zookeeper
==== ZOOKEEPER 安装配置===
[[email protected] ~]$ tar xf ~/^Cftware/zookeeper-3.4.5-cdh5.7.0.tar.gz -C ~/app
[[email protected] conf]$ cd ~/app/zookeeper-3.4.5-cdh5.7.0/conf/
[[email protected] conf]$ cp -rp zoo_sample.cfg zoo.cfg
修改 zoo.cfg
dataDir=/home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/data
dataLogDir=/home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/logs
clientPort=2181
mkdir -p /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/data
mkdir -p /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/logs
添加环境变量
[[email protected] ~]$ cat /home/hadoop/.bash_profile |grep ZOOKEEPER_HOME
export ZOOKEEPER_HOME=/home/hadoop/app/zookeeper-3.4.5-cdh5.7.0
export PATH=$PATH:$ZOOKEEPER_HOME/bin
[[email protected] ~]$ source /home/hadoop/.bash_profile
启动 zookeeper
[[email protected] ~]$ /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/bin/zkServer.sh start
JMX enabled by default
Using config: /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/bin/../conf/zoo.cfg
Starting zookeeper ... /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/bin/zkServer.sh: line 120: [: /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/data: binary operator expected
STARTED
==== 安装配置 伪分布式 hbase ==
[[email protected] software]$ pwd
/home/hadoop/software
[[email protected] software]$ tar xf hbase-1.2.0-cdh5.7.0.tar.gz -C /home/hadoop/app/
添加 HBASE 的环境变量
[[email protected] ~]$ cat .bash_profile | grep HBASE
export HBASE_HOME=/home/hadoop/app/hbase-1.2.0-cdh5.7.0
export PATH=$PATH:$HBASE_HOME/bin
修改 hbase-env.sh
export JAVA_HOME=/usr/java/jdk1.8.0_92
export HBASE_MANAGES_ZK=false
修改 hbase-site.xml
<property>
<name>hbase.rootdir</name>
<value>hdfs://node1.oracle.com:8020/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>node1.oracle.com:2181</value>
</property>
<property>
<name>hbase.regionserver.wal.codec</name>
<value>org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec</value>
</property>
=====安装phoenix ===
[[email protected] phoenix-4.13.2-cdh5.7.0]$ cp -rp *.jar ~/app/hadoop-2.6.0-cdh5.7.0/lib/
[[email protected] software]$ tar xf phoenix-4.13.2-cdh5.7.0.tar.gz
[[email protected] software]$ cd phoenix-4.13.2-cdh5.7.0
[[email protected] phoenix-4.13.2-cdh5.7.0]$ pwd
/home/hadoop/software/phoenix-4.13.2-cdh5.7.0
[[email protected] phoenix-4.13.2-cdh5.7.0]$ cp -rp phoenix-4.13.2-cdh5.7.0-server.jar phoenix-4.13.2-cdh5.7.0-queryserver.jar ~/app/hbase-1.2.0-cdh5.7.0/lib/
start-hbase.sh
./software/phoenix-4.13.2-cdh5.7.0/bin/sqlline.py node1.oracle.com:2181
[[email protected] bin]$ ./sqlline.py node1.oracle.com:2181
Traceback (most recent call last):
File "./sqlline.py", line 27, in <module>
import argparse
ImportError: No module named argparse
将 argparse.py 上传到/home/hadoop/software/phoenix-4.13.2-cdh5.7.0/bin
./software/phoenix-4.13.2-cdh5.7.0/bin/sqlline.py node1.oracle.com:2181
[[email protected] bin]$ ./sqlline.py node1.oracle.com:2181
0: jdbc:phoenix:node1.oracle.com:2181> !table
+------------+--------------+---------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+------+
| TABLE_CAT | TABLE_SCHEM | TABLE_NAME | TABLE_TYPE | REMARKS | TYPE_NAME | SELF_REFERENCING_COL_NAME | REF_GENERATION | INDEX_STATE | IMMUTABLE_ROWS | SALT |
+------------+--------------+---------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+------+
| | SYSTEM | CATALOG | SYSTEM TABLE | | | | | | false | null |
| | SYSTEM | FUNCTION | SYSTEM TABLE | | | | | | false | null |
| | SYSTEM | SEQUENCE | SYSTEM TABLE | | | | | | false | null |
| | SYSTEM | STATS | SYSTEM TABLE | | | | | | false | null |
+------------+--------------+---------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+------+
[[email protected] phoenix-4.13.2-cdh5.7.0]$ bin/sqlline.py node1.orcale.com:2181 ./examples/STOCK_SYMBOL.sql 或是用下面语句手工创建
创建表：CREATE TABLE IF NOT EXISTS STOCK_SYMBOL (SYMBOL VARCHAR NOT
NULL PRIMARY KEY, COMPANY VARCHAR);
插入数据：
UPSERT INTO STOCK_SYMBOL VALUES ('CRM','SalesForce.com');
查看数据：
SELECT * FROM STOCK_SYMBOL;
导入数据：
[[email protected] phoenix-4.13.2-cdh5.7.0]$ bin/psql.py node1.oracle.com:2181 -t STOCK_SYMBOL ./examples/STOCK_SYMBOL.csv
[[email protected] app]$ hbase shell
hbase(main):001:0> list
TABLE
STOCK_SYMBOL
SYSTEM.CATALOG
SYSTEM.FUNCTION
SYSTEM.MUTEX
SYSTEM.SEQUENCE
SYSTEM.STATS
6 row(s) in 0.4260 seconds
=> ["STOCK_SYMBOL", "SYSTEM.CATALOG", "SYSTEM.FUNCTION", "SYSTEM.MUTEX", "SYSTEM.SEQUENCE", "SYSTEM.STATS"]
==== ZOOKEEPER 安装配置===
[[email protected] ~]$ tar xf ~/^Cftware/zookeeper-3.4.5-cdh5.7.0.tar.gz -C ~/app
[[email protected] conf]$ cd ~/app/zookeeper-3.4.5-cdh5.7.0/conf/
[[email protected] conf]$ cp -rp zoo_sample.cfg zoo.cfg
修改 zoo.cfg
dataDir=/home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/data
dataLogDir=/home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/logs
clientPort=2181
mkdir -p /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/data
mkdir -p /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/logs
添加环境变量
[[email protected] ~]$ cat /home/hadoop/.bash_profile |grep ZOOKEEPER_HOME
export ZOOKEEPER_HOME=/home/hadoop/app/zookeeper-3.4.5-cdh5.7.0
export PATH=$PATH:$ZOOKEEPER_HOME/bin
[[email protected] ~]$ source /home/hadoop/.bash_profile
启动 zookeeper
[[email protected] ~]$ /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/bin/zkServer.sh start
JMX enabled by default
Using config: /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/bin/../conf/zoo.cfg
Starting zookeeper ... /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/bin/zkServer.sh: line 120: [: /home/hadoop/app/zookeeper-3.4.5-cdh5.7.0/data: binary operator expected
STARTED
==== 安装配置 伪分布式 hbase ==
[[email protected] software]$ pwd
/home/hadoop/software
[[email protected] software]$ tar xf hbase-1.2.0-cdh5.7.0.tar.gz -C /home/hadoop/app/
添加 HBASE 的环境变量
[[email protected] ~]$ cat .bash_profile | grep HBASE
export HBASE_HOME=/home/hadoop/app/hbase-1.2.0-cdh5.7.0
export PATH=$PATH:$HBASE_HOME/bin
修改 hbase-env.sh
export JAVA_HOME=/usr/java/jdk1.8.0_92
export HBASE_MANAGES_ZK=false
修改 hbase-site.xml
<property>
<name>hbase.rootdir</name>
<value>hdfs://node1.oracle.com:8020/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>node1.oracle.com:2181</value>
</property>
<property>
<name>hbase.regionserver.wal.codec</name>
<value>org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec</value>
</property>
=====安装phoenix ===
[[email protected] phoenix-4.13.2-cdh5.7.0]$ cp -rp *.jar ~/app/hadoop-2.6.0-cdh5.7.0/lib/
[[email protected] software]$ tar xf phoenix-4.13.2-cdh5.7.0.tar.gz
[[email protected] software]$ cd phoenix-4.13.2-cdh5.7.0
[[email protected] phoenix-4.13.2-cdh5.7.0]$ pwd
/home/hadoop/software/phoenix-4.13.2-cdh5.7.0
[[email protected] phoenix-4.13.2-cdh5.7.0]$ cp -rp phoenix-4.13.2-cdh5.7.0-server.jar phoenix-4.13.2-cdh5.7.0-queryserver.jar ~/app/hbase-1.2.0-cdh5.7.0/lib/
start-hbase.sh
./software/phoenix-4.13.2-cdh5.7.0/bin/sqlline.py node1.oracle.com:2181
[[email protected] bin]$ ./sqlline.py node1.oracle.com:2181
Traceback (most recent call last):
File "./sqlline.py", line 27, in <module>
import argparse
ImportError: No module named argparse
将 argparse.py 上传到/home/hadoop/software/phoenix-4.13.2-cdh5.7.0/bin
./software/phoenix-4.13.2-cdh5.7.0/bin/sqlline.py node1.oracle.com:2181
[[email protected] bin]$ ./sqlline.py node1.oracle.com:2181
0: jdbc:phoenix:node1.oracle.com:2181> !table
+------------+--------------+---------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+------+
| TABLE_CAT | TABLE_SCHEM | TABLE_NAME | TABLE_TYPE | REMARKS | TYPE_NAME | SELF_REFERENCING_COL_NAME | REF_GENERATION | INDEX_STATE | IMMUTABLE_ROWS | SALT |
+------------+--------------+---------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+------+
| | SYSTEM | CATALOG | SYSTEM TABLE | | | | | | false | null |
| | SYSTEM | FUNCTION | SYSTEM TABLE | | | | | | false | null |
| | SYSTEM | SEQUENCE | SYSTEM TABLE | | | | | | false | null |
| | SYSTEM | STATS | SYSTEM TABLE | | | | | | false | null |
+------------+--------------+---------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+------+
[[email protected] phoenix-4.13.2-cdh5.7.0]$ bin/sqlline.py node1.orcale.com:2181 ./examples/STOCK_SYMBOL.sql 或是用下面语句手工创建
创建表：CREATE TABLE IF NOT EXISTS STOCK_SYMBOL (SYMBOL VARCHAR NOT
NULL PRIMARY KEY, COMPANY VARCHAR);
插入数据：
UPSERT INTO STOCK_SYMBOL VALUES ('CRM','SalesForce.com');
查看数据：
SELECT * FROM STOCK_SYMBOL;
导入数据：
[[email protected] phoenix-4.13.2-cdh5.7.0]$ bin/psql.py node1.oracle.com:2181 -t STOCK_SYMBOL ./examples/STOCK_SYMBOL.csv
查看 导入的数据
[[email protected] app]$ hbase shell
hbase(main):001:0> list
TABLE
STOCK_SYMBOL
SYSTEM.CATALOG
SYSTEM.FUNCTION
SYSTEM.MUTEX
SYSTEM.SEQUENCE
SYSTEM.STATS
6 row(s) in 0.4260 seconds
=> ["STOCK_SYMBOL", "SYSTEM.CATALOG", "SYSTEM.FUNCTION", "SYSTEM.MUTEX", "SYSTEM.SEQUENCE", "SYSTEM.STATS"]