Greenplum安装
目录
1、安装说明
1.1、环境说明
| 名称 | 版本 |
| 操作系统 | CentOS Linux release 7.5.1804 |
| greenplum | greenplum-db-5.21.0-rhel6-x86_64.rpm |
1.2、集群介绍
5台虚拟机，1个master节点，4个segment的集群，示例：
wuxiang-test-1（master）
wuxiang-test-2
wuxiang-test-3
wuxiang-test-4
wuxiang-test-5
1.3、修改主机名称
由于虚拟机重启后主机名称变为localhost，所以要永久性地修改为wuxiang-test-1这种形式，进行如下操作：
2、安装准备
2.1、修改各节点hosts（所有节点）
[[email protected] ~]# cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 192.168.40.218 wuxiang-test-1 192.168.40.238 wuxiang-test-2 192.168.40.239 wuxiang-test-3 192.168.40.240 wuxiang-test-4 192.168.40.241 wuxiang-test-5
注：标注了所有节点的配置项可以在安装greenplum并配置免密后用gpssh统一操作3.3。
2.2、修改network文件（所有节点，名称有差异）
[[email protected] ~]# cat /etc/sysconfig/network NISDOMAIN=QI HOSTNAME=wuxiang-test-2
2.3修改内核文件（所有节点）
[[email protected] ~]# cat /etc/sysctl.conf vm.swappiness = 10 kernel.shmmax = 500000000 kernel.shmmni = 4096 kernel.shmall = 4000000000 kernel.sem = 250 512000 100 2048 kernel.sysrq = 1 kernel.core_uses_pid = 1 kernel.msgmnb = 65536 kernel.msgmax = 65536 kernel.msgmni = 2048 net.ipv4.tcp_syncookies = 1 net.ipv4.ip_forward = 0 net.ipv4.conf.default.accept_source_route = 0 net.ipv4.tcp_tw_recycle = 1 net.ipv4.tcp_max_syn_backlog = 4096 net.ipv4.conf.all.arp_filter = 1 net.ipv4.ip_local_port_range = 1025 65535 net.core.netdev_max_backlog = 10000 vm.overcommit_memory = 2
最后使配置生效：
[[email protected] ~]# sysctl -p
2.4、修改进程数文件（所有节点）
[[email protected] ~]# cat /etc/security/limits.d/20-nproc.conf # Default limit for number of user's processes to prevent # accidental fork bombs. # See rhbz #432903 for reasoning. * soft nproc 4096 root soft nproc unlimited
2.5、关闭防火墙（所有节点）
查看防火墙状态：firewall-cmd --state
关闭防火墙：systemctl stop firewalld.service
禁止防火墙开机启动：systemctl disable firewalld.service
修改配置（所有节点）：
[[email protected] ~]# cat /etc/selinux/confin SELINUX=disabled SELINUXTYPE=targeted
2.6、创建用户（各节点共享）
groupadd -g 530 gpadmin useradd -g 530 -u 530 -m -d /home/gpadmin -s /bin/bash gpadmin chown -R gpadmin:gpadmin /home/gpadmin echo "gpadmin" | passwd --stdin gpadmin
3、安装Greenplum DB
3.1、在Master节点上安装Greenplum
安装包下载地址：https://network.pivotal.io/products/pivotal-gpdb/#/releases/413133/file_groups/1866
安装包是rpm格式的执行rpm安装命令：
[[email protected] ~]# rpm -ivh greenplum-db-5.21.0-rhel6-x86_64.rpm
默认的安装路径是/usr/local。
将/usr/local/greenplum-db-5.21.0文件拷贝至所有节点（可以压缩再解压，也可以使用gpssh方式）
然后需要修改该路径gpadmin操作权限（所有节点）：
chown -R gpadmin:gpadmin /usr/local chown -R gpadmin:gpadmin /opt
建立软连接（所有节点）:
ln -s /usr/local/greenplum-db-5.21.0 greenplum-db
3.2、创建hostlist、seg_hosts文件
切换gpadmin用户，创建conf文件夹，
[[email protected] ~]# cd conf/ [[email protected] conf]# cat hostlist wuxiang-test-1 wuxiang-test-2 wuxiang-test-3 wuxiang-test-4 wuxiang-test-5 [[email protected] conf]# cat seg_hosts wuxiang-test-2 wuxiang-test-3 wuxiang-test-4 wuxiang-test-5
3.3、配置免密连接
[[email protected] wuxiang-test-1 ~]# su gpadmin [[email protected] wuxiang-test-1 ~]# source /usr/local/greenplum-db/greenplum_path.sh [[email protected] wuxiang-test-1 ~]# gpssh-exkeys -f /home/gpadmin/conf/hostlist [STEP 1 of 5] create local ID and authorize on local host ... /home/gpadmin/.ssh/id_rsa file exists ... key generation skipped [STEP 2 of 5] keyscan all hosts and update known_hosts file [STEP 3 of 5] authorize current user on remote hosts ... send to wuxiang-test-1 ... send to wuxiang-test-2 ... send to wuxiang-test-3 ... send to wuxiang-test-4 ... send to wuxiang-test-5 #提示：这里提示输入各个子节点gpadmin用户密码 [STEP 4 of 5] determine common authentication file content [STEP 5 of 5] copy authentication files to all remote hosts ... finished key exchange with wuxiang-test-1 ... finished key exchange with wuxiang-test-2 ... finished key exchange with wuxiang-test-3 ... finished key exchange with wuxiang-test-4 ... finished key exchange with wuxiang-test-5 [INFO] completed successfully
测试免密是否成功：
[[email protected] ~]# ssh wuxiang-test-4
或者用gpssh：
[[email protected] ~]$ gpssh -f /home/gpadmin/conf/hostlist => pwd [wuxiang-test-1] /home/gpadmin [wuxiang-test-4] /home/gpadmin [wuxiang-test-5] /home/gpadmin [wuxiang-test-3] /home/gpadmin [wuxiang-test-2] /home/gpadmin => exit
显示上面内容，即为成功。
4、初始化数据库
4.1、创建资源目录
source /usr/local/ greenplum-db/greenplum_path.sh gpssh -f /home/gpadmin/conf/hostlist #统一处理所有节点 #创建资源目录 /opt/greenplum/data下一系列目录（生产目录个数可根据需求生成） => mkdir -p /opt/greenplum/data/master => mkdir -p /opt/greenplum/data/primary => mkdir -p /opt/greenplum/data/mirror => mkdir -p /opt/greenplum/data2/primary => mkdir -p /opt/greenplum/data2/mirror
4.2、环境变量配置（所有节点）
[[email protected] ~]$ cat /home/gpadmin/.bash_profile # .bash_profile # Get the aliases and functions if [ -f ~/.bashrc ]; then . ~/.bashrc fi # User specific environment and startup programs PATH=$PATH:$HOME/.local/bin:$HOME/bin export PATH source /usr/local/greenplum-db/greenplum_path.sh export MASTER_DATA_DIRECTORY=/opt/greenplum/data/master/gpseg-1 export GPPORT=5432 export PGDATABASE=gp_sydb
注：不能用gpssh编辑文件
让环境变量生效：
source /home/gpadmin/.bash_profile
4.3、NTP配置
启用master节点上的ntp，并在Segment节点上配置和启动NTP：
#master 节点 [[email protected] ~]# echo "server 127.127.1.0" >>/etc/ntp.conf #Segment节点 [[email protected] ~]# echo "server wuxiang-test-1 perfer" >>/etc/ntp.conf #master节点 [[email protected] ~]# systemctl start ntpd [[email protected] ~]# systemctl enable ntpd
4.4、检查各节点的连通性
[[email protected] bin]$ cd /usr/local/greenplum-db/bin
[[email protected] bin]$ gpcheckperf -f /home/gpadmin/conf/hostlist -r N -d /tmp /usr/local/greenplum-db/./bin/gpcheckperf -f /home/gpadmin/conf/hostlist -r N -d /tmp ------------------- -- NETPERF TEST ------------------- [Warning] retrying with port 23012 [Warning] retrying with port 23024 [Warning] retrying with port 23036 [Warning] retrying with port 23048 [Warning] retrying with port 23060 ==================== == RESULT ==================== Netperf bisection bandwidth test wuxiang-test-1 -> wuxiang-test-2 = 110.490000 wuxiang-test-3 -> wuxiang-test-4 = 112.120000 wuxiang-test-5 -> wuxiang-test-1 = 108.990000 wuxiang-test-2 -> wuxiang-test-1 = 102.830000 wuxiang-test-4 -> wuxiang-test-3 = 112.010000 wuxiang-test-1 -> wuxiang-test-5 = 108.930000 Summary: sum = 655.37 MB/sec min = 102.83 MB/sec max = 112.12 MB/sec avg = 109.23 MB/sec median = 110.49 MB/sec
我在安装过程中由于反复尝试了多次，出现了如下错误：
[[email protected] bin]$ gpcheckperf -f /home/gpadmin/conf/hostlist -r N -d /tmp /usr/local/greenplum-db/./bin/gpcheckperf -f /home/gpadmin/conf/hostlist -r N -d /tmp ------------------- -- NETPERF TEST ------------------- [Warning] retrying with port 23012 [Warning] retrying with port 23024 [Warning] retrying with port 23036 [Warning] retrying with port 23048 [Error] unable to start netserver ... abort netperf test ==================== == RESULT ====================
经尝试是由于端口占用过多导致，gpcheckperf文件中默认是尝试5次，如果5次都没连通，则会报这个错误，由于未找到删除端口办法，所以修改了gpcheckperf文件中xrange为10次
4.5、执行初始化
[[email protected] bin]$ cd /usr/local/greenplum-db/docs/cli_help/gpconfigs [[email protected] gpconfigs]$ cp gpinitsystem_config initgp_config [[email protected] gpconfigs]$ vim initgp_config
修改内容：
#目录与4.1创建的目录一致 declare -a DATA_DIRECTORY=(/opt/greenplum//data/primary /opt/greenplum//data/primary /opt/greenplum//data/primary /opt/greenplum//data2/primary /opt/greenplum//data2/primary /opt/greenplum//data2/primary) declare -a MIRROR_DATA_DIRECTORY=(/opt/greenplum/data/mirror /opt/greenplum/data/mirror /opt/greenplum/data/mirror /opt/greenplum/data2/mirror /opt/greenplum/data2/mirror /opt/greenplum/data2/mirror) ARRAY_NAME="gp_sydb" #初始化数据库名称 MASTER_HOSTNAME=wuxiang-test-1 #主节点名称 MASTER_DIRECTORY=/opt/greenplum/data/master MASTER_DATA_DIRECTORY=/opt/greenplum/data/master/gpseg-1 DATABASE_NAME=gp_sydb MACHINE_LIST_FILE=/home/gpadmin/conf/seg_hosts
执行初始化：
View Code
若初始化失败，则重新执行4.1，删除已初始化的数据。
执行psql -d postgres进入到数据库，则说明安装完成。
5、数据库操作
5.1、停止和启动集群
gpstop -M fast gpstart -a
5.2、登陆数据库
$ psql -d postgres
5.3、集群状态
gpstate -e #查看mirror的状态 gpstate -f #查看standby master的状态 gpstate -s #查看整个GP群集的状态 gpstate -i #查看GP的版本 gpstate --help #帮助文档，可以查看gpstate更多用法
目前为止数据库已经操作完毕。默认只有本地可以连数据库，如果需要别的I可以连，需要修改gp_hba.conf文件。