mysql-mmm配合amoeba实现高可用、读写分离及负载均衡


mysql-mmm只是把数据库的读写功能分离出来,对于web服务器不可能说我要执行读的功能就连接哪个IP,要执行写的功能就连接哪个IP,这是不可能的,解决这一问题我使用amoeba(变形虫)数据库透明代理,根据执行的sql可自动路由至相应的Ip,很好地结合mysql-mmm真正实现读写分离。

整个拓扑如下:

mysql-mmm配合amoeba实现高可用、读写分离及负载均衡

amoeba服务器我也安装在server4上,下面是我的安装步骤:

一、安装java

wget http://download.oracle.com/otn-pub/java/jdk/6u25-b06/jdk-6u25-linux-i586.bin 
chmod 755 jdk-6u25-linux-i586.bin 
./jdk-6u25-linux-i586.bin 

mv jdk1.6.0_25/ /usr/local/jdk

配置环境变量vi /etc/profile

export JAVA_HOME=/usr/local/jdk/
export CLASSPATH=.:$JAVA_HOME/jre/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$JAVA_HOME/bin:$PATH

使文件即时生效

 source /etc/profile

检查

[[email protected] opt]# java -version
java version "1.6.0_25"
Java(TM) SE Runtime Environment (build 1.6.0_25-b06)
Java HotSpot(TM) Client VM (build 20.0-b11, mixed mode, sharing)

二、安装amoeba

wget http://sourceforge.net/projects/amoeba/files/Amoeba%20for%20mysql/2.x/amoeba-mysql-binary-2.1.0-RC5.tar.gz
mkdir /usr/local/amoeba
mv amoeba-mysql-binary-2.1.0-RC5.tar.gz  /usr/local/amoeba/
cd /usr/local/amoeba/
tar zxvf amoeba-mysql-binary-2.1.0-RC5.tar.gz
chmod 755 bin/*
cd bin/
./amoeba

PS:可能会出现如下报错

mysql-mmm配合amoeba实现高可用、读写分离及负载均衡

解决方法:

打开bin目录下 的amoeba启动文件

# vim amoeba

修改58行的Xss参数:

DEFAULT_OPTS="-server -Xms1024m -Xmx1024m -Xss128k"

修改为:
DEFAULT_OPTS="-server -Xms1024m -Xmx1024m -Xss256k"

再次执行,成功
mysql-mmm配合amoeba实现高可用、读写分离及负载均衡
 [[email protected] bin]# ./amoeba 
amoeba start|stop

三、配置读写分离

Amoeba的配置分成几个文件:

amoeba.xml      需要修改 主配置文件,配置所有数据源及Amoeba自身的参数
dbServer.xml     需要修改
access_list.conf   需要修改
rule.xml        数据切分时使用
log4j.xml        无需修改
functionMap.xml 无需修改       配置用于解析Query中的函数所对应的Java实现类nullFunctionMap.xml 无需修改    配置路由规则中需要使用到的特定函数的实现类。

 dbServer.xml

<factoryConfig class="com.meidusa.amoeba.mysql.net.MysqlServerConnectionFactory">
                        <property name="manager">${defaultManager}</property>
                        <property name="sendBufferSize">64</property>
                        <property name="receiveBufferSize">128</property>

                        <!-- mysql port -->
                        <property name="port">3306</property>

                        <!-- mysql schema -->
                        <property name="schema">test</property>  #外部访问的数据库

                        <!-- mysql user -->
                        <property name="user">lihuipeng</property>  #配置mmm的时候在write服务器上创建的全局用户供外部登录

                        <!--  mysql password-->
                        <property name="password">lihuipeng</property>
                        
                </factoryConfig>

……

        <dbServer name="server1"  parent="abstractServer">
                <factoryConfig>
                        <!-- mysql ip -->
                        <property name="ipAddress">192.168.93.141</property>
                </factoryConfig>
        </dbServer>

        <dbServer name="server2"  parent="abstractServer">
                <factoryConfig>
                        <!-- mysql ip -->
                        <property name="ipAddress">192.168.93.142</property>
                </factoryConfig>
        </dbServer>

        <dbServer name="server3"  parent="abstractServer">
                <factoryConfig>
                        <!-- mysql ip -->
                        <property name="ipAddress">192.168.93.144</property>
                </factoryConfig>
        </dbServer>

        <dbServer name="ReadPool" virtual="true">
                <poolConfig class="com.meidusa.amoeba.server.MultipleServerPool">
                        <!-- Load balancing strategy: 1=ROUNDROBIN , 2=WEIGHTBASED , 3=HA-->   #负载均衡参数:1=轮询,2=加权轮询,3=高可用

                        <property name="loadbalance">1</property>

                        <!-- Separated by commas,such as: server1,server2,server1 -->
                        <property name="poolNames">server2,server3</property>
                </poolConfig>
        </dbServer>

这里无需配置192.168.93.143,因为所有的读都不通过write角色的机器,也就是读写分离,此时server2、server3的查询权重为1:1,也可更改权重,如下即为1:2

<property name="poolNames">server2,server3,server3</property>

定义dbserver的时候,记得参考mmm_control show的信息,关键是write角色的机器一定要用write的ip
 [[email protected] ~]# mmm_control show
  db1(192.168.93.137) master/ONLINE. Roles: reader(192.168.93.143), writer(192.168.93.141)
  db2(192.168.93.138) master/ONLINE. Roles: reader(192.168.93.142)
  db3(192.168.93.139) slave/ONLINE. Roles: 
reader(192.168.93.144)


amoeba.xml

<property name="authenticator">
          <bean class="com.meidusa.amoeba.mysql.server.MysqlClientAuthenticator">

                                        <property name="user">amoeba</property>

                                        <property name="password">amoeba</property>

                                        <property name="filter">
                                                <bean class="com.meidusa.amoeba.server.IPAccessController">
                                                        <property name="ipFile">${amoeba.home}/conf/access_list.conf</property>
                                                </bean>
                                        </property>
                                </bean>
                        </property>

 

……

      <queryRouter class="com.meidusa.amoeba.mysql.parser.MysqlQueryRouter">
                <property name="ruleLoader">
                        <bean class="com.meidusa.amoeba.route.TableRuleFileLoader">
                                <property name="ruleFile">${amoeba.home}/conf/rule.xml</property>
                                <property name="functionFile">${amoeba.home}/conf/ruleFunctionMap.xml</property>
                        </bean>
                </property>
                <property name="sqlFunctionFile">${amoeba.home}/conf/functionMap.xml</property>
                <property name="LRUMapSize">1500</property>
 
               <property name="defaultPool">server1</property>


                <property name="writePool">server1</property>
                <property name="readPool">ReadPool</property>  #此处对应dbServer.xml的dbServer name="ReadPool"

                <property name="needParse">true</property>
        </queryRouter>

第一处修改web数据库可以连接使用的帐号密码,第二处修改amoeba读 写对应的server,该server就是我们之前定义的。

启动amoeba

 nohup /usr/local/amoeba/bin/amoeba start &

nohup 命令:可以简单理解为把执行信息输出到当前目录下的nohup.out

查看进程

 [[email protected] conf]# netstat -tunlp | grep java
tcp        0      0 :::8066                     :::*                        LISTEN      28426/java          
tcp        0      0 ::ffff:127.0.0.1:19356      :::*                        LISTEN      28426/java

测试登陆

 [[email protected] conf]# mysql -uamoeba -pamoeba -P8066 -h192.168.93.140
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 17244592
Server version: 5.1.45-mysql-amoeba-proxy-2.1.0-RC5 Source distribution

Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| test               |
+--------------------+
2 rows in set (0.02 sec)

 

可在三台mysql节点开启通用日志,然后找一台局域网内安装了mysql客户端的机器访问服务器(注:host为amoeba服务器的地址,此处为192.168.93.140,用户名密码为上面amoeba.xml设置的amoeba,端口号为amoeba默认端口8066,然后分别执行多次查询及写入,可以看到在日志看到查询操作会随机(权重为1:1:1)出现在三个mysql节点的其中一台,而写入的操作只会出现在server1。

原文:http://blog.csdn.net/xyz846/article/details/7451778