mysql cluster解决方案-白红宇

mysql cluster解决方案

阅读量：6310 次

发布时间：2019-06-22

本文共 13805 字，大约阅读时间需要 46 分钟。

Mysql cluster实验

1 测试环境：

1.1 软件系统版本

Gentoo 3.8.13

Mysql 5.1.67

Haproxy-1.4.24

1.2 架构

1.3 主机信息

hostname	Network interface	IP addr	note	主机编号
Mysql111	Enp2s1	192.168.254.111	master1	1
Mysql112	Enp2s1	192.168.254.112	master2	2
Mysql121	Enp2s1	192.168.254.121	master1/slave1	3
Mysql122	Enp2s1	192.168.254.122	master1/slave2	4
Mysql123	Enp2s1	192.168.254.123	master2/slave3	5
Mysql124	Enp2s1	192.168.254.124	master2/slave4	6
Haproxy110	Enp2s1	192.168.254.110	Double port	0
Haproxy110	Enp2s4	192.168.254.120	Double port	0

1.Mysql111和mysql112为主主模式同步数据

2.Mysql121,mysql122,mysql123,mysql124和mysql111，mysql112为主从模式，其中mysql111和mysql121，mysql122为主从； mysql112和mysql123，mysql124为主从

3.当mysql112停止同步，mysql111为主库，代理停止发送请求到mysql112，mysql123，mysql124

4.当mysql111停止同步，mysql112为主库，代理停止发送请求到mysql111，mysql121，mysql122

5.当mysql111和mysql112同时停止同步，集群变为readonly状态

6.当mysql112宕机，mysql111为backup模式，haproxy停止发送请求到mysql112，mysql123，mysql124

7.当mysql111宕机，mysql112为backup模式，haproxy停止发送请求到mysql111，mysql121，mysql122

8.当mysql111和mysql112同时宕机，集群停止工作

2. 准备工作

主机1-6

Vi /etc/mysql/mysql.cnf

如果有注销掉，或者修改为0.0.0.0

重启数据库

/etc/init.d/mysql restart

3. 配置mysql111和mysql112主主同步

3.1 主机1上

Vi /etc/mysql/my.cnf

主机 2上

主机1和2上

/etc/init.d/mysql restart

添加同步用户

Mysql –uroot -p

Grant replication slave on *.* to ‘copy’@’192.168.254.%’ identified by ‘copy’;

如上图，root是原有的账号，copy是刚才添加的

记录日志文件名称和pos号

在主机1上

Change master to

Master_host=’192.168.254.112’,

Master_port=3306,

Master_user=’copy’,

Master_password=’copy’,

Master_log_file=’mysql-bin.000004’

Master_log_pos=’192’;

Start slave;

Show slave status

在主机2上

Change master to

Master_host=’192.168.254.111’,

Master_port=3306,

Master_user=’copy’,

Master_password=’copy’,

Master_log_file=’mysql-bin.000005’,

Master_log_pos=’106’;

Start slave;

Show slave status

测试主主同步的可用性

分别在主机1和主机2 上创建个数据库，然后看另一台主机上是否存在就可以了

4. 在主机1,2,3,4,5,6上配置主从同步

在主机3-6上

Vi /etc/mysql/my.cnf

备注：server-id不能相同，其他换成改主机主机号就可以了

重启mysql

/etc/init.d/mysql restart

在主机3-4上

Mysql –uroot –p

Change master to

Master_host=’192.168.254.111’,

Master_port=3306,

Master_user=’copy’,

Master_password=’copy’,

Master_log_file=’mysql-bin.000005’,

Master_log_pos=’106’;

Start slave;

Show slave status;

在主机5-6上

Mysql –uroot –p

Change master to

Master_host=’192.168.254.112’,

Master_port=3306,

Master_user=’copy’,

Master_password=’copy’,

Master_log_file=’mysql-bin.000004’,

Master_log_pos=’192’;

Start slave;

Show slave status;

测试

同上，分别在1和2上创建1个数据库，看是否同步

5 安装xinetd

在主机1-6上

Emerge –av xinetd

Rc-update add xinetd default

/etc/init.d/xinetd start

在主机1-2上

Vi /etc/xinetd.d/mysqlchk

## /etc/xinetd.d/mysqlchk#service mysqlchk_write{flags       = REUSEsocket_type = streamport        = 9200wait        = nouser        = nobodyserver      = /opt/mysqlchk_status.shlog_on_failure  += USERIDdisable     = noonly_from   =192.168.254.0/24}service mysqlchk_replication{flags       = REUSEsocket_type = streamport        = 9201wait        = nouser        = nobodyserver      = /opt/mysqlchk_replication.shlog_on_failure  += USERIDdisable     = noonly_from   = 192.168.254.0/24}

添加服务端口

Mysqlchk_write9200/tcp# mysqlchk_write

Mysqlchk_replication9201/tcp# mysqlchk_replication

备注：

如果9200和9201端口被占用也可以使用其他端口号

在主机1上

Vi /opt/mysqlchk_status.sh

#!/bin/bashMYSQL_HOST="localhost"MYSQL_PORT="3306"MYSQL_USERNAME="root"MYSQL_PASSWORD="root"ERROR_MSG=`/usr/bin/mysql --host=$MYSQL_HOST --port=$MYSQL_PORT --user=$MYSQL_USERNAME --password=$MYSQL_PASSWORD -e "show databases;" 2>dev/null`if [ "$ERROR_MSG" != "" ]then# mysql is fine, return http 200/bin/echo -e "HTTP/1.1 200 OK\r\n"/bin/echo -e "Content-Type: Content-Type:text\r\n"/bin/echo -e "\r\n"/bin/echo -e "MySQL is running.\r\n"/bin/echo -e "\r\n"else#mysql is down, return http 503/bin/echo -e "HTTP/1.1 503 Service Unavailable\r\n"/bin/echo -e "Content-Type: Content-Type:text/plain\r\n"/bin/echo -e "\r\n"/bin/echo -e "MYSQL is *down*.\r\n"/bin/echo -e "\r\n"fi

Vi /opt/mysqlchk_replication.sh

#!/bin/bashMYSQL_HOST="localhost"MYSQL_PORT="3306"MYSQL_USERNAME="root"MYSQL_PASSWORD="root"/usr/bin/mysql --host=$MYSQL_HOST --port=$MYSQL_PORT --user=$MYSQL_USERNAME --password=$MYSQL_PASSWORD -e "show slave status;" > /tmp/check_repl.txtiostat=`grep "Slave_IO_Running" /tmp/check_repl.txt | awk '{print $2}'`sqlstat=`grep "Slave_SQL_Running" /tmp/check_repl.txt | awk '{print $2}'`#echo iostat:$iostat and sqlstat:$sqlstatif [ "$iostat" = "No" ] || [ "$sqlstat" = "No" ];then#mysql is down,return http 503/bin/echo -e "HTTP/1.1 503 Service Unavailable\r\n"/bin/echo -e "Content-Type: Content-Type:text/plain\r\n"/bin/echo -e "\r\n"/bin/echo -e "MySQL replication is *down*.\r\n"/bin/echo -e "\r\n"else#mysql is fine,return http 200/bin/echo -e "HTTP/1.1 200 OK\r\n"/bin/echo -e "Content-Type: Content-Type:text/plain\r\n"/bin/echo -e "\r\n"/bin/echo -e "MySQL replication is running.\r\n"/bin/echo -e "\r\n"fi

在主机2上

Vi /opt/mysqlchk_status.sh

#!/bin/bashMYSQL_HOST="localhost"MYSQL_PORT="3306"MYSQL_USERNAME="root"MYSQL_PASSWORD="root"ERROR_MSG=`/usr/bin/mysql --host=$MYSQL_HOST --port=$MYSQL_PORT --user=$MYSQL_USERNAME --password=$MYSQL_PASSWORD -e "show databases;" 2>dev/null`if [ "$ERROR_MSG" != "" ]then# mysql is fine, return http 200/bin/echo -e "HTTP/1.1 200 OK\r\n"/bin/echo -e "Content-Type: Content-Type:text\r\n"/bin/echo -e "\r\n"/bin/echo -e "MySQL is running.\r\n"/bin/echo -e "\r\n"else#mysql is down, return http 503/bin/echo -e "HTTP/1.1 503 Service Unavailable\r\n"/bin/echo -e "Content-Type: Content-Type:text/plain\r\n"/bin/echo -e "\r\n"/bin/echo -e "MYSQL is *down*.\r\n"/bin/echo -e "\r\n"fi

Vi /opt/mysqlchk_replication.sh

#!/bin/bashMYSQL_HOST="localhost"MYSQL_PORT="3306"MYSQL_USERNAME="root"MYSQL_PASSWORD="root"/usr/bin/mysql --host=$MYSQL_HOST --port=$MYSQL_PORT --user=$MYSQL_USERNAME --password=$MYSQL_PASSWORD -e "show slave status;" > /tmp/check_repl.txtiostat=`grep "Slave_IO_Running" /tmp/check_repl.txt | awk '{print $2}'`sqlstat=`grep "Slave_SQL_Running" /tmp/check_repl.txt | awk '{print $2}'`#echo iostat:$iostat and sqlstat:$sqlstatif [ "$iostat" = "No" ] || [ "$sqlstat" = "No" ];then#mysql is down,return http 503/bin/echo -e "HTTP/1.1 503 Service Unavailable\r\n"/bin/echo -e "Content-Type: Content-Type:text/plain\r\n"/bin/echo -e "\r\n"/bin/echo -e "MySQL replication is *down*.\r\n"/bin/echo -e "\r\n"else#mysql is fine,return http 200/bin/echo -e "HTTP/1.1 200 OK\r\n"/bin/echo -e "Content-Type: Content-Type:text/plain\r\n"/bin/echo -e "\r\n"/bin/echo -e "MySQL replication is running.\r\n"/bin/echo -e "\r\n"fi

在主机3-6上

Vi /etc/xinetd.d/mysqlchk

## /etc/xinetd.d/mysqlchk##service mysqlchk_replication{flags           = REUSEsocket_type     = streamport            = 9201wait            = nouser            = nobodyserver          = /opt/mysqlchk_replication.shlog_on_failure      += USERIDdisable         = noonly_from       = 192.168.254.0/24}

Vi /opt/mysqlchk_replication.sh

#!/bin/bashMYSQL_HOST="localhost"MYSQL_PORT="3306"MYSQL_USERNAME="root"MYSQL_PASSWORD="root"/usr/bin/mysql --host=$MYSQL_HOST --port=$MYSQL_PORT --user=$MYSQL_USERNAME --password=$MYSQL_PASSWORD -e "show slave status\G">/tmp/check_repl.txtiostat=`grep "Slave_IO_Running" /tmp/check_repl.txt | awk '{print $2}'`sqlstat=`grep "Slave_SQL_Running" /tmp/check_repl.txt | awk '{print $2}'`# echo iostat:$iostat and sqlstat:$sqlstatif [ "$iostat" = "No" ] || [ "$sqlstat" = "No" ]then#mysql is down,return http 503/bin/echo -e "HTTP/1.1 503 Service Unavailable\r\n"/bin/echo -e "Content-Type: Content-Type:text/plain\r\n"/bin/echo -e "\r\n"/bin/echo -e "MySQL replication is *down*.\r\n"/bin/echo -e "\r\n"else#mysql is fine,return http 200/bin/echo -e "HTTP/1.1 200 OK\r\n"/bin/echo -e "Content-Type: Content-Type:text/plain\r\n"/bin/echo -e "\r\n"/bin/echo -e "MySQL replication is running.\r\n"/bin/echo -e "\r\n"fi

在主机1-6上

Chmod +x /opt/mysql*.sh

重启系统或者重启xinetd

reboot

|| /etc/init.d/xinetd restart

查看监听端口

在主机1-2上

如上图9201和9200开始监听

在主机3-6上

如上图9201开始监听

7 haproxy 安装配置

下载haproxy*.tar.gz，这里我下载的是最新版本1.4.24

Tar zxvf haproxy-1.4.24.tar.gz

Cd haproxy-1.4.24

Make TARGET=linux2628

Make install

配置haproxy配置文件

## 在源码包里example目录下有个，可以参考！这里配置如下

Vi /etc/haproxy.cfg

globalmaxconn 40000debug#quietuser haproxygroup haproxynbproc 1log 127.0.0.1 local3spread-checks 2defaultstimeout server 3stimeout connect 3stimeout client 60stimeout http-request 3stimeout queue 3sfrontend db_writebind 192.168.254.110:3306default_backend cluster_db_writefrontend db_readbind 192.168.254.120:3306default_backend cluster_db_readfrontend web_haproxy_statusbind *:80default_backend web_statusfrontend monitor_mysql111bind 127.0.0.1:9301mode httpacl no_repl_mysql111 nbsrv(mysql111_replication) eq 0acl no_repl_mysql112 nbsrv(mysql112_replication) eq 0acl no_mysql111 nbsrv(mysql111_status) eq 0acl no_mysql112 nbsrv(mysql112_status) eq 0monitor-uri /dbsmonitor fail unless no_repl_mysql111 no_repl_mysql112 no_mysql112monitor fail if no_mysql111 no_mysql112frontend monitor_mysql112bind 127.0.0.1:9302mode httpacl no_repl_mysql111 nbsrv(mysql111_replication) eq 0acl no_repl_mysql112 nbsrv(mysql112_replication) eq 0acl no_mysql111 nbsrv(mysql111_status) eq 0acl no_mysql112 nbsrv(mysql112_status) eq 0monitor-uri /dbsmonitor fail unless no_repl_mysql111 no_repl_mysql112 no_mysql111monitor fail if no_mysql111 no_mysql112frontend monitor_mysql121bind 127.0.0.1:9303mode httpacl no_repl_mysql121 nbsrv(mysql121_replication) eq 0acl no_repl_mysql111 nbsrv(mysql111_replication) eq 0acl no_mysql112 nbsrv(mysql112_status) eq 1monitor-uri /dbsmonitor fail if no_repl_mysql121monitor fail if no_repl_mysql111  no_mysql112frontend monitor_mysql122bind 127.0.0.1:9304mode httpacl no_repl_mysql122 nbsrv(mysql122_replication) eq 0acl no_repl_mysql111 nbsrv(mysql111_replication) eq 0acl no_mysql112 nbsrv(mysql112_status) eq 1monitor-uri /dbsmonitor fail if no_repl_mysql122monitor fail if no_repl_mysql111 no_mysql112frontend monitor_mysql123bind 127.0.0.1:9305mode httpacl no_repl_mysql123 nbsrv(mysql123_replication) eq 0acl no_repl_mysql112 nbsrv(mysql112_replication) eq 0acl no_mysql111 nbsrv(mysql111_status) eq 1monitor-uri /dbsmonitor fail if no_repl_mysql123monitor fail if no_repl_mysql112 no_mysql111frontend monitor_mysql124bind 127.0.0.1:9306mode httpacl no_repl_mysql124 nbsrv(mysql124_replication) eq 0acl no_repl_mysql112 nbsrv(mysql112_replication) eq 0acl no_mysql111 nbsrv(mysql111_status) eq 1monitor-uri /dbsmonitor fail if no_repl_mysql124monitor fail if no_repl_mysql112 no_mysql111frontend monitor_splitbrainbind 127.0.0.1:9300mode httpacl no_repl01 nbsrv(mysql111_replication) eq 0acl no_repl02 nbsrv(mysql112_replication) eq 0acl mysql111 nbsrv(mysql111_status) eq 1acl mysql112 nbsrv(mysql112_status) eq 1monitor-uri /dbsmonitor fail unless no_repl01 no_repl02 mysql111 mysql112backend mysql111_replicationmode tcpbalance roundrobinoption tcpkaoption httpchkserver mysql111 192.168.254.111:3306 check port 9201 inter 1s rise 1 fall 1backend mysql112_replicationmode tcpbalance roundrobinoption tcpkaoption httpchkserver mysql112 192.168.254.112:3306 check port 9201 inter 1s rise 1 fall 1backend mysql121_replicationmode tcpbalance roundrobinoption tcpkaoption httpchkserver mysql121 192.168.254.121:3306 check port 9201 inter 1s rise 1 fall 1backend mysql122_replicationmode tcpbalance roundrobinoption tcpkaoption httpchkserver mysql122 192.168.254.122:3306 check port 9201 inter 1s rise 1 fall 1backend mysql123_replicationmode tcpbalance roundrobinoption tcpkaoption httpchkserver mysql123 192.168.254.123:3306 check port 9201 inter 1s rise 1 fall 1backend mysql124_replicationmode tcpbalance roundrobinoption tcpkaoption httpchkserver mysql124 192.168.254.124:3306 check port 9201 inter 1s rise 1 fall 1backend mysql111_statusmode tcpbalance roundrobinoption tcpkaoption httpchkserver mysql111 192.168.254.111:3306 check port 9200 inter 1s rise 2 fall 2backend mysql112_statusmode tcpbalance roundrobinoption tcpkaoption httpchkserver mysql112 192.168.254.112:3306 check port 9200 inter 1s rise 2 fall 2backend cluster_db_writemode tcpoption tcpkabalance roundrobinoption httpchk GET /dbsserver mysql111 192.168.254.111:3306 weight 1 check port 9201 inter 1s rise 5 fall 1server mysql112 192.168.254.112:3306 weight 1 check port 9201 inter 1s rise 5 fall 1 backupserver mysql111_backup 192.168.254.111:3306 weight 1 check port 9301 inter 1s rise 2 fall 2 addr 127.0.0.1 backupserver mysql112_backup 192.168.254.112:3306 weight 1 check port 9302 inter 1s rise 2 fall 2 addr 127.0.0.1 backupbackend cluster_db_readmode tcpoption tcpkabalance roundrobinoption httpchk GET /dbsserver mysql111 192.168.254.111:3306 weight 1 track cluster_db_write/mysql111server mysql112 192.168.254.112:3306 weight 1 track cluster_db_write/mysql112server mysql111_backup 192.168.254.111:3306 weight 1 track cluster_db_write/mysql111_backupserver mysql112_backup 192.168.254.112:3306 weight 1 track cluster_db_write/mysql112_backupserver mysql111_splitbrain 192.168.254.111:3306 weight 1 check port 9300 inter 1s rise 1 fall 2 addr 127.0.0.1server mysql112_splitbrain 192.168.254.112:3306 weight 1 check port 9300 inter 1s rise 1 fall 2 addr 127.0.0.1server mysql121_slave 192.168.254.121:3306 weight 1 check port 9303 inter 1s rise 5 fall 1 addr 127.0.0.1server mysql122_slave 192.168.254.122:3306 weight 1 check port 9304 inter 1s rise 5 fall 1 addr 127.0.0.1server mysql123_slave 192.168.254.123:3306 weight 1 check port 9305 inter 1s rise 5 fall 1 addr 127.0.0.1server mysql124_slave 192.168.254.124:3306 weight 1 check port 9306 inter 1s rise 5 fall 1 addr 127.0.0.1backend web_statusmode httpstats enable#stats scope#stats hide-versionstats refresh 5sstats uri /statusstats realm Haproxy/statisticsstats auth copy:copy

启动haproxy

/usr/local/sbin/haproxy –f /etc/haproxy.cfg

查看状态

访问haproxy监控页面

到这里配置完成

测试，按照以下步骤看是否可以达到要求

1.停止主机2,的同步

2.停止主机1,2的同步

3.停止主机1的同步

4.断开主机1网络或者关闭它

5.断开主机2网络或者关闭它

6.同时端口主机1,2网络或者关闭它们