MySQL/Galera是MySQL/InnoDB的多主集群,有以下特性:
- 同步复制
- Active-active的多主拓扑结构
- 集群任意节点可以读和写
- 自动身份控制,失败节点自动脱离集群
- 自动节点接入
- 真正的基于”行”级别和ID检查的并行复制
- 无单点故障,易扩展
# yum install gcc gcc-c++
- 确认安装有boost-devel的版本至少为1.4.1
# yum install boost-devel
- 安装scons check-devel openssl-devel
# yum install scons check-devel openssl-devel
# yum install libaio# wget https://launchpad.net/codership-mysql/5.5/5.5.29-23.7.3/+download/mysql-5.5.29_wsrep_23.7.3-linux-x86_64.tar.gz# tar zxvf mysql-5.5.29_wsrep_23.7.3-linux-x86_64.tar.gz # # mv mysql-5.5.29_wsrep_23.7.3-linux-x86_64 /usr/local/mysql# cd /usr/local/mysql/# groupadd mysql# useradd -r -g mysql mysql# chown -R mysql:mysql .# ./scripts/mysql_install_db --no-defaults --datadir=/usr/local/mysql/data --user=mysql# chown -R root .# chown -R mysql data
# wget https://launchpad.net/galera/2.x/23.2.4/+download/galera-23.2.4-src.tar.gz# tar zxvf galera-23.2.4-src.tar.gz# cd galera-23.2.4-src# scons# cp garb/garbd /usr/local/mysql/bin/# cp libgalera_smm.so /usr/local/mysql/lib/plugin/
# cp /usr/local/mysql/support-files/mysql.server /etc/init.d/mysql# mkdir -p /var/lib/mysql# chown mysql:mysql /var/lib/mysql# vi /etc/my.cnf# cat /etc/my.cnf
[client]port = 3306socket = /var/lib/mysql/mysql.sock[mysqld_safe]log-error = /var/lib/mysql/mysql.logpid-file = /var/lib/mysql/mysql.pid[mysqld]wsrep_node_name = node1wsrep_provider = /usr/local/mysql/lib/plugin/libgalera_smm.so#wsrep_provider_options ='gcache.size=1G;socket.ssl_key=my_key;socket.ssl_cert=my_cert'#wsrep_slave_threads=16wsrep_sst_method = rsync#wsrep_sst_auth=root:port = 3306socket = /var/lib/mysql/mysql.sockuser = mysqlbasedir = /usr/local/mysqldatadir = /usr/local/mysql/datadefault_storage_engine=InnoDB#innodb_buffer_pool_size=1G#innodb_log_file_size=256Minnodb_autoinc_lock_mode=2innodb_locks_unsafe_for_binlog=1innodb_flush_log_at_trx_commit=0innodb_doublewrite=0innodb_file_per_table=1binlog_format=ROWlog-bin=mysql-binserver-id=101relay-log=mysql-relay-bin#read_only=1log-slave-updates=1
注: 可参考MySQL wsrep参数
[root@G221 ~]# /usr/local/mysql/bin/mysqld_safe --wsrep_cluster_address=gcomm:// >/dev/null &
或
[root@G221 ~]# service mysql start --wsrep_cluster_address=gcomm://
查看mysqld监听的端口:
[root@G221 ~]# netstat -plantu | grep mysqldtcp 0 0 0.0.0.0:4567 0.0.0.0:* LISTEN 3656/mysqld tcp 0 0 0.0.0.0:3306 0.0.0.0:* LISTEN 3656/mysqld注:
1)”gcomm://”是特殊的地址,仅仅是galera cluster初始化启动时候使用,再次启动的时候需要使用具体的IP地址.
2) 端口4567是wsrep使用的默认端口.该端口的防火墙设置规则应该和3306的一样.
[root@G221 ~]# /usr/local/mysql/bin/mysqladmin -uroot -p shutdown
接入节点G222:
[root@G222 data]# /usr/local/mysql/bin/mysqld_safe --wsrep_cluster_address="gcomm://192.168.1.221:4567,192.168.1.223:4567" >/dev/null &
接入节点G223:
[root@G223 data]# service mysql start --wsrep_cluster_address="gcomm://192.168.1.221:4567,192.168.1.222:4567"
[root@G221 data]# service mysql restart --wsrep_cluster_address="gcomm://192.168.1.222:4567,192.168.1.223:4567"Shutting down MySQL.... SUCCESS! Starting MySQL....... SUCCESS!
2)直接修改MySQL全局变量
mysql> SHOW VARIABLES LIKE 'wsrep_cluster_address';+-----------------------+----------------------------+| Variable_name | Value |+-----------------------+----------------------------+| wsrep_cluster_address | gcomm://192.168.1.222:4567 |+-----------------------+----------------------------+1 row in set (0.00 sec)mysql> set global wsrep_cluster_address="gcomm://192.168.1.222:4567,192.168.1.223:4567";Query OK, 0 rows affected (2.20 sec)mysql> SHOW VARIABLES LIKE 'wsrep_cluster_address';+-----------------------+-------------------------------------------------------+| Variable_name | Value |+-----------------------+-------------------------------------------------------+| wsrep_cluster_address | gcomm://192.168.1.222:4567,192.168.1.223:4567 |+-----------------------+-------------------------------------------------------+1 row in set (0.00 sec)查看MySQL版本:
mysql> SHOW GLOBAL VARIABLES LIKE 'version';+---------------+------------+| Variable_name | Value |+---------------+------------+| version | 5.5.29-log |+---------------+------------+1 row in set (0.00 sec)
查看wsrep版本:
mysql> SHOW GLOBAL STATUS LIKE 'wsrep_provider_version';+------------------------+------------+| Variable_name | Value |+------------------------+------------+| wsrep_provider_version | 2.4(rXXXX) |+------------------------+------------+1 row in set (0.00 sec)
查看wsrep有关的所有变量:
mysql> SHOW VARIABLES LIKE 'wsrep%' \G*************************** 1. row ***************************Variable_name: wsrep_OSU_method Value: TOI*************************** 2. row ***************************Variable_name: wsrep_auto_increment_control Value: ON*************************** 3. row ***************************Variable_name: wsrep_causal_reads Value: OFF*************************** 4. row ***************************Variable_name: wsrep_certify_nonPK Value: ON*************************** 5. row ***************************Variable_name: wsrep_cluster_address Value: gcomm://192.168.1.222:4567,192.168.1.223:4567*************************** 6. row ***************************Variable_name: wsrep_cluster_name Value: my_wsrep_cluster*************************** 7. row ***************************Variable_name: wsrep_convert_LOCK_to_trx Value: OFF*************************** 8. row ***************************Variable_name: wsrep_data_home_dir Value: /usr/local/mysql/data/*************************** 9. row ***************************Variable_name: wsrep_dbug_option Value: *************************** 10. row ***************************Variable_name: wsrep_debug Value: OFF*************************** 11. row ***************************Variable_name: wsrep_drupal_282555_workaround Value: OFF*************************** 12. row ***************************Variable_name: wsrep_forced_binlog_format Value: NONE*************************** 13. row ***************************Variable_name: wsrep_log_conflicts Value: OFF*************************** 14. row ***************************Variable_name: wsrep_max_ws_rows Value: 131072*************************** 15. row ***************************Variable_name: wsrep_max_ws_size Value: 1073741824*************************** 16. row ***************************Variable_name: wsrep_mysql_replication_bundle Value: 0*************************** 17. row ***************************Variable_name: wsrep_node_address Value: *************************** 18. row ***************************Variable_name: wsrep_node_incoming_address Value: AUTO*************************** 19. row ***************************Variable_name: wsrep_node_name Value: node1*************************** 20. row ***************************Variable_name: wsrep_notify_cmd Value: *************************** 21. row ***************************Variable_name: wsrep_on Value: ON*************************** 22. row ***************************Variable_name: wsrep_provider Value: /usr/local/mysql/lib/plugin/libgalera_smm.so*************************** 23. row ***************************Variable_name: wsrep_provider_options Value: base_host = 192.168.1.221; base_port = 4567; cert.log_conflicts = no; evs.causal_keepalive_period = PT1S; evs.debug_log_mask = 0x1; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.info_log_mask = 0; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.keepalive_period = PT1S; evs.max_install_timeouts = 1; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.use_aggregate = true; evs.user_send_window = 2; evs.version = 0; evs.view_forget_timeout = PT5M; gcache.dir = /usr/local/mysql/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /usr/local/mysql/data//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; gmcast.listen_addr = tcp://0.0.0.0:4567; gmcast.mcast_addr = ; gmcast.mcast_ttl = 1; gmcast.peer_timeout = PT3S; gmcast.time_wait = PT5S; gmcast.version = 0; ist.recv_addr = 192.168.1.221; pc.checksum = true; pc.ignore_quorum = false; pc.ignore_sb = false; pc.linger = PT20S; pc.npvo = false; pc.version = 0; pc.weight = 1; protonet.backend = asio; protonet.version = 0; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3*************************** 24. row ***************************Variable_name: wsrep_recover Value: OFF*************************** 25. row ***************************Variable_name: wsrep_replicate_myisam Value: OFF*************************** 26. row ***************************Variable_name: wsrep_retry_autocommit Value: 1*************************** 27. row ***************************Variable_name: wsrep_slave_threads Value: 2*************************** 28. row ***************************Variable_name: wsrep_sst_auth Value: *************************** 29. row ***************************Variable_name: wsrep_sst_donor Value: *************************** 30. row ***************************Variable_name: wsrep_sst_donor_rejects_queries Value: OFF*************************** 31. row ***************************Variable_name: wsrep_sst_method Value: rsync*************************** 32. row ***************************Variable_name: wsrep_sst_receive_address Value: AUTO*************************** 33. row ***************************Variable_name: wsrep_start_position Value: 80cdd13d-8cf2-11e2-0800-e0817023b754:033 rows in set (0.00 sec)
查看Galera集群状态:
mysql> show status like 'wsrep%';+----------------------------+----------------------------------------------------------+| Variable_name | Value |+----------------------------+----------------------------------------------------------+| wsrep_local_state_uuid | 80cdd13d-8cf2-11e2-0800-e0817023b754 || wsrep_protocol_version | 4 || wsrep_last_committed | 3 || wsrep_replicated | 3 || wsrep_replicated_bytes | 522 || wsrep_received | 6 || wsrep_received_bytes | 1134 || wsrep_local_commits | 1 || wsrep_local_cert_failures | 0 || wsrep_local_bf_aborts | 0 || wsrep_local_replays | 0 || wsrep_local_send_queue | 0 || wsrep_local_send_queue_avg | 0.000000 || wsrep_local_recv_queue | 0 || wsrep_local_recv_queue_avg | 0.000000 || wsrep_flow_control_paused | 0.000000 || wsrep_flow_control_sent | 0 || wsrep_flow_control_recv | 0 || wsrep_cert_deps_distance | 1.000000 || wsrep_apply_oooe | 0.000000 || wsrep_apply_oool | 0.000000 || wsrep_apply_window | 1.000000 || wsrep_commit_oooe | 0.000000 || wsrep_commit_oool | 0.000000 || wsrep_commit_window | 1.000000 || wsrep_local_state | 4 || wsrep_local_state_comment | Synced || wsrep_cert_index_size | 5 || wsrep_causal_reads | 0 || wsrep_incoming_addresses | 192.168.1.221:3306,192.168.1.222:3306,192.168.1.223:3306 || wsrep_cluster_conf_id | 13 || wsrep_cluster_size | 3 || wsrep_cluster_state_uuid | 80cdd13d-8cf2-11e2-0800-e0817023b754 || wsrep_cluster_status | Primary || wsrep_connected | ON || wsrep_local_index | 0 || wsrep_provider_name | Galera || wsrep_provider_vendor | Codership Oy <info@codership.com> || wsrep_provider_version | 2.4(rXXXX) || wsrep_ready | ON |+----------------------------+----------------------------------------------------------+40 rows in set (0.00 sec)
最慢的节点的wsrep_flow_control_sent和wsrep_local_recv_queue_avg这两个值最高.这两个值较低的话,相对更好.
garbd可以做为一个无数据的Galera节点运行,该节点可以用一种优化的方式帮助检测和处理网络分裂(network splits).
一个好的garbd节点可以防止”split-brain”状况发生.
Galera支持SSL通讯,这对增加数据安全性很重要(特别是云部署).可以通过参数socket.ssl_cert和socket.ssl_key来定义.
SST允许新接入的节点使用定制的方法来获取最初的数据.SST方式有mysqldump(默认,比较慢),rsync,和xtrabackup(很快).
可通过wsrep_sst_method来定义.Production环境中建议使用rsync或是xtrabackup方式.
联系客服
