Два сервера БД (MariaDB 10.4) в кластере работали нормально затем один сервер внезапно выпадает из кластера и не может присоединиться к узлу Попытки запустить результаты в журнале journalctl -xe ниже.
Также заметил, что я могу выключить каждую БД и запустить одну, но когда я пытаюсь добавить другую, появляется ошибка
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: backend: asio
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: restore pc from disk successfully
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: GMCast version 0
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: (2d57300d, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: (2d57300d, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: EVS version 1
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: gcomm: connecting to group 'galeracluster', peer '10.81.0.92:,10.81.0.93:'
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: (2d57300d, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://10.81.0.93:4567
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: (2d57300d, 'tcp://0.0.0.0:4567') connection established to 8e8ac3b0 tcp://10.81.0.92:4567
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: (2d57300d, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: EVS version upgrade 0 -> 1
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: declaring 8e8ac3b0 at tcp://10.81.0.92:4567 stable
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: PC protocol upgrade 0 -> 1
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Note] WSREP: view(view_id(NON_PRIM,2d57300d,4) memb {
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2d57300d,0
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 8e8ac3b0,0
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: } joined {
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: } left {
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: } partitioned {
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2d57300d,0
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: })
Apr 29 16:26:36 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:36 0 [Warning] WSREP: node uuid: 2d57300d last_prim(type: 3, uuid: 2d57300d) is inconsistent to restored view(type: V_NON_PRIM, uuid: 2d57300d
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 0 [Note] WSREP: gcomm: connected
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 0 [Note] WSREP: Opened channel 'galeracluster'
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 2
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 0 [Note] WSREP: Flow-control interval: [23, 23]
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 0 [Note] WSREP: Received NON-PRIMARY.
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: Starting applier thread 2
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 1 [Note] WSREP: Starting rollbacker thread 1
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: ####### processing CC -1, local, unordered
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: ####### My UUID: 2d57300d-8a36-11ea-ae19-7b317ce1545e
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: Server crmplatformsvr02 connected to cluster at position 1bab5d7f-1c5b-11ea-bcc1-0bff7bcce9e9:-1 with ID 2d57300d-8a36-11ea-ae19-7b317ce1545e
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: Server status change disconnected -> connected
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: ####### ST not required
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: ================================================
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: View:
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: id: 1bab5d7f-1c5b-11ea-bcc1-0bff7bcce9e9:-1
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: status: non-primary
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: protocol_version: -1
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: capabilities:
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: final: no
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: own_index: 0
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: members(2):
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 0: 2d57300d-8a36-11ea-ae19-7b317ce1545e, crmplatformsvr02
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 1: 8e8ac3b0-8a36-11ea-b06f-be7e4c020d7c, unspecified
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: =================================================
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: Non-primary view
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: Server status change connected -> connected
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
Apr 29 16:26:39 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:39 0 [Note] WSREP: (2d57300d, 'tcp://0.0.0.0:4567') turning message relay requesting off
Apr 29 16:26:41 crmplatformsvr02 sudo[1646]: crmplatformcare : TTY=pts/3 ; PWD=/var/lib/mysql ; USER=root ; COMMAND=/bin/journalctl -xe
Apr 29 16:26:41 crmplatformsvr02 sudo[1646]: pam_systemd(sudo:session): Cannot create session: Already running in a session or user slice
Apr 29 16:26:41 crmplatformsvr02 sudo[1646]: pam_unix(sudo:session): session opened for user root by crmplatformcare(uid=0)
[crmplatformcare@crmplatformsvr02 mysql]$
[crmplatformcare@crmplatformsvr02 mysql]$
[crmplatformcare@crmplatformsvr02 mysql]$
[crmplatformcare@crmplatformsvr02 mysql]$
[crmplatformcare@crmplatformsvr02 mysql]$ sudo systemctl status mariadb
â— mariadb.service - MariaDB 10.4.11 database server
Loaded: loaded (/usr/lib/systemd/system/mariadb.service; disabled; vendor preset: disabled)
Drop-In: /etc/systemd/system/mariadb.service.d
└─migrated-from-my.cnf-settings.conf
Active: deactivating (stop-sigterm) (Result: timeout)
Docs: man:mysqld(8)
https://mariadb.com/kb/en/library/systemd/
Process: 1550 ExecStartPre=/bin/sh -c [ ! -e /usr/bin/galera_recovery ] && VAR= || VAR=`/usr/bin/galera_recovery`; [ $? -eq 0 ] && systemctl set-environment _WSREP_START_POSITION=$VAR || exit 1 (code=exited, status=0/SUCCESS)
Process: 1548 ExecStartPre=/bin/sh -c systemctl unset-environment _WSREP_START_POSITION (code=exited, status=0/SUCCESS)
Main PID: 1638 (mysqld)
Tasks: 7 (limit: 26213)
Memory: 34.2M
CGroup: /system.slice/mariadb.service
└─1638 /usr/sbin/mysqld --wsrep_start_position=1bab5d7f-1c5b-11ea-bcc1-0bff7bcce9e9:5691091
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: own_index: 0
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: members(2):
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 0: 2d57300d-8a36-11ea-ae19-7b317ce1545e, crmplatformsvr02
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 1: 8e8ac3b0-8a36-11ea-b06f-be7e4c020d7c, unspecified
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: =================================================
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: Non-primary view
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: Server status change connected -> connected
Apr 29 16:26:37 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
Apr 29 16:26:39 crmplatformsvr02 mysqld[1638]: 2020-04-29 16:26:39 0 [Note] WSREP: (2d57300d, 'tcp://0.0.0.0:4567') turning message relay requesting off
Apr 29 16:28:06 crmplatformsvr02 systemd[1]: mariadb.service: Start operation timed out. Terminating.