We have an issue with database server. Some one day all ~100 websites suddenly doesn't work (can't be reached or 504 gateway time out etc). But at same time Plesk works fine, we can log into it. We are able to ping Plesk server. So I tried to restart database server (service mysql restart || service mariadb restart || service mysqld restart) then all websites goes back to up and works nicely. So issue is database server.
We have tried Plesk self-repair tool (Plesk Database and MySQL), it didn't detect any issues.
I checked /etc/my.cnf and added "innodb_buffer_pool_size=8G" (default is 128MB, I though it would help fix this issue) as our dedicated server has 64GB RAM.
I checked /var/log/mariadb/mariadb.log and found something strange ("InnoDB: ERROR: the age of the last checkpoint is 9438524,"...)
Any suggestions?
We have tried Plesk self-repair tool (Plesk Database and MySQL), it didn't detect any issues.
I checked /etc/my.cnf and added "innodb_buffer_pool_size=8G" (default is 128MB, I though it would help fix this issue) as our dedicated server has 64GB RAM.
Code:
[mysqld]
#bind-address = ::ffff:127.0.0.1
bind-address = ::
local-infile=0
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0
# Settings user and group are ignored when systemd is used.
# If you need to run mysqld under a different user or group,
# customize your systemd unit file for mariadb according to the
# instructions in http://fedoraproject.org/wiki/Systemd
wait_timeout = 31536000
max_allowed_packet=16M
innodb_buffer_pool_size=8G
[mysqldump]
max_allowed_packet=16M
[mysqld_safe]
log-error=/var/log/mariadb/mariadb.log
pid-file=/var/run/mariadb/mariadb.pid
#
# include all files from the config directory
#
!includedir /etc/my.cnf.d
I checked /var/log/mariadb/mariadb.log and found something strange ("InnoDB: ERROR: the age of the last checkpoint is 9438524,"...)
Code:
InnoDB: largest such row.
210728 11:55:39 InnoDB: ERROR: the age of the last checkpoint is 9438524,
InnoDB: which exceeds the log group capacity 9433498.
InnoDB: If you are using big BLOB or TEXT rows, you must set the
InnoDB: combined size of log files at least 10 times bigger than the
InnoDB: largest such row.
210728 11:56:04 InnoDB: ERROR: the age of the last checkpoint is 9433886,
InnoDB: which exceeds the log group capacity 9433498.
InnoDB: If you are using big BLOB or TEXT rows, you must set the
InnoDB: combined size of log files at least 10 times bigger than the
InnoDB: largest such row.
210728 11:56:51 InnoDB: ERROR: the age of the last checkpoint is 9442756,
InnoDB: which exceeds the log group capacity 9433498.
InnoDB: If you are using big BLOB or TEXT rows, you must set the
InnoDB: combined size of log files at least 10 times bigger than the
InnoDB: largest such row.
210728 11:57:21 InnoDB: ERROR: the age of the last checkpoint is 9449805,
InnoDB: which exceeds the log group capacity 9433498.
InnoDB: If you are using big BLOB or TEXT rows, you must set the
InnoDB: combined size of log files at least 10 times bigger than the
InnoDB: largest such row.
210728 11:57:39 InnoDB: ERROR: the age of the last checkpoint is 9438356,
InnoDB: which exceeds the log group capacity 9433498.
InnoDB: If you are using big BLOB or TEXT rows, you must set the
InnoDB: combined size of log files at least 10 times bigger than the
InnoDB: largest such row.
210728 11:57:58 InnoDB: ERROR: the age of the last checkpoint is 9436155,
InnoDB: which exceeds the log group capacity 9433498.
InnoDB: If you are using big BLOB or TEXT rows, you must set the
InnoDB: combined size of log files at least 10 times bigger than the
InnoDB: largest such row.
210728 11:58:19 InnoDB: ERROR: the age of the last checkpoint is 9446266,
InnoDB: which exceeds the log group capacity 9433498.
InnoDB: If you are using big BLOB or TEXT rows, you must set the
InnoDB: combined size of log files at least 10 times bigger than the
InnoDB: largest such row.
210728 12:16:11 [Note] /usr/libexec/mysqld: Normal shutdown
210728 12:16:11 [Note] Event Scheduler: Purging the queue. 0 events
210728 12:16:11 InnoDB: Starting shutdown...
210728 12:16:12 InnoDB: Waiting for 201 pages to be flushed
210728 12:16:17 InnoDB: Shutdown completed; log sequence number 56775266295252
210728 12:16:17 [Note] /usr/libexec/mysqld: Shutdown complete
210728 12:16:17 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
210728 12:16:18 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
210728 12:16:18 [Note] /usr/libexec/mysqld (mysqld 5.5.68-MariaDB) starting as process 23760 ...
210728 12:16:18 InnoDB: The InnoDB memory heap is disabled
210728 12:16:18 InnoDB: Mutexes and rw_locks use GCC atomic builtins
210728 12:16:18 InnoDB: Compressed tables use zlib 1.2.7
210728 12:16:18 InnoDB: Using Linux native AIO
210728 12:16:18 InnoDB: Initializing buffer pool, size = 8.0G
210728 12:16:18 InnoDB: Completed initialization of buffer pool
210728 12:16:18 InnoDB: highest supported file format is Barracuda.
210728 12:16:19 InnoDB: Waiting for the background threads to start
210728 12:16:20 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 56775266295252
210728 12:16:20 [Note] Plugin 'FEEDBACK' is disabled.
210728 12:16:20 [Note] Server socket created on IP: '::'.
210728 12:16:20 [Note] Event Scheduler: Loaded 0 events
210728 12:16:20 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.68-MariaDB' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server
Any suggestions?
CPU | Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz (8 core(s)) |
Version | Plesk Obsidian v18.0.36_build1800210604.22 os_CentOS 7 |
OS | CentOS Linux 7.9.2009 (Core) |