Sorry my english is not fluent. I am a newbie in MySQL database. I use MySQL 8.0.30 on Windows Server 2022 Datacenter. I have problem that MySQL crashes frequently (the MySQL service stops) always with same error log. I've tried to find the source of the problem but it's not resolved.
For the information I used Grafana Web Server and MySQL on same device with the following specs:
Processor Intel(R) Xeon(R) Silver 4208 CPU # 2.10GHz 2.10 GHz
Installed RAM 16.0 GB (15.6 GB usable)
System type 64-bit operating system, x64-based processor
Please give me an advice to resolve this trouble.
Thanks before
Here is the error MySQL log details :
10:01:25 UTC - mysqld got exception 0xc0000005 ;
Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware.
Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
7ffa8ac5b496 jemalloc.dll!???
7ffa8ac5b918 jemalloc.dll!???
7ffa8ac5ef91 jemalloc.dll!je_realloc()
7ffa82547ddd libcrypto-1_1-x64.dll!CRYPTO_memcmp()
7ffa8258bcea libcrypto-1_1-x64.dll!CRYPTO_memcmp()
7ffa8258e7e3 libcrypto-1_1-x64.dll!CRYPTO_memcmp()
7ffa8255956d libcrypto-1_1-x64.dll!CRYPTO_memcmp()
7ffa8246263c libcrypto-1_1-x64.dll!CRYPTO_memcmp()
7ffa826092ff libcrypto-1_1-x64.dll!CRYPTO_memcmp()
7ffab7d47167 ntdll.dll!RtlActivateActivationContextUnsafeFast()
7ffab7d4848a ntdll.dll!LdrShutdownThread()
7ffab7d28bae ntdll.dll!RtlExitUserThread()
7ffab5851b8a KERNELBASE.dll!FreeLibraryAndExitThread()
7ffab55c6c5d ucrtbase.dll!_recalloc()
7ffab55f3c19 ucrtbase.dll!_endthreadex()
7ff682fc4605 mysqld.exe!?modify_thread_cache_size#Per_thread_connection_handler##SAXK#Z()
7ff6844987a9 mysqld.exe!?deallocate#?$allocator#V?$sub_match#V?$_String_const_iterator#V?$_String_val#U?$_Simple_types#D#std###std###std###std###std##QEAAXQEAV?$sub_match#V?$_String_const_iterator#V?$_String_val#U?$_Simple_types#D#std###std###std###2#_K#Z() [truncated, 260 bytes total]
7ff68405139c mysqld.exe!?my_thread_self_setname##YAXPEBD#Z()
7ffab55c6b4c ucrtbase.dll!_recalloc()
7ffab7274ed0 KERNEL32.DLL!BaseThreadInitThunk()
7ffab7d9e44b ntdll.dll!RtlUserThreadStart()
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.
I have tried reducing the data read and written, then increasing the client connection limit
Rate Per Second = RPS
Suggestions to consider for your my.ini [mysqld] section to possibly avoid unplanned shutdowns.
innodb_thread_concurrency=10 # from 33 for reasonable limit for your 16 available total threads
innodb_redo_log_capacity=96M # from innodb_log_file_size name and 48M limit
**** this is current name rather then deprecated innodb_log_file_size per error log
innodb_buffer_pool_size=8G # from 124M for about 1/2 available RAM to reduce innodb_data_reads RPS of 31.
read_rnd_buffer_size=32K from 256K to reduce handler_read_rnd_next RPS of 63,041
thread_cache_size=128 # from 10 to reduce threads_created RPS of ~ 5
Please view profile for contact info. You have many opportunities to improve performance with additional Global Variable changes.
Would like to hear your story of how you get this much activity in 96 seconds of uptime. :)
Related
I am trying to set-up configuration file on Ubuntu 20.04. I have tried several thing and searched for errors on other websites (link1, link2, link3) and slurm-website as well. Another similar question on SO as well.
Given the following information about my computer, what is the minimum required information must be provided in slurm.conf file.
The general information for my computer;
RAM: 125.5 GB
CPU: 1-20 (Intel® Xeon(R) CPU E5-2687W v3 # 3.10GHz × 20 )
Graphics: NVIDIA Corporation GP104 [GeForce GTX 1080] / NVIDIA Corporation
OS: Ubuntu 20.04.2 LTS 64 bit
and I want to have 2 nodes with 10 CPUs for each and 1 node for GPU.
I have tried the followings;
After configuration and running the followings;
>sudo systemctl restart slurmctld
with no error. But I got error witj slurmd.
> sudo systemctl restart slurmd
Error is as below;
Job for slurmd.service failed because the control process exited with error code.
See "systemctl status slurmd.service" and "journalctl -xe" for details.
if I run "systemctl status slurmd.service"
● slurmd.service - Slurm node daemon
Loaded: loaded (/lib/systemd/system/slurmd.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Sun 2021-06-06 21:47:26 CEST; 1min 14s ago
Docs: man:slurmd(8)
Process: 52710 ExecStart=/usr/sbin/slurmd $SLURMD_OPTIONS (code=exited, status=1/FAILURE)
Here is my configuration file slurm.conf generated by configurator_easy.html and saved in /etc/slurm-llnl/slurm.conf
# slurm.conf file generated by configurator easy.html.
# Put this file on all nodes of your cluster.
# See the slurm.conf man page for more information.
#
SlurmctldHost=myhostname
#
AuthType=auth/menge
Epilog=/usr/local/slurm/epilog
Prolog=/usr/local/slurm/prolog
FirstJobId=0
InactiveLimit=120
JobCompType=jobcomp/filetxt
JobCompLoc=/var/log/slurm/jobcomp
KillWait=30
MinJobAge=300
MaxJobCount=10000
#PluginDir=/usr/local/lib
ReturnToService=0
SlurmdPort=6818
SlurmctldPort=6817
SlurmdSpoolDir=/var/spool/slurmd.spool
StateSaveLocation=/var/spool/slurm-llnl/slurm.state
SwitchType=switch/none
TmpFS=/tmp
WaitTime=30
SlurmctldPidFile=/run/slurmctld.pid
SlurmdPidFile=/run/slurmd.pid
SlurmUser=slurm
SlurmdUser=root
TaskPlugin=task/affinity
#
# TIMERS
SlurmctldTimeout=120
SlurmdTimeout=300
#
# SCHEDULING
SchedulerType=sched/backfill
SelectType=select/cons_res
SelectTypeParameters=CR_Core
#
# LOGGING AND ACCOUNTING
#AccountingStorageType=accounting_storage/none
ClusterName=cluster
#JobAcctGatherFrequency=30
#JobAcctGatherType=jobacct_gather/linux
#SlurmctldDebug=info
SlurmctldLogFile=/var/log/slurm-llnl/SlurmctldLogFile
#SlurmdDebug=info
#SlurmdLogFile=
#
# COMPUTE NODES
NodeName=Linux[1-32] State=UP
NodeName=DEFAULT State=UNKNOWN
PartitionName=Linux[1-32] Default=YES
I have Ubuntu 20.04 running on wsl and I was also struggling with setting up slurm as well. It looks like everything is running fine now. I am still a beginner..
I recommend you to really check the logs:
cat /var/log/slurmctld.log
cat /var/log/slurmd.log
In my case I had some permission issues and therefore had to make sure slurm related directories had to be owned by SlurmUser as defined in your config.
At first glance I see in your config the following lines which could cause the problem (if I compare the settings with mine):
I wonder that you defined NodeName twice.
In my case it has at first the value of SlurmctldHost
Hope something of the above mentioned can help.
Regards
Edit: I also would refer to the following Post, which could be similar to yours, if you run your command with sudo.
I have a cloud in the digital ocean where it has 1 GB of ram.
I need to install a docker, laravel, mysql, nginx environment, I found the laradock and installed it normally but when running the composer in the container I am returning a memory limit error.
Error running: composer install
root#b9864446a1e1:/var/www/site# composer install
Loading composer repositories with package information
Updating dependencies (including require-dev)
mmap() failed: [12] Cannot allocate memory
mmap() failed: [12] Cannot allocate memory
PHP Fatal error: Out of memory (allocated 677388288) (tried to allocate 4096 bytes) in phar:///usr/local/bin/composer/src/Composer/DependencyResolver/RuleWatchGraph.php on line 52
Fatal error: Out of memory (allocated 677388288) (tried to allocate 4096 bytes) in phar:///usr/local/bin/composer/src/Composer/DependencyResolver/RuleWatchGraph.php on line 52
Error when trying to change memory.
WARNING: Your kernel does not support swap limit capabilities or the
cgroup is not mounted. Memory limited without swap.
This could be happening because the VPS runs out of memory and has no Swap space enabled.
free -m
total used free shared buffers cached
Mem: xxxx xxx xxxx x x xxx
-/+ buffers/cache: xxx xxxx
Swap: 0 0 0
To enable the swap you can use for example:
/bin/dd if=/dev/zero of=/var/swap.1 bs=1M count=1024
/sbin/mkswap /var/swap.1
/sbin/swapon /var/swap.1
You can make a permanent swap file following this tutorial from DigitalOcean.
I'm using (the free trial of) Openshift online and this tier apparently offers 2G of memory for the pods.
I'm trying to install a node project and the npm install phase tries to build some native modules and terminates with an oom error, while trying a gcc compile.
On looking the console we can see that the sti-build container has a limit of 512M
Containers
sti-build
Image: openshift3/ose-docker-builder
Command: openshift-sti-build --loglevel=0
Mount: buildworkdir → /tmp/build read-write
Mount: docker-socket → /var/run/docker.sock read-write
Mount: crio-socket → /var/run/crio/crio.sock read-write
Mount: builder-dockercfg-kpj4q-push → /var/run/secrets/openshift.io/push read-only
Mount: builder-dockercfg-kpj4q-pull → /var/run/secrets/openshift.io/pull read-only
Mount: builder-token-pl672 → /var/run/secrets/kubernetes.io/serviceaccount read-only
CPU: 30 millicores to 1 core
Memory: 409 MiB to 512 MiB
This seems to come from a limit ranger that the platform has injected - as the documentation says that builds should be unlimited.
Any way of overriding?
2019-03-19 01:43:26 22929 [Warning] Buffered warning: Could not increase number of max_open_files to more than 79992 (request: 4294967295)
2019-03-19 01:43:26 22929 [Warning] Buffered warning: Changed limits: table_open_cache: 39915 (requested 524288)
This is my problem in mysql when starting service this is from log. I did not yet google solution because FREEBSD OS
It seems like you have hit this FreeBSD bug, which was reported for package mysql57-server-5.7.12.
A workaround is to change the permissions of file /usr/local/etc/mysql/my.cnf to something like 646 (the key point is that others need write permissions).
You can also see this this FreeBSD forum thread for more information..
When I select with 2 conditions, mysql is always crashed.For me the problem is very strange:
It's just for this table
It's only happened on my notebook. We have test server (linux) with the same version mysql and the same sql is ok
It's not happened with either condition only
I tried drop and recreate the table, dump data and problem is still
I tried reinstall the same version mysql and in my notebook it happened again
Someone said mysql 5.6 is Ok, I haven't try
Mysql version is 5.7.17.OS: win7 64. I want to use 5.7. Can anybody give some advice.
PS: Is is possible that the problem is relevant with my.cnf?
Error log:
01:15:19 UTC - mysqld got exception 0xc000001d ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
Attempting to collect some information that could help diagnose the problem.
As this is a crash and something is definitely wrong, the information
collection process might fail.
key_buffer_size=8388608
read_buffer_size=131072
max_used_connections=1
max_threads=151
thread_count=1
connection_count=1
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 68005 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0xe5fe040
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
13ff93c21 mysqld.exe!pow()[pow.asm:1616]
13f4d3b4b mysqld.exe!get_sweep_read_cost()[handler.cc:7055]
13fa90117 mysqld.exe!ror_intersect_add()[opt_range.cc:5430]
13fa861e9 mysqld.exe!get_best_ror_intersect()[opt_range.cc:5611]
13fa923b5 mysqld.exe!test_quick_select()[opt_range.cc:3078]
13f68bdde mysqld.exe!get_quick_record_count()[sql_optimizer.cc:5890]
13f68a8cd mysqld.exe!JOIN::estimate_rowcount()[sql_optimizer.cc:5636]
13f68d479 mysqld.exe!JOIN::make_join_plan()[sql_optimizer.cc:4993]
13f68ef3f mysqld.exe!JOIN::optimize()[sql_optimizer.cc:363]
13f66a659 mysqld.exe!st_select_lex::optimize()[sql_select.cc:1009]
13f66852d mysqld.exe!handle_query()[sql_select.cc:164]
13f5227f6 mysqld.exe!execute_sqlcom_select()[sql_parse.cc:4947]
13f5246de mysqld.exe!mysql_execute_command()[sql_parse.cc:2597]
13f527faa mysqld.exe!mysql_parse()[sql_parse.cc:5363]
13f5212c9 mysqld.exe!dispatch_command()[sql_parse.cc:1287]
13f52226a mysqld.exe!do_command()[sql_parse.cc:854]
13f4c9634 mysqld.exe!handle_connection()[connection_handler_per_thread.cc:295]
13fedad82 mysqld.exe!pfs_spawn_thread()[pfs.cc:2195]
13fc046fb mysqld.exe!win_thread_start()[my_thread.c:38]
13ff9b39f mysqld.exe!_callthreadstartex()[threadex.c:376]
13ff9b5ea mysqld.exe!_threadstartex()[threadex.c:354]
773af56d kernel32.dll!BaseThreadInitThunk()
77723281 ntdll.dll!RtlUserThreadStart()
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (e61cf50): select * from sys_dauth_filter_item
where ENTITY_ID_ = 1
and FIELD_ID_ = 1
Connection ID (thread ID): 2
Status: NOT_KILLED
You should try to update the Windows.
In my case, MySql 5.7.17, Windows 2008 R2 server, update Win to sp1 => solve that problem.
Reference: http://bugs.mysql.com/bug.php?id=81197
My error log:
Thread pointer: 0x5705b3850
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
140692571 mysqld.exe!pow()[pow.asm:1616]
13fc439a8 mysqld.exe!Item_func_pow::val_real()[item_func.cc:2924]
13fc03188 mysqld.exe!Item::send()[item.cc:7566]
13fc167a2 mysqld.exe!THD::send_result_set_row()[sql_class.cc:4661]
13fc15a1c mysqld.exe!Query_result_send::send_data()[sql_class.cc:2716]
140158d8f mysqld.exe!JOIN::exec()[sql_executor.cc:158]
13fd6d1e1 mysqld.exe!handle_query()[sql_select.cc:185]
13fbe4107 mysqld.exe!execute_sqlcom_select()[sql_parse.cc:5195]
13fbe6036 mysqld.exe!mysql_execute_command()[sql_parse.cc:2794]
13fbe9a83 mysqld.exe!mysql_parse()[sql_parse.cc:5617]
13fbe2b83 mysqld.exe!dispatch_command()[sql_parse.cc:1464]
13fbe3b7a mysqld.exe!do_command()[sql_parse.cc:1001]
13fbb981c mysqld.exe!handle_connection()[connection_handler_per_thread.cc:300]
1405d7392 mysqld.exe!pfs_spawn_thread()[pfs.cc:2191]
1402efc4b mysqld.exe!win_thread_start()[my_thread.c:38]
140699a3f mysqld.exe!_callthreadstartex()[threadex.c:376]
140699c8a mysqld.exe!_threadstartex()[threadex.c:354]
770cf34d kernel32.dll!BaseThreadInitThunk()
77302ca1 ntdll.dll!RtlUserThreadStart()
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (57133e640): SELECT POWER(1024,1)
Connection ID (thread ID): 5
Status: NOT_KILLED
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.