I have deployed Orion Context Broker v0.20 on OpenStack - CentOS 6.5 with 4GB RAM | 2 VCPU | 5.0GB Disk.
It works as expected until the multi-threaded HTTP request (for 100 users) test with Apache JMeter 2.13.
The service shuts down with;
Out of memory: Kill process 5640 (contextBroker) score 946 or
sacrifice child Killed process 5640, UID 501, (contextBroker)
total-vm:15377736kB, anon-rss:3822
The problem seems to be the libmicrohttpd.
libmicrohttpd invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
libmicrohttpd cpuset=/ mems_allowed=0
Pid: 2551, comm: libmicrohttpd Not tainted 2.6.32-431.el6.x86_64 #1
Call Trace:
[<ffffffff810d05b1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
[<ffffffff81122960>] ? dump_header+0x90/0x1b0
[<ffffffff8122798c>] ? security_real_capable_noaudit+0x3c/0x70
[<ffffffff81122de2>] ? oom_kill_process+0x82/0x2a0
[<ffffffff81122d21>] ? select_bad_process+0xe1/0x120
[<ffffffff81123220>] ? out_of_memory+0x220/0x3c0
[<ffffffff8112fb3c>] ? __alloc_pages_nodemask+0x8ac/0x8d0
[<ffffffff81167b9a>] ? alloc_pages_vma+0x9a/0x150
[<ffffffff81149c3c>] ? do_wp_page+0x52c/0x920
[<ffffffff8100bc2e>] ? invalidate_interrupt1+0xe/0x20
[<ffffffff8100bc2e>] ? invalidate_interrupt1+0xe/0x20
[<ffffffff8114a82d>] ? handle_pte_fault+0x2cd/0xb00
[<ffffffff8104eeb7>] ? pte_alloc_one+0x37/0x50
[<ffffffff8100bc2e>] ? invalidate_interrupt1+0xe/0x20
[<ffffffff8114b28a>] ? handle_mm_fault+0x22a/0x300
[<ffffffff8104a8d8>] ? __do_page_fault+0x138/0x480
[<ffffffff8105dbef>] ? finish_task_switch+0x4f/0xf0
[<ffffffff81527910>] ? thread_return+0x4e/0x76e
[<ffffffff8152d45e>] ? do_page_fault+0x3e/0xa0
[<ffffffff8152a815>] ? page_fault+0x25/0x30
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 30
CPU 1: hi: 186, btch: 31 usd: 30
Node 0 Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 48
CPU 1: hi: 186, btch: 31 usd: 51
active_anon:771153 inactive_anon:199950 isolated_anon:352
active_file:17 inactive_file:48 isolated_file:38
unevictable:0 dirty:0 writeback:612 unstable:0
free:21204 slab_reclaimable:2119 slab_unreclaimable:5685
mapped:90 shmem:41 pagetables:3131 bounce:0
Node 0 DMA free:15740kB min:248kB low:308kB high:372kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15352kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 3512 4017 4017
Node 0 DMA32 free:60708kB min:58868kB low:73584kB high:88300kB active_anon:2857740kB inactive_anon:593508kB active_file:72kB inactive_file:48kB unevictable:0kB isolated(anon):640kB isolated(file):0kB present:3596504kB mlocked:0kB dirty:0kB writeback:2444kB mapped:88kB shmem:0kB slab_reclaimable:44kB slab_unreclaimable:400kB kernel_stack:328kB pagetables:868kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1248 all_unreclaimable? no
lowmem_reserve[]: 0 0 505 505
Node 0 Normal free:8368kB min:8464kB low:10580kB high:12696kB active_anon:231444kB inactive_anon:201556kB active_file:0kB inactive_file:144kB unevictable:0kB isolated(anon):896kB isolated(file):24kB present:517120kB mlocked:0kB dirty:0kB writeback:4kB mapped:272kB shmem:164kB slab_reclaimable:8432kB slab_unreclaimable:22340kB kernel_stack:1616kB pagetables:11656kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:312 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 3*4kB 2*8kB 2*16kB 2*32kB 2*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15740kB
Node 0 DMA32: 3*4kB 7*8kB 4*16kB 7*32kB 3*64kB 0*128kB 29*256kB 51*512kB 26*1024kB 0*2048kB 0*4096kB = 60708kB
Node 0 Normal: 346*4kB 188*8kB 101*16kB 47*32kB 15*64kB 5*128kB 2*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 8120kB
1824 total pagecache pages
1705 pages in swap cache
Swap cache stats: add 68397, delete 66692, find 1718/1909
Free swap = 0kB
Total swap = 262136kB
1048575 pages RAM
34863 pages reserved
1067 pages shared
988252 pages non-shared
Has anyone faced this issue or have suggestion to workaround it?
The JMeter Test Plan;
<?xml version="1.0" encoding="UTF-8"?>
<jmeterTestPlan version="1.2" properties="2.8" jmeter="2.13 r1665067">
<hashTree>
<HTTPSamplerProxy guiclass="HttpTestSampleGui" testclass="HTTPSamplerProxy" testname="HTTP Request" enabled="true">
<elementProp name="HTTPsampler.Arguments" elementType="Arguments" guiclass="HTTPArgumentsPanel" testclass="Arguments" testname="User Defined Variables" enabled="true">
<collectionProp name="Arguments.arguments"/>
</elementProp>
<stringProp name="HTTPSampler.domain">ORION_IP_ADDRESS</stringProp>
<stringProp name="HTTPSampler.port">1026</stringProp>
<stringProp name="HTTPSampler.connect_timeout"></stringProp>
<stringProp name="HTTPSampler.response_timeout"></stringProp>
<stringProp name="HTTPSampler.protocol"></stringProp>
<stringProp name="HTTPSampler.contentEncoding"></stringProp>
<stringProp name="HTTPSampler.path">/v1/contextTypes</stringProp>
<stringProp name="HTTPSampler.method">GET</stringProp>
<boolProp name="HTTPSampler.follow_redirects">true</boolProp>
<boolProp name="HTTPSampler.auto_redirects">false</boolProp>
<boolProp name="HTTPSampler.use_keepalive">true</boolProp>
<boolProp name="HTTPSampler.DO_MULTIPART_POST">false</boolProp>
<boolProp name="HTTPSampler.monitor">false</boolProp>
<stringProp name="HTTPSampler.embedded_url_re"></stringProp>
</HTTPSamplerProxy>
<hashTree/>
</hashTree>
</jmeterTestPlan>
Related
I've installed mysql(The version is:mysql-5.7.39-1.el7.x86_64.rpm-bundle.tar) in Linux redhat, while after the installation, I can't start mysqld.service successfully.The Terminal indicates that:
[jsadmin#ahq-vsvr10-0120 new]$ sudo systemctl start mysqld.service
Job for mysqld.service failed because the control process exited with error code. See "systemctl status mysqld.service" and "journalctl -xe" for details.
The result for "journalctl -xe" is:
[jsadmin#ahq-vsvr10-0120 /]$ journalctl -xe
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840843Z 0 [Note] Shutting down plugin 'INNODB_SYS_FIELDS'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840848Z 0 [Note] Shutting down plugin 'INNODB_SYS_COLUMNS'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840853Z 0 [Note] Shutting down plugin 'INNODB_SYS_INDEXES'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840858Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESTATS'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840863Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLES'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840868Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_TABLE'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840873Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_CACHE'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840878Z 0 [Note] Shutting down plugin 'INNODB_FT_CONFIG'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840883Z 0 [Note] Shutting down plugin 'INNODB_FT_BEING_DELETED'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840888Z 0 [Note] Shutting down plugin 'INNODB_FT_DELETED'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840893Z 0 [Note] Shutting down plugin 'INNODB_FT_DEFAULT_STOPWORD'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840898Z 0 [Note] Shutting down plugin 'INNODB_METRICS'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840903Z 0 [Note] Shutting down plugin 'INNODB_TEMP_TABLE_INFO'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840908Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_POOL_STATS'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840913Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE_LRU'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840918Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840922Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX_RESET'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840927Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840932Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM_RESET'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840937Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840942Z 0 [Note] Shutting down plugin 'INNODB_CMP_RESET'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840947Z 0 [Note] Shutting down plugin 'INNODB_CMP'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840952Z 0 [Note] Shutting down plugin 'INNODB_LOCK_WAITS'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840956Z 0 [Note] Shutting down plugin 'INNODB_LOCKS'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840961Z 0 [Note] Shutting down plugin 'INNODB_TRX'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.840966Z 0 [Note] Shutting down plugin 'InnoDB'
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.841107Z 0 [Note] InnoDB: FTS optimize thread exiting.
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.841684Z 0 [Note] InnoDB: Starting shutdown...
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.942060Z 0 [Note] InnoDB: Dumping buffer pool(s) to /data/mysql/ib_buffer_pool
Nov 16 22:31:36 ahq-vsvr10-0120 mysqld[11028]: 2022-11-16T14:31:36.943909Z 0 [Note] InnoDB: Buffer pool(s) dump completed at 221116 22:31:36
Nov 16 22:31:37 ahq-vsvr10-0120 sshd[11060]: Accepted password for jsadmin from 10.1.19.72 port 58014 ssh2
The result for "systemctl status mysqld.service" is:
[jsadmin#ahq-vsvr10-0120 /]$ systemctl status mysqld.service -l
● mysqld.service - MySQL Server
Loaded: loaded (/usr/lib/systemd/system/mysqld.service; enabled; vendor preset: disabled)
Active: deactivating (stop-sigterm) (Result: exit-code) since Wed 2022-11-16 22:03:46 CST; 30min ago
Docs: man:mysqld(8)
http://dev.mysql.com/doc/refman/en/using-systemd.html
Process: 13625 ExecStart=/usr/sbin/mysqld --daemonize --pid-file=/var/run/mysqld/mysqld.pid $MYSQLD_OPTS (code=exited, status=1/FAILURE)
Process: 13607 ExecStartPre=/usr/bin/mysqld_pre_systemd (code=exited, status=0/SUCCESS)
Main PID: 110983 (code=exited, status=0/SUCCESS)
CGroup: /system.slice/mysqld.service
└─13628 /usr/sbin/mysqld --daemonize --pid-file=/var/run/mysqld/mysqld.pid
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.082340Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.082939Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.091421Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.136359Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.136434Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.138057Z 0 [Note] InnoDB: Waiting for purge to start
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.188733Z 0 [Note] InnoDB: 5.7.39 started; log sequence number 3718895665
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.189136Z 0 [Note] InnoDB: Loading buffer pool(s) from /data/mysql/ib_buffer_pool
Nov 16 22:34:00 ahq-vsvr10-0120 mysqld[13625]: 2022-11-16T14:34:00.189588Z 0 [Note] Plugin 'FEDERATED' is disabled.
Nov 16 22:34:00 ahq-vsvr10-0120 systemd[1]: mysqld.service: control process exited, code=exited status=1
/ect/my.inf file is:
[jsadmin#ahq-vsvr10-0119 etc]$ cat my.cnf
[mysql]
port = 3306
[mysqld]
sql_mode='STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION'
user = mysql
default-storage-engine = InnoDB
lower_case_table_names = 1
max_allowed_packet = 1000M
key-buffer-size = 32M
read-buffer-size = 1M
read-rnd-buffer-size = 4M
bulk-insert-buffer-size = 8M
myisam-sort-buffer-size = 8M
myisam-max-sort-file-size = 1G
myisam-repair-threads = 1
group_concat_max_len = 4294967295
max-allowed-packet = 32M
max-connect-errors = 1000000
datadir = /data/mysql/
server-id = 1
log-bin=/data/mysql/mysql-bin.log
binlog_format=mixed
#binlog-do-db=virt
#binlog-ignore-db=mysql
#binlog-ignore-db=information_schema
#binlog-ignore-db=performance_schema
innodb_flush_log_at_trx_commit=1
sync_binlog=1
expire_logs_days = 5
auto_increment_increment=2
auto_increment_offset=1
tmp-table-size = 64M
max-heap-table-size = 64M
query-cache-type = 0
query-cache-size = 0
max-connections = 4000
thread-cache-size = 1000
open-files-limit = 65535
table-definition-cache = 512
table-open-cache = 1024
innodb-flush-method = O_DIRECT
innodb-log-files-in-group = 2
innodb-log-file-size = 500M
innodb-flush-log-at-trx-commit = 1
innodb-file-per-table = 1
innodb-buffer-pool-size = 1G
character-set-server = utf8mb4
collation-server = utf8mb4_general_ci
skip-external-locking
skip-host-cache
skip-name-resolve
log-queries-not-using-indexes = 1
slow-query-log = 1
slow-query-log-file = /data/mysql/mysql-slow.log
[jsadmin#ahq-vsvr10-0119 etc]$
so why does the mysqld can't start?
supplement:
memory info:
[jsadmin#ahq-vsvr10-0119 ~]$ cat /proc/meminfo
MemTotal: 32761648 kB
MemFree: 15545800 kB
MemAvailable: 29155252 kB
Buffers: 3144 kB
Cached: 14909264 kB
SwapCached: 0 kB
Active: 11288772 kB
Inactive: 4748276 kB
Active(anon): 2248488 kB
Inactive(anon): 510168 kB
Active(file): 9040284 kB
Inactive(file): 4238108 kB
Unevictable: 128 kB
Mlocked: 132 kB
SwapTotal: 16773116 kB
SwapFree: 16773116 kB
Dirty: 0 kB
Writeback: 0 kB
AnonPages: 1124772 kB
Mapped: 114308 kB
Shmem: 1634012 kB
Slab: 843912 kB
SReclaimable: 733808 kB
SUnreclaim: 110104 kB
KernelStack: 7584 kB
PageTables: 11012 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 33153940 kB
Committed_AS: 4910808 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 236636 kB
VmallocChunk: 34359310332 kB
Percpu: 24064 kB
HardwareCorrupted: 0 kB
AnonHugePages: 507904 kB
CmaTotal: 0 kB
CmaFree: 0 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 153408 kB
DirectMap2M: 9283584 kB
DirectMap1G: 26214400 kB
[jsadmin#ahq-vsvr10-0119 ~]$
cpu info:
[jsadmin#ahq-vsvr10-0119 ~]$ cat /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 79
model name : Intel(R) Xeon(R) CPU E5-2660 v4 # 2.00GHz
stepping : 1
microcode : 0xb000036
cpu MHz : 1997.686
cache size : 35840 KB
physical id : 0
siblings : 4
core id : 0
cpu cores : 4
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 20
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch epb invpcid_single fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 invpcid rtm rdseed adx smap xsaveopt dtherm ida arat pln pts
bogomips : 3995.37
clflush size : 64
cache_alignment : 64
address sizes : 42 bits physical, 48 bits virtual
power management:
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 79
model name : Intel(R) Xeon(R) CPU E5-2660 v4 # 2.00GHz
stepping : 1
microcode : 0xb000036
cpu MHz : 1997.686
cache size : 35840 KB
physical id : 0
siblings : 4
core id : 1
cpu cores : 4
apicid : 1
initial apicid : 1
fpu : yes
fpu_exception : yes
cpuid level : 20
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch epb invpcid_single fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 invpcid rtm rdseed adx smap xsaveopt dtherm ida arat pln pts
bogomips : 3995.37
clflush size : 64
cache_alignment : 64
address sizes : 42 bits physical, 48 bits virtual
power management:
processor : 2
vendor_id : GenuineIntel
cpu family : 6
model : 79
model name : Intel(R) Xeon(R) CPU E5-2660 v4 # 2.00GHz
stepping : 1
microcode : 0xb000036
cpu MHz : 1997.686
cache size : 35840 KB
physical id : 0
siblings : 4
core id : 2
cpu cores : 4
apicid : 2
initial apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 20
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch epb invpcid_single fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 invpcid rtm rdseed adx smap xsaveopt dtherm ida arat pln pts
bogomips : 3995.37
clflush size : 64
cache_alignment : 64
address sizes : 42 bits physical, 48 bits virtual
power management:
processor : 3
vendor_id : GenuineIntel
cpu family : 6
model : 79
model name : Intel(R) Xeon(R) CPU E5-2660 v4 # 2.00GHz
stepping : 1
microcode : 0xb000036
cpu MHz : 1997.686
cache size : 35840 KB
physical id : 0
siblings : 4
core id : 3
cpu cores : 4
apicid : 3
initial apicid : 3
fpu : yes
fpu_exception : yes
cpuid level : 20
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch epb invpcid_single fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 invpcid rtm rdseed adx smap xsaveopt dtherm ida arat pln pts
bogomips : 3995.37
clflush size : 64
cache_alignment : 64
address sizes : 42 bits physical, 48 bits virtual
power management:
processor : 4
vendor_id : GenuineIntel
cpu family : 6
model : 79
model name : Intel(R) Xeon(R) CPU E5-2660 v4 # 2.00GHz
stepping : 1
microcode : 0xb000036
cpu MHz : 1997.686
cache size : 35840 KB
physical id : 1
siblings : 4
core id : 0
cpu cores : 4
apicid : 4
initial apicid : 4
fpu : yes
fpu_exception : yes
cpuid level : 20
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch epb invpcid_single fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 invpcid rtm rdseed adx smap xsaveopt dtherm ida arat pln pts
bogomips : 3995.37
clflush size : 64
cache_alignment : 64
address sizes : 42 bits physical, 48 bits virtual
power management:
processor : 5
vendor_id : GenuineIntel
cpu family : 6
model : 79
model name : Intel(R) Xeon(R) CPU E5-2660 v4 # 2.00GHz
stepping : 1
microcode : 0xb000036
cpu MHz : 1997.686
cache size : 35840 KB
physical id : 1
siblings : 4
core id : 1
cpu cores : 4
apicid : 5
initial apicid : 5
fpu : yes
fpu_exception : yes
cpuid level : 20
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch epb invpcid_single fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 invpcid rtm rdseed adx smap xsaveopt dtherm ida arat pln pts
bogomips : 3995.37
clflush size : 64
cache_alignment : 64
address sizes : 42 bits physical, 48 bits virtual
power management:
processor : 6
vendor_id : GenuineIntel
cpu family : 6
model : 79
model name : Intel(R) Xeon(R) CPU E5-2660 v4 # 2.00GHz
stepping : 1
microcode : 0xb000036
cpu MHz : 1997.686
cache size : 35840 KB
physical id : 1
siblings : 4
core id : 2
cpu cores : 4
apicid : 6
initial apicid : 6
fpu : yes
fpu_exception : yes
cpuid level : 20
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch epb invpcid_single fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 invpcid rtm rdseed adx smap xsaveopt dtherm ida arat pln pts
bogomips : 3995.37
clflush size : 64
cache_alignment : 64
address sizes : 42 bits physical, 48 bits virtual
power management:
processor : 7
vendor_id : GenuineIntel
cpu family : 6
model : 79
model name : Intel(R) Xeon(R) CPU E5-2660 v4 # 2.00GHz
stepping : 1
microcode : 0xb000036
cpu MHz : 1997.686
cache size : 35840 KB
physical id : 1
siblings : 4
core id : 3
cpu cores : 4
apicid : 7
initial apicid : 7
fpu : yes
fpu_exception : yes
cpuid level : 20
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc aperfmperf eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch epb invpcid_single fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 invpcid rtm rdseed adx smap xsaveopt dtherm ida arat pln pts
bogomips : 3995.37
clflush size : 64
cache_alignment : 64
address sizes : 42 bits physical, 48 bits virtual
power management:
[jsadmin#ahq-vsvr10-0119 ~]$
Here is the http-livestream setup: The server is running ffmpeg with the DASH protocol and h264 encoding. The client is using Dash.js. Resolution is fixed to 1920x1080, with 24 bit depth, and 60hz.
The artefacting (image below) is only present when the last row of the video is within chrome viewport (so it disapears if the page is scrolled up). It manifests itself as stretching of the center row of pixels downwards, and appears to only affect some color channels.
I have attempted changing the bitrate, and cutting the last row from the source, thinking the issue could be on the server side, without any impact. The fact that the issue depends on the position in the viewport makes me suspect a glitch in chrome itself.
I have also attempted to force hardware decoding off in chrome:\flags and it does not solve the issue.
Please submit your hypothesis on what could be the cause of this issue. Thanks.
Update #1
Here is the ffmpeg command line and logs:
export DISPLAY=:0 && ffmpeg -f x11grab -framerate 60 -video_size 1920x1080 -i :0.0+0,0 -draw_mouse 0 -f dash -utc_timing_url https://time.akamai.com/?iso -streaming 1 -seg_duration 2 -frag_duration 0.033 -fflags nobuffer -fflags flush_packets -c:v h264 -preset ultrafast data/stream.mpd
And the logs:
ffmpeg version 4.2.4-1ubuntu0.1 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 9 (Ubuntu 9.3.0-10ubuntu2)
configuration: --prefix=/usr --extra-version=1ubuntu0.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-nvenc --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil 56. 31.100 / 56. 31.100
libavcodec 58. 54.100 / 58. 54.100
libavformat 58. 29.100 / 58. 29.100
libavdevice 58. 8.100 / 58. 8.100
libavfilter 7. 57.100 / 7. 57.100
libavresample 4. 0. 0 / 4. 0. 0
libswscale 5. 5.100 / 5. 5.100
libswresample 3. 5.100 / 3. 5.100
libpostproc 55. 5.100 / 55. 5.100
[x11grab # 0x561ca34b9980] Stream #0: not enough frames to estimate rate; consider increasing probesize
Input #0, x11grab, from ':0.0+0,0':
Duration: N/A, start: 1618941693.853256, bitrate: N/A
Stream #0:0: Video: rawvideo (BGR[0] / 0x524742), bgr0, 1920x1080, 60 fps, 1000k tbr, 1000k tbn, 1000k tbc
Stream mapping:
Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 # 0x561ca34c5300] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 AVX512
[libx264 # 0x561ca34c5300] profile High 4:4:4 Predictive, level 4.2, 4:4:4 8-bit
[libx264 # 0x561ca34c5300] 264 - core 155 r2917 0a84d98 - H.264/MPEG-4 AVC codec - Copyleft 2003-2018 - http://www.videolan.org/x264.html - options: cabac=0 ref=1 deblock=0:0:0 analyse=0:0 me=dia subme=0 psy=1 psy_rd=1.00:0.00 mixed_ref=0 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=6 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=0 keyint=250 keyint_min=25 scenecut=0 intra_refresh=0 rc=crf mbtree=0 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=0
[dash # 0x561ca34c3740] No bit rate set for stream 0
[dash # 0x561ca34c3740] Opening 'data/init-stream0.m4s' for writing
Output #0, dash, to 'data/stream.mpd':
Metadata:
encoder : Lavf58.29.100
Stream #0:0: Video: h264 (libx264), yuv444p, 1920x1080, q=-1--1, 60 fps, 15360 tbn, 60 tbc
Metadata:
encoder : Lavc58.54.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
[dash # 0x561ca34c3740] Opening 'data/chunk-stream0-00001.m4s.tmp' for writing
frame= 34 fps=0.0 q=15.0 size=N/A time=00:00:00.43 bitrate=N/A dup=5 drop=0 speed=0.836x
frame= 65 fps= 64 q=15.0 size=N/A time=00:00:00.95 bitrate=N/A dup=5 drop=0 speed=0.929x
frame= 96 fps= 62 q=15.0 size=N/A time=00:00:01.46 bitrate=N/A dup=5 drop=2 speed=0.955x
frame= 126 fps= 62 q=15.0 size=N/A time=00:00:01.96 bitrate=N/A dup=5 drop=3 speed=0.962x
frame= 157 fps= 62 q=15.0 size=N/A time=00:00:02.48 bitrate=N/A dup=5 drop=3 speed=0.973x
frame= 188 fps= 61 q=15.0 size=N/A time=00:00:03.00 bitrate=N/A dup=5 drop=3 speed=0.98x
frame= 217 fps= 61 q=15.0 size=N/A time=00:00:03.48 bitrate=N/A dup=5 drop=3 speed=0.977x
frame= 247 fps= 61 q=15.0 size=N/A time=00:00:03.98 bitrate=N/A dup=6 drop=3 speed=0.976x
[dash # 0x561ca34c3740] Opening 'data/stream.mpd.tmp' for writing
[dash # 0x561ca34c3740] Opening 'data/chunk-stream0-00002.m4s.tmp' for writing
frame= 279 fps= 61 q=15.0 size=N/A t
Add the -vf format=yuv420p output option for YUV 4:2:0 chroma subsampling. This is the only widely supported chroma subsampling scheme for H.264.
Your input pixel format is bgr0. Your output is yuv444p. ffmpeg tries to preserve as much fidelity as it can so it auto converts it to a pixel format supported by the selected encoder that most resembles the source. In this case it is yuv444p (YUV 4:4:4) which is not universally supported.
Even after editing the appropriate ext-xdebug.ini (/usr/local/etc/php/7.1/conf.d/ext-xdebug.ini), PhpStorm still does not reflect what is seen withphpinfo().
PHP version: 7.1.16
PHP CLI: /usr/local/Cellar/php#7.1/7.1.16/bin/php PHP CGI: /usr/local/Cellar/php#7.1/7.1.16/bin/php-cgi
Loaded Configuration File: /usr/local/etc/php/7.1/php.ini
Additional .ini files parsed: /usr/local/etc/php/7.1/conf.d/ext-imagick.ini /usr/local/etc/php/7.1/conf.d/ext-opcache.ini /usr/local/etc/php/7.1/conf.d/ext-xdebug.ini
Debugger extension: Xdebug 2.6.0
Loaded extensions: bcmath, bz2, calendar, Core, ctype, curl, date, dba, dom, exif, fileinfo, filter, ftp, gd, gettext, gmp, hash, iconv, imagick, intl, json, ldap, libxml, mbstring, mcrypt, mysqli, mysqlnd, odbc, openssl, pcntl, pcre, PDO, pdo_dblib, pdo_mysql, PDO_ODBC, pdo_pgsql, pdo_sqlite, pgsql, Phar, phpdbg_webhelper, posix, pspell, readline, Reflection, session, shmop, SimpleXML, soap, sockets, SPL, sqlite3, standard, sysvmsg, sysvsem, sysvshm, tokenizer, wddx, xdebug, xml, xmlreader, xmlrpc, xmlwriter, xsl, Zend OPcache, zip, zlib
Configuration options:
allow_url_fopen
1
allow_url_include
arg_separator.input
&
arg_separator.output
&
assert.active
1
assert.bail
0
assert.callback
assert.exception
0
assert.quiet_eval
0
assert.warning
1
auto_append_file
auto_detect_line_endings
0
auto_globals_jit
1
auto_prepend_file
bcmath.scale
0
browscap
cli.pager
cli.prompt
\b \>
curl.cainfo
date.default_latitude
31.7667
date.default_longitude
35.2333
date.sunrise_zenith
90.583333
date.sunset_zenith
90.583333
date.timezone
dba.default_handler
flatfile
default_charset
UTF-8
default_mimetype
text/html
default_socket_timeout
60
disable_classes
disable_functions
display_errors
1
display_startup_errors
1
doc_root
docref_ext
docref_root
enable_dl
enable_post_data_reading
1
error_append_string
error_log
error_prepend_string
error_reporting
32767
exif.decode_jis_intel
JIS
exif.decode_jis_motorola
JIS
exif.decode_unicode_intel
UCS-2LE
exif.decode_unicode_motorola
UCS-2BE
exif.encode_jis
exif.encode_unicode
ISO-8859-15
expose_php
1
extension_dir
/usr/local/Cellar/php#7.1/7.1.16/lib/php/20160303
file_uploads
1
filter.default
unsafe_raw
filter.default_flags
from
gd.jpeg_ignore_warning
1
hard_timeout
2
highlight.comment
#FF8000
highlight.default
#0000BB
highlight.html
#000000
highlight.keyword
#007700
highlight.string
#DD0000
html_errors
0
iconv.input_encoding
iconv.internal_encoding
iconv.output_encoding
ignore_repeated_errors
ignore_repeated_source
ignore_user_abort
0
imagick.locale_fix
0
imagick.progress_monitor
0
imagick.skip_version_check
0
implicit_flush
1
include_path
.:/usr/local/Cellar/php#7.1/7.1.16/share/pear
input_encoding
internal_encoding
intl.default_locale
intl.error_level
0
intl.use_exceptions
0
ldap.max_links
-1
log_errors
1
log_errors_max_len
1024
mail.add_x_header
1
mail.force_extra_parameters
mail.log
max_execution_time
0
max_file_uploads
20
max_input_nesting_level
64
max_input_time
-1
max_input_vars
1000
mbstring.detect_order
mbstring.encoding_translation
0
mbstring.func_overload
0
mbstring.http_input
mbstring.http_output
mbstring.http_output_conv_mimetypes
^(text/|application/xhtml\+xml)
mbstring.internal_encoding
mbstring.language
neutral
mbstring.strict_detection
0
mbstring.substitute_character
mcrypt.algorithms_dir
mcrypt.modes_dir
memory_limit
512M
mysqli.allow_local_infile
1
mysqli.allow_persistent
1
mysqli.default_host
mysqli.default_port
3306
mysqli.default_pw
mysqli.default_socket
/tmp/mysql.sock
mysqli.default_user
mysqli.max_links
-1
mysqli.max_persistent
-1
mysqli.reconnect
mysqli.rollback_on_cached_plink
0
mysqlnd.collect_memory_statistics
1
mysqlnd.collect_statistics
1
mysqlnd.debug
mysqlnd.fetch_data_copy
0
mysqlnd.log_mask
0
mysqlnd.mempool_default_size
16000
mysqlnd.net_cmd_buffer_size
4096
mysqlnd.net_read_buffer_size
32768
mysqlnd.net_read_timeout
31536000
mysqlnd.sha256_server_public_key
mysqlnd.trace_alloc
odbc.allow_persistent
1
odbc.check_persistent
1
odbc.default_cursortype
3
odbc.default_db
odbc.default_pw
odbc.default_user
odbc.defaultbinmode
1
odbc.defaultlrl
4096
odbc.max_links
-1
odbc.max_persistent
-1
opcache.blacklist_filename
opcache.consistency_checks
0
opcache.dups_fix
0
opcache.enable
1
opcache.enable_cli
0
opcache.enable_file_override
0
opcache.error_log
opcache.fast_shutdown
0
opcache.file_cache
opcache.file_cache_consistency_checks
1
opcache.file_cache_only
0
opcache.file_update_protection
2
opcache.force_restart_timeout
180
opcache.huge_code_pages
0
opcache.inherited_hack
1
opcache.interned_strings_buffer
8
opcache.lockfile_path
/tmp
opcache.log_verbosity_level
1
opcache.max_accelerated_files
10000
opcache.max_file_size
0
opcache.max_wasted_percentage
5
opcache.memory_consumption
128
opcache.opt_debug_level
0
opcache.optimization_level
0x7FFFBFFF
opcache.preferred_memory_model
opcache.protect_memory
0
opcache.restrict_api
opcache.revalidate_freq
2
opcache.revalidate_path
0
opcache.save_comments
1
opcache.use_cwd
1
opcache.validate_permission
0
opcache.validate_root
0
opcache.validate_timestamps
1
open_basedir
openssl.cafile
openssl.capath
output_buffering
0
output_encoding
output_handler
pcre.backtrack_limit
1000000
pcre.jit
1
pcre.recursion_limit
100000
pdo_mysql.default_socket
/tmp/mysql.sock
pgsql.allow_persistent
1
pgsql.auto_reset_persistent
pgsql.ignore_notice
0
pgsql.log_notice
0
pgsql.max_links
-1
pgsql.max_persistent
-1
phar.cache_list
phar.readonly
1
phar.require_hash
1
phpdbg.auth
phpdbg.path
post_max_size
8M
precision
14
realpath_cache_size
4096K
realpath_cache_ttl
120
register_argc_argv
1
report_memleaks
1
report_zend_debug
0
request_order
GP
sendmail_from
sendmail_path
/usr/sbin/sendmail -t -i
serialize_precision
-1
session.auto_start
0
session.cache_expire
180
session.cache_limiter
nocache
session.cookie_domain
session.cookie_httponly
session.cookie_lifetime
0
session.cookie_path
/
session.cookie_secure
session.gc_divisor
1000
session.gc_maxlifetime
1440
session.gc_probability
1
session.lazy_write
1
session.name
PHPSESSID
session.referer_check
session.save_handler
files
session.save_path
session.serialize_handler
php
session.sid_bits_per_character
5
session.sid_length
26
session.trans_sid_hosts
session.trans_sid_tags
a=href,area=href,frame=src,form=
session.upload_progress.cleanup
1
session.upload_progress.enabled
1
session.upload_progress.freq
1%
session.upload_progress.min_freq
1
session.upload_progress.name
PHP_SESSION_UPLOAD_PROGRESS
session.upload_progress.prefix
upload_progress_
session.use_cookies
1
session.use_only_cookies
1
session.use_strict_mode
0
session.use_trans_sid
0
short_open_tag
SMTP
localhost
smtp_port
25
soap.wsdl_cache
1
soap.wsdl_cache_dir
/tmp
soap.wsdl_cache_enabled
1
soap.wsdl_cache_limit
5
soap.wsdl_cache_ttl
86400
sql.safe_mode
sqlite3.extension_dir
sys_temp_dir
track_errors
1
unserialize_callback_func
upload_max_filesize
2M
upload_tmp_dir
url_rewriter.hosts
url_rewriter.tags
form=
user_agent
user_dir
user_ini.cache_ttl
300
user_ini.filename
.user.ini
variables_order
GPCS
xdebug.auto_trace
0
xdebug.cli_color
0
xdebug.collect_assignments
0
xdebug.collect_includes
1
xdebug.collect_params
0
xdebug.collect_return
0
xdebug.collect_vars
0
xdebug.coverage_enable
1
xdebug.default_enable
1
xdebug.dump.COOKIE
xdebug.dump.ENV
xdebug.dump.FILES
xdebug.dump.GET
xdebug.dump.POST
xdebug.dump.REQUEST
xdebug.dump.SERVER
xdebug.dump.SESSION
xdebug.dump_globals
1
xdebug.dump_once
1
xdebug.dump_undefined
0
xdebug.extended_info
1
xdebug.file_link_format
xdebug.filename_format
xdebug.force_display_errors
0
xdebug.force_error_reporting
0
xdebug.gc_stats_enable
0
xdebug.gc_stats_output_dir
/var/tmp/
xdebug.gc_stats_output_name
gcstats.%p
xdebug.halt_level
0
xdebug.idekey
xdebug.max_nesting_level
256
xdebug.max_stack_frames
-1
xdebug.overload_var_dump
2
xdebug.profiler_aggregate
0
xdebug.profiler_append
0
xdebug.profiler_enable
0
xdebug.profiler_enable_trigger
0
xdebug.profiler_enable_trigger_value
xdebug.profiler_output_dir
/var/tmp/
xdebug.profiler_output_name
cachegrind.out.%p
xdebug.remote_addr_header
xdebug.remote_autostart
0
xdebug.remote_connect_back
0
xdebug.remote_cookie_expire_time
3600
xdebug.remote_enable
0
xdebug.remote_handler
dbgp
xdebug.remote_host
localhost
xdebug.remote_log
xdebug.remote_mode
req
xdebug.remote_port
9000
xdebug.remote_timeout
200
xdebug.scream
0
xdebug.show_error_trace
0
xdebug.show_exception_trace
0
xdebug.show_local_vars
0
xdebug.show_mem_delta
0
xdebug.trace_enable_trigger
0
xdebug.trace_enable_trigger_value
xdebug.trace_format
0
xdebug.trace_options
0
xdebug.trace_output_dir
/var/tmp/
xdebug.trace_output_name
trace.%c
xdebug.var_display_max_children
128
xdebug.var_display_max_data
512
xdebug.var_display_max_depth
3
xmlrpc_error_number
0
xmlrpc_errors
0
zend.assertions
1
zend.detect_unicode
1
zend.enable_gc
1
zend.multibyte
0
zend.script_encoding
zend.signal_check
0
zlib.output_compression
zlib.output_compression_level
-1
zlib.output_handler
Full xdebug phpinfo()
Second half of xdebug phpinfo
Log closed at 2018-04-05 15:47:08
Log opened at 2018-04-05 15:49:27
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17035" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:29
Log opened at 2018-04-05 15:49:31
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17035" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
Log opened at 2018-04-05 15:49:31
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17036" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
Log opened at 2018-04-05 15:49:32
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17040" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:33
Log opened at 2018-04-05 15:49:33
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17035" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:33
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:33
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:34
Log opened at 2018-04-05 15:49:34
Log opened at 2018-04-05 15:49:34
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17036" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17035" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
Log opened at 2018-04-05 15:49:34
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17040" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:34
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:34
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:34
Log opened at 2018-04-05 15:49:48
I: Connecting to configured address/port: 127.0.0.1:9000.
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/bin/console" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17042" idekey="16246"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:49:49
Log opened at 2018-04-05 15:54:32
I: Connecting to configured address/port: localhost:9000.
W: Creating socket for 'localhost:9000', poll success, but error: Operation now in progress (19).
I: Connected to client. :-)
-> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" fileuri="file:///Users/namehere/PhpstormProjects/arc/web/index.php" language="PHP" xdebug:language_version="7.1.13" protocol_version="1.0" appid="17035" idekey="17743"><engine version="2.6.0"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[http://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2018 by Derick Rethans]]></copyright></init>
-> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="http://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
Log closed at 2018-04-05 15:54:32
I had the same issue and spent about 2 hours without success.
I am putting the solution mentioned by #LazyOne from the comments here to the top(thanks!)
Stop the PHP-FPM or change port to different than 9000!
P.S. My PHPStorm shows xdebug.remote_enable=0 also but debugging started to work!
I have a problem with ubuntu killing mySQL server due to out of memory when running Magento. I've ran the mySQLtuner script (which warned that possible memory allocation for mySQL was higher than system memory) and adjusted the mySQL /etc/mysql/my.cnf file accordingly.
According to the script the maximum allowed memory usage for mySQL is 218,9 MB which should not cause a problem. Free memory when the server is just started and everything is working is 277 / 590 MB. After clicking around for a wile in Magento frontend the mySQL server is killed, here is a dump from /var/log/syslog:
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037361] mysqld invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037367] mysqld cpuset=/ mems_allowed=0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037370] Pid: 948, comm: mysqld Not tainted 3.2.0-29-virtual #46-Ubuntu
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037372] Call Trace:
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037382] [<ffffffff810bd5fd>] ? cpuset_print_task_mems_allowed+0x9d/0xb0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037386] [<ffffffff81117ce1>] dump_header+0x91/0xe0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037388] [<ffffffff81118065>] oom_kill_process+0x85/0xb0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037391] [<ffffffff8111840a>] out_of_memory+0xfa/0x220
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037394] [<ffffffff8111de3a>] __alloc_pages_nodemask+0x7ea/0x800
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037398] [<ffffffff8165296e>] ? _raw_spin_unlock_irqrestore+0x1e/0x30
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037403] [<ffffffff81154b73>] alloc_pages_current+0xa3/0x110
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037406] [<ffffffff81114a4f>] __page_cache_alloc+0x8f/0xa0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037409] [<ffffffff81114d4e>] ? find_get_page+0x1e/0x90
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037412] [<ffffffff81116bd2>] filemap_fault+0x212/0x3c0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037415] [<ffffffff81136e62>] __do_fault+0x72/0x550
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037419] [<ffffffff8108ca60>] ? lock_hrtimer_base.isra.24+0x30/0x60
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037422] [<ffffffff8113a70a>] handle_pte_fault+0xfa/0x200
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037426] [<ffffffff8100648e>] ? xen_pmd_val+0xe/0x10
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037428] [<ffffffff810052e9>] ? __raw_callee_save_xen_pmd_val+0x11/0x1e
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037431] [<ffffffff8113abc8>] handle_mm_fault+0x1f8/0x350
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037434] [<ffffffff8165625b>] do_page_fault+0x14b/0x520
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037437] [<ffffffff8108d2a4>] ? hrtimer_start_range_ns+0x14/0x20
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037440] [<ffffffff8103cda5>] ? pvclock_clocksource_read+0x55/0xf0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037444] [<ffffffff8100a640>] ? xen_clocksource_read+0x20/0x30
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037447] [<ffffffff8100a729>] ? xen_clocksource_get_cycles+0x9/0x10
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037456] [<ffffffff81093177>] ? getnstimeofday+0x57/0xe0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037459] [<ffffffff81652eb5>] page_fault+0x25/0x30
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037460] Mem-Info:
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037462] Node 0 DMA per-cpu:
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037464] CPU 0: hi: 0, btch: 1 usd: 0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037466] Node 0 DMA32 per-cpu:
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037468] CPU 0: hi: 186, btch: 31 usd: 123
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037471] active_anon:139853 inactive_anon:31 isolated_anon:0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037472] active_file:38 inactive_file:169 isolated_file:0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037473] unevictable:0 dirty:0 writeback:0 unstable:0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037473] free:1375 slab_reclaimable:1934 slab_unreclaimable:2073
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037474] mapped:55 shmem:64 pagetables:2195 bounce:0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037476] Node 0 DMA free:2464kB min:72kB low:88kB high:108kB active_anon:12232kB inactive_anon:0kB active_file:0kB inactive_file:12kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:14524kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:32kB slab_unreclaimable:12kB kernel_stack:0kB pagetables:24kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3 all_unreclaimable? yes
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037484] lowmem_reserve[]: 0 597 597 597
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037487] Node 0 DMA32 free:3036kB min:3088kB low:3860kB high:4632kB active_anon:547180kB inactive_anon:124kB active_file:152kB inactive_file:664kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:611856kB mlocked:0kB dirty:0kB writeback:0kB mapped:220kB shmem:256kB slab_reclaimable:7704kB slab_unreclaimable:8280kB kernel_stack:792kB pagetables:8756kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1943 all_unreclaimable? yes
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037495] lowmem_reserve[]: 0 0 0 0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037498] Node 0 DMA: 8*4kB 6*8kB 5*16kB 2*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 2464kB
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037506] Node 0 DMA32: 247*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3036kB
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037513] 279 total pagecache pages
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037514] 0 pages in swap cache
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037516] Swap cache stats: add 0, delete 0, find 0/0
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037517] Free swap = 0kB
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.037518] Total swap = 0kB
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041176] 159472 pages RAM
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041180] 8376 pages reserved
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041181] 16609 pages shared
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041182] 143523 pages non-shared
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041184] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041194] [ 246] 0 246 4306 49 0 0 0 upstart-udev-br
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041197] [ 250] 0 250 5365 116 0 -17 -1000 udevd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041200] [ 300] 0 300 5364 98 0 -17 -1000 udevd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041203] [ 301] 0 301 5364 97 0 -17 -1000 udevd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041206] [ 393] 0 393 3795 47 0 0 0 upstart-socket-
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041209] [ 444] 0 444 1814 123 0 0 0 dhclient3
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041212] [ 617] 0 617 12487 153 0 -17 -1000 sshd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041215] [ 629] 101 629 63428 103 0 0 0 rsyslogd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041218] [ 636] 102 636 5952 74 0 0 0 dbus-daemon
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041221] [ 692] 0 692 3624 39 0 0 0 getty
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041224] [ 699] 0 699 3624 43 0 0 0 getty
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041227] [ 710] 0 710 3624 41 0 0 0 getty
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041230] [ 711] 0 711 3624 41 0 0 0 getty
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041236] [ 718] 0 718 3624 43 0 0 0 getty
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041239] [ 725] 0 725 1080 36 0 0 0 acpid
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041242] [ 727] 0 727 4776 59 0 0 0 cron
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041245] [ 728] 0 728 4225 40 0 0 0 atd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041248] [ 753] 106 753 203063 19815 0 0 0 mysqld
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041251] [ 808] 103 808 46895 299 0 0 0 whoopsie
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041254] [ 857] 0 857 6274 78 0 0 0 master
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041257] [ 867] 107 867 6831 84 0 0 0 qmgr
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041260] [ 910] 0 910 76016 1435 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041263] [ 953] 33 953 84720 10145 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041266] [ 954] 33 954 90925 15531 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041272] [ 955] 33 955 76062 1474 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041275] [ 957] 33 957 81127 6426 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041278] [ 1065] 0 1065 22444 5138 0 0 0 /usr/share/webm
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041281] [ 1069] 0 1069 3624 41 0 0 0 getty
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041284] [ 1243] 33 1243 90163 15653 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041287] [ 1246] 33 1246 79452 4952 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041290] [ 1247] 33 1247 93679 18462 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041292] [ 1248] 33 1248 93574 19110 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041295] [ 1249] 33 1249 92189 16935 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041298] [ 5116] 107 5116 6790 68 0 0 0 pickup
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041301] [ 5169] 0 5169 18338 200 0 0 0 sshd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041304] [ 5287] 1000 5287 18338 200 0 0 0 sshd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041307] [ 5288] 1000 5288 6248 1457 0 0 0 bash
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041310] [ 5562] 0 5562 22444 5098 0 0 0 miniserv.pl
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041313] [ 5597] 0 5597 18338 201 0 0 0 sshd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041315] [ 5687] 1000 5687 18338 201 0 0 0 sshd
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041318] [ 5688] 1000 5688 6235 1446 0 0 0 bash
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041321] [ 5784] 1000 5784 10474 92 0 0 0 sudo
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041324] [ 5785] 0 5785 3337 171 0 0 0 nano
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041327] [ 5786] 33 5786 84584 10087 0 0 0 apache2
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041330] Out of memory: Kill process 753 (mysqld) score 131 or sacrifice child
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.041396] Killed process 753 (mysqld) total-vm:812252kB, anon-rss:79260kB, file-rss:0kB
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.217049] init: mysql main process (753) killed by KILL signal
Dec 28 11:11:52 ip-10-228-98-15 kernel: [37224.218251] init: mysql main process ended, respawning
Dec 28 11:11:53 ip-10-228-98-15 kernel: [37225.185699] type=1400 audit(1356693113.390:11): apparmor="STATUS" operation="profile_replace" name="/usr/sbin/mysqld" pid=5794 comm="apparmor_parser"
Dec 28 11:11:54 ip-10-228-98-15 kernel: [37226.152344] init: mysql main process (5798) terminated with status 1
Dec 28 11:11:54 ip-10-228-98-15 kernel: [37226.152382] init: mysql main process ended, respawning
Dec 28 11:11:54 ip-10-228-98-15 kernel: [37226.768092] init: mysql post-start process (5799) terminated with status 1
Dec 28 11:11:54 ip-10-228-98-15 kernel: [37226.784475] type=1400 audit(1356693114.990:12): apparmor="STATUS" operation="profile_replace" name="/usr/sbin/mysqld" pid=5822 comm="apparmor_parser"
Dec 28 11:11:55 ip-10-228-98-15 kernel: [37226.844954] init: mysql main process (5826) terminated with status 1
Dec 28 11:11:55 ip-10-228-98-15 kernel: [37226.844991] init: mysql respawning too fast, stopped
So basically mySQL is busted for hogging to much memory and then sentenced to death. The question is why? I thought my settings in my.cnf had limited the memory mySQL could use?
Another interesting question is why it won't restart again? It has nothing to do with apparmor, I removed it but same result but without the apparmor reference in the syslog.
my.cnf:
#
# The MySQL database server configuration file.
#
# You can copy this to one of:
# - "/etc/mysql/my.cnf" to set global options,
# - "~/.my.cnf" to set user-specific options.
#
# One can use all long options that the program supports.
# Run program with --help to get a list of available options and with
# --print-defaults to see which it would actually understand and use.
#
# For explanations see
# http://dev.mysql.com/doc/mysql/en/server-system-variables.html
# This will be passed to all mysql clients
# It has been reported that passwords should be enclosed with ticks/quotes
# escpecially if they contain "#" chars...
# Remember to edit /etc/mysql/debian.cnf when changing the socket location.
[client]
port = 3306
socket = /var/run/mysqld/mysqld.sock
# Here is entries for some specific programs
# The following values assume you have at least 32M ram
# This was formally known as [safe_mysqld]. Both versions are currently parsed.
[mysqld_safe]
socket = /var/run/mysqld/mysqld.sock
nice = 0
[mysqld]
#
# * Basic Settings
#
user = mysql
pid-file = /var/run/mysqld/mysqld.pid
socket = /var/run/mysqld/mysqld.sock
port = 3306
basedir = /usr
datadir = /var/lib/mysql
tmpdir = /tmp
lc-messages-dir = /usr/share/mysql
skip-external-locking
#
# Instead of skip-networking the default is now to listen only on
# localhost which is more compatible and is not less secure.
bind-address = 127.0.0.1
#
# * Fine Tuning
#
key_buffer = 16M
max_allowed_packet = 16M
thread_stack = 192K
thread_cache_size = 1
# This replaces the startup script and checks MyISAM tables if needed
# the first time they are touched
myisam-recover = BACKUP
max_connections = 10
#table_cache = 64
#thread_concurrency = 10
#
# * Query Cache Configuration
#
query_cache_limit = 1M
query_cache_size = 16M
#
# * Logging and Replication
#
# Both location gets rotated by the cronjob.
# Be aware that this log type is a performance killer.
# As of 5.1 you can enable the log at runtime!
#general_log_file = /var/log/mysql/mysql.log
#general_log = 1
#
# Error logging goes to syslog due to /etc/mysql/conf.d/mysqld_safe_syslog.cnf.
#
# Here you can see queries with especially long duration
#log_slow_queries = /var/log/mysql/mysql-slow.log
#long_query_time = 2
#log-queries-not-using-indexes
#
# The following can be used as easy to replay backup logs or for replication.
# note: if you are setting up a replication slave, see README.Debian about
# other settings you may need to change.
#server-id = 1
#log_bin = /var/log/mysql/mysql-bin.log
expire_logs_days = 10
max_binlog_size = 100M
#binlog_do_db = include_database_name
#binlog_ignore_db = include_database_name
#
# * InnoDB
#
# InnoDB is enabled by default with a 10MB datafile in /var/lib/mysql/.
# Read the manual for more InnoDB related options. There are many!
#
# * Security Features
#
# Read the manual, too, if you want chroot!
# chroot = /var/lib/mysql/
#
# For generating SSL certificates I recommend the OpenSSL GUI "tinyca".
#
# ssl-ca=/etc/mysql/cacert.pem
# ssl-cert=/etc/mysql/server-cert.pem
# ssl-key=/etc/mysql/server-key.pem
[mysqldump]
quick
quote-names
max_allowed_packet = 16M
[mysql]
#no-auto-rehash # faster start of mysql but no tab completition
[isamchk]
key_buffer = 16M
#
# * IMPORTANT: Additional settings that can override those from this file!
# The files must end with '.cnf', otherwise they'll be ignored.
#
!includedir /etc/mysql/conf.d/
I do realize that these memory settings are way to low for any performance in Magento but I've tried all kinds of value here to the same result. Crasch!
The server is a EC2 micro instance running Ubuntu 12.04 x64 and i don't by any means expect blazing speeds (no production use) but at least I should be able to configure it so it doesn't crasch all the time. I've another EC2 micro instance running on 32bit Ubuntu and the mySQL server has never ever crashed on that one. Could it be related to to 32 vs 64 bit Ubuntu?
As you can see there are many questions but limited knowledge, grateful for any pointers. I'll keep you posted.
In the end I went with the suggestion of Anton S above and simply accepted that the instance did not have enough memory. Launched it as an ec2 small instance instead and now it works like a charm.
top - 12:24:22 up 1 day, 18:37, 2 users, load average: 1.19, 1.77, 1.59
Tasks: 166 total, 4 running, 162 sleeping, 0 stopped, 0 zombie
Cpu(s): 20.1%us, 5.8%sy, 0.0%ni, 62.4%id, 10.8%wa, 0.0%hi, 1.0%si, 0.0%st
Mem: 987780k total, 979052k used, 8728k free, 17240k buffers
Swap: 2104432k total, 106760k used, 1997672k free, 174100k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4116 mysql 15 0 356m 105m 4176 S 12.0 11.0 139:58.69 mysqld
5722 apache 15 0 160m 17m 4224 S 10.0 1.8 0:00.78 httpd
5741 apache 15 0 161m 17m 4220 S 9.3 1.8 0:00.37 httpd
5840 apache 15 0 161m 17m 4148 S 8.3 1.8 0:00.52 httpd
5846 apache 15 0 161m 17m 4132 S 6.3 1.8 0:00.47 httpd
5744 apache 15 0 162m 18m 4224 S 2.0 1.9 0:00.37 httpd
5725 apache 15 0 161m 17m 4424 S 1.3 1.8 0:00.34 httpd
5755 apache 15 0 105m 14m 4248 R 1.3 1.5 0:00.17 httpd
5564 apache 15 0 163m 19m 4360 S 1.0 2.0 0:00.65 httpd
5322 apache 16 0 162m 19m 4456 S 0.7 2.0 0:02.26 httpd
5586 apache 15 0 161m 18m 4468 S 0.7 1.9 0:01.77 httpd
5852 apache 16 0 99.9m 11m 3424 S 0.7 1.2 0:00.02 httpd
5121 root 18 0 98.3m 10m 4320 S 0.3 1.1 0:00.07 httpd
5723 apache 15 0 161m 17m 4240 S 0.3 1.8 0:00.31 httpd
5833 apeadm 15 0 12740 1128 808 R 0.3 0.1 0:00.03 top
5834 apache 15 0 160m 16m 4172 S 0.3 1.7 0:00.20 httpd
5836 apache 15 0 98.5m 9388 2912 S 0.3 1.0 0:00.01 httpd
1 root 15 0 10348 592 560 S 0.0 0.1 0:00.72 init
2 root RT -5 0 0 0 S 0.0 0.0 0:00.01 migration/0
Server Spec:
CENTOS CPU:E5200 RAM:1G
Software: Zencart X 3, Piwik x1
Server always down,How to tuning apache and mysql?
Thanks a lot.
httpd.conf
<IfModule mpm_prefork_module>
StartServers 8
MinSpareServers 8
MaxSpareServers 15
ServerLimit 450
MaxClients 450
MaxRequestsPerChild 10000
</IfModule>
<IfModule mpm_worker_module>
StartServers 2
ServerLimit 450
MaxClients 450
MinSpareThreads 25
MaxSpareThreads 75
ThreadsPerChild 25
MaxRequestsPerChild 10000
</IfModule>
<IfModule mpm_beos_module>
StartThreads 10
MaxClients 50
MaxRequestsPerThread 10000
</IfModule>
<IfModule mpm_netware_module>
ThreadStackSize 65536
StartThreads 250
MinSpareThreads 25
MaxSpareThreads 250
MaxThreads 1000
MaxRequestsPerChild 10000
MaxMemFree 100
</IfModule>
<IfModule mpm_mpmt_os2_module>
StartServers 2
MinSpareThreads 5
MaxSpareThreads 10
MaxRequestsPerChild 10000
</IfModule>
my.cnf
[mysqld]
set-variable = query_cache_limit=1M
set-variable = query_cache_size=16M
set-variable = query_cache_type=1
set-variable = max_connections=400
set-variable = interactive_timeout=100
set-variable = wait_timeout=100
set-variable = connect_timeout=100
set-variable = thread_cache_size=16
#
# Set key_buffer to 5 - 50% of your RAM depending on how much
# you use MyISAM tables, but keep key_buffer_size + InnoDB
# buffer pool size < 80% of your RAM
set-variable = key_buffer=32M
set-variable = join_buffer=1M
set-variable = max_allowed_packet=8M
set-variable = table_cache=1024
set-variable = record_buffer=1M
set-variable = sort_buffer_size=2M
set-variable = read_buffer_size=2M
set-variable = max_connect_errors=10
set-variable = myisam_sort_buffer_size=16M
#Useful for SMP
set-variable = thread_concurrency=8
Server always down,How to tuning apache and mysql?
eh? If its always down how did you get those figures? Tuning isn't going to fix stability issues.
A short answer to how to tune Apache and mysql would fill a large book. Here's some links to books on MysQL: http://forums.mysql.com/read.php?24,92131,92131
And for Apache try searching on Amazon.
Also, you've not provded any information about what's running in between Apache and MySQL - understanding what's going on here is pretty critical too - as is understanding how to improve HTTP and browser performance (caching, keepalives, compression, javascript....).