<p dir="ltr">Dump some kernel/user stacks to see if we can narrow down the loop it is spinning in.</p>
<p dir="ltr">cat /process/PID/stack will show the kernel stack<br>
pstack should show user stack.</p>
<div class="gmail_quote">On May 2, 2014 8:12 AM, <<a href="mailto:molo.coc@web.de">molo.coc@web.de</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><div style="font-family:Verdana;font-size:12.0px"><div>
<div>its PHP-FPM</div>
<div><br>
root 1951 1.5 0.1 362344 7704 ? Ss 17:09 0:01 php-fpm: master process (/etc/php5/fpm/php-fpm.conf) <br>
www-data 1953 0.0 0.<a href="tel:1%20360340%C2%A0%204868" value="+13603404868" target="_blank">1 360340 4868</a> ? S 17:09 0:00 php-fpm: pool www <br>
www-data 1954 0.0 0.<a href="tel:1%20360340%C2%A0%204868" value="+13603404868" target="_blank">1 360340 4868</a> ? S 17:09 0:00 php-fpm: pool www <br>
www-data 1955 0.0 0.<a href="tel:1%20360340%C2%A0%204868" value="+13603404868" target="_blank">1 360340 4868</a> ? S 17:09 0:00 php-fpm: pool www <br>
www-data 1956 0.0 0.<a href="tel:1%20360340%C2%A0%204868" value="+13603404868" target="_blank">1 360340 4868</a> ? S 17:09 0:00 php-fpm: pool www <br>
web1 2439 26.5 0.7 376132 30328 ? R 17:10 0:17 php-fpm: pool web1 <br>
web1 2442 18.3 0.6 375592 25524 ? R 17:10 0:11 php-fpm: pool web1 <br>
web1 2451 21.3 0.5 374200 21792 ? R 17:10 0:08 php-fpm: pool web1 <br>
web1 2453 27.0 0.3 366288 13960 ? R 17:10 0:11 php-fpm: pool web1 <br>
web1 2454 25.5 0.2 364068 9244 ? R 17:10 0:10 php-fpm: pool web1 <br>
web1 2455 31.6 0.2 364072 9716 ? R 17:10 0:12 php-fpm: pool web1 <br>
web1 2456 19.4 0.2 364312 9048 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2458 22.9 0.2 364068 9108 ? R 17:10 0:08 php-fpm: pool web1 <br>
web1 2459 26.7 0.2 364068 9152 ? R 17:10 0:10 php-fpm: pool web1 <br>
web1 2460 19.3 0.2 364020 9136 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2461 23.4 0.2 364068 9092 ? R 17:10 0:09 php-fpm: pool web1 <br>
web1 2462 19.6 0.2 364068 8948 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2463 23.7 0.2 364072 8988 ? R 17:10 0:09 php-fpm: pool web1 <br>
web1 2466 27.2 0.2 364068 9072 ? R 17:10 0:10 php-fpm: pool web1 <br>
web1 2471 24.2 0.2 364040 9160 ? R 17:10 0:08 php-fpm: pool web1 <br>
web1 2472 20.7 0.2 364068 8948 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2473 21.2 0.2 364068 8912 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2482 19.8 0.2 364068 8924 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2483 22.0 0.2 364068 8964 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2484 22.4 0.2 364068 8984 ? R 17:10 0:08 php-fpm: pool web1 <br>
web1 2485 22.2 0.2 364068 8904 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2486 16.5 0.2 364068 8852 ? R 17:10 0:05 php-fpm: pool web1 <br>
web1 2487 22.4 0.2 364076 8864 ? R 17:10 0:07 php-fpm: pool web1 <br>
web1 2488 24.3 0.2 364068 9020 ? R 17:10 0:08 php-fpm: pool web1 <br>
web1 2499 29.7 0.2 364068 9080 ? R 17:10 0:10 php-fpm: pool web1 <br>
web1 2500 19.8 0.2 364068 8996 ? R 17:10 0:06 php-fpm: pool web1 <br>
web1 2502 31.3 0.2 364068 9168 ? R 17:10 0:10 php-fpm: pool web1 <br>
web1 2503 20.9 0.2 364020 8984 ? R 17:10 0:07 php-fpm: pool web1 </div>
<div>
<div>root 2277 1.3 0.4 438232 16256 ? Ss 17:09 0:01 /usr/sbin/apache2 -k start<br>
www-data 2283 0.3 0.0 134164 3928 ? S 17:09 0:00 /usr/sbin/apache2 -k start<br>
www-data 2293 2.2 0.2 439204 9904 ? S 17:09 0:02 /usr/sbin/apache2 -k start<br>
www-data 2294 1.4 0.2 439572 10616 ? S 17:09 0:01 /usr/sbin/apache2 -k start<br>
www-data 2295 2.7 0.2 439288 10016 ? S 17:09 0:02 /usr/sbin/apache2 -k start<br>
www-data 2296 2.9 0.2 439632 10364 ? S 17:09 0:03 /usr/sbin/apache2 -k start<br>
www-data 2297 2.9 0.2 439204 10052 ? S 17:09 0:03 /usr/sbin/apache2 -k start<br>
www-data 2440 3.5 0.2 439196 10016 ? S 17:10 0:03 /usr/sbin/apache2 -k start<br>
www-data 2443 1.5 0.2 439300 10160 ? S 17:10 0:01 /usr/sbin/apache2 -k start<br>
www-data 2444 0.2 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2445 0.5 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2446 0.4 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2447 0.4 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2448 0.4 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2449 0.3 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2450 0.5 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2457 0.9 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2464 0.2 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2465 0.3 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2467 0.5 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2468 0.4 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2469 0.5 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2470 0.4 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2474 0.1 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2475 0.3 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2476 0.4 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2477 0.4 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2478 0.3 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2479 0.3 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2480 0.2 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2481 0.2 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2489 0.2 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2490 0.1 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2491 0.4 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2492 0.1 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2493 3.1 0.2 439132 9908 ? S 17:10 0:01 /usr/sbin/apache2 -k start<br>
www-data 2494 0.1 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2495 0.2 0.2 439188 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2496 1.5 0.2 439132 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2498 1.6 0.2 439132 9908 ? S 17:10 0:01 /usr/sbin/apache2 -k start<br>
www-data 2501 0.8 0.2 439132 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2505 0.6 0.2 439132 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2506 0.7 0.2 439132 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2507 0.6 0.2 439132 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start<br>
www-data 2508 0.8 0.2 439132 9908 ? S 17:10 0:00 /usr/sbin/apache2 -k start</div>
<div> </div>
</div>
<div>Which process is pegging the CPU?</div>
<div>
<div name="quote" style="margin:10px 5px 5px 10px;padding:10px 0 10px 10px;border-left:2px solid #c3d9e5;word-wrap:break-word">
<div name="quoted-content">
<div class="gmail_quote">On May 2, 2014 6:12 AM, <<a href="http://molo.coc@web.de" target="_blank">molo.coc@web.de</a>> wrote:
<blockquote class="gmail_quote" style="margin:0 0 0 0.8ex;border-left:1.0px rgb(204,204,204) solid;padding-left:1.0ex">
<div>
<div style="font-family:Verdana;font-size:12.0px">
<div>We have two nodes which are serving PHP webpages with PHP5-FPM. Both Nodes are configured with drbd in dual primary mode.</div>
<div>In our tests, if one of these two nodes get 10-20 Pagerefresh's at the same time, the CPU are 100% in use.</div>
<div>For these 10-20 Pagerequests the server are 1.5 minutes busy.</div>
<div> </div>
<div>Without OCFS (harddrive is formatted with ext4) for the same 10-20 requests, it tooks only 0.1 Seconds to complete.</div>
<div>We only see a long running PHP Process which get timeouted sometime with '30 seconds exceeded for including a file' . We tried mounting the ocfs2 device with 'noatime, nodiratime, data=writeback', but it didn't helped.</div>
<div> </div>
<div>does someone has a tip for us ?</div>
<div>(If we use ocfs2 with icsci, there are no changes)</div>
<div> </div>
<div>thanks a lot!</div>
</div>
</div>
<br>
_______________________________________________<br>
Ocfs2-users mailing list<br>
<a href="http://Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a><br>
<a href="https://oss.oracle.com/mailman/listinfo/ocfs2-users" target="_blank">https://oss.oracle.com/mailman/listinfo/ocfs2-users</a></blockquote>
</div>
</div>
</div>
</div>
</div></div></div>
</blockquote></div>