Dear Tao,<br><br>Thanks for your help. Please find the attach file for output from stat_sysdir.sh (downloaded from <a href="http://oss.oracle.com/~seeda/misc/stat_sysdir.sh">http://oss.oracle.com/~seeda/misc/stat_sysdir.sh</a>, hope it is the right script). <br>
<br>As for o2image, I am generating it right now. Will send it to you once finish.<br><br>If the fragmentation is the real culprit, could it possibly be solved by changing block size?<br><br>Rgds,<br><br clear="all">Somsak<br>
<br><a href="mailto:somsaks@gmail.com" target="_blank">somsaks@gmail.com</a><br><br>
<br><br><div class="gmail_quote">On Fri, Jul 30, 2010 at 9:33 PM, Tao Ma <span dir="ltr"><<a href="http://tao.ma">tao.ma</a>@<a href="http://oracle.com">oracle.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
Hi Somsak,<div class="im"><br>
<br>
On 07/30/2010 12:54 AM, Somsak Sriprayoonsakul wrote:<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
Hi,<br>
<br>
(I am in the same team with Mr. Wanchat)<br>
<br>
Just want to note that we already format OCFS2 with -T mail option. As<br>
note below, data=writeback,noatime, and commit interval has been<br>
increase already.<br>
<br>
The weird thing about this problem is that, OCFS2 will work for like<br>
about 30 days, after that the I/O delay time will increase greatly, to<br>
the point that the system is unusable at all.<br>
<br>
</blockquote>
<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
This problem is quite serious for us. It disrupt the services every<br>
month. Right now the only cure we found is by formating another SAN and<br>
copy everything there (we did it with rsync).<br>
<br>
Right now the old SAN which contains the file system with trouble is<br>
still left intact. We can play around with it since it is not in<br>
production anymore. We can do some debugging on this. Just let us know<br>
what we should do.<br>
</blockquote></div>
I would guess that is because of the file system fragmentation.<br>
So do you have stat_sysdir output?<br>
<br>
And also if you don't mind, can you give us the o2image of the disk? with it we can try to reproduce it locally. For more information about o2image, see man page.<br>
Also please tell us how to reproduce the case in your env.<br>
<br>
Regards,<br>
Tao<br>
<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<br>
<br>
Somsak<br>
<br>
<a href="mailto:somsaks@gmail.com" target="_blank">somsaks@gmail.com</a> <mailto:<a href="mailto:somsaks@gmail.com" target="_blank">somsaks@gmail.com</a>><div class="im"><br>
<br>
<br>
<br>
On Wed, Jul 28, 2010 at 12:33 PM, wanchat padungrat<br></div><div class="im">
<<a href="mailto:wanchat.p@pantip.com" target="_blank">wanchat.p@pantip.com</a> <mailto:<a href="mailto:wanchat.p@pantip.com" target="_blank">wanchat.p@pantip.com</a>>> wrote:<br>
<br>
Dear Sunil,<br>
Thank you for your promptly reply,<br>
Yes, we do mount as data=writeback .<br>
following is our current mount option : type ocfs2<br>
(rw,_netdev,noatime,commit=15,data=writeback,heartbeat=local)<br>
<br>
Wanchat P.<br>
2010/7/28 Sunil Mushran <<a href="mailto:sunil.mushran@oracle.com" target="_blank">sunil.mushran@oracle.com</a><br></div>
<mailto:<a href="mailto:sunil.mushran@oracle.com" target="_blank">sunil.mushran@oracle.com</a>>><div class="im"><br>
<br>
Have you tried mounting with data=writeback ?<br>
<br>
<br>
On Jul 27, 2010, at 9:31 PM, wanchat padungrat<br></div><div class="im">
<<a href="mailto:wanchat.p@pantip.com" target="_blank">wanchat.p@pantip.com</a> <mailto:<a href="mailto:wanchat.p@pantip.com" target="_blank">wanchat.p@pantip.com</a>>> wrote:<br>
<br>
</div><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"><div class="im">
Dear all,<br>
<br>
Not realy sure whether this is bug or not, but we found that<br>
sometimes OCFS2 on our system do journaling a lot.<br>
<br>
(Please see screen shot below)<br>
<br>
As you can see, the IO was jumped from 111 w/s to 11,960 w/s ,<br>
IO utilize jumped from 1.5% to 97% , %iowait jumped from 0.25%<br>
to 10.94%.<br>
<br>
It will not come into question, if this happen in short time<br>
period (eg. 1-2 sec.) , but sometimes we found this persist<br>
for half an hour or even more.<br>
<br>
Is this normal for OCFS2 or not ? How could I tune OCFS2 to<br>
avoid the above situation.<br>
<br>
We also suspect the relation of this symptom with another<br>
problem similar to<br></div>
<<a href="http://oss.oracle.com/pipermail/ocfs2-users/2009-January/003250.html" target="_blank">http://oss.oracle.com/pipermail/ocfs2-users/2009-January/003250.html</a>><a href="http://oss.oracle.com/pipermail/ocfs2-users/2009-January/003250.html" target="_blank">http://oss.oracle.com/pipermail/ocfs2-users/2009-January/003250.html</a><div>
<div></div><div class="h5"><br>
, because we found OCFS2 file system pause for a long period<br>
of time too ( 5-20 Sec. on open for write). Those scattered<br>
happen all day with more frequence during highload time.<br>
(Screen shot below)<br>
<br>
Our configuration is 3 web servers connect to HP SAN Storage<br>
using OCFS2 1.4.7. Amongst those 3 servers , there are 2 for<br>
reading data and 1 for writing data (traffic seperate at proxy<br>
layer) . The symptom above happen on data writing server.<br>
<br>
Thank you.<br>
<br>
Wanchat Padungrat<br>
<br>
PS. We keep our service by reinstall the whole data every<br>
month, without doing whole data copy (consumed 12 hours), the<br>
symptom getting worse an worse eg. journaling persist longer ,<br>
file system pause longer (sometimes more than a minute !!) ...<br>
which affect the whole system , such as, too many waiting<br>
apache process, lavg going skyrocket(sometimes 400+) and<br>
cannot recover itself etc. .<br>
<br>
<br>
<br>
Screen shot<br>
<br>
-----------------<br>
<br>
-----------------------------------------------------------------------------<br>
<br>
Here is iostat+top during journaling process running.<br>
<br>
-----------------------------------------------------------------------------<br>
<br>
avg-cpu: %user %nice %system %iowait %steal %idle<br>
<br>
1.88 0.00 5.38 10.94 0.00 81.81<br>
<br>
Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz<br>
await svctm %util<br>
<br>
sda 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sda1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sda2 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sdb 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sdb1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sdc 0.00 5156.00 5.00 6804.50 19.00 47892.25 14.07 9.76 1.43<br>
0.14 97.55<br>
<br>
sdc1 0.00 5156.00 5.00 6804.50 19.00 47892.25 14.07 9.76 1.43<br>
0.14 97.60<br>
<br>
sdd 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sdd1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sde 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sde1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
dm-1 0.00 0.00 5.00 11960.00 19.00 47838.25 8.00 13.65 1.14<br>
0.08 97.25<br>
<br>
dm-2 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
dm-3 0.00 0.00 5.00 11960.00 19.00 47838.25 8.00 13.66 1.14<br>
0.08 97.30<br>
<br>
-------------------------------------------------------------------------------------------<br>
<br>
Tasks: 215 total, 2 running, 213 sleeping, 0 stopped, 0 zombie<br>
<br>
Cpu(s): 2.5%us, 3.6%sy, 0.0%ni, 81.9%id, 10.9%wa, 0.0%hi,<br>
1.1%si, 0.0%st<br>
<br>
Mem: 12298636k total, 11783892k used, 514744k free, 1679156k<br>
buffers<br>
<br>
Swap: 2048276k total, 396k used, 2047880k free, 6149700k cached<br>
<br>
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND<br>
<br>
3416 root 10 -5 0 0 0 S 5.7 0.0 473:10.53 o2net<br>
<br>
10034 httpd 16 0 192m 18m 2476 D 3.7 0.2 0:43.44 httpd<br>
<br>
16119 httpd 16 0 190m 16m 2200 S 3.7 0.1 0:25.65 httpd<br>
<br>
6660 root 10 -5 0 0 0 D 3.3 0.0 39:15.14 ocfs2cmt <--- Journaling<br>
<br>
20840 httpd 16 0 191m 16m 2168 D 3.3 0.1 0:14.99 httpd<br>
<br>
6659 root 10 -5 0 0 0 S 3.0 0.0 34:32.57 kjournald <---<br>
Journaling<br>
<br>
14282 httpd 16 0 190m 16m 2240 D 2.7 0.1 0:29.31 httpd<br>
<br>
6656 root 11 -5 0 0 0 S 1.7 0.0 79:21.05 dlm_thread<br>
<br>
17159 httpd 16 0 190m 16m 2240 D 1.7 0.1 0:24.06 httpd<br>
<br>
14718 httpd 16 0 192m 18m 2408 D 1.3 0.2 0:28.30 httpd<br>
<br>
6655 root 10 -5 0 0 0 S 1.0 0.0 12:02.41 ocfs2dc<br>
<br>
10041 httpd 16 0 192m 18m 2252 R 1.0 0.2 0:41.68 httpd<br>
<br>
14227 httpd 16 0 191m 17m 2248 D 1.0 0.1 0:29.96 httpd<br>
<br>
14246 httpd 16 0 194m 20m 2236 D 1.0 0.2 0:30.14 httpd<br>
<br>
19852 httpd 16 0 191m 16m 2160 D 1.0 0.1 0:16.72 httpd<br>
<br>
25976 httpd 16 0 191m 16m 2148 D 1.0 0.1 0:05.45 httpd<br>
<br>
6658 root 11 -5 0 0 0 S 0.7 0.0 86:50.46 dlm_wq<br>
<br>
7387 httpd 16 0 201m 27m 2284 D 0.7 0.2 0:49.53 httpd<br>
<br>
9843 httpd 16 0 191m 17m 2288 D 0.7 0.1 0:40.68 httpd<br>
<br>
-------------------------------------------------------------------------------------------<br>
<br>
Here is iostat+top during journaling process sleep (normal run).<br>
<br>
-------------------------------------------------------------------------------------------<br>
<br>
avg-cpu: %user %nice %system %iowait %steal %idle<br>
<br>
3.00 0.00 2.31 0.25 0.00 94.44<br>
<br>
Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz<br>
await svctm %util<br>
<br>
sda 0.00 26.00 0.00 10.50 0.00 146.00 27.81 0.13 12.05 1.38 1.45<br>
<br>
sda1 0.00 26.00 0.00 10.50 0.00 146.00 27.81 0.13 12.05 1.38 1.45<br>
<br>
sda2 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sdb 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sdb1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sdc 0.00 80.50 3.00 31.00 11.00 444.25 26.78 0.05 1.41 0.46 1.55<br>
<br>
sdc1 0.00 80.50 3.00 31.00 11.00 444.25 26.78 0.05 1.41 0.46 1.55<br>
<br>
sdd 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sdd1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sde 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
sde1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
dm-1 0.00 0.00 3.00 111.50 11.00 444.25 7.95 0.13 1.10 0.14 1.55<br>
<br>
dm-2 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00<br>
<br>
dm-3 0.00 0.00 3.00 111.50 11.00 444.25 7.95 0.13 1.11 0.14 1.55<br>
<br>
-------------------------------------------------------------------------------------------<br>
<br>
top - 15:44:49 up 12 days, 2:21, 1 user, load average: 0.72,<br>
9.27, 15.66<br>
<br>
Tasks: 215 total, 1 running, 214 sleeping, 0 stopped, 0 zombie<br>
<br>
Cpu(s): 2.2%us, 1.0%sy, 0.0%ni, 96.0%id, 0.2%wa, 0.0%hi,<br>
0.5%si, 0.0%st<br>
<br>
Mem: 12298636k total, 11832348k used, 466288k free, 1688052k<br>
buffers<br>
<br>
Swap: 2048276k total, 396k used, 2047880k free, 6215116k cached<br>
<br>
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND<br>
<br>
26088 httpd 16 0 189m 15m 2152 S 4.0 0.1 0:11.31 httpd<br>
<br>
3416 root 11 -5 0 0 0 S 3.3 0.0 474:07.19 o2net<br>
<br>
29193 httpd 15 0 191m 17m 2152 S 3.0 0.1 0:05.16 httpd<br>
<br>
9842 httpd 15 0 191m 17m 2252 S 2.7 0.1 0:47.80 httpd<br>
<br>
14329 httpd 15 0 191m 16m 2240 S 2.7 0.1 0:35.21 httpd<br>
<br>
13245 httpd 15 0 190m 16m 2272 S 1.7 0.1 0:37.53 httpd<br>
<br>
14719 httpd 16 0 190m 16m 2240 S 1.3 0.1 0:31.97 httpd<br>
<br>
6658 root 11 -5 0 0 0 D 1.0 0.0 86:59.26 dlm_wq<br>
<br>
10039 httpd 16 0 190m 16m 2328 S 0.7 0.1 0:44.13 httpd<br>
<br>
10041 httpd 16 0 191m 17m 2252 S 0.7 0.1 0:46.10 httpd<br>
<br>
16120 httpd 15 0 190m 16m 2240 S 0.7 0.1 0:36.17 httpd<br>
<br>
6656 root 10 -5 0 0 0 D 0.3 0.0 79:35.89 dlm_thread<br>
<br>
9844 httpd 15 0 188m 14m 2260 S 0.3 0.1 0:47.96 httpd<br>
<br>
9845 httpd 15 0 191m 17m 2292 S 0.3 0.1 0:46.30 httpd<br>
<br>
14227 httpd 15 0 192m 18m 2248 S 0.3 0.2 0:35.18 httpd<br>
<br>
14232 httpd 15 0 190m 16m 2244 S 0.3 0.1 0:33.24 httpd<br>
<br>
14247 httpd 15 0 190m 16m 2164 S 0.3 0.1 0:35.52 httpd<br>
<br>
14281 httpd 15 0 189m 15m 2272 S 0.3 0.1 0:36.51 httpd<br>
<br>
14327 httpd 15 0 192m 18m 2196 S 0.3 0.2 0:35.16 httpd<br>
<br>
14331 httpd 15 0 190m 16m 2240 S 0.3 0.1 0:33.99 httpd<br>
<br>
<br>
<br>
-------------------------------------------------------------------------------------------<br>
<br>
Lag on open file for write shown by strace simple cp command,<br>
<br>
the symptom appear at bottom of the list<br>
<br>
------------------------------------------------------------------------------------------<br>
<br>
[root@cafe4 wanchat-san1]# strace -T cp source_file<br>
destiantion_file<br>
<br>
execve("/bin/cp", ["cp", "source_file", "destiantion_file"],<br>
[/* 22 vars */]) = 0 <0.000210><br>
<br>
brk(0) = 0x2347000 <0.000006><br>
<br>
mmap(NULL, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b6d685af000 <0.000006><br>
<br>
uname({sys="Linux", node="<br></div></div>
<<a href="http://cafe4.pantip.com/" target="_blank">http://cafe4.pantip.com/</a>><a href="http://cafe4.pantip.com" target="_blank">cafe4.pantip.com</a><br>
<<a href="http://cafe4.pantip.com/" target="_blank">http://cafe4.pantip.com/</a>>", ...}) = 0 <0.000006><div><div></div><div class="h5"><br>
<br>
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file<br>
or directory) <0.000008><br>
<br>
open("/etc/ld.so.cache", O_RDONLY) = 3 <0.000009><br>
<br>
fstat(3, {st_mode=S_IFREG|0644, st_size=63180, ...}) = 0<br>
<0.000006><br>
<br>
mmap(NULL, 63180, PROT_READ, MAP_PRIVATE, 3, 0) =<br>
0x2b6d685b0000 <0.000010><br>
<br>
close(3) = 0 <0.000007><br>
<br>
open("/lib64/libacl.so.1", O_RDONLY) = 3 <0.000013><br>
<br>
read(3,<br>
"\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\0\31`\0379\0\0\0"...,<br>
832) = 832 <0.000008><br>
<br>
fstat(3, {st_mode=S_IFREG|0755, st_size=28008, ...}) = 0<br>
<0.000020><br>
<br>
mmap(NULL, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b6d685c0000 <0.000008><br>
<br>
mmap(0x391f600000, 2120992, PROT_READ|PROT_EXEC,<br>
MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x391f600000 <0.000010><br>
<br>
mprotect(0x391f606000, 2093056, PROT_NONE) = 0 <0.000012><br>
<br>
mmap(0x391f805000, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5000) = 0x391f805000<br>
<0.000007><br>
<br>
close(3) = 0 <0.000005><br>
<br>
open("/lib64/libselinux.so.1", O_RDONLY) = 3 <0.000007><br>
<br>
read(3,<br>
"\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`E\240\0369\0\0\0"...,<br>
832) = 832 <0.000006><br>
<br>
fstat(3, {st_mode=S_IFREG|0755, st_size=95464, ...}) = 0<br>
<0.000005><br>
<br>
mmap(0x391ea00000, 2192784, PROT_READ|PROT_EXEC,<br>
MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x391ea00000 <0.000007><br>
<br>
mprotect(0x391ea15000, 2097152, PROT_NONE) = 0 <0.000007><br>
<br>
mmap(0x391ec15000, 8192, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x15000) =<br>
0x391ec15000 <0.000011><br>
<br>
mmap(0x391ec17000, 1424, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x391ec17000<br>
<0.000010><br>
<br>
close(3) = 0 <0.000007><br>
<br>
open("/lib64/libattr.so.1", O_RDONLY) = 3 <0.000012><br>
<br>
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\320\17<br>
\0369\0\0\0"..., 832) = 832 <0.000007><br>
<br>
fstat(3, {st_mode=S_IFREG|0755, st_size=17888, ...}) = 0<br>
<0.000005><br>
<br>
mmap(0x391e200000, 2110728, PROT_READ|PROT_EXEC,<br>
MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x391e200000 <0.000007><br>
<br>
mprotect(0x391e204000, 2093056, PROT_NONE) = 0 <0.000011><br>
<br>
mmap(0x391e403000, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3000) = 0x391e403000<br>
<0.000012><br>
<br>
close(3) = 0 <0.000007><br>
<br>
open("/lib64/libc.so.6", O_RDONLY) = 3 <0.000012><br>
<br>
read(3,<br>
"\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220\332!\0359\0\0\0"...,<br>
832) = 832 <0.000009><br>
<br>
fstat(3, {st_mode=S_IFREG|0755, st_size=1717800, ...}) = 0<br>
<0.000005><br>
<br>
mmap(NULL, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b6d685c1000 <0.000009><br>
<br>
mmap(0x391d200000, 3498328, PROT_READ|PROT_EXEC,<br>
MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x391d200000 <0.000009><br>
<br>
mprotect(0x391d34d000, 2097152, PROT_NONE) = 0 <0.000009><br>
<br>
mmap(0x391d54d000, 20480, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x14d000) =<br>
0x391d54d000 <0.000011><br>
<br>
mmap(0x391d552000, 16728, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x391d552000<br>
<0.000014><br>
<br>
close(3) = 0 <0.000005><br>
<br>
open("/lib64/libdl.so.2", O_RDONLY) = 3 <0.000012><br>
<br>
read(3,<br>
"\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\20\16`\0359\0\0\0"...,<br>
832) = 832 <0.000008><br>
<br>
fstat(3, {st_mode=S_IFREG|0755, st_size=23360, ...}) = 0<br>
<0.000007><br>
<br>
mmap(0x391d600000, 2109696, PROT_READ|PROT_EXEC,<br>
MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x391d600000 <0.000009><br>
<br>
mprotect(0x391d602000, 2097152, PROT_NONE) = 0 <0.000007><br>
<br>
mmap(0x391d802000, 8192, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x391d802000<br>
<0.000007><br>
<br>
close(3) = 0 <0.000005><br>
<br>
open("/lib64/libsepol.so.1", O_RDONLY) = 3 <0.000009><br>
<br>
read(3,<br>
"\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\0=`\0369\0\0\0"...,<br>
832) = 832 <0.000006><br>
<br>
fstat(3, {st_mode=S_IFREG|0755, st_size=247496, ...}) = 0<br>
<0.000005><br>
<br>
mmap(0x391e600000, 2383136, PROT_READ|PROT_EXEC,<br>
MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x391e600000 <0.000006><br>
<br>
mprotect(0x391e63b000, 2097152, PROT_NONE) = 0 <0.000007><br>
<br>
mmap(0x391e83b000, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3b000) =<br>
0x391e83b000 <0.000008><br>
<br>
mmap(0x391e83c000, 40224, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x391e83c000<br>
<0.000007><br>
<br>
close(3) = 0 <0.000005><br>
<br>
mmap(NULL, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b6d685c2000 <0.000005><br>
<br>
mmap(NULL, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b6d685c3000 <0.000005><br>
<br>
arch_prctl(ARCH_SET_FS, 0x2b6d685c2f90) = 0 <0.000005><br>
<br>
mprotect(0x391d54d000, 16384, PROT_READ) = 0 <0.000007><br>
<br>
mprotect(0x391d802000, 4096, PROT_READ) = 0 <0.000006><br>
<br>
mprotect(0x391d01b000, 4096, PROT_READ) = 0 <0.000005><br>
<br>
munmap(0x2b6d685b0000, 63180) = 0 <0.000010><br>
<br>
access("/etc/selinux/", F_OK) = 0 <0.000007><br>
<br>
brk(0) = 0x2347000 <0.000005><br>
<br>
brk(0x2368000) = 0x2368000 <0.000005><br>
<br>
open("/etc/selinux/config", O_RDONLY) = 3 <0.000013><br>
<br>
fstat(3, {st_mode=S_IFREG|0644, st_size=511, ...}) = 0 <0.000005><br>
<br>
mmap(NULL, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b6d685b0000 <0.000005><br>
<br>
read(3, "# This file controls the state o"..., 4096) = 511<br>
<0.000009><br>
<br>
read(3, "", 4096) = 0 <0.000006><br>
<br>
close(3) = 0 <0.000006><br>
<br>
munmap(0x2b6d685b0000, 4096) = 0 <0.000008><br>
<br>
open("/proc/mounts", O_RDONLY) = 3 <0.000033><br>
<br>
fstat(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0 <0.000005><br>
<br>
mmap(NULL, 4096, PROT_READ|PROT_WRITE,<br>
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b6d685b0000 <0.000005><br>
<br>
read(3, "rootfs / rootfs rw 0 0\n/dev/root"..., 4096) = 667<br>
<0.000041><br>
<br>
read(3, "", 4096) = 0 <0.000005><br>
<br>
close(3) = 0 <0.000006><br>
<br>
munmap(0x2b6d685b0000, 4096) = 0 <0.000007><br>
<br>
open("/proc/filesystems", O_RDONLY) = 3 <0.000011><br>
<br>
read(3, "nodev\tsysfs\nnodev\trootfs\nnodev\tb"..., 4095) =<br>
354 <0.000014><br>
<br>
close(3) = 0 <0.000006><br>
<br>
open("/usr/lib/locale/locale-archive", O_RDONLY) = 3 <0.000010><br>
<br>
fstat(3, {st_mode=S_IFREG|0644, st_size=56471264, ...}) = 0<br>
<0.000005><br>
<br>
mmap(NULL, 56471264, PROT_READ, MAP_PRIVATE, 3, 0) =<br>
0x2b6d685c4000 <0.000006><br>
<br>
close(3) = 0 <0.000004><br>
<br>
geteuid() = 0 <0.000006><br>
<br>
stat("destiantion_file", {st_mode=S_IFREG|0644, st_size=1307,<br>
...}) = 0 <0.000013><br>
<br>
stat("source_file", {st_mode=S_IFREG|0644, st_size=1307, ...})<br>
= 0 <0.000009><br>
<br>
stat("destiantion_file", {st_mode=S_IFREG|0644, st_size=1307,<br>
...}) = 0 <0.000008><br>
<br>
open("source_file", O_RDONLY) = 3 <0.000022><br>
<br>
fstat(3, {st_mode=S_IFREG|0644, st_size=1307, ...}) = 0 <0.000005><br>
<br>
open("destiantion_file", O_WRONLY|O_TRUNC) = 4 <8.159196><br>
<------ 8 Sec ! During normal condition 0.000034<br>
<br>
fstat(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0 <0.000008><br>
<br>
fstat(3, {st_mode=S_IFREG|0644, st_size=1307, ...}) = 0 <0.000007><br>
<br>
read(3, "Linux 2.6.18-194.3.1.el5 (cafe4."..., 4096) = 1307<br>
<0.000012><br>
<br>
write(4, "Linux 2.6.18-194.3.1.el5 (cafe4."..., 1307) = 1307<br>
<0.003315><br>
<br>
read(3, "", 4096) = 0 <0.000010><br>
<br>
close(4) = 0 <0.000006><br>
<br>
close(3) = 0 <0.000007><br>
<br>
close(1) = 0 <0.000005><br>
<br>
exit_group(0) = ?<br>
<br>
_______________________________________________<br>
Ocfs2-users mailing list<br></div></div>
<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a> <mailto:<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a>><div class="im">
<br>
<a href="http://oss.oracle.com/mailman/listinfo/ocfs2-users" target="_blank">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a><br>
</div></blockquote>
<br>
_______________________________________________<br>
Ocfs2-users mailing list<br>
<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a> <mailto:<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a>><div class="im">
<br>
<a href="http://oss.oracle.com/mailman/listinfo/ocfs2-users" target="_blank">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a><br>
<br>
<br>
<br>
_______________________________________________<br>
Ocfs2-users mailing list<br></div>
<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a> <mailto:<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a>><div class="im"><br>
<a href="http://oss.oracle.com/mailman/listinfo/ocfs2-users" target="_blank">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a><br>
<br>
<br>
<br>
<br>
_______________________________________________<br>
Ocfs2-users mailing list<br>
<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a><br>
<a href="http://oss.oracle.com/mailman/listinfo/ocfs2-users" target="_blank">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a><br>
</div></blockquote>
</blockquote></div><br>