[Ocfs2-users] ocfs2 - Kernel panic on many write/read from bothservers
Marek Krolikowski
admin at wset.edu.pl
Sat Dec 17 07:30:30 PST 2011
This is empty filesystem.
I just create and copy/delete files from local hdd /usr to EMC storage with
OCFS2.
I create via command:
mkfs.ocfs2 -L NEW-PLK --fs-feature-level=max-features /dev/dm-0
and i run scripts on both servers:
MAIL1# cat terror2.sh
#!/bin/bash
while true
do
rm -rf /mnt/EMC/MAIL1
mkdir /mnt/EMC/MAIL1
cp -r /usr /mnt/EMC/MAIL1
rm -rf /mnt/EMC/MAIL1
done;
MAIL2# cat terror2.sh
#!/bin/bash
while true
do
rm -rf /mnt/EMC/MAIL2
mkdir /mnt/EMC/MAIL2
cp -r /usr /mnt/EMC/MAIL2
rm -rf /mnt/EMC/MAIL2
done;
Thanks for help
-----Oryginalna wiadomość-----
From: Eduardo Diaz - Gmail
Sent: Saturday, December 17, 2011 2:21 PM
To: Marek Królikowski
Cc: ocfs2-users at oss.oracle.com
Subject: Re: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
bothservers
Save you data and, recreate the filesystem again and restore??
regards!
2011/12/17 Marek Królikowski <admin at wset.edu.pl>:
> I just check what You say and i download and compile:
> http://public-yum.oracle.com/repo/OracleLinux/OL6/2/base/x86_64/kernel-uek-2.6.32-300.3.1.el6uek.src.rpm
> with x86_64 config file from this RPM
> But almost this same effect:
> INFO: task rm:32379 blocked for more than 120 seconds.
> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> rm D 000000010099fb65 0 32379 16422 0x00000000
> ffff880252d31bc8 0000000000000082 ffff880252d31b18 ffffffff81450ce3
> ffff880252d31b48 ffff880252d2e400 0000000000014c00 ffff880252d31fd8
> 0000000000014c00 0000000000014c00 0000000000014c00 ffff880252d31fd8
> Call Trace:
> [<ffffffff81450ce3>] ? _spin_unlock_irqrestore+0x17/0x19
> [<ffffffffa086fd73>] ? ocfs2_read_blocks+0x67e/0x760 [ocfs2]
> [<ffffffff8144fedf>] __mutex_lock_common.clone.3+0x139/0x1a0
> [<ffffffffa08bed15>] ? ocfs2_get_system_file_inode+0x5d/0x1c0 [ocfs2]
> [<ffffffff8144ff59>] __mutex_lock_slowpath+0x13/0x15
> [<ffffffff8144fd8c>] mutex_lock+0x23/0x3d
> [<ffffffffa089b4f6>] ocfs2_lookup_lock_orphan_dir+0xa8/0x168 [ocfs2]
> [<ffffffff8108872d>] ? __raw_local_irq_save+0x1d/0x23
> [<ffffffffa089b9e5>] ocfs2_prepare_orphan_dir+0x3d/0x1fb [ocfs2]
> [<ffffffffa089c54a>] ocfs2_unlink+0x544/0xaa9 [ocfs2]
> [<ffffffff81044abc>] ? need_resched+0x23/0x2d
> [<ffffffff81124903>] vfs_unlink+0x7a/0xb7
> [<ffffffff81125436>] do_unlinkat+0xd1/0x15f
> [<ffffffff8111a2d3>] ? fput+0x26/0x2b
> [<ffffffff81013ac4>] ? math_state_restore+0x52/0x57
> [<ffffffff81126656>] sys_unlinkat+0x29/0x2b
> [<ffffffff81011db2>] system_call_fastpath+0x16/0x1b
>
> Have a nice weekend.
>
> -----Oryginalna wiadomość-----
> From: Kushnir, Michael (NIH/NLM/LHC) [C]
> Sent: Friday, December 16, 2011 5:34 PM
> To: Marek Królikowski ; ocfs2-users at oss.oracle.com
> Subject: RE: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
> bothservers
>
> I was under the impression that OCFS2 1.6 only works with UEK...
>
> Thanks,
> Michael
>
>
>
> -----Original Message-----
> From: Marek Królikowski [mailto:admin at wset.edu.pl]
> Sent: Friday, December 16, 2011 11:27 AM
> To: ocfs2-users at oss.oracle.com
> Subject: Re: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
> both
> servers
>
> I got everything new on server and this is a problem - on old servers
> OCFS2
> working good so new version ocfs2 or kernel got BUG.
> Check kernel 3.1.X and ocfs-tools 1.6.X and u see u get kernel panic i
> check
> forums and many ppl got this same effect on new instances of OCFS2
> clusters..
>
> -----Oryginalna wiadomość-----
> From: Eduardo Diaz - Gmail
> Sent: Friday, December 16, 2011 4:34 PM
> To: Marek Królikowski
> Cc: ocfs2-users at oss.oracle.com
> Subject: Re: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
> both
> servers
>
> My recomendation is upgrade all y recreate the filesystem in the cluster..
>
> If you need profesional help please make a support or use profesional...
> ocfs2 is very hard to use if you don't know how to use it..
>
> the list is for help, or not, but it is free..
>
> 2011/12/15 Marek Królikowski <admin at wset.edu.pl>:
>> Anyone can help wme with this?
>>
>>
>>
>> -----Oryginalna wiadomość-----
>> From: Marek Królikowski
>> Sent: Sunday, December 04, 2011 11:15 AM
>> To: ocfs2-users at oss.oracle.com
>> Subject: ocfs2 - Kernel panic on many write/read from both servers
>>
>> I do for all night tests with write/read files from ocfs2 on both
>> servers something like this:
>> On MAIL1 server:
>> #!/bin/bash
>> while true
>> do
>> rm -rf /mnt/EMC/MAIL1
>> mkdir /mnt/EMC/MAIL1
>> cp -r /usr /mnt/EMC/MAIL1
>> rm -rf /mnt/EMC/MAIL1
>> done;
>> On MAIL2 server:
>> #!/bin/bash
>> while true
>> do
>> rm -rf /mnt/EMC/MAIL2
>> mkdir /mnt/EMC/MAIL2
>> cp -r /usr /mnt/EMC/MAIL2
>> rm -rf /mnt/EMC/MAIL2
>> done;
>>
>> Today i check logs and see:
>> o2dlm: Node 1 joins domain EAC7942B71964050AE2046D3F0CDD7B2
>> o2dlm: Nodes in domain EAC7942B71964050AE2046D3F0CDD7B2: 0 1
>> (rm,26136,0):ocfs2_unlink:953 ERROR: status = -2
>> (touch,26137,0):ocfs2_check_dir_for_entry:2120 ERROR: status = -17
>> (touch,26137,0):ocfs2_mknod:461 ERROR: status = -17
>> (touch,26137,0):ocfs2_create:631 ERROR: status = -17
>> (rm,26142,0):ocfs2_unlink:953 ERROR: status = -2
>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>> manage_workers.clone.21+0x120/0x120
>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>> gs_change+0x13/0x13
>> INFO: task rm:5192 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>> system_call_fastpath+0x16/0x1b
>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>> manage_workers.clone.21+0x120/0x120
>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>> gs_change+0x13/0x13
>> INFO: task rm:5192 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>> system_call_fastpath+0x16/0x1b
>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>> manage_workers.clone.21+0x120/0x120
>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>> gs_change+0x13/0x13
>> INFO: task rm:5192 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>> system_call_fastpath+0x16/0x1b
>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>> manage_workers.clone.21+0x120/0x120
>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>> gs_change+0x13/0x13
>> INFO: task rm:5192 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>> system_call_fastpath+0x16/0x1b
>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>> manage_workers.clone.21+0x120/0x120
>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>> gs_change+0x13/0x13
>> INFO: task rm:5192 blocked for more than 120 seconds.
>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>> Call Trace:
>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>> system_call_fastpath+0x16/0x1b
>>
>>
>> _______________________________________________
>> Ocfs2-users mailing list
>> Ocfs2-users at oss.oracle.com
>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users
More information about the Ocfs2-users
mailing list