[Ocfs2-users] ocfs2 - Kernel panic on many write/read from bothservers
Marek Królikowski
admin at wset.edu.pl
Sun Dec 18 11:39:42 PST 2011
I do this but don`t help.
-----Oryginalna wiadomość-----
From: Eduardo Diaz - Gmail
Sent: Sunday, December 18, 2011 8:37 PM
To: Marek Królikowski
Cc: ocfs2-users at oss.oracle.com
Subject: Re: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
bothservers
you must use the features that you need..
and the nodes? if you has 2 nodes use N 2
regards!
2011/12/18 Marek Królikowski <admin at wset.edu.pl>:
> Hey
> Why max-features - i read in documentation to use this and number of nodes
> i
> give 2 and don`t help that`s why i don`t give this option - default is 16
> ;-)
>
>
>
> -----Oryginalna wiadomość-----
> From: Eduardo Diaz - Gmail
> Sent: Sunday, December 18, 2011 7:12 PM
> To: Marek Krolikowski
> Cc: ocfs2-users at oss.oracle.com
> Subject: Re: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
> bothservers
>
> Why use max-features? use -n number_of_nodes ..
>
> regards!
>
> On Sat, Dec 17, 2011 at 4:30 PM, Marek Krolikowski <admin at wset.edu.pl>
> wrote:
>> This is empty filesystem.
>> I just create and copy/delete files from local hdd /usr to EMC storage
>> with
>> OCFS2.
>> I create via command:
>> mkfs.ocfs2 -L NEW-PLK --fs-feature-level=max-features /dev/dm-0
>>
>> and i run scripts on both servers:
>> MAIL1# cat terror2.sh
>> #!/bin/bash
>> while true
>> do
>> rm -rf /mnt/EMC/MAIL1
>> mkdir /mnt/EMC/MAIL1
>> cp -r /usr /mnt/EMC/MAIL1
>> rm -rf /mnt/EMC/MAIL1
>> done;
>>
>> MAIL2# cat terror2.sh
>> #!/bin/bash
>> while true
>> do
>> rm -rf /mnt/EMC/MAIL2
>> mkdir /mnt/EMC/MAIL2
>> cp -r /usr /mnt/EMC/MAIL2
>> rm -rf /mnt/EMC/MAIL2
>> done;
>>
>> Thanks for help
>>
>>
>> -----Oryginalna wiadomość-----
>> From: Eduardo Diaz - Gmail
>> Sent: Saturday, December 17, 2011 2:21 PM
>> To: Marek Królikowski
>> Cc: ocfs2-users at oss.oracle.com
>> Subject: Re: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
>> bothservers
>>
>> Save you data and, recreate the filesystem again and restore??
>> regards!
>>
>> 2011/12/17 Marek Królikowski <admin at wset.edu.pl>:
>>> I just check what You say and i download and compile:
>>> http://public-yum.oracle.com/repo/OracleLinux/OL6/2/base/x86_64/kernel-uek-2.6.32-300.3.1.el6uek.src.rpm
>>> with x86_64 config file from this RPM
>>> But almost this same effect:
>>> INFO: task rm:32379 blocked for more than 120 seconds.
>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>> message.
>>> rm D 000000010099fb65 0 32379 16422 0x00000000
>>> ffff880252d31bc8 0000000000000082 ffff880252d31b18 ffffffff81450ce3
>>> ffff880252d31b48 ffff880252d2e400 0000000000014c00 ffff880252d31fd8
>>> 0000000000014c00 0000000000014c00 0000000000014c00 ffff880252d31fd8
>>> Call Trace:
>>> [<ffffffff81450ce3>] ? _spin_unlock_irqrestore+0x17/0x19
>>> [<ffffffffa086fd73>] ? ocfs2_read_blocks+0x67e/0x760 [ocfs2]
>>> [<ffffffff8144fedf>] __mutex_lock_common.clone.3+0x139/0x1a0
>>> [<ffffffffa08bed15>] ? ocfs2_get_system_file_inode+0x5d/0x1c0 [ocfs2]
>>> [<ffffffff8144ff59>] __mutex_lock_slowpath+0x13/0x15
>>> [<ffffffff8144fd8c>] mutex_lock+0x23/0x3d
>>> [<ffffffffa089b4f6>] ocfs2_lookup_lock_orphan_dir+0xa8/0x168 [ocfs2]
>>> [<ffffffff8108872d>] ? __raw_local_irq_save+0x1d/0x23
>>> [<ffffffffa089b9e5>] ocfs2_prepare_orphan_dir+0x3d/0x1fb [ocfs2]
>>> [<ffffffffa089c54a>] ocfs2_unlink+0x544/0xaa9 [ocfs2]
>>> [<ffffffff81044abc>] ? need_resched+0x23/0x2d
>>> [<ffffffff81124903>] vfs_unlink+0x7a/0xb7
>>> [<ffffffff81125436>] do_unlinkat+0xd1/0x15f
>>> [<ffffffff8111a2d3>] ? fput+0x26/0x2b
>>> [<ffffffff81013ac4>] ? math_state_restore+0x52/0x57
>>> [<ffffffff81126656>] sys_unlinkat+0x29/0x2b
>>> [<ffffffff81011db2>] system_call_fastpath+0x16/0x1b
>>>
>>> Have a nice weekend.
>>>
>>> -----Oryginalna wiadomość-----
>>> From: Kushnir, Michael (NIH/NLM/LHC) [C]
>>> Sent: Friday, December 16, 2011 5:34 PM
>>> To: Marek Królikowski ; ocfs2-users at oss.oracle.com
>>> Subject: RE: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
>>> bothservers
>>>
>>> I was under the impression that OCFS2 1.6 only works with UEK...
>>>
>>> Thanks,
>>> Michael
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Marek Królikowski [mailto:admin at wset.edu.pl]
>>> Sent: Friday, December 16, 2011 11:27 AM
>>> To: ocfs2-users at oss.oracle.com
>>> Subject: Re: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
>>> both
>>> servers
>>>
>>> I got everything new on server and this is a problem - on old servers
>>> OCFS2
>>> working good so new version ocfs2 or kernel got BUG.
>>> Check kernel 3.1.X and ocfs-tools 1.6.X and u see u get kernel panic i
>>> check
>>> forums and many ppl got this same effect on new instances of OCFS2
>>> clusters..
>>>
>>> -----Oryginalna wiadomość-----
>>> From: Eduardo Diaz - Gmail
>>> Sent: Friday, December 16, 2011 4:34 PM
>>> To: Marek Królikowski
>>> Cc: ocfs2-users at oss.oracle.com
>>> Subject: Re: [Ocfs2-users] ocfs2 - Kernel panic on many write/read from
>>> both
>>> servers
>>>
>>> My recomendation is upgrade all y recreate the filesystem in the
>>> cluster..
>>>
>>> If you need profesional help please make a support or use profesional...
>>> ocfs2 is very hard to use if you don't know how to use it..
>>>
>>> the list is for help, or not, but it is free..
>>>
>>> 2011/12/15 Marek Królikowski <admin at wset.edu.pl>:
>>>> Anyone can help wme with this?
>>>>
>>>>
>>>>
>>>> -----Oryginalna wiadomość-----
>>>> From: Marek Królikowski
>>>> Sent: Sunday, December 04, 2011 11:15 AM
>>>> To: ocfs2-users at oss.oracle.com
>>>> Subject: ocfs2 - Kernel panic on many write/read from both servers
>>>>
>>>> I do for all night tests with write/read files from ocfs2 on both
>>>> servers something like this:
>>>> On MAIL1 server:
>>>> #!/bin/bash
>>>> while true
>>>> do
>>>> rm -rf /mnt/EMC/MAIL1
>>>> mkdir /mnt/EMC/MAIL1
>>>> cp -r /usr /mnt/EMC/MAIL1
>>>> rm -rf /mnt/EMC/MAIL1
>>>> done;
>>>> On MAIL2 server:
>>>> #!/bin/bash
>>>> while true
>>>> do
>>>> rm -rf /mnt/EMC/MAIL2
>>>> mkdir /mnt/EMC/MAIL2
>>>> cp -r /usr /mnt/EMC/MAIL2
>>>> rm -rf /mnt/EMC/MAIL2
>>>> done;
>>>>
>>>> Today i check logs and see:
>>>> o2dlm: Node 1 joins domain EAC7942B71964050AE2046D3F0CDD7B2
>>>> o2dlm: Nodes in domain EAC7942B71964050AE2046D3F0CDD7B2: 0 1
>>>> (rm,26136,0):ocfs2_unlink:953 ERROR: status = -2
>>>> (touch,26137,0):ocfs2_check_dir_for_entry:2120 ERROR: status = -17
>>>> (touch,26137,0):ocfs2_mknod:461 ERROR: status = -17
>>>> (touch,26137,0):ocfs2_create:631 ERROR: status = -17
>>>> (rm,26142,0):ocfs2_unlink:953 ERROR: status = -2
>>>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>>>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>>>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>>>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>>>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>>>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>>>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>>>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>>>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>>>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>>>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>>>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>>>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>>>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>>>> manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>>>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>>>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>>>> gs_change+0x13/0x13
>>>> INFO: task rm:5192 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>>>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>>>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>>>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>>>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>>>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>>>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>>>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>>>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>>>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>>>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>>>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>>>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>>>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>>>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>>>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>>>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>>>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>>>> system_call_fastpath+0x16/0x1b
>>>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>>>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>>>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>>>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>>>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>>>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>>>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>>>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>>>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>>>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>>>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>>>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>>>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>>>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>>>> manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>>>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>>>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>>>> gs_change+0x13/0x13
>>>> INFO: task rm:5192 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>>>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>>>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>>>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>>>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>>>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>>>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>>>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>>>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>>>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>>>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>>>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>>>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>>>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>>>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>>>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>>>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>>>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>>>> system_call_fastpath+0x16/0x1b
>>>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>>>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>>>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>>>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>>>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>>>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>>>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>>>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>>>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>>>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>>>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>>>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>>>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>>>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>>>> manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>>>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>>>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>>>> gs_change+0x13/0x13
>>>> INFO: task rm:5192 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>>>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>>>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>>>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>>>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>>>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>>>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>>>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>>>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>>>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>>>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>>>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>>>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>>>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>>>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>>>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>>>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>>>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>>>> system_call_fastpath+0x16/0x1b
>>>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>>>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>>>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>>>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>>>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>>>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>>>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>>>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>>>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>>>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>>>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>>>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>>>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>>>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>>>> manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>>>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>>>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>>>> gs_change+0x13/0x13
>>>> INFO: task rm:5192 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>>>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>>>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>>>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>>>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>>>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>>>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>>>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>>>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>>>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>>>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>>>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>>>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>>>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>>>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>>>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>>>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>>>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>>>> system_call_fastpath+0x16/0x1b
>>>> INFO: task kworker/u:2:20246 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> kworker/u:2 D ffff88107f4525c0 0 20246 2 0x00000000
>>>> ffff880b730b57d0 0000000000000046 ffff8810201297d0 00000000000125c0
>>>> ffff880f5a399fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff880f5a398000 00000000000125c0 ffff880f5a399fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff81481b71>] ? __mutex_lock_slowpath+0xd1/0x140
>>>> [<ffffffff814818d3>] ? mutex_lock+0x23/0x40 [<ffffffffa0937d95>] ?
>>>> ocfs2_wipe_inode+0x105/0x690 [ocfs2] [<ffffffffa0935cfb>] ?
>>>> ocfs2_query_inode_wipe.clone.9+0xcb/0x370 [ocfs2] [<ffffffffa09385a4>]
>>>> ? ocfs2_delete_inode+0x284/0x3f0 [ocfs2] [<ffffffffa0919a10>] ?
>>>> ocfs2_dentry_attach_lock+0x5a0/0x5a0 [ocfs2] [<ffffffffa093872e>] ?
>>>> ocfs2_evict_inode+0x1e/0x50 [ocfs2] [<ffffffff81145900>] ?
>>>> evict+0x70/0x140 [<ffffffffa0919322>] ?
>>>> __ocfs2_drop_dl_inodes.clone.2+0x32/0x60 [ocfs2] [<ffffffffa0919a39>]
>>>> ? ocfs2_drop_dl_inodes+0x29/0x90 [ocfs2] [<ffffffff8106e56f>] ?
>>>> process_one_work+0x11f/0x440 [<ffffffff8106f279>] ?
>>>> worker_thread+0x159/0x330 [<ffffffff8106f120>] ?
>>>> manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff8106f120>] ? manage_workers.clone.21+0x120/0x120
>>>> [<ffffffff81073fa6>] ? kthread+0x96/0xa0 [<ffffffff8148bb24>] ?
>>>> kernel_thread_helper+0x4/0x10 [<ffffffff81073f10>] ?
>>>> kthread_worker_fn+0x1a0/0x1a0 [<ffffffff8148bb20>] ?
>>>> gs_change+0x13/0x13
>>>> INFO: task rm:5192 blocked for more than 120 seconds.
>>>> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this
>>>> message.
>>>> rm D ffff88107f2725c0 0 5192 16338 0x00000000
>>>> ffff881014ccb040 0000000000000082 ffff8810206b8040 00000000000125c0
>>>> ffff8804d7697fd8 00000000000125c0 00000000000125c0 00000000000125c0
>>>> ffff8804d7696000 00000000000125c0 ffff8804d7697fd8 00000000000125c0
>>>> Call Trace:
>>>> [<ffffffff8148148d>] ? schedule_timeout+0x1ed/0x2e0
>>>> [<ffffffffa0886162>] ? dlmconvert_master+0xe2/0x190 [ocfs2_dlm]
>>>> [<ffffffffa08878bf>] ? dlmlock+0x7f/0xb70 [ocfs2_dlm]
>>>> [<ffffffff81480e0a>] ? wait_for_common+0x13a/0x190
>>>> [<ffffffff8104bc50>] ? try_to_wake_up+0x280/0x280 [<ffffffffa0928a38>]
>>>> ? __ocfs2_cluster_lock.clone.21+0x1d8/0x6b0 [ocfs2]
>>>> [<ffffffffa0928fcc>] ? ocfs2_inode_lock_full_nested+0xbc/0x490 [ocfs2]
>>>> [<ffffffffa0943c1b>] ? ocfs2_lookup_lock_orphan_dir+0x6b/0x1b0 [ocfs2]
>>>> [<ffffffffa09454ba>] ? ocfs2_prepare_orphan_dir+0x4a/0x280 [ocfs2]
>>>> [<ffffffffa094616f>] ? ocfs2_unlink+0x6ef/0xb90 [ocfs2]
>>>> [<ffffffff811b35a9>] ? may_link.clone.22+0xd9/0x170
>>>> [<ffffffff8113aa58>] ? vfs_unlink+0x98/0x100 [<ffffffff8113ac41>] ?
>>>> do_unlinkat+0x181/0x1b0 [<ffffffff8113e7cd>] ? vfs_readdir+0x9d/0xe0
>>>> [<ffffffff811653d8>] ? fsnotify_find_inode_mark+0x28/0x40
>>>> [<ffffffff81166324>] ? dnotify_flush+0x54/0x110 [<ffffffff8112b07f>] ?
>>>> filp_close+0x5f/0x90 [<ffffffff8148aa12>] ?
>>>> system_call_fastpath+0x16/0x1b
>>>>
>>>>
>>>> _______________________________________________
>>>> Ocfs2-users mailing list
>>>> Ocfs2-users at oss.oracle.com
>>>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>>
>>>
>>> _______________________________________________
>>> Ocfs2-users mailing list
>>> Ocfs2-users at oss.oracle.com
>>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>>
>>>
>>> _______________________________________________
>>> Ocfs2-users mailing list
>>> Ocfs2-users at oss.oracle.com
>>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>>
>>
>> _______________________________________________
>> Ocfs2-users mailing list
>> Ocfs2-users at oss.oracle.com
>> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users
More information about the Ocfs2-users
mailing list