<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
<title></title>
</head>
<body bgcolor="#ffffff" text="#000000">
cat /sys/kernel/config/cluster/CLUSTERNAME/heartbeat/HBREGION/dev<br>
<br>
Mount and run the following. Replace CLUSTERNAME and HBREGION<br>
appropriately.<br>
<br>
On 07/26/2011 01:12 AM, Simon Hargrave wrote:
<blockquote
cite="mid:83B9398A54BE50429CD78BB4800885E710A6C319@EX-MB-VS2.YBS.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
<meta content="MSHTML 6.00.2900.5512" name="GENERATOR">
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial">Thanks Sunil</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"></span> </div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial">Interestingly I seem
to have found a potential workaround.</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"></span> </div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial">Using sdb directly
causes the problem I described. However, if I allow sdb to
be subsumed by dm-multipath and use the multipath device
directly, no such deadlocking occurs.</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"></span> </div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial">For example: -</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"></span> </div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial"> * Allow dm-multipath
to subsume the paths (6 in the case of a physical server,
only 1 in the case of a VMware guest) under
/dev/mapper/mpathX</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial"> * mkfs on the
/dev/map/mpathX device</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial"> * Mount the
filesytem</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial"> * Resize the LUN</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial"> * echo "1" >
/dev/block/sdX/device/rescan for each path for the multipath
device</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial"> * multipathd
-k"resize map mpathX"</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial"> * tune2fs to resize
the filesystem</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial"> </font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial">I can then unmount the
filesystem without issue. </font></span><span
class="234474807-26072011"><font size="2" color="#0000ff"
face="Arial">The only problem with this approach seems to be
I cannot mount by label, since it tries to use the sdX
devices so I have to specify the mpath device directly - not
really an issue since they are persistent across reboots due
to /var/lib/multipath/bindings.</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"></span> </div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial">Can you explain why
the deadlock issue doesn't occur when using dm-multipath?</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"></span> </div>
<div dir="ltr" align="left"><span class="234474807-26072011"></span> </div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial">Simon</font></span></div>
<div dir="ltr" align="left"><span class="234474807-26072011"></span> </div>
<div dir="ltr" align="left"><span class="234474807-26072011"><font
size="2" color="#0000ff" face="Arial">Incidentally, it also
appears that when using dm-multipath, I can actually use a
partition rather than the raw device - I can fdisk the
mpath0 and rerun partprive and kpartx -a to reread the
partition table into the kernel and resize the partition.
This cannot be done when using the partition directly.</font></span></div>
<div> </div>
<div align="left">
<div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
tahoma,verdana,sans-serif;" align="left"><font style="color:
rgb(0, 0, 0);" size="2" face="tahoma,verdana,sans-serif">- <br>
Simon Hargrave <a moz-do-not-send="true"
title="blocked::blocked::mailto:szhargrave@ybs.co.uk
blocked::mailto:szhargrave@ybs.co.uk
mailto:szhargrave@ybs.co.uk"
href="blocked::blocked::blocked::mailto:szhargrave@ybs.co.uk">szhargrave@ybs.co.uk</a> <br>
Enterprise Systems Team Leader x2831</font><font
style="color: rgb(0, 0, 0);" size="2"
face="tahoma,verdana,sans-serif"><br>
Yorkshire Building Society 01274 472831</font></div>
<div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
tahoma,verdana,sans-serif;" align="left"><font size="2"
face="Arial"><a moz-do-not-send="true"
title="http://wwwtech/sysint/tsgcore.asp"
href="blocked::http://wwwtech/sysint/tsgcore.asp">http://wwwtech/sysint/tsgcore.asp</a></font></div>
</div>
<div> </div>
<br>
<div class="OutlookMessageHeader" dir="ltr" align="left"
lang="en-us">
<hr tabindex="-1">
<font size="2" face="Tahoma"><b>From:</b> Sunil Mushran
[<a class="moz-txt-link-freetext" href="mailto:sunil.mushran@oracle.com">mailto:sunil.mushran@oracle.com</a>] <br>
<b>Sent:</b> 25 July 2011 19:22<br>
<b>To:</b> Simon Hargrave<br>
<b>Cc:</b> <a class="moz-txt-link-abbreviated" href="mailto:ocfs2-users@oss.oracle.com">ocfs2-users@oss.oracle.com</a><br>
<b>Subject:</b> Re: [Ocfs2-users] OCFS2 unmount problems after
online resize<br>
</font><br>
</div>
The umount and the hb stop threads are deadlocking on the s_umount
lock.<br>
<br>
This problem is due to the local heartbeat scheme employed in
which the<br>
hb device is the same as the mounted one. umount trigger hb stop
which<br>
calls open() => ... => rescan_partitions() => ... =>
get_super() => down_read().<br>
The same lock should be held by the umount thread.<br>
<br>
Unfortunately there is no fix for this other than using a
different hb scheme.<br>
<br>
Later this year we will be releasing global heartbeat as part of
the o2cb stack<br>
that will allow users to specify different hb devices.<br>
<br>
Another option is to move to sles11 and make use of the pacemaker
cluster<br>
stack.<br>
<br>
On 07/25/2011 06:58 AM, Simon Hargrave wrote:
<blockquote
cite="mid:83B9398A54BE50429CD78BB4800885E70FAEE94E@EX-MB-VS2.YBS.com"
type="cite">
<meta content="MSHTML 6.00.2900.5512" name="GENERATOR">
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011">A further
update, which simplifies the situation. It appears to be
more fundamental, and not actually anything to do with the
online resize.</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011">Basically it
appears that simply the act of resizing the LUN and
performing the scsi rescan is enough to make the next
unmount fail, i.e.:-</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"> * create
filesystem</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"> * mount
filesystem</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"> * unmounts
and mounts fine</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"> * extend LUN
on storage</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"> * echo 1 to
/sys/block/sdb/device/rescan</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"> * unmount
filesystem, which hangs</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011">The above
happens even if only one node is in the cluster, so it
doesn't appear to be a locking issue between the hosts.</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011">I have tried
exactly the same with ext3 (one node obviously!) and the
same resize doesn't cause a hang.</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011">I have also
configure ocfs on a single physical machine (to rule out
VMware), and the symptoms are identical.</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011">So for
whatever reason, the system call to umount() for an ocfs2
filesystem hangs if the underlying block device has
changed size?</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011">Simon</span></font></div>
<div dir="ltr" align="left"><font size="2" color="#0000ff"
face="Arial"><span class="533375413-25072011"></span></font> </div>
<div align="left">
<div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
tahoma,verdana,sans-serif;" align="left"><font style="color:
rgb(0, 0, 0);" size="2" face="tahoma,verdana,sans-serif">-
<br>
Simon Hargrave <a
title="blocked::blocked::mailto:szhargrave@ybs.co.uk
blocked::mailto:szhargrave@ybs.co.uk
mailto:szhargrave@ybs.co.uk"
href="blocked::blocked::blocked::mailto:szhargrave@ybs.co.uk"
moz-do-not-send="true">szhargrave@ybs.co.uk</a> <br>
Enterprise Systems Team Leader x2831</font><font
style="color: rgb(0, 0, 0);" size="2"
face="tahoma,verdana,sans-serif"><br>
Yorkshire Building Society 01274 472831</font></div>
<div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
tahoma,verdana,sans-serif;" align="left"><font size="2"
face="Arial"><a title="http://wwwtech/sysint/tsgcore.asp"
href="blocked::http://wwwtech/sysint/tsgcore.asp"
moz-do-not-send="true">http://wwwtech/sysint/tsgcore.asp</a></font></div>
</div>
<div> </div>
<br>
<div class="OutlookMessageHeader" dir="ltr" align="left"
lang="en-us">
<hr tabindex="-1"> <font size="2" face="Tahoma"><b>From:</b>
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:ocfs2-users-bounces@oss.oracle.com">ocfs2-users-bounces@oss.oracle.com</a>
[<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="mailto:ocfs2-users-bounces@oss.oracle.com">mailto:ocfs2-users-bounces@oss.oracle.com</a>]
<b>On Behalf Of </b>Simon Hargrave<br>
<b>Sent:</b> 25 July 2011 13:50<br>
<b>To:</b> <a moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="mailto:ocfs2-users@oss.oracle.com">ocfs2-users@oss.oracle.com</a><br>
<b>Subject:</b> Re: [Ocfs2-users] OCFS2 unmount problems
after online resize<br>
</font><br>
</div>
<div dir="ltr" align="left"><span class="500464912-25072011"><font
size="2" color="#0000ff" face="Arial">Further to this, I
get the following in dmesg every 120 seconds after the
attempted unmount: -</font></span></div>
<div dir="ltr" align="left"><span class="500464912-25072011"></span> </div>
<div dir="ltr" align="left"><span class="500464912-25072011"><font
size="2" color="#0000ff" face="Arial">INFO: task
ocfs2_hb_ctl:3794 blocked for more than 120 seconds.<br>
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.<br>
ocfs2_hb_ctl D ffff810003db6420 0 3794
3793 (NOTLB)<br>
ffff8100b9d05cf8 0000000000000086 00000000f000020a
ffffffff8002d0ee<br>
0000000000000000 0000000000000007 ffff8100d801e820
ffffffff80310b60<br>
000000887c712d88 000000000000791a ffff8100d801ea08
0000000080009852<br>
Call Trace:<br>
[<ffffffff8002d0ee>] wake_up_bit+0x11/0x22<br>
[<ffffffff8006466c>] __down_read+0x7a/0x92<br>
[<ffffffff800e68aa>] get_super+0x48/0x95<br>
[<ffffffff800e387b>] fsync_bdev+0xe/0x3b<br>
[<ffffffff8014a6f8>] invalidate_partition+0x28/0x40<br>
[<ffffffff8010d6e7>] rescan_partitions+0x37/0x279<br>
[<ffffffff800e78ec>] do_open+0x231/0x30f<br>
[<ffffffff800e7c1e>] blkdev_open+0x0/0x4f<br>
[<ffffffff800e7c41>] blkdev_open+0x23/0x4f<br>
[<ffffffff8001eab6>] __dentry_open+0xd9/0x1dc<br>
[<ffffffff8002751f>] do_filp_open+0x2a/0x38<br>
[<ffffffff8002ae16>] iput+0x4b/0x84<br>
[<ffffffff800dddf3>] alternate_node_alloc+0x70/0x8c<br>
[<ffffffff80019f7e>] do_sys_open+0x44/0xbe<br>
[<ffffffff8005d28d>] tracesys+0xd5/0xe0<br>
</font></span></div>
<div dir="ltr" align="left"><span class="500464912-25072011"></span> </div>
<div align="left">
<div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
tahoma,verdana,sans-serif;" align="left"><font style="color:
rgb(0, 0, 0);" size="2" face="tahoma,verdana,sans-serif">-
<br>
Simon Hargrave <a
title="blocked::blocked::mailto:szhargrave@ybs.co.uk
blocked::mailto:szhargrave@ybs.co.uk
mailto:szhargrave@ybs.co.uk"
href="blocked::blocked::blocked::mailto:szhargrave@ybs.co.uk"
moz-do-not-send="true">szhargrave@ybs.co.uk</a> <br>
Enterprise Systems Team Leader x2831</font><font
style="color: rgb(0, 0, 0);" size="2"
face="tahoma,verdana,sans-serif"><br>
Yorkshire Building Society 01274 472831</font></div>
<div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
tahoma,verdana,sans-serif;" align="left"><font size="2"
face="Arial"><a title="http://wwwtech/sysint/tsgcore.asp"
href="blocked::http://wwwtech/sysint/tsgcore.asp"
moz-do-not-send="true">http://wwwtech/sysint/tsgcore.asp</a></font></div>
</div>
<div> </div>
<br>
<div class="OutlookMessageHeader" dir="ltr" align="left"
lang="en-us">
<hr tabindex="-1"> <font size="2" face="Tahoma"><b>From:</b>
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:ocfs2-users-bounces@oss.oracle.com">ocfs2-users-bounces@oss.oracle.com</a>
[<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="mailto:ocfs2-users-bounces@oss.oracle.com">mailto:ocfs2-users-bounces@oss.oracle.com</a>]
<b>On Behalf Of </b>Simon Hargrave<br>
<b>Sent:</b> 25 July 2011 13:26<br>
<b>To:</b> <a moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="mailto:ocfs2-users@oss.oracle.com">ocfs2-users@oss.oracle.com</a><br>
<b>Subject:</b> [Ocfs2-users] OCFS2 unmount problems after
online resize<br>
</font><br>
</div>
<p><span style="font-size: 8.2pt; font-family: 'MS Sans Serif';">Please
read the warning at the end of this email<br>
</span><span style="font-size: 8pt; font-family: 'Arial';">________________________________________________</span></p>
<p><span style="font-size: 8pt; font-family: 'Arial';"></span> </p>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Hi</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">I'm doing some experimentation with
OCFS2 (1.4 on RHEL5) with a view to using as a 2-node
clustered filesystem. I seem to be having issues with
online resize (which documentation suggests is supported
under 1.4). I'm creating a LUN and publishing from a HP
EVA6400 storage array to the 2 nodes, and creating a
filesystem which works fine. However, it appears that if
I online-increase the size of the LUN and subsequently the
filesystem, it hangs indefinately on unmount. Full
transcript of issue is as below: -</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">/etc/ocfs2/cluster.conf (created via
ocfs2console)</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">--------------------------------------------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">node:<br>
ip_port = 7777<br>
ip_address = 10.34.8.90<br>
number = 0<br>
name = ybsxlx45<br>
cluster = ocfs2</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">node:<br>
ip_port = 7777<br>
ip_address = 10.34.8.91<br>
number = 1<br>
name = ybsxlx46<br>
cluster = ocfs2</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">cluster:<br>
node_count = 2<br>
name = ocfs2</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">/etc/sysconfig/o2cb (created via
ocfs2console)</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">----------------------------------------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># O2CB_ENABLED: 'true' means to load
the driver on boot.<br>
O2CB_ENABLED=true</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># O2CB_STACK: The name of the cluster
stack backing O2CB.<br>
O2CB_STACK=o2cb</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># O2CB_BOOTCLUSTER: If not empty, the
name of a cluster to start.<br>
O2CB_BOOTCLUSTER=ocfs2</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># O2CB_HEARTBEAT_THRESHOLD: Iterations
before a node is considered dead.<br>
O2CB_HEARTBEAT_THRESHOLD=</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># O2CB_IDLE_TIMEOUT_MS: Time in ms
before a network connection is considered dead.<br>
O2CB_IDLE_TIMEOUT_MS=</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># O2CB_KEEPALIVE_DELAY_MS: Max time in
ms before a keepalive packet is sent<br>
O2CB_KEEPALIVE_DELAY_MS=</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Arial"><font face="Courier New">#
O2CB_RECONNECT_DELAY_MS: Min time in ms between
connection attempts<br>
O2CB_RECONNECT_DELAY_MS=</font><br>
</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">2GB LUN published to both nodes and
appears as /dev/sdb</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">-------------------------------------------------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># grep sdb /proc/partitions<br>
8 16 2097152 sdb</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Operating System</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">----------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Red Hat Enterprise Linux Server
release 5.6 (Tikanga)<br>
Linux ybsxlx45 2.6.18-238.1.1.el5 #1 SMP Tue Jan 4
13:32:19 EST 2011 x86_64 x86_64 x86_64 GNU/Linux</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">OCFS2 Packages</font></span></div>
<div><font face="Courier New"><font size="2"><span
class="502530112-25072011">--------------</span></font></font></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">ocfs2-2.6.18-238.1.1.el5-1.4.7-1.el5<br>
ocfs2console-1.4.4-1.el5<br>
ocfs2-tools-1.4.4-1.el5</font></span><span
class="502530112-25072011"></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"><font
face="Courier New">Create and exercise filesystem</font></font></span></div>
<div><span class="502530112-25072011"><font size="2"><font
face="Courier New">------------------------------</font></font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># mkfs.ocfs2 -L "ocfstest" /dev/sdb<br>
# mount -L ocfstest /ocfstest<br>
# dd if=/dev/zero of=/ocfstest/file1 bs=1024k count=500
(on first node)<br>
# dd if=/dev/zero of=/ocfstest/file2 bs=1024k count=500
(on second node)</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># df -k /ocfstest<br>
Filesystem 1K-blocks Used Available Use%
Mounted on<br>
/dev/sdb 2097152 1320836 776316 63%
/ocfstest</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Test unmount and remount</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">------------------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># strace -f -o before.txt umount
/ocfstest<br>
# mount -L ocfstest /ocfstest</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">LUN resized to 3GB and rescan on each
host</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">------------------------------------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># echo "1" >
/sys/block/sdb/device/rescan<br>
# grep sdb /proc/partitions<br>
8 16 3145728 sdb</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">(new device size showing)</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Online resize of filesystem</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">---------------------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># df -k /ocfstest<br>
Filesystem 1K-blocks Used Available Use%
Mounted on<br>
/dev/sdb 2097152 1312644 784508 63%
/ocfstest</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># tunefs.ocfs2 -S /dev/sdb</font></span></div>
<div> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># df -k /ocfstest<br>
Filesystem 1K-blocks Used Available Use%
Mounted on<br>
/dev/sdb 3145728 1312676 1833052 42%
/ocfstest</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">(new filesystem size shows on both
nodes)</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Exercise filesystem</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">-------------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># dd if=/dev/zero of=/ocfstest/file3
bs=1024k count=500 (on first node)<br>
# dd if=/dev/zero of=/ocfstest/file4 bs=1024k count=500
(on second node)</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># df -k /ocfstest<br>
Filesystem 1K-blocks Used Available Use%
Mounted on<br>
/dev/sdb 3145728 2340772 804956 75%
/ocfstest</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">(filesystem continues to function and
can be filled past old size)</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Unmount filesystem</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">------------------</font></span></div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New"># strace -f -o after.txt umount
/ocfstest</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">At this point, the unmount hangs
forever and only a reboot will clear it.</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Comparing the "strace" output, the
second one hangs during the call to umount() system call,
after having checked that umount.ocfs2 doesn't exist.</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Whilst hung, the filesystem still
"appears" in /etc/mtab and df output, but it is not
mounted according to the kernel (/proc/mounts).</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Other node continues to function
whilst in this state, filesystem does not hang.</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">So the question is, is this a bug, or
am I doing something wrong? The OCFS2 1.4 user guide does
state: -</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">9. Online File system Resize<br>
Users can now grow the file system without having to
unmount it. This feature requires a compatible clustered
logical volume manager. Compatible volumes managers will
be announced when support is available.</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">However since I'm using the raw
device, not LVM this should work, provided the scsi device
rescan has been performed on all nodes prior to running
tunefs.ocfs2?</font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font face="Arial"><font
size="2" face="Courier New">I should finally point out
that this is being performed on 2 VMware guests, but the
LUN is published directly to the guests as a Raw Device
Mapping in Physical Compatibility Mode (passthru), as
per the various VMware whitepapers. I don't have 2
spare SAN-attached crash-and-burn hosts to test this out
physically, but I don't believe this should be a factor.</font></font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font face="Arial"><font
size="2" face="Courier New">Any help appreciated as
online resize is a must in a 24x7 clustered environment!</font></font></span></div>
<div><span class="502530112-25072011"></span> </div>
<div><span class="502530112-25072011"><font size="2"
face="Courier
New">Thanks</font></span></div>
<div><span class="502530112-25072011"></span><span
class="502530112-25072011"></span> </div>
<div align="left">
<div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
tahoma,verdana,sans-serif;" align="left"><font style="color:
rgb(0, 0, 0);" size="2" face="tahoma,verdana,sans-serif">-
<br>
Simon Hargrave <a
title="blocked::blocked::mailto:szhargrave@ybs.co.uk
blocked::mailto:szhargrave@ybs.co.uk
mailto:szhargrave@ybs.co.uk"
href="blocked::blocked::blocked::mailto:szhargrave@ybs.co.uk"
moz-do-not-send="true">szhargrave@ybs.co.uk</a> <br>
Enterprise Systems Team Leader x2831</font><font
style="color: rgb(0, 0, 0);" size="2"
face="tahoma,verdana,sans-serif"><br>
Yorkshire Building Society 01274 472831</font></div>
<div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
tahoma,verdana,sans-serif;" align="left"><font size="2"
face="Arial"><a title="http://wwwtech/sysint/tsgcore.asp"
href="blocked::http://wwwtech/sysint/tsgcore.asp"
moz-do-not-send="true">http://wwwtech/sysint/tsgcore.asp</a></font></div>
</div>
<div> </div>
<p><span style="font-size: 8pt; font-family: 'Arial';">________________________________________________</span></p>
<p><span style="font-size: 8pt; font-family: 'Arial';">This
email and any attachments are confidential and may contain
privileged information.</span></p>
<p><span style="font-size: 8pt; font-family: 'Arial';">If you
are not the person for whom they are intended please return
the email and then delete all material from any computer.
You must not use the email or attachments for any purpose,
nor disclose its contents to anyone other than the intended
recipient.</span></p>
<p><span style="font-size: 8pt; font-family: 'Arial';">Any
statements made by an individual in this email do not
necessarily reflect the views of the Yorkshire Building
Society Group.</span></p>
<p><span style="font-size: 8pt; font-family: 'Arial';">________________________________________________<br>
<br>
Yorkshire Building Society, which is authorised and
regulated by the Financial Services Authority, chooses to
introduce its customers to Legal & General for the
purposes of advising on and arranging life assurance and
investment products bearing Legal & General’s name.</span></p>
<p><span style="font-size: 8pt; font-family: 'Arial';"><br>
We are entered in the FSA Register and our FSA registration
number is 106085 <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="http://www.fsa.gov.uk/register">http://www.fsa.gov.uk/register</a><br>
<br>
Head Office: Yorkshire Building Society, Yorkshire House,
Yorkshire Drive, Bradford, BD5 8LJ<br>
Tel: 0845 1 200 100<br>
<br>
Visit Our Website<br>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://www.ybs.co.uk">http://www.ybs.co.uk</a><br>
<br>
All communications with us may be monitored/recorded to
improve the quality of our service and for your protection
and security.<br>
</span></p>
<p><span style="font-size: 8pt; font-family: 'Arial';"></span> </p>
<br>
________________________________________________________________________<br>
This e-mail has been scanned for all viruses by Star. The<br>
service is powered by MessageLabs. For more information on a
proactive<br>
anti-virus service working around the clock, around the globe,
visit:<br>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
<br>
________________________________________________________________________<br>
This e-mail has been scanned for all viruses by Star. The<br>
service is powered by MessageLabs. For more information on a
proactive<br>
anti-virus service working around the clock, around the globe,
visit:<br>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
<br>
________________________________________________________________________<br>
This e-mail has been scanned for all viruses by Star. The<br>
service is powered by MessageLabs. For more information on a
proactive<br>
anti-virus service working around the clock, around the globe,
visit:<br>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
<br>
________________________________________________________________________<br>
This e-mail has been scanned for all viruses by Star. The<br>
service is powered by MessageLabs. For more information on a
proactive<br>
anti-virus service working around the clock, around the globe,
visit:<br>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
<br>
________________________________________________________________________<br>
This e-mail has been scanned for all viruses by Star. The<br>
service is powered by MessageLabs. For more information on a
proactive<br>
anti-virus service working around the clock, around the globe,
visit:<br>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
<pre wrap=""><fieldset class="mimeAttachmentHeader"></fieldset>
_______________________________________________
Ocfs2-users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:Ocfs2-users@oss.oracle.com">Ocfs2-users@oss.oracle.com</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://oss.oracle.com/mailman/listinfo/ocfs2-users">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a></pre>
</blockquote>
<br>
<br>
________________________________________________________________________<br>
This e-mail has been scanned for all viruses by Star. The<br>
service is powered by MessageLabs. For more information on a
proactive<br>
anti-virus service working around the clock, around the globe,
visit:<br>
<a class="moz-txt-link-freetext" href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
<br>
________________________________________________________________________<br>
This e-mail has been scanned for all viruses by Star. The<br>
service is powered by MessageLabs. For more information on a
proactive<br>
anti-virus service working around the clock, around the globe,
visit:<br>
<a class="moz-txt-link-freetext" href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
<pre wrap="">
<fieldset class="mimeAttachmentHeader"></fieldset>
_______________________________________________
Ocfs2-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Ocfs2-users@oss.oracle.com">Ocfs2-users@oss.oracle.com</a>
<a class="moz-txt-link-freetext" href="http://oss.oracle.com/mailman/listinfo/ocfs2-users">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a></pre>
</blockquote>
<br>
</body>
</html>