<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#ffffff" text="#000000">
    The umount and the hb stop threads are deadlocking on the s_umount
    lock.<br>
    <br>
    This problem is due to the local heartbeat scheme employed in which
    the<br>
    hb device is the same as the mounted one. umount trigger hb stop
    which<br>
    calls open() =&gt; ... =&gt; rescan_partitions() =&gt; ... =&gt;
    get_super() =&gt; down_read().<br>
    The same lock should be held by the umount thread.<br>
    <br>
    Unfortunately there is no fix for this other than using a different
    hb scheme.<br>
    <br>
    Later this year we will be releasing global heartbeat as part of the
    o2cb stack<br>
    that will allow users to specify different hb devices.<br>
    <br>
    Another option is to move to sles11 and make use of the pacemaker
    cluster<br>
    stack.<br>
    <br>
    On 07/25/2011 06:58 AM, Simon Hargrave wrote:
    <blockquote
      cite="mid:83B9398A54BE50429CD78BB4800885E70FAEE94E@EX-MB-VS2.YBS.com"
      type="cite">
      <meta http-equiv="Content-Type" content="text/html;
        charset=ISO-8859-1">
      <meta content="MSHTML 6.00.2900.5512" name="GENERATOR">
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">A further
            update, which simplifies the situation.&nbsp; It appears to be
            more fundamental, and not actually anything to do with the
            online resize.</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">Basically it
            appears that simply the act of resizing the LUN and
            performing the scsi rescan is enough to make the next
            unmount fail, i.e.:-</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">&nbsp; * create
            filesystem</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">&nbsp; * mount
            filesystem</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">&nbsp; * unmounts and
            mounts fine</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">&nbsp; * extend LUN
            on storage</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">&nbsp; * echo 1 to
            /sys/block/sdb/device/rescan</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">&nbsp; * unmount
            filesystem, which hangs</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">The above
            happens even if only one node is in the cluster, so it
            doesn't appear to be a&nbsp;locking issue between the hosts.</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">I have tried
            exactly the same with ext3 (one node obviously!) and the
            same resize doesn't cause a hang.</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">I have also
            configure ocfs on a single physical machine (to rule out
            VMware), and the symptoms are identical.</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">So for whatever
            reason, the system call to umount() for an ocfs2 filesystem
            hangs if the underlying block device has changed size?</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011">Simon</span></font></div>
      <div dir="ltr" align="left"><font size="2" color="#0000ff"
          face="Arial"><span class="533375413-25072011"></span></font>&nbsp;</div>
      <div align="left">
        <div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
          tahoma,verdana,sans-serif;" align="left"><font style="color:
            rgb(0, 0, 0);" size="2" face="tahoma,verdana,sans-serif">- <br>
            Simon Hargrave <a moz-do-not-send="true"
              title="blocked::blocked::mailto:szhargrave@ybs.co.uk
              blocked::mailto:szhargrave@ybs.co.uk
              mailto:szhargrave@ybs.co.uk"
              href="blocked::blocked::blocked::mailto:szhargrave@ybs.co.uk">szhargrave@ybs.co.uk</a>&nbsp;<br>
            Enterprise Systems&nbsp;Team Leader&nbsp;x2831</font><font
            style="color: rgb(0, 0, 0);" size="2"
            face="tahoma,verdana,sans-serif"><br>
            Yorkshire Building Society 01274 472831</font></div>
        <div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
          tahoma,verdana,sans-serif;" align="left"><font size="2"
            face="Arial"><a moz-do-not-send="true"
              title="http://wwwtech/sysint/tsgcore.asp"
              href="blocked::http://wwwtech/sysint/tsgcore.asp">http://wwwtech/sysint/tsgcore.asp</a></font></div>
      </div>
      <div>&nbsp;</div>
      <br>
      <div class="OutlookMessageHeader" dir="ltr" align="left"
        lang="en-us">
        <hr tabindex="-1">
        <font size="2" face="Tahoma"><b>From:</b>
          <a class="moz-txt-link-abbreviated" href="mailto:ocfs2-users-bounces@oss.oracle.com">ocfs2-users-bounces@oss.oracle.com</a>
          [<a class="moz-txt-link-freetext" href="mailto:ocfs2-users-bounces@oss.oracle.com">mailto:ocfs2-users-bounces@oss.oracle.com</a>] <b>On Behalf Of </b>Simon
          Hargrave<br>
          <b>Sent:</b> 25 July 2011 13:50<br>
          <b>To:</b> <a class="moz-txt-link-abbreviated" href="mailto:ocfs2-users@oss.oracle.com">ocfs2-users@oss.oracle.com</a><br>
          <b>Subject:</b> Re: [Ocfs2-users] OCFS2 unmount problems after
          online resize<br>
        </font><br>
      </div>
      <div dir="ltr" align="left"><span class="500464912-25072011"><font
            size="2" color="#0000ff" face="Arial">Further to this, I get
            the following in dmesg every 120 seconds after the attempted
            unmount: -</font></span></div>
      <div dir="ltr" align="left"><span class="500464912-25072011"></span>&nbsp;</div>
      <div dir="ltr" align="left"><span class="500464912-25072011"><font
            size="2" color="#0000ff" face="Arial">INFO: task
            ocfs2_hb_ctl:3794 blocked for more than 120 seconds.<br>
            "echo 0 &gt; /proc/sys/kernel/hung_task_timeout_secs"
            disables this message.<br>
            ocfs2_hb_ctl&nbsp; D ffff810003db6420&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp; 3794&nbsp;&nbsp;
            3793&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; (NOTLB)<br>
            &nbsp;ffff8100b9d05cf8 0000000000000086 00000000f000020a
            ffffffff8002d0ee<br>
            &nbsp;0000000000000000 0000000000000007 ffff8100d801e820
            ffffffff80310b60<br>
            &nbsp;000000887c712d88 000000000000791a ffff8100d801ea08
            0000000080009852<br>
            Call Trace:<br>
            &nbsp;[&lt;ffffffff8002d0ee&gt;] wake_up_bit+0x11/0x22<br>
            &nbsp;[&lt;ffffffff8006466c&gt;] __down_read+0x7a/0x92<br>
            &nbsp;[&lt;ffffffff800e68aa&gt;] get_super+0x48/0x95<br>
            &nbsp;[&lt;ffffffff800e387b&gt;] fsync_bdev+0xe/0x3b<br>
            &nbsp;[&lt;ffffffff8014a6f8&gt;] invalidate_partition+0x28/0x40<br>
            &nbsp;[&lt;ffffffff8010d6e7&gt;] rescan_partitions+0x37/0x279<br>
            &nbsp;[&lt;ffffffff800e78ec&gt;] do_open+0x231/0x30f<br>
            &nbsp;[&lt;ffffffff800e7c1e&gt;] blkdev_open+0x0/0x4f<br>
            &nbsp;[&lt;ffffffff800e7c41&gt;] blkdev_open+0x23/0x4f<br>
            &nbsp;[&lt;ffffffff8001eab6&gt;] __dentry_open+0xd9/0x1dc<br>
            &nbsp;[&lt;ffffffff8002751f&gt;] do_filp_open+0x2a/0x38<br>
            &nbsp;[&lt;ffffffff8002ae16&gt;] iput+0x4b/0x84<br>
            &nbsp;[&lt;ffffffff800dddf3&gt;] alternate_node_alloc+0x70/0x8c<br>
            &nbsp;[&lt;ffffffff80019f7e&gt;] do_sys_open+0x44/0xbe<br>
            &nbsp;[&lt;ffffffff8005d28d&gt;] tracesys+0xd5/0xe0<br>
          </font></span></div>
      <div dir="ltr" align="left"><span class="500464912-25072011"><font
            size="2" color="#0000ff" face="Arial">&nbsp;</font></span></div>
      <div align="left">
        <div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
          tahoma,verdana,sans-serif;" align="left"><font style="color:
            rgb(0, 0, 0);" size="2" face="tahoma,verdana,sans-serif">- <br>
            Simon Hargrave <a moz-do-not-send="true"
              title="blocked::blocked::mailto:szhargrave@ybs.co.uk
              blocked::mailto:szhargrave@ybs.co.uk
              mailto:szhargrave@ybs.co.uk"
              href="blocked::blocked::blocked::mailto:szhargrave@ybs.co.uk">szhargrave@ybs.co.uk</a>&nbsp;<br>
            Enterprise Systems&nbsp;Team Leader&nbsp;x2831</font><font
            style="color: rgb(0, 0, 0);" size="2"
            face="tahoma,verdana,sans-serif"><br>
            Yorkshire Building Society 01274 472831</font></div>
        <div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
          tahoma,verdana,sans-serif;" align="left"><font size="2"
            face="Arial"><a moz-do-not-send="true"
              title="http://wwwtech/sysint/tsgcore.asp"
              href="blocked::http://wwwtech/sysint/tsgcore.asp">http://wwwtech/sysint/tsgcore.asp</a></font></div>
      </div>
      <div>&nbsp;</div>
      <br>
      <div class="OutlookMessageHeader" dir="ltr" align="left"
        lang="en-us">
        <hr tabindex="-1">
        <font size="2" face="Tahoma"><b>From:</b>
          <a class="moz-txt-link-abbreviated" href="mailto:ocfs2-users-bounces@oss.oracle.com">ocfs2-users-bounces@oss.oracle.com</a>
          [<a class="moz-txt-link-freetext" href="mailto:ocfs2-users-bounces@oss.oracle.com">mailto:ocfs2-users-bounces@oss.oracle.com</a>] <b>On Behalf Of </b>Simon
          Hargrave<br>
          <b>Sent:</b> 25 July 2011 13:26<br>
          <b>To:</b> <a class="moz-txt-link-abbreviated" href="mailto:ocfs2-users@oss.oracle.com">ocfs2-users@oss.oracle.com</a><br>
          <b>Subject:</b> [Ocfs2-users] OCFS2 unmount problems after
          online resize<br>
        </font><br>
      </div>
      <p><span style="font-size: 8.2pt; font-family: 'MS Sans Serif';">Please
          read the warning at the end of this email<br>
        </span><span style="font-size: 8pt; font-family: 'Arial';">________________________________________________</span></p>
      <p><span style="font-size: 8pt; font-family: 'Arial';"></span>&nbsp;</p>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Hi</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">I'm doing some experimentation with OCFS2 (1.4 on
            RHEL5) with a view to using as a 2-node clustered
            filesystem.&nbsp; I seem to be having issues with online resize
            (which documentation suggests is supported under 1.4).&nbsp; I'm
            creating a LUN and publishing from a HP EVA6400 storage
            array to the 2 nodes, and creating a filesystem which works
            fine.&nbsp; However, it appears that if I online-increase the
            size of the LUN and subsequently the filesystem, it hangs
            indefinately on unmount.&nbsp; Full transcript of issue is as
            below: -</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">/etc/ocfs2/cluster.conf (created via ocfs2console)</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">--------------------------------------------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">node:<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ip_port = 7777<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ip_address = 10.34.8.90<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; number = 0<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; name = ybsxlx45<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; cluster = ocfs2</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">node:<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ip_port = 7777<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ip_address = 10.34.8.91<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; number = 1<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; name = ybsxlx46<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; cluster = ocfs2</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">cluster:<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; node_count = 2<br>
            &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; name = ocfs2</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">/etc/sysconfig/o2cb (created via ocfs2console)</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">----------------------------------------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># O2CB_ENABLED: 'true' means to load the driver on
            boot.<br>
            O2CB_ENABLED=true</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># O2CB_STACK: The name of the cluster stack backing
            O2CB.<br>
            O2CB_STACK=o2cb</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># O2CB_BOOTCLUSTER: If not empty, the name of a cluster
            to start.<br>
            O2CB_BOOTCLUSTER=ocfs2</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># O2CB_HEARTBEAT_THRESHOLD: Iterations before a node is
            considered dead.<br>
            O2CB_HEARTBEAT_THRESHOLD=</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># O2CB_IDLE_TIMEOUT_MS: Time in ms before a network
            connection is considered dead.<br>
            O2CB_IDLE_TIMEOUT_MS=</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># O2CB_KEEPALIVE_DELAY_MS: Max time in ms before a
            keepalive packet is sent<br>
            O2CB_KEEPALIVE_DELAY_MS=</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Arial"><font
              face="Courier New"># O2CB_RECONNECT_DELAY_MS: Min time in
              ms between connection attempts<br>
              O2CB_RECONNECT_DELAY_MS=</font><br>
          </font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">2GB LUN published to both nodes and appears as /dev/sdb</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">-------------------------------------------------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># grep sdb /proc/partitions<br>
            &nbsp;&nbsp; 8&nbsp;&nbsp;&nbsp; 16&nbsp;&nbsp;&nbsp; 2097152 sdb</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Operating System</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">----------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Red Hat Enterprise Linux Server release 5.6 (Tikanga)<br>
            Linux ybsxlx45 2.6.18-238.1.1.el5 #1 SMP Tue Jan 4 13:32:19
            EST 2011 x86_64 x86_64 x86_64 GNU/Linux</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">OCFS2 Packages</font></span></div>
      <div><font face="Courier New"><font size="2"><span
              class="502530112-25072011">--------------</span></font></font></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">ocfs2-2.6.18-238.1.1.el5-1.4.7-1.el5<br>
            ocfs2console-1.4.4-1.el5<br>
            ocfs2-tools-1.4.4-1.el5</font></span><span
          class="502530112-25072011"></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2"><font
              face="Courier New">Create and exercise filesystem</font></font></span></div>
      <div><span class="502530112-25072011"><font size="2"><font
              face="Courier New">------------------------------</font></font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># mkfs.ocfs2 -L "ocfstest" /dev/sdb<br>
            # mount -L ocfstest /ocfstest<br>
            # dd if=/dev/zero of=/ocfstest/file1 bs=1024k count=500 (on
            first node)<br>
            # dd if=/dev/zero of=/ocfstest/file2 bs=1024k count=500 (on
            second node)</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># df -k /ocfstest<br>
            Filesystem&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1K-blocks&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Used Available Use%
            Mounted on<br>
            /dev/sdb&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2097152&nbsp;&nbsp; 1320836&nbsp;&nbsp;&nbsp; 776316&nbsp; 63%
            /ocfstest</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Test unmount and remount</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">------------------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># strace -f -o before.txt umount /ocfstest<br>
            # mount -L ocfstest /ocfstest</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">LUN resized to 3GB and rescan on each host</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">------------------------------------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># echo "1" &gt; /sys/block/sdb/device/rescan<br>
            # grep sdb /proc/partitions<br>
            &nbsp;&nbsp; 8&nbsp;&nbsp;&nbsp; 16&nbsp;&nbsp;&nbsp; 3145728 sdb</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">(new device size showing)</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Online resize of filesystem</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">---------------------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># df -k /ocfstest<br>
            Filesystem&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1K-blocks&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Used Available Use%
            Mounted on<br>
            /dev/sdb&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2097152&nbsp;&nbsp; 1312644&nbsp;&nbsp;&nbsp; 784508&nbsp; 63%
            /ocfstest</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># tunefs.ocfs2 -S /dev/sdb</font></span></div>
      <div>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># df -k /ocfstest<br>
            Filesystem&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1K-blocks&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Used Available Use%
            Mounted on<br>
            /dev/sdb&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3145728&nbsp;&nbsp; 1312676&nbsp;&nbsp; 1833052&nbsp; 42%
            /ocfstest</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">(new filesystem size shows on both nodes)</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Exercise filesystem</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">-------------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># dd if=/dev/zero of=/ocfstest/file3 bs=1024k count=500
            (on first node)<br>
            # dd if=/dev/zero of=/ocfstest/file4 bs=1024k count=500 (on
            second node)</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># df -k /ocfstest<br>
            Filesystem&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1K-blocks&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Used Available Use%
            Mounted on<br>
            /dev/sdb&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3145728&nbsp;&nbsp; 2340772&nbsp;&nbsp;&nbsp; 804956&nbsp; 75%
            /ocfstest</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">(filesystem continues to function and can be filled
            past old size)</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Unmount filesystem</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">------------------</font></span></div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New"># strace -f -o after.txt umount /ocfstest</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">At this point, the unmount hangs forever and only a
            reboot will clear it.</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Comparing the "strace" output, the second one hangs
            during the call to umount() system call, after having
            checked that umount.ocfs2 doesn't exist.</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Whilst hung, the filesystem still "appears" in
            /etc/mtab and df output, but it is not mounted according to
            the kernel (/proc/mounts).</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Other node continues to function whilst in this state,
            filesystem does not hang.</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">So the question is, is this a bug, or am I doing
            something wrong?&nbsp; The OCFS2 1.4 user guide does state: -</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">9. Online File system Resize<br>
            Users can now grow the file system without having to unmount
            it. This feature requires a compatible clustered logical
            volume manager. Compatible volumes managers will be
            announced when support is available.</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">However since I'm using the raw device, not LVM this
            should work, provided the scsi device rescan has been
            performed on all nodes prior to running tunefs.ocfs2?</font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font face="Arial"><font
              size="2" face="Courier New">I should finally point out
              that this is being performed on 2 VMware guests, but the
              LUN is published directly to the guests as a Raw Device
              Mapping in Physical Compatibility Mode (passthru), as per
              the various VMware whitepapers.&nbsp; I don't have 2 spare
              SAN-attached crash-and-burn hosts to test this out
              physically, but I don't believe this should be a factor.</font></font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font face="Arial"><font
              size="2" face="Courier New">Any help appreciated as online
              resize is a must in a 24x7 clustered environment!</font></font></span></div>
      <div><span class="502530112-25072011"></span>&nbsp;</div>
      <div><span class="502530112-25072011"><font size="2" face="Courier
            New">Thanks</font></span></div>
      <div><span class="502530112-25072011"></span><span
          class="502530112-25072011"></span>&nbsp;</div>
      <div align="left">
        <div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
          tahoma,verdana,sans-serif;" align="left"><font style="color:
            rgb(0, 0, 0);" size="2" face="tahoma,verdana,sans-serif">- <br>
            Simon Hargrave <a moz-do-not-send="true"
              title="blocked::blocked::mailto:szhargrave@ybs.co.uk
              blocked::mailto:szhargrave@ybs.co.uk
              mailto:szhargrave@ybs.co.uk"
              href="blocked::blocked::blocked::mailto:szhargrave@ybs.co.uk">szhargrave@ybs.co.uk</a>&nbsp;<br>
            Enterprise Systems&nbsp;Team Leader&nbsp;x2831</font><font
            style="color: rgb(0, 0, 0);" size="2"
            face="tahoma,verdana,sans-serif"><br>
            Yorkshire Building Society 01274 472831</font></div>
        <div style="font-size: 100%; color: rgb(0, 0, 0); font-family:
          tahoma,verdana,sans-serif;" align="left"><font size="2"
            face="Arial"><a moz-do-not-send="true"
              title="http://wwwtech/sysint/tsgcore.asp"
              href="blocked::http://wwwtech/sysint/tsgcore.asp">http://wwwtech/sysint/tsgcore.asp</a></font></div>
      </div>
      <div>&nbsp;</div>
      <p><span style="font-size: 8pt; font-family: 'Arial';">________________________________________________</span></p>
      <p><span style="font-size: 8pt; font-family: 'Arial';">This email
          and any attachments are confidential and may contain
          privileged information.</span></p>
      <p><span style="font-size: 8pt; font-family: 'Arial';">If you are
          not the person for whom they are intended please return the
          email and then delete all material from any computer. You must
          not use the email or attachments for any purpose, nor disclose
          its contents to anyone other than the intended recipient.</span></p>
      <p><span style="font-size: 8pt; font-family: 'Arial';">Any
          statements made by an individual in this email do not
          necessarily reflect the views of the Yorkshire Building
          Society Group.</span></p>
      <p><span style="font-size: 8pt; font-family: 'Arial';">________________________________________________<br>
          <br>
          Yorkshire Building Society, which is authorised and regulated
          by the Financial Services Authority, chooses to introduce its
          customers to Legal &amp; General for the purposes of advising
          on and arranging life assurance and investment products
          bearing Legal &amp; General&#8217;s name.</span></p>
      <p><span style="font-size: 8pt; font-family: 'Arial';"><br>
          We are entered in the FSA Register and our FSA registration
          number is 106085 <a class="moz-txt-link-freetext" href="http://www.fsa.gov.uk/register">http://www.fsa.gov.uk/register</a><br>
          <br>
          Head Office: Yorkshire Building Society, Yorkshire House,
          Yorkshire Drive, Bradford, BD5 8LJ<br>
          Tel: 0845 1 200 100<br>
          <br>
          Visit Our Website<br>
          <a class="moz-txt-link-freetext" href="http://www.ybs.co.uk">http://www.ybs.co.uk</a><br>
          <br>
          All communications with us may be monitored/recorded to
          improve the quality of our service and for your protection and
          security.<br>
        </span></p>
      <p><span style="font-size: 8pt; font-family: 'Arial';"></span>&nbsp;</p>
      <br>
________________________________________________________________________<br>
      This e-mail has been scanned for all viruses by Star. The<br>
      service is powered by MessageLabs. For more information on a
      proactive<br>
      anti-virus service working around the clock, around the globe,
      visit:<br>
      <a class="moz-txt-link-freetext" href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
      <br>
________________________________________________________________________<br>
      This e-mail has been scanned for all viruses by Star. The<br>
      service is powered by MessageLabs. For more information on a
      proactive<br>
      anti-virus service working around the clock, around the globe,
      visit:<br>
      <a class="moz-txt-link-freetext" href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
      <br>
________________________________________________________________________<br>
      This e-mail has been scanned for all viruses by Star. The<br>
      service is powered by MessageLabs. For more information on a
      proactive<br>
      anti-virus service working around the clock, around the globe,
      visit:<br>
      <a class="moz-txt-link-freetext" href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
      <br>
________________________________________________________________________<br>
      This e-mail has been scanned for all viruses by Star. The<br>
      service is powered by MessageLabs. For more information on a
      proactive<br>
      anti-virus service working around the clock, around the globe,
      visit:<br>
      <a class="moz-txt-link-freetext" href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
      <br>
________________________________________________________________________<br>
      This e-mail has been scanned for all viruses by Star. The<br>
      service is powered by MessageLabs. For more information on a
      proactive<br>
      anti-virus service working around the clock, around the globe,
      visit:<br>
      <a class="moz-txt-link-freetext" href="http://www.star.net.uk">http://www.star.net.uk</a><br>
________________________________________________________________________<br>
      <pre wrap="">
<fieldset class="mimeAttachmentHeader"></fieldset>
_______________________________________________
Ocfs2-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Ocfs2-users@oss.oracle.com">Ocfs2-users@oss.oracle.com</a>
<a class="moz-txt-link-freetext" href="http://oss.oracle.com/mailman/listinfo/ocfs2-users">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a></pre>
    </blockquote>
    <br>
  </body>
</html>