<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.2900.5512" name=GENERATOR></HEAD>
<BODY>
<p><span style="font-family:'MS Sans Serif';font-size:8.2pt;">Please read the warning at the end of this email<br>
</span><span style="font-family:'Arial';font-size:8pt;">________________________________________________</span></p>
<p><span style="font-family:'Arial';font-size:8pt;"> </span></p>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>Hi</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>I'm doing
some experimentation with OCFS2 (1.4 on RHEL5) with a view to using as a 2-node
clustered filesystem. I seem to be having issues with online resize (which
documentation suggests is supported under 1.4). I'm creating a LUN and
publishing from a HP EVA6400 storage array to the 2 nodes, and creating a
filesystem which works fine. However, it appears that if I online-increase
the size of the LUN and subsequently the filesystem, it hangs indefinately on
unmount. Full transcript of issue is as below: -</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>/etc/ocfs2/cluster.conf (created via ocfs2console)</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>--------------------------------------------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>node:<BR> ip_port =
7777<BR> ip_address =
10.34.8.90<BR> number =
0<BR> name =
ybsxlx45<BR> cluster =
ocfs2</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>node:<BR> ip_port =
7777<BR> ip_address =
10.34.8.91<BR> number =
1<BR> name =
ybsxlx46<BR> cluster =
ocfs2</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>cluster:<BR> node_count =
2<BR> name = ocfs2</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>/etc/sysconfig/o2cb (created via ocfs2console)</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>----------------------------------------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>#
O2CB_ENABLED: 'true' means to load the driver on
boot.<BR>O2CB_ENABLED=true</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>#
O2CB_STACK: The name of the cluster stack backing
O2CB.<BR>O2CB_STACK=o2cb</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>#
O2CB_BOOTCLUSTER: If not empty, the name of a cluster to
start.<BR>O2CB_BOOTCLUSTER=ocfs2</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>#
O2CB_HEARTBEAT_THRESHOLD: Iterations before a node is considered
dead.<BR>O2CB_HEARTBEAT_THRESHOLD=</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>#
O2CB_IDLE_TIMEOUT_MS: Time in ms before a network connection is considered
dead.<BR>O2CB_IDLE_TIMEOUT_MS=</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>#
O2CB_KEEPALIVE_DELAY_MS: Max time in ms before a keepalive packet is
sent<BR>O2CB_KEEPALIVE_DELAY_MS=</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face=Arial size=2><FONT
face="Courier New"># O2CB_RECONNECT_DELAY_MS: Min time in ms between connection
attempts<BR>O2CB_RECONNECT_DELAY_MS=</FONT><BR></FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>2GB LUN
published to both nodes and appears as /dev/sdb</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>-------------------------------------------------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># grep sdb
/proc/partitions<BR> 8 16
2097152 sdb</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Operating
System</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>----------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Red Hat
Enterprise Linux Server release 5.6 (Tikanga)<BR>Linux ybsxlx45
2.6.18-238.1.1.el5 #1 SMP Tue Jan 4 13:32:19 EST 2011 x86_64 x86_64 x86_64
GNU/Linux</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>OCFS2
Packages</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"><FONT size=2><SPAN
class=502530112-25072011>--------------</SPAN></FONT></FONT></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>ocfs2-2.6.18-238.1.1.el5-1.4.7-1.el5<BR>ocfs2console-1.4.4-1.el5<BR>ocfs2-tools-1.4.4-1.el5</FONT></SPAN><SPAN
class=502530112-25072011><FONT></DIV></FONT></SPAN>
<DIV><SPAN class=502530112-25072011><FONT size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT size=2><FONT face="Courier New">Create
and exercise filesystem</FONT></FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT size=2><FONT
face="Courier New">------------------------------</FONT></FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># mkfs.ocfs2
-L "ocfstest" /dev/sdb<BR># mount -L ocfstest /ocfstest<BR># dd if=/dev/zero
of=/ocfstest/file1 bs=1024k count=500 (on first node)<BR># dd if=/dev/zero
of=/ocfstest/file2 bs=1024k count=500 (on second node)</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># df -k
/ocfstest<BR>Filesystem
1K-blocks Used Available Use% Mounted
on<BR>/dev/sdb
2097152 1320836 776316 63%
/ocfstest</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Test unmount
and remount</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>------------------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># strace -f
-o before.txt umount /ocfstest<BR># mount -L ocfstest
/ocfstest</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>LUN resized
to 3GB and rescan on each host</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>------------------------------------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># echo "1"
> /sys/block/sdb/device/rescan<BR># grep sdb /proc/partitions<BR>
8 16 3145728 sdb</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>(new device
size showing)</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Online
resize of filesystem</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>---------------------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># df -k
/ocfstest<BR>Filesystem
1K-blocks Used Available Use% Mounted
on<BR>/dev/sdb
2097152 1312644 784508 63%
/ocfstest</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>#
tunefs.ocfs2 -S /dev/sdb</FONT></SPAN></DIV>
<DIV><FONT face="Courier New"></FONT> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># df -k
/ocfstest<BR>Filesystem
1K-blocks Used Available Use% Mounted
on<BR>/dev/sdb
3145728 1312676 1833052 42%
/ocfstest</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>(new
filesystem size shows on both nodes)</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Exercise
filesystem</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>-------------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># dd
if=/dev/zero of=/ocfstest/file3 bs=1024k count=500 (on first node)<BR># dd
if=/dev/zero of=/ocfstest/file4 bs=1024k count=500 (on second
node)</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># df -k
/ocfstest<BR>Filesystem
1K-blocks Used Available Use% Mounted
on<BR>/dev/sdb
3145728 2340772 804956 75%
/ocfstest</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>(filesystem
continues to function and can be filled past old size)</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Unmount
filesystem</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>------------------</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2># strace -f
-o after.txt umount /ocfstest</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>At this
point, the unmount hangs forever and only a reboot will clear
it.</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Comparing
the "strace" output, the second one hangs during the call to umount() system
call, after having checked that umount.ocfs2 doesn't exist.</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Whilst hung,
the filesystem still "appears" in /etc/mtab and df output, but it is not mounted
according to the kernel (/proc/mounts).</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>Other node
continues to function whilst in this state, filesystem does not
hang.</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>So the
question is, is this a bug, or am I doing something wrong? The OCFS2 1.4
user guide does state: -</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>9. Online
File system Resize<BR>Users can now grow the file system without having to
unmount it. This feature requires a compatible clustered logical volume manager.
Compatible volumes managers will be announced when support is
available.</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New" size=2>However
since I'm using the raw device, not LVM this should work, provided the scsi
device rescan has been performed on all nodes prior to running
tunefs.ocfs2?</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face=Arial><FONT face="Courier New"
size=2>I should finally point out that this is being performed on 2 VMware
guests, but the LUN is published directly to the guests as a Raw Device Mapping
in Physical Compatibility Mode (passthru), as per the various VMware
whitepapers. I don't have 2 spare SAN-attached crash-and-burn hosts to
test this out physically, but I don't believe this should be a
factor.</FONT></FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face=Arial><FONT face="Courier New"
size=2></FONT></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face=Arial><FONT face="Courier New"
size=2>Any help appreciated as online resize is a must in a 24x7 clustered
environment!</FONT></FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=502530112-25072011><FONT face="Courier New"
size=2>Thanks</FONT></SPAN></DIV>
<DIV><SPAN class=502530112-25072011></SPAN><SPAN
class=502530112-25072011></SPAN><FONT face=Arial size=2></FONT> </DIV>
<DIV align=left>
<DIV
style="FONT-SIZE: 100%; COLOR: rgb(0,0,0); FONT-FAMILY: tahoma,verdana,sans-serif"
align=left><FONT style="COLOR: rgb(0,0,0)" face=tahoma,verdana,sans-serif
size=2>- <BR>Simon Hargrave <A
title="blocked::blocked::mailto:szhargrave@ybs.co.uk blocked::mailto:szhargrave@ybs.co.uk mailto:szhargrave@ybs.co.uk"
href="blocked::blocked::blocked::mailto:szhargrave@ybs.co.uk">szhargrave@ybs.co.uk</A> <BR>Enterprise
Systems Team Leader x2831</FONT><FONT style="COLOR: rgb(0,0,0)"
face=tahoma,verdana,sans-serif size=2><BR>Yorkshire Building Society 01274
472831</FONT></DIV>
<DIV
style="FONT-SIZE: 100%; COLOR: rgb(0,0,0); FONT-FAMILY: tahoma,verdana,sans-serif"
align=left><FONT face=Arial size=2><A title=http://wwwtech/sysint/tsgcore.asp
href="blocked::http://wwwtech/sysint/tsgcore.asp">http://wwwtech/sysint/tsgcore.asp</A></FONT></DIV></DIV>
<DIV> </DIV>
<p><span style="font-family:'Arial';font-size:8pt;">________________________________________________</span></p>
<p><span style="font-family:'Arial';font-size:8pt;">This email and any attachments are confidential and may contain privileged information.</span></p>
<p><span style="font-family:'Arial';font-size:8pt;">If you are not the person for whom they are intended please return the email and then delete all material from any computer. You must not use the email or attachments for any purpose, nor disclose its contents to anyone other than the intended recipient.</span></p>
<p><span style="font-family:'Arial';font-size:8pt;">Any statements made by an individual in this email do not necessarily reflect the views of the Yorkshire Building Society Group.</span></p>
<p><span style="font-family:'Arial';font-size:8pt;">________________________________________________<br>
<br>
Yorkshire Building Society, which is authorised and regulated by the Financial Services Authority, chooses to introduce its customers to Legal & General for the purposes of advising on and arranging life assurance and investment products bearing Legal & General’s name.</span></p>
<p><span style="font-family:'Arial';font-size:8pt;"><br>
We are entered in the FSA Register and our FSA registration number is 106085 http://www.fsa.gov.uk/register<br>
<br>
Head Office: Yorkshire Building Society, Yorkshire House, Yorkshire Drive, Bradford, BD5 8LJ<br>
Tel: 0845 1 200 100<br>
<br>
Visit Our Website<br>
http://www.ybs.co.uk<br>
<br>
All communications with us may be monitored/recorded to improve the quality of our service and for your protection and security.<br>
</span></p>
<p><span style="font-family:'Arial';font-size:8pt;"> </span></p><BR>
________________________________________________________________________<BR>
This e-mail has been scanned for all viruses by Star. The<BR>
service is powered by MessageLabs. For more information on a proactive<BR>
anti-virus service working around the clock, around the globe, visit:<BR>
http://www.star.net.uk<BR>
________________________________________________________________________<BR>
</BODY></HTML>