[Ocfs2-users] 10 Node OCFS2 Cluster - Performance

[Sunil Mushran]

Get some iostat/vmstat numbers.
# iostat -x /dev/sdX 1
# vmstat 1

How much memory do the nodes have? If more than 2G, XFS
is probably leveraging its delayed allocation feature to heavily
cache the writes. iostat/vmstat should show that.

Is the timing for the 10 node test cumulative?

Laurence Mayer wrote:
> Hi,
>
> I am currently running a 10 Node OCFS2  Cluster (version 1.3.9-0ubuntu1) 
> on Ubuntu Server 8.04 x86_64.
> Linux n1 2.6.24-24-server #1 SMP Tue Jul 7 19:39:36 UTC 2009 x86_64 
> GNU/Linux
>
> The Cluster is connected to a 1Tera iSCSI Device presented by an IBM 
> 3300 Storage System, running over a 1Gig Network.
> Mounted on all nodes:  /dev/sdc1 on /cfs1 type ocfs2 
> (rw,_netdev,data=writeback,heartbeat=local)
> Maximum Nodes: 32
> Block Size=4k
> Cluster Size=4k
>
> My testing shows that to write simultaneously from the 10 nodes, 10 x 
> 200Meg files (1 file per node,  total of 2Gig) takes ~23.54secs.
> Reading the files back can take just as long.
>
> Do these numbers sound correct?
>
> Doing dd if=/dev/zero of=/cfs1/xxxxx/txt count=1000 bs=2048000 (2Gig) 
> from a single node takes 16secs.
>
> (running the same dd command on an XFS filesystem connected to the same 
> iSCSI Storage takes 2.2secs)
>
> Is there any tips & tricks to improve performance on OCFS2?
>
> Thanks in advance
> Laurence
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>