[Ocfs2-users] Slow OCFS2 on very high-end hardware

[Joel Becker]

On Sun, Dec 04, 2011 at 10:48:40AM +0100, Marek Królikowski wrote:
> From: Joel Becker
> Sent: Sunday, December 04, 2011 2:10 AM
> To: MarekKrólikowski
> Cc: ocfs2-users at oss.oracle.com
> Subject: Re: [Ocfs2-users] Slow OCFS2 on very high-end hardware
> 
> On Sat, Dec 03, 2011 at 08:32:30PM +0100, Marek Królikowski wrote:
> >> Hello
> >> Today i create a cluster with OCFS2.
> >> I name servers MAIL1 and MAIL2
> >> Both connect via HBA card with 2 links 4Gbit/s and EMC storage with FC 
> >> RAID10.
> >> Both connect to this same Cisco switch 1Gbit/s line.
> >> Hardware is awsome but ocfs2 work verrrry slow.
> >> I use Gentoo Linux with Kernel 3.0.6 and ocfs2-tools-1.6.4 that will be 
> >> postfix/imap/pop3 cluster with maildir support so there will be many many 
> >> directores and little files.
> >> I link /home to my ocfs2 and do few tests but work verry slow...
> >> When i write any file on server MAIL1 and try check mailbox from MAIL2 
> >> working amazing slow...
> >I've gotta ask, what is "amazingly slow" to you?  A cluster
> >filesystem accessing the same files from two places necessarily is
> >slower than local access.  But if it is slow enough that you notice it
> >by hand, it's probably something in configuration.
> >Did you select the 'mail' filesystem type when creating the
> >filesystem?  This probably shouldn't affect your simple test, but it
> >will absolutely help as your system grows.
> When i copy any file from/to MAIL1 and enter to home directory (using MC) 
> where is 7000 users on MAIL2 i need wait 30+ sec.... at normal when  i don`t 
> copy write on ocfs2 i wait 3 sec.

	Yeah, that seems really long.  Are you using indexed
directories?  I don't think your multipath setup is the problem.

Joel

-- 

"There are only two ways to live your life. One is as though nothing
 is a miracle. The other is as though everything is a miracle."
        - Albert Einstein

			http://www.jlbec.org/
			jlbec at evilplan.org