[Ocfs2-users] The mounting of too many OCFS2 volumes (i.e. 50 or more) per cluster

[Marko Sutic]

Hi Sunil,

thank you for answer.
Can you please explain me this problem with o2cb stack heartbeats.

We're using IBM XIV storage system as our storage solution.
This is 2 node active/passive failover cluster with 1 Gbit/s ethernet for
interconnect and 10 Gbit/s ethernet for public network.

Should we expect heartbeat problems due to the our storage solution or
interconnect?

Can we avoid o2cb stack heartbeat problems with fewer OCFS2 volumes mounted?

Regards,
Marko Sutic




On Thu, Sep 15, 2011 at 8:57 PM, Sunil Mushran <sunil.mushran at oracle.com>wrote:

> That's very old. We have users having 50+ mounts. The one disadvantage
> is that the o2cb stack heartbeats on all mounts. That problem will be
> addressed
> in 1.8 (the tools will be released soon), with global heartbeat (hb volumes
> are user-configurable).
>
> Having said that, the number of volumes depends on the hardware capability.
> It is hard to provide simple rules for this. The best solution is to test
> and figure
> out the perf bottleneck.
>
>
> On 09/15/2011 01:00 AM, Marko Sutic wrote:
>
>> Hi list,
>>
>> I have a question concerning number of OCFS2 volumes per cluster.
>>
>> From our storage vendor we received recommendations how to configure mount
>> volumes per database to gain the best possible performance.
>> Basically, we should separate redo logs,archive logs, temp, data, etc.
>>
>> This is not hard to configure but I'm concerned about this line that I've
>> found on Oracle support site:
>>
>> Linux OCFS2 - Best Practices [ID 603080.1]
>> Number of volumes
>> The mounting of too many OCFS2 volumes (i.e. 50 or more) per cluster is
>> likely to create a performance (process) bottleneck - this is not
>> specifically related to OCFS2. Ideally, it is desirable to have no more than
>> around 20 OCFS2 partitions per system.
>> See also http://oss.oracle.com/**bugzilla/show_bug.cgi?id=992<http://oss.oracle.com/bugzilla/show_bug.cgi?id=992>
>>
>>
>>
>> In our configuration we would need more than 60 OCFS2 mount volumes per
>> cluster so I don't know should we expect any performance problems due to the
>> number of OCFS2 volumes?
>> What is your recommendation about number of OCFS2 volumes per cluster
>> regarding performance and stability?
>>
>>
>> Our kernel and ocfs2 version:
>> # uname -rvp
>> 2.6.18-274.0.0.0.1.el5 #1 SMP Mon Jul 25 14:33:14 EDT 2011 x86_64
>>
>> # rpm -qa|grep ocfs2
>> ocfs2-tools-1.6.3-2.el5
>> ocfs2-2.6.18-274.0.0.0.1.el5-**1.4.8-2.el5
>> ocfs2console-1.6.3-2.el5
>>
>>
>>
>> Thank you very much for your help.
>>
>> Regards,
>> Marko Sutic
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110916/9f412160/attachment.html