[Ocfs2-users] multiple cluster doesn't work
Richard Pickett
richard.pickett at csrtechnologies.com
Tue Jun 28 08:07:40 PDT 2011
1 Terabyte. We have 3 1Terabyte drives. They are already being replicated by
the lower-layer architecture, so we don't need to raid them. We'd like to be
able to use all three devices at the same time for archive purposes.
I'm surprised to find out ocfs2 only allows access to one of these devices
at a time.
What release was your free() fix in?
Thanks and God Bless,
Richard W. Pickett, Jr.
www.MyHaitianAdoption.org
P.S. Have you downloaded the journal from my trip to Haiti:
http://www.myhaitianadoption.org/trips/journal-earthquake-rescue-jan-23-feb-2/
On Tue, Jun 28, 2011 at 12:09 AM, Sunil Mushran <sunil.mushran at oracle.com>wrote:
> **
> Sorry not following you. What's 1T?
>
> The link has been added to the bug you posted.
>
>
> On 6/27/2011 9:26 PM, Richard Pickett wrote:
>
> We need 3 clusters concurrently because each one is only 1T each, the
> underlying infrastructure won't allow us to combine the 3 into one device
> without shelling out more money than the company is willing to pay.
>
> Where/what is the 'bz' so I can go find the link?
>
>
> Thanks and God Bless,
>
> Richard W. Pickett, Jr.
> www.MyHaitianAdoption.org
>
> P.S. Have you downloaded the journal from my trip to Haiti:
>
>
> http://www.myhaitianadoption.org/trips/journal-earthquake-rescue-jan-23-feb-2/
>
>
>
> On Mon, Jun 27, 2011 at 9:05 PM, Sunil Mushran <sunil.mushran at oracle.com>wrote:
>
>> Whereas the cluster.conf allows users to define multiple
>> clusters, only one cluster can be active at any time. The bug
>> you ran into has probably been fixed. The link has been posted
>> in the bz.
>>
>> Why do you need multiple clusters active concurrently?
>>
>>
>> On 06/27/2011 04:44 PM, Richard Pickett wrote:
>>
>> We're trying to setup 3 PRDM partitions (VMware) across 2 nodes. As long
>> as only one is configured in cluster.conf, there's not problem. As soon as
>> we try to use 2 or more we get issues.
>>
>> It looks the same as bug 636:
>>
>> http://oss.oracle.com/bugzilla/show_bug.cgi?id=636
>>
>> I posted my cluster.conf and command line results there. I'm including
>> them here in the hopes that someone on this list can offer a shorter
>> solution than recompiling the o2cb_ctl (which we have in process).
>>
>> Thanks in advance for any and all help. Here's my post on the bug:
>>
>> seems like we're back to having this bug again. I'm posting both
>> cluster.conf and the error that happens at the command line.
>>
>> <cluster.conf>
>> cluster:
>> node_count = 2
>> name = xport1
>>
>> node:
>> ip_port = 7777
>> ip_address = 10.8.4.81
>> number = 1
>> name = wings
>> cluster = xport1
>> node:
>> ip_port = 7777
>> ip_address = 10.8.4.82
>> number = 2
>> name = xtc
>> cluster = xport1
>>
>> cluster:
>> node_count = 2
>> name = xport2
>>
>> node:
>> ip_port = 7778
>> ip_address = 10.8.4.81
>> number = 1
>> name = wings
>> cluster = xport2
>> node:
>> ip_port = 7778
>> ip_address = 10.8.4.82
>> number = 2
>> name = xtc
>> cluster = xport2
>>
>> cluster:
>> node_count = 2
>> name = xport3
>>
>> node:
>> ip_port = 7779
>> ip_address = 10.8.4.81
>> number = 1
>> name = wings
>> cluster = xport3
>> node:
>> ip_port = 7779
>> ip_address = 10.8.4.82
>> number = 2
>> name = xtc
>> cluster = xport3
>> </cluster.conf>
>>
>> If I comment out the second and third "cluster" I don't hit this error,
>> but then I can't load multiple clusters on one machine.
>>
>> Command line:
>>
>> root at wings:/var/log# /etc/init.d/o2cb start
>> Loading filesystem "configfs": OK
>> Mounting configfs filesystem at /sys/kernel/config: OK
>> Loading stack plugin "o2cb": OK
>> Loading filesystem "ocfs2_dlmfs": OK
>> Mounting ocfs2_dlmfs filesystem at /dlm: OK
>> Setting cluster stack "o2cb": OK
>> Starting O2CB cluster xport1: *** glibc detected *** o2cb_ctl: free():
>> invalid pointer: 0x0000000001179080 ***
>> ======= Backtrace: =========
>> /lib/libc.so.6(+0x774b6)[0x7fab33f234b6]
>> /lib/libc.so.6(cfree+0x73)[0x7fab33f29c83]
>> o2cb_ctl[0x40511a]
>> o2cb_ctl[0x403a22]
>> /lib/libc.so.6(__libc_start_main+0xfe)[0x7fab33ecad8e]
>> o2cb_ctl[0x402b59]
>> ======= Memory map: ========
>> 00400000-00411000 r-xp 00000000 08:01 131365
>> /sbin/o2cb_ctl
>> 00610000-00611000 r--p 00010000 08:01 131365
>> /sbin/o2cb_ctl
>> 00611000-00612000 rw-p 00011000 08:01 131365
>> /sbin/o2cb_ctl
>> 01178000-01199000 rw-p 00000000 00:00 0
>> [heap]
>> 7fab2c000000-7fab2c021000 rw-p 00000000 00:00 0
>> 7fab2c021000-7fab30000000 ---p 00000000 00:00 0
>> 7fab33848000-7fab3385d000 r-xp 00000000 08:01 917566
>> /lib/libgcc_s.so.1
>> 7fab3385d000-7fab33a5c000 ---p 00015000 08:01 917566
>> /lib/libgcc_s.so.1
>> 7fab33a5c000-7fab33a5d000 r--p 00014000 08:01 917566
>> /lib/libgcc_s.so.1
>> 7fab33a5d000-7fab33a5e000 rw-p 00015000 08:01 917566
>> /lib/libgcc_s.so.1
>> 7fab33a5e000-7fab33a76000 r-xp 00000000 08:01 921986
>> /lib/libpthread-2.12.1.so
>> 7fab33a76000-7fab33c75000 ---p 00018000 08:01 921986
>> /lib/libpthread-2.12.1.so
>> 7fab33c75000-7fab33c76000 r--p 00017000 08:01 921986
>> /lib/libpthread-2.12.1.so
>> 7fab33c76000-7fab33c77000 rw-p 00018000 08:01 921986
>> /lib/libpthread-2.12.1.so
>> 7fab33c77000-7fab33c7b000 rw-p 00000000 00:00 0
>> 7fab33c7b000-7fab33cab000 r-xp 00000000 08:01 917607
>> /lib/libpcre.so.3.12.1
>> 7fab33cab000-7fab33eaa000 ---p 00030000 08:01 917607
>> /lib/libpcre.so.3.12.1
>> 7fab33eaa000-7fab33eab000 r--p 0002f000 08:01 917607
>> /lib/libpcre.so.3.12.1
>> 7fab33eab000-7fab33eac000 rw-p 00030000 08:01 917607
>> /lib/libpcre.so.3.12.1
>> 7fab33eac000-7fab34026000 r-xp 00000000 08:01 921984
>> /lib/libc-2.12.1.so
>> 7fab34026000-7fab34225000 ---p 0017a000 08:01 921984
>> /lib/libc-2.12.1.so
>> 7fab34225000-7fab34229000 r--p 00179000 08:01 921984
>> /lib/libc-2.12.1.so
>> 7fab34229000-7fab3422a000 rw-p 0017d000 08:01 921984
>> /lib/libc-2.12.1.so
>> 7fab3422a000-7fab3422f000 rw-p 00000000 00:00 0
>> 7fab3422f000-7fab34232000 r-xp 00000000 08:01 917517
>> /lib/libcom_err.so.2.1
>> 7fab34232000-7fab34431000 ---p 00003000 08:01 917517
>> /lib/libcom_err.so.2.1
>> 7fab34431000-7fab34432000 r--p 00002000 08:01 917517
>> /lib/libcom_err.so.2.1
>> 7fab34432000-7fab34433000 rw-p 00003000 08:01 917517
>> /lib/libcom_err.so.2.1
>> 7fab34433000-7fab34513000 r-xp 00000000 08:01 917576
>> /lib/libglib-2.0.so.0.2600.1
>> 7fab34513000-7fab34712000 ---p 000e0000 08:01 917576
>> /lib/libglib-2.0.so.0.2600.1
>> 7fab34712000-7fab34713000 r--p 000df000 08:01 917576
>> /lib/libglib-2.0.so.0.2600.1
>> 7fab34713000-7fab34714000 rw-p 000e0000 08:01 917576
>> /lib/libglib-2.0.so.0.2600.1
>> 7fab34714000-7fab34715000 rw-p 00000000 00:00 0
>> 7fab34715000-7fab34735000 r-xp 00000000 08:01 921992
>> /lib/ld-2.12.1.so
>> 7fab3492a000-7fab3492e000 rw-p 00000000 00:00 0
>> 7fab34933000-7fab34935000 rw-p 00000000 00:00 0
>> 7fab34935000-7fab34936000 r--p 00020000 08:01 921992
>> /lib/ld-2.12.1.so
>> 7fab34936000-7fab34937000 rw-p 00021000 08:01 921992
>> /lib/ld-2.12.1.so
>> 7fab34937000-7fab34938000 rw-p 00000000 00:00 0
>> 7fff14f37000-7fff14f58000 rw-p 00000000 00:00 0
>> [stack]
>> 7fff14fff000-7fff15000000 r-xp 00000000 00:00 0
>> [vdso]
>> ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
>> [vsyscall]
>> Failed
>> Cluster xport1 created
>> Node wings added
>> Node xtc added
>> Stopping O2CB cluster xport1: *** glibc detected *** o2cb_ctl: free():
>> invalid pointer: 0x00000000012daf00 ***
>> ======= Backtrace: =========
>> /lib/libc.so.6(+0x774b6)[0x7f922e12b4b6]
>> /lib/libc.so.6(cfree+0x73)[0x7f922e131c83]
>> o2cb_ctl[0x40511a]
>> o2cb_ctl[0x403a22]
>> /lib/libc.so.6(__libc_start_main+0xfe)[0x7f922e0d2d8e]
>> o2cb_ctl[0x402b59]
>> ======= Memory map: ========
>> 00400000-00411000 r-xp 00000000 08:01 131365
>> /sbin/o2cb_ctl
>> 00610000-00611000 r--p 00010000 08:01 131365
>> /sbin/o2cb_ctl
>> 00611000-00612000 rw-p 00011000 08:01 131365
>> /sbin/o2cb_ctl
>> 012da000-012fb000 rw-p 00000000 00:00 0
>> [heap]
>> 7f9228000000-7f9228021000 rw-p 00000000 00:00 0
>> 7f9228021000-7f922c000000 ---p 00000000 00:00 0
>> 7f922da50000-7f922da65000 r-xp 00000000 08:01 917566
>> /lib/libgcc_s.so.1
>> 7f922da65000-7f922dc64000 ---p 00015000 08:01 917566
>> /lib/libgcc_s.so.1
>> 7f922dc64000-7f922dc65000 r--p 00014000 08:01 917566
>> /lib/libgcc_s.so.1
>> 7f922dc65000-7f922dc66000 rw-p 00015000 08:01 917566
>> /lib/libgcc_s.so.1
>> 7f922dc66000-7f922dc7e000 r-xp 00000000 08:01 921986
>> /lib/libpthread-2.12.1.so
>> 7f922dc7e000-7f922de7d000 ---p 00018000 08:01 921986
>> /lib/libpthread-2.12.1.so
>> 7f922de7d000-7f922de7e000 r--p 00017000 08:01 921986
>> /lib/libpthread-2.12.1.so
>> 7f922de7e000-7f922de7f000 rw-p 00018000 08:01 921986
>> /lib/libpthread-2.12.1.so
>> 7f922de7f000-7f922de83000 rw-p 00000000 00:00 0
>> 7f922de83000-7f922deb3000 r-xp 00000000 08:01 917607
>> /lib/libpcre.so.3.12.1
>> 7f922deb3000-7f922e0b2000 ---p 00030000 08:01 917607
>> /lib/libpcre.so.3.12.1
>> 7f922e0b2000-7f922e0b3000 r--p 0002f000 08:01 917607
>> /lib/libpcre.so.3.12.1
>> 7f922e0b3000-7f922e0b4000 rw-p 00030000 08:01 917607
>> /lib/libpcre.so.3.12.1
>> 7f922e0b4000-7f922e22e000 r-xp 00000000 08:01 921984
>> /lib/libc-2.12.1.so
>> 7f922e22e000-7f922e42d000 ---p 0017a000 08:01 921984
>> /lib/libc-2.12.1.so
>> 7f922e42d000-7f922e431000 r--p 00179000 08:01 921984
>> /lib/libc-2.12.1.soFailed
>>
>>
>> _______________________________________________
>> Ocfs2-users mailing listOcfs2-users at oss.oracle.comhttp://oss.oracle.com/mailman/listinfo/ocfs2-users
>>
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110628/77f44a32/attachment-0001.html
More information about the Ocfs2-users
mailing list