[Ocfs2-users] multiple cluster doesn't work

Richard Pickett richard.pickett at csrtechnologies.com
Mon Jun 27 21:26:23 PDT 2011


We need 3 clusters concurrently because each one is only 1T each, the
underlying infrastructure won't allow us to combine the 3 into one device
without shelling out more money than the company is willing to pay.

Where/what is the 'bz' so I can go find the link?


Thanks and God Bless,

Richard W. Pickett, Jr.
www.MyHaitianAdoption.org

P.S. Have you downloaded the journal from my trip to Haiti:

http://www.myhaitianadoption.org/trips/journal-earthquake-rescue-jan-23-feb-2/



On Mon, Jun 27, 2011 at 9:05 PM, Sunil Mushran <sunil.mushran at oracle.com>wrote:

> **
> Whereas the cluster.conf allows users to define multiple
> clusters, only one cluster can be active at any time. The bug
> you ran into has probably been fixed. The link has been posted
> in the bz.
>
> Why do you need multiple clusters active concurrently?
>
>
> On 06/27/2011 04:44 PM, Richard Pickett wrote:
>
> We're trying to setup 3 PRDM partitions (VMware) across 2 nodes. As long as
> only one is configured in cluster.conf, there's not problem. As soon as we
> try to use 2 or more we get issues.
>
> It looks the same as bug 636:
>
> http://oss.oracle.com/bugzilla/show_bug.cgi?id=636
>
> I posted my cluster.conf and command line results there. I'm including them
> here in the hopes that someone on this list can offer a shorter solution
> than recompiling the o2cb_ctl (which we have in process).
>
> Thanks in advance for any and all help. Here's my post on the bug:
>
> seems like we're back to having this bug again. I'm posting both
> cluster.conf and the error that happens at the command line.
>
> <cluster.conf>
> cluster:
>         node_count = 2
>         name = xport1
>
> node:
>         ip_port = 7777
>         ip_address = 10.8.4.81
>         number = 1
>         name = wings
>         cluster = xport1
> node:
>         ip_port = 7777
>         ip_address = 10.8.4.82
>         number = 2
>         name = xtc
>         cluster = xport1
>
> cluster:
>        node_count = 2
>        name = xport2
>
> node:
>        ip_port = 7778
>        ip_address = 10.8.4.81
>        number = 1
>        name = wings
>        cluster = xport2
> node:
>        ip_port = 7778
>        ip_address = 10.8.4.82
>        number = 2
>        name = xtc
>        cluster = xport2
>
> cluster:
>        node_count = 2
>        name = xport3
>
> node:
>        ip_port = 7779
>        ip_address = 10.8.4.81
>        number = 1
>        name = wings
>        cluster = xport3
> node:
>        ip_port = 7779
>        ip_address = 10.8.4.82
>        number = 2
>        name = xtc
>        cluster = xport3
> </cluster.conf>
>
> If I comment out the second and third "cluster" I don't hit this error, but
> then I can't load multiple clusters on one machine.
>
> Command line:
>
> root at wings:/var/log# /etc/init.d/o2cb start
> Loading filesystem "configfs": OK
> Mounting configfs filesystem at /sys/kernel/config: OK
> Loading stack plugin "o2cb": OK
> Loading filesystem "ocfs2_dlmfs": OK
> Mounting ocfs2_dlmfs filesystem at /dlm: OK
> Setting cluster stack "o2cb": OK
> Starting O2CB cluster xport1: *** glibc detected *** o2cb_ctl: free():
> invalid pointer: 0x0000000001179080 ***
> ======= Backtrace: =========
> /lib/libc.so.6(+0x774b6)[0x7fab33f234b6]
> /lib/libc.so.6(cfree+0x73)[0x7fab33f29c83]
> o2cb_ctl[0x40511a]
> o2cb_ctl[0x403a22]
> /lib/libc.so.6(__libc_start_main+0xfe)[0x7fab33ecad8e]
> o2cb_ctl[0x402b59]
> ======= Memory map: ========
> 00400000-00411000 r-xp 00000000 08:01 131365
> /sbin/o2cb_ctl
> 00610000-00611000 r--p 00010000 08:01 131365
> /sbin/o2cb_ctl
> 00611000-00612000 rw-p 00011000 08:01 131365
> /sbin/o2cb_ctl
> 01178000-01199000 rw-p 00000000 00:00 0
> [heap]
> 7fab2c000000-7fab2c021000 rw-p 00000000 00:00 0
> 7fab2c021000-7fab30000000 ---p 00000000 00:00 0
> 7fab33848000-7fab3385d000 r-xp 00000000 08:01 917566
> /lib/libgcc_s.so.1
> 7fab3385d000-7fab33a5c000 ---p 00015000 08:01 917566
> /lib/libgcc_s.so.1
> 7fab33a5c000-7fab33a5d000 r--p 00014000 08:01 917566
> /lib/libgcc_s.so.1
> 7fab33a5d000-7fab33a5e000 rw-p 00015000 08:01 917566
> /lib/libgcc_s.so.1
> 7fab33a5e000-7fab33a76000 r-xp 00000000 08:01 921986
> /lib/libpthread-2.12.1.so
> 7fab33a76000-7fab33c75000 ---p 00018000 08:01 921986
> /lib/libpthread-2.12.1.so
> 7fab33c75000-7fab33c76000 r--p 00017000 08:01 921986
> /lib/libpthread-2.12.1.so
> 7fab33c76000-7fab33c77000 rw-p 00018000 08:01 921986
> /lib/libpthread-2.12.1.so
> 7fab33c77000-7fab33c7b000 rw-p 00000000 00:00 0
> 7fab33c7b000-7fab33cab000 r-xp 00000000 08:01 917607
> /lib/libpcre.so.3.12.1
> 7fab33cab000-7fab33eaa000 ---p 00030000 08:01 917607
> /lib/libpcre.so.3.12.1
> 7fab33eaa000-7fab33eab000 r--p 0002f000 08:01 917607
> /lib/libpcre.so.3.12.1
> 7fab33eab000-7fab33eac000 rw-p 00030000 08:01 917607
> /lib/libpcre.so.3.12.1
> 7fab33eac000-7fab34026000 r-xp 00000000 08:01 921984
> /lib/libc-2.12.1.so
> 7fab34026000-7fab34225000 ---p 0017a000 08:01 921984
> /lib/libc-2.12.1.so
> 7fab34225000-7fab34229000 r--p 00179000 08:01 921984
> /lib/libc-2.12.1.so
> 7fab34229000-7fab3422a000 rw-p 0017d000 08:01 921984
> /lib/libc-2.12.1.so
> 7fab3422a000-7fab3422f000 rw-p 00000000 00:00 0
> 7fab3422f000-7fab34232000 r-xp 00000000 08:01 917517
> /lib/libcom_err.so.2.1
> 7fab34232000-7fab34431000 ---p 00003000 08:01 917517
> /lib/libcom_err.so.2.1
> 7fab34431000-7fab34432000 r--p 00002000 08:01 917517
> /lib/libcom_err.so.2.1
> 7fab34432000-7fab34433000 rw-p 00003000 08:01 917517
> /lib/libcom_err.so.2.1
> 7fab34433000-7fab34513000 r-xp 00000000 08:01 917576
> /lib/libglib-2.0.so.0.2600.1
> 7fab34513000-7fab34712000 ---p 000e0000 08:01 917576
> /lib/libglib-2.0.so.0.2600.1
> 7fab34712000-7fab34713000 r--p 000df000 08:01 917576
> /lib/libglib-2.0.so.0.2600.1
> 7fab34713000-7fab34714000 rw-p 000e0000 08:01 917576
> /lib/libglib-2.0.so.0.2600.1
> 7fab34714000-7fab34715000 rw-p 00000000 00:00 0
> 7fab34715000-7fab34735000 r-xp 00000000 08:01 921992
> /lib/ld-2.12.1.so
> 7fab3492a000-7fab3492e000 rw-p 00000000 00:00 0
> 7fab34933000-7fab34935000 rw-p 00000000 00:00 0
> 7fab34935000-7fab34936000 r--p 00020000 08:01 921992
> /lib/ld-2.12.1.so
> 7fab34936000-7fab34937000 rw-p 00021000 08:01 921992
> /lib/ld-2.12.1.so
> 7fab34937000-7fab34938000 rw-p 00000000 00:00 0
> 7fff14f37000-7fff14f58000 rw-p 00000000 00:00 0
> [stack]
> 7fff14fff000-7fff15000000 r-xp 00000000 00:00 0
> [vdso]
> ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
> [vsyscall]
> Failed
> Cluster xport1 created
> Node wings added
> Node xtc added
> Stopping O2CB cluster xport1: *** glibc detected *** o2cb_ctl: free():
> invalid pointer: 0x00000000012daf00 ***
> ======= Backtrace: =========
> /lib/libc.so.6(+0x774b6)[0x7f922e12b4b6]
> /lib/libc.so.6(cfree+0x73)[0x7f922e131c83]
> o2cb_ctl[0x40511a]
> o2cb_ctl[0x403a22]
> /lib/libc.so.6(__libc_start_main+0xfe)[0x7f922e0d2d8e]
> o2cb_ctl[0x402b59]
> ======= Memory map: ========
> 00400000-00411000 r-xp 00000000 08:01 131365
> /sbin/o2cb_ctl
> 00610000-00611000 r--p 00010000 08:01 131365
> /sbin/o2cb_ctl
> 00611000-00612000 rw-p 00011000 08:01 131365
> /sbin/o2cb_ctl
> 012da000-012fb000 rw-p 00000000 00:00 0
> [heap]
> 7f9228000000-7f9228021000 rw-p 00000000 00:00 0
> 7f9228021000-7f922c000000 ---p 00000000 00:00 0
> 7f922da50000-7f922da65000 r-xp 00000000 08:01 917566
> /lib/libgcc_s.so.1
> 7f922da65000-7f922dc64000 ---p 00015000 08:01 917566
> /lib/libgcc_s.so.1
> 7f922dc64000-7f922dc65000 r--p 00014000 08:01 917566
> /lib/libgcc_s.so.1
> 7f922dc65000-7f922dc66000 rw-p 00015000 08:01 917566
> /lib/libgcc_s.so.1
> 7f922dc66000-7f922dc7e000 r-xp 00000000 08:01 921986
> /lib/libpthread-2.12.1.so
> 7f922dc7e000-7f922de7d000 ---p 00018000 08:01 921986
> /lib/libpthread-2.12.1.so
> 7f922de7d000-7f922de7e000 r--p 00017000 08:01 921986
> /lib/libpthread-2.12.1.so
> 7f922de7e000-7f922de7f000 rw-p 00018000 08:01 921986
> /lib/libpthread-2.12.1.so
> 7f922de7f000-7f922de83000 rw-p 00000000 00:00 0
> 7f922de83000-7f922deb3000 r-xp 00000000 08:01 917607
> /lib/libpcre.so.3.12.1
> 7f922deb3000-7f922e0b2000 ---p 00030000 08:01 917607
> /lib/libpcre.so.3.12.1
> 7f922e0b2000-7f922e0b3000 r--p 0002f000 08:01 917607
> /lib/libpcre.so.3.12.1
> 7f922e0b3000-7f922e0b4000 rw-p 00030000 08:01 917607
> /lib/libpcre.so.3.12.1
> 7f922e0b4000-7f922e22e000 r-xp 00000000 08:01 921984
> /lib/libc-2.12.1.so
> 7f922e22e000-7f922e42d000 ---p 0017a000 08:01 921984
> /lib/libc-2.12.1.so
> 7f922e42d000-7f922e431000 r--p 00179000 08:01 921984
> /lib/libc-2.12.1.soFailed
>
>
> _______________________________________________
> Ocfs2-users mailing listOcfs2-users at oss.oracle.comhttp://oss.oracle.com/mailman/listinfo/ocfs2-users
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110627/451ebf37/attachment.html 


More information about the Ocfs2-users mailing list