[Ocfs2-users] multiple cluster doesn't work

Sunil Mushran sunil.mushran at oracle.com
Mon Jun 27 19:05:26 PDT 2011


Whereas the cluster.conf allows users to define multiple
clusters, only one cluster can be active at any time. The bug
you ran into has probably been fixed. The link has been posted
in the bz.

Why do you need multiple clusters active concurrently?

On 06/27/2011 04:44 PM, Richard Pickett wrote:
> We're trying to setup 3 PRDM partitions (VMware) across 2 nodes. As 
> long as only one is configured in cluster.conf, there's not problem. 
> As soon as we try to use 2 or more we get issues.
>
> It looks the same as bug 636:
>
> http://oss.oracle.com/bugzilla/show_bug.cgi?id=636
>
> I posted my cluster.conf and command line results there. I'm including 
> them here in the hopes that someone on this list can offer a shorter 
> solution than recompiling the o2cb_ctl (which we have in process).
>
> Thanks in advance for any and all help. Here's my post on the bug:
>
> seems like we're back to having this bug again. I'm posting both 
> cluster.conf and the error that happens at the command line.
>
> <cluster.conf>
> cluster:
>         node_count = 2
>         name = xport1
>
> node:
>         ip_port = 7777
>         ip_address = 10.8.4.81
>         number = 1
>         name = wings
>         cluster = xport1
> node:
>         ip_port = 7777
>         ip_address = 10.8.4.82
>         number = 2
>         name = xtc
>         cluster = xport1
>
> cluster:
>        node_count = 2
>        name = xport2
>
> node:
>        ip_port = 7778
>        ip_address = 10.8.4.81
>        number = 1
>        name = wings
>        cluster = xport2
> node:
>        ip_port = 7778
>        ip_address = 10.8.4.82
>        number = 2
>        name = xtc
>        cluster = xport2
>
> cluster:
>        node_count = 2
>        name = xport3
>
> node:
>        ip_port = 7779
>        ip_address = 10.8.4.81
>        number = 1
>        name = wings
>        cluster = xport3
> node:
>        ip_port = 7779
>        ip_address = 10.8.4.82
>        number = 2
>        name = xtc
>        cluster = xport3
> </cluster.conf>
>
> If I comment out the second and third "cluster" I don't hit this 
> error, but then I can't load multiple clusters on one machine.
>
> Command line:
>
> root at wings:/var/log# /etc/init.d/o2cb start
> Loading filesystem "configfs": OK
> Mounting configfs filesystem at /sys/kernel/config: OK
> Loading stack plugin "o2cb": OK
> Loading filesystem "ocfs2_dlmfs": OK
> Mounting ocfs2_dlmfs filesystem at /dlm: OK
> Setting cluster stack "o2cb": OK
> Starting O2CB cluster xport1: *** glibc detected *** o2cb_ctl: free(): 
> invalid pointer: 0x0000000001179080 ***
> ======= Backtrace: =========
> /lib/libc.so.6(+0x774b6)[0x7fab33f234b6]
> /lib/libc.so.6(cfree+0x73)[0x7fab33f29c83]
> o2cb_ctl[0x40511a]
> o2cb_ctl[0x403a22]
> /lib/libc.so.6(__libc_start_main+0xfe)[0x7fab33ecad8e]
> o2cb_ctl[0x402b59]
> ======= Memory map: ========
> 00400000-00411000 r-xp 00000000 08:01 
> 131365                             /sbin/o2cb_ctl
> 00610000-00611000 r--p 00010000 08:01 
> 131365                             /sbin/o2cb_ctl
> 00611000-00612000 rw-p 00011000 08:01 
> 131365                             /sbin/o2cb_ctl
> 01178000-01199000 rw-p 00000000 00:00 
> 0                                  [heap]
> 7fab2c000000-7fab2c021000 rw-p 00000000 00:00 0
> 7fab2c021000-7fab30000000 ---p 00000000 00:00 0
> 7fab33848000-7fab3385d000 r-xp 00000000 08:01 
> 917566                     /lib/libgcc_s.so.1
> 7fab3385d000-7fab33a5c000 ---p 00015000 08:01 
> 917566                     /lib/libgcc_s.so.1
> 7fab33a5c000-7fab33a5d000 r--p 00014000 08:01 
> 917566                     /lib/libgcc_s.so.1
> 7fab33a5d000-7fab33a5e000 rw-p 00015000 08:01 
> 917566                     /lib/libgcc_s.so.1
> 7fab33a5e000-7fab33a76000 r-xp 00000000 08:01 
> 921986                     /lib/libpthread-2.12.1.so 
> <http://libpthread-2.12.1.so>
> 7fab33a76000-7fab33c75000 ---p 00018000 08:01 
> 921986                     /lib/libpthread-2.12.1.so 
> <http://libpthread-2.12.1.so>
> 7fab33c75000-7fab33c76000 r--p 00017000 08:01 
> 921986                     /lib/libpthread-2.12.1.so 
> <http://libpthread-2.12.1.so>
> 7fab33c76000-7fab33c77000 rw-p 00018000 08:01 
> 921986                     /lib/libpthread-2.12.1.so 
> <http://libpthread-2.12.1.so>
> 7fab33c77000-7fab33c7b000 rw-p 00000000 00:00 0
> 7fab33c7b000-7fab33cab000 r-xp 00000000 08:01 
> 917607                     /lib/libpcre.so.3.12.1
> 7fab33cab000-7fab33eaa000 ---p 00030000 08:01 
> 917607                     /lib/libpcre.so.3.12.1
> 7fab33eaa000-7fab33eab000 r--p 0002f000 08:01 
> 917607                     /lib/libpcre.so.3.12.1
> 7fab33eab000-7fab33eac000 rw-p 00030000 08:01 
> 917607                     /lib/libpcre.so.3.12.1
> 7fab33eac000-7fab34026000 r-xp 00000000 08:01 
> 921984                     /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> 7fab34026000-7fab34225000 ---p 0017a000 08:01 
> 921984                     /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> 7fab34225000-7fab34229000 r--p 00179000 08:01 
> 921984                     /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> 7fab34229000-7fab3422a000 rw-p 0017d000 08:01 
> 921984                     /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> 7fab3422a000-7fab3422f000 rw-p 00000000 00:00 0
> 7fab3422f000-7fab34232000 r-xp 00000000 08:01 
> 917517                     /lib/libcom_err.so.2.1
> 7fab34232000-7fab34431000 ---p 00003000 08:01 
> 917517                     /lib/libcom_err.so.2.1
> 7fab34431000-7fab34432000 r--p 00002000 08:01 
> 917517                     /lib/libcom_err.so.2.1
> 7fab34432000-7fab34433000 rw-p 00003000 08:01 
> 917517                     /lib/libcom_err.so.2.1
> 7fab34433000-7fab34513000 r-xp 00000000 08:01 
> 917576                     /lib/libglib-2.0.so.0.2600.1
> 7fab34513000-7fab34712000 ---p 000e0000 08:01 
> 917576                     /lib/libglib-2.0.so.0.2600.1
> 7fab34712000-7fab34713000 r--p 000df000 08:01 
> 917576                     /lib/libglib-2.0.so.0.2600.1
> 7fab34713000-7fab34714000 rw-p 000e0000 08:01 
> 917576                     /lib/libglib-2.0.so.0.2600.1
> 7fab34714000-7fab34715000 rw-p 00000000 00:00 0
> 7fab34715000-7fab34735000 r-xp 00000000 08:01 
> 921992                     /lib/ld-2.12.1.so <http://ld-2.12.1.so>
> 7fab3492a000-7fab3492e000 rw-p 00000000 00:00 0
> 7fab34933000-7fab34935000 rw-p 00000000 00:00 0
> 7fab34935000-7fab34936000 r--p 00020000 08:01 
> 921992                     /lib/ld-2.12.1.so <http://ld-2.12.1.so>
> 7fab34936000-7fab34937000 rw-p 00021000 08:01 
> 921992                     /lib/ld-2.12.1.so <http://ld-2.12.1.so>
> 7fab34937000-7fab34938000 rw-p 00000000 00:00 0
> 7fff14f37000-7fff14f58000 rw-p 00000000 00:00 
> 0                          [stack]
> 7fff14fff000-7fff15000000 r-xp 00000000 00:00 
> 0                          [vdso]
> ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 
> 0                  [vsyscall]
> Failed
> Cluster xport1 created
> Node wings added
> Node xtc added
> Stopping O2CB cluster xport1: *** glibc detected *** o2cb_ctl: free(): 
> invalid pointer: 0x00000000012daf00 ***
> ======= Backtrace: =========
> /lib/libc.so.6(+0x774b6)[0x7f922e12b4b6]
> /lib/libc.so.6(cfree+0x73)[0x7f922e131c83]
> o2cb_ctl[0x40511a]
> o2cb_ctl[0x403a22]
> /lib/libc.so.6(__libc_start_main+0xfe)[0x7f922e0d2d8e]
> o2cb_ctl[0x402b59]
> ======= Memory map: ========
> 00400000-00411000 r-xp 00000000 08:01 
> 131365                             /sbin/o2cb_ctl
> 00610000-00611000 r--p 00010000 08:01 
> 131365                             /sbin/o2cb_ctl
> 00611000-00612000 rw-p 00011000 08:01 
> 131365                             /sbin/o2cb_ctl
> 012da000-012fb000 rw-p 00000000 00:00 
> 0                                  [heap]
> 7f9228000000-7f9228021000 rw-p 00000000 00:00 0
> 7f9228021000-7f922c000000 ---p 00000000 00:00 0
> 7f922da50000-7f922da65000 r-xp 00000000 08:01 
> 917566                     /lib/libgcc_s.so.1
> 7f922da65000-7f922dc64000 ---p 00015000 08:01 
> 917566                     /lib/libgcc_s.so.1
> 7f922dc64000-7f922dc65000 r--p 00014000 08:01 
> 917566                     /lib/libgcc_s.so.1
> 7f922dc65000-7f922dc66000 rw-p 00015000 08:01 
> 917566                     /lib/libgcc_s.so.1
> 7f922dc66000-7f922dc7e000 r-xp 00000000 08:01 
> 921986                     /lib/libpthread-2.12.1.so 
> <http://libpthread-2.12.1.so>
> 7f922dc7e000-7f922de7d000 ---p 00018000 08:01 
> 921986                     /lib/libpthread-2.12.1.so 
> <http://libpthread-2.12.1.so>
> 7f922de7d000-7f922de7e000 r--p 00017000 08:01 
> 921986                     /lib/libpthread-2.12.1.so 
> <http://libpthread-2.12.1.so>
> 7f922de7e000-7f922de7f000 rw-p 00018000 08:01 
> 921986                     /lib/libpthread-2.12.1.so 
> <http://libpthread-2.12.1.so>
> 7f922de7f000-7f922de83000 rw-p 00000000 00:00 0
> 7f922de83000-7f922deb3000 r-xp 00000000 08:01 
> 917607                     /lib/libpcre.so.3.12.1
> 7f922deb3000-7f922e0b2000 ---p 00030000 08:01 
> 917607                     /lib/libpcre.so.3.12.1
> 7f922e0b2000-7f922e0b3000 r--p 0002f000 08:01 
> 917607                     /lib/libpcre.so.3.12.1
> 7f922e0b3000-7f922e0b4000 rw-p 00030000 08:01 
> 917607                     /lib/libpcre.so.3.12.1
> 7f922e0b4000-7f922e22e000 r-xp 00000000 08:01 
> 921984                     /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> 7f922e22e000-7f922e42d000 ---p 0017a000 08:01 
> 921984                     /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> 7f922e42d000-7f922e431000 r--p 00179000 08:01 
> 921984                     /lib/libc-2.12.1.soFailed
>
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110627/e51593a3/attachment-0001.html 


More information about the Ocfs2-users mailing list