[Ocfs2-users] multiple cluster doesn't work

Richard Pickett richard.pickett at csrtechnologies.com
Mon Jun 27 16:44:21 PDT 2011 

We're trying to setup 3 PRDM partitions (VMware) across 2 nodes. As long as
only one is configured in cluster.conf, there's not problem. As soon as we
try to use 2 or more we get issues.

It looks the same as bug 636:

http://oss.oracle.com/bugzilla/show_bug.cgi?id=636

I posted my cluster.conf and command line results there. I'm including them
here in the hopes that someone on this list can offer a shorter solution
than recompiling the o2cb_ctl (which we have in process).

Thanks in advance for any and all help. Here's my post on the bug:

seems like we're back to having this bug again. I'm posting both
cluster.conf and the error that happens at the command line.

<cluster.conf>
cluster:
        node_count = 2
        name = xport1

node:
        ip_port = 7777
        ip_address = 10.8.4.81
        number = 1
        name = wings
        cluster = xport1
node:
        ip_port = 7777
        ip_address = 10.8.4.82
        number = 2
        name = xtc
        cluster = xport1

cluster:
       node_count = 2
       name = xport2

node:
       ip_port = 7778
       ip_address = 10.8.4.81
       number = 1
       name = wings
       cluster = xport2
node:
       ip_port = 7778
       ip_address = 10.8.4.82
       number = 2
       name = xtc
       cluster = xport2

cluster:
       node_count = 2
       name = xport3

node:
       ip_port = 7779
       ip_address = 10.8.4.81
       number = 1
       name = wings
       cluster = xport3
node:
       ip_port = 7779
       ip_address = 10.8.4.82
       number = 2
       name = xtc
       cluster = xport3
</cluster.conf>

If I comment out the second and third "cluster" I don't hit this error, but
then I can't load multiple clusters on one machine.

Command line:

root at wings:/var/log# /etc/init.d/o2cb start
Loading filesystem "configfs": OK
Mounting configfs filesystem at /sys/kernel/config: OK
Loading stack plugin "o2cb": OK
Loading filesystem "ocfs2_dlmfs": OK
Mounting ocfs2_dlmfs filesystem at /dlm: OK
Setting cluster stack "o2cb": OK
Starting O2CB cluster xport1: *** glibc detected *** o2cb_ctl: free():
invalid pointer: 0x0000000001179080 ***
======= Backtrace: =========
/lib/libc.so.6(+0x774b6)[0x7fab33f234b6]
/lib/libc.so.6(cfree+0x73)[0x7fab33f29c83]
o2cb_ctl[0x40511a]
o2cb_ctl[0x403a22]
/lib/libc.so.6(__libc_start_main+0xfe)[0x7fab33ecad8e]
o2cb_ctl[0x402b59]
======= Memory map: ========
00400000-00411000 r-xp 00000000 08:01 131365
/sbin/o2cb_ctl
00610000-00611000 r--p 00010000 08:01 131365
/sbin/o2cb_ctl
00611000-00612000 rw-p 00011000 08:01 131365
/sbin/o2cb_ctl
01178000-01199000 rw-p 00000000 00:00 0
[heap]
7fab2c000000-7fab2c021000 rw-p 00000000 00:00 0
7fab2c021000-7fab30000000 ---p 00000000 00:00 0
7fab33848000-7fab3385d000 r-xp 00000000 08:01 917566
/lib/libgcc_s.so.1
7fab3385d000-7fab33a5c000 ---p 00015000 08:01 917566
/lib/libgcc_s.so.1
7fab33a5c000-7fab33a5d000 r--p 00014000 08:01 917566
/lib/libgcc_s.so.1
7fab33a5d000-7fab33a5e000 rw-p 00015000 08:01 917566
/lib/libgcc_s.so.1
7fab33a5e000-7fab33a76000 r-xp 00000000 08:01 921986
/lib/libpthread-2.12.1.so
7fab33a76000-7fab33c75000 ---p 00018000 08:01 921986
/lib/libpthread-2.12.1.so
7fab33c75000-7fab33c76000 r--p 00017000 08:01 921986
/lib/libpthread-2.12.1.so
7fab33c76000-7fab33c77000 rw-p 00018000 08:01 921986
/lib/libpthread-2.12.1.so
7fab33c77000-7fab33c7b000 rw-p 00000000 00:00 0
7fab33c7b000-7fab33cab000 r-xp 00000000 08:01 917607
/lib/libpcre.so.3.12.1
7fab33cab000-7fab33eaa000 ---p 00030000 08:01 917607
/lib/libpcre.so.3.12.1
7fab33eaa000-7fab33eab000 r--p 0002f000 08:01 917607
/lib/libpcre.so.3.12.1
7fab33eab000-7fab33eac000 rw-p 00030000 08:01 917607
/lib/libpcre.so.3.12.1
7fab33eac000-7fab34026000 r-xp 00000000 08:01 921984
/lib/libc-2.12.1.so
7fab34026000-7fab34225000 ---p 0017a000 08:01 921984
/lib/libc-2.12.1.so
7fab34225000-7fab34229000 r--p 00179000 08:01 921984
/lib/libc-2.12.1.so
7fab34229000-7fab3422a000 rw-p 0017d000 08:01 921984
/lib/libc-2.12.1.so
7fab3422a000-7fab3422f000 rw-p 00000000 00:00 0
7fab3422f000-7fab34232000 r-xp 00000000 08:01 917517
/lib/libcom_err.so.2.1
7fab34232000-7fab34431000 ---p 00003000 08:01 917517
/lib/libcom_err.so.2.1
7fab34431000-7fab34432000 r--p 00002000 08:01 917517
/lib/libcom_err.so.2.1
7fab34432000-7fab34433000 rw-p 00003000 08:01 917517
/lib/libcom_err.so.2.1
7fab34433000-7fab34513000 r-xp 00000000 08:01 917576
/lib/libglib-2.0.so.0.2600.1
7fab34513000-7fab34712000 ---p 000e0000 08:01 917576
/lib/libglib-2.0.so.0.2600.1
7fab34712000-7fab34713000 r--p 000df000 08:01 917576
/lib/libglib-2.0.so.0.2600.1
7fab34713000-7fab34714000 rw-p 000e0000 08:01 917576
/lib/libglib-2.0.so.0.2600.1
7fab34714000-7fab34715000 rw-p 00000000 00:00 0
7fab34715000-7fab34735000 r-xp 00000000 08:01 921992
/lib/ld-2.12.1.so
7fab3492a000-7fab3492e000 rw-p 00000000 00:00 0
7fab34933000-7fab34935000 rw-p 00000000 00:00 0
7fab34935000-7fab34936000 r--p 00020000 08:01 921992
/lib/ld-2.12.1.so
7fab34936000-7fab34937000 rw-p 00021000 08:01 921992
/lib/ld-2.12.1.so
7fab34937000-7fab34938000 rw-p 00000000 00:00 0
7fff14f37000-7fff14f58000 rw-p 00000000 00:00 0
[stack]
7fff14fff000-7fff15000000 r-xp 00000000 00:00 0
[vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
[vsyscall]
Failed
Cluster xport1 created
Node wings added
Node xtc added
Stopping O2CB cluster xport1: *** glibc detected *** o2cb_ctl: free():
invalid pointer: 0x00000000012daf00 ***
======= Backtrace: =========
/lib/libc.so.6(+0x774b6)[0x7f922e12b4b6]
/lib/libc.so.6(cfree+0x73)[0x7f922e131c83]
o2cb_ctl[0x40511a]
o2cb_ctl[0x403a22]
/lib/libc.so.6(__libc_start_main+0xfe)[0x7f922e0d2d8e]
o2cb_ctl[0x402b59]
======= Memory map: ========
00400000-00411000 r-xp 00000000 08:01 131365
/sbin/o2cb_ctl
00610000-00611000 r--p 00010000 08:01 131365
/sbin/o2cb_ctl
00611000-00612000 rw-p 00011000 08:01 131365
/sbin/o2cb_ctl
012da000-012fb000 rw-p 00000000 00:00 0
[heap]
7f9228000000-7f9228021000 rw-p 00000000 00:00 0
7f9228021000-7f922c000000 ---p 00000000 00:00 0
7f922da50000-7f922da65000 r-xp 00000000 08:01 917566
/lib/libgcc_s.so.1
7f922da65000-7f922dc64000 ---p 00015000 08:01 917566
/lib/libgcc_s.so.1
7f922dc64000-7f922dc65000 r--p 00014000 08:01 917566
/lib/libgcc_s.so.1
7f922dc65000-7f922dc66000 rw-p 00015000 08:01 917566
/lib/libgcc_s.so.1
7f922dc66000-7f922dc7e000 r-xp 00000000 08:01 921986
/lib/libpthread-2.12.1.so
7f922dc7e000-7f922de7d000 ---p 00018000 08:01 921986
/lib/libpthread-2.12.1.so
7f922de7d000-7f922de7e000 r--p 00017000 08:01 921986
/lib/libpthread-2.12.1.so
7f922de7e000-7f922de7f000 rw-p 00018000 08:01 921986
/lib/libpthread-2.12.1.so
7f922de7f000-7f922de83000 rw-p 00000000 00:00 0
7f922de83000-7f922deb3000 r-xp 00000000 08:01 917607
/lib/libpcre.so.3.12.1
7f922deb3000-7f922e0b2000 ---p 00030000 08:01 917607
/lib/libpcre.so.3.12.1
7f922e0b2000-7f922e0b3000 r--p 0002f000 08:01 917607
/lib/libpcre.so.3.12.1
7f922e0b3000-7f922e0b4000 rw-p 00030000 08:01 917607
/lib/libpcre.so.3.12.1
7f922e0b4000-7f922e22e000 r-xp 00000000 08:01 921984
/lib/libc-2.12.1.so
7f922e22e000-7f922e42d000 ---p 0017a000 08:01 921984
/lib/libc-2.12.1.so
7f922e42d000-7f922e431000 r--p 00179000 08:01 921984
/lib/libc-2.12.1.soFailed
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110627/58337d12/attachment.html

More information about the Ocfs2-users mailing list