[Ocfs2-users] multiple cluster doesn't work
Sunil Mushran
sunil.mushran at oracle.com
Tue Jun 28 09:06:17 PDT 2011
While you can do that, it is not recommended.
ocfs2 does not use the label. It is only used by the user to identify a volume.
On 06/28/2011 08:18 AM, Richard Pickett wrote:
> That's good news. When I go to format them, do I give them all the same name:
>
> mkfs.ocfs2 -b 4k -C 32K -L "*OCFS2Cluster*" -N 2 /dev/*sdb1*
> mkfs.ocfs2 -b 4k -C 32K -L "*OCFS2Cluster*" -N 2 /dev/*sdc1*
> mkfs.ocfs2 -b 4k -C 32K -L "*OCFS2Cluster*" -N 2 /dev/*sdd1*
>
> If "no", then how do I do it?
>
> If "yes", then how does o2cb know the difference between each device when they are mounted? (how do the nodes distinguish each device when they are communicating to the other nodes in the cluster that they are making a change?)
>
>
> Thanks and God Bless,
>
> Richard W. Pickett, Jr.
> www.MyHaitianAdoption.org <http://www.MyHaitianAdoption.org>
>
> P.S. Have you downloaded the journal from my trip to Haiti:
>
> http://www.myhaitianadoption.org/trips/journal-earthquake-rescue-jan-23-feb-2/
>
>
>
> 2011/6/28 Sérgio Surkamp <sergio at gruposinternet.com.br <mailto:sergio at gruposinternet.com.br>>
>
> Hi.
>
> You don't need 3 clusters configured to mount 3 different devices. You
> can configure only one cluster and mount as many devices as you want
> using it.
>
> bz is the short name for BugZilla, the bug tracker.
>
> Regards,
> Sérgio
>
> Em Mon, 27 Jun 2011 23:26:23 -0500
> Richard Pickett <richard.pickett at csrtechnologies.com <mailto:richard.pickett at csrtechnologies.com>> escreveu:
>
> > We need 3 clusters concurrently because each one is only 1T each, the
> > underlying infrastructure won't allow us to combine the 3 into one
> > device without shelling out more money than the company is willing to
> > pay.
> >
> > Where/what is the 'bz' so I can go find the link?
> >
> >
> > Thanks and God Bless,
> >
> > Richard W. Pickett, Jr.
> > www.MyHaitianAdoption.org <http://www.MyHaitianAdoption.org>
> >
> > P.S. Have you downloaded the journal from my trip to Haiti:
> >
> > http://www.myhaitianadoption.org/trips/journal-earthquake-rescue-jan-23-feb-2/
> >
> >
> >
> > On Mon, Jun 27, 2011 at 9:05 PM, Sunil Mushran
> > <sunil.mushran at oracle.com <mailto:sunil.mushran at oracle.com>>wrote:
> >
> > > **
> > > Whereas the cluster.conf allows users to define multiple
> > > clusters, only one cluster can be active at any time. The bug
> > > you ran into has probably been fixed. The link has been posted
> > > in the bz.
> > >
> > > Why do you need multiple clusters active concurrently?
> > >
> > >
> > > On 06/27/2011 04:44 PM, Richard Pickett wrote:
> > >
> > > We're trying to setup 3 PRDM partitions (VMware) across 2 nodes. As
> > > long as only one is configured in cluster.conf, there's not
> > > problem. As soon as we try to use 2 or more we get issues.
> > >
> > > It looks the same as bug 636:
> > >
> > > http://oss.oracle.com/bugzilla/show_bug.cgi?id=636
> > >
> > > I posted my cluster.conf and command line results there. I'm
> > > including them here in the hopes that someone on this list can
> > > offer a shorter solution than recompiling the o2cb_ctl (which we
> > > have in process).
> > >
> > > Thanks in advance for any and all help. Here's my post on the bug:
> > >
> > > seems like we're back to having this bug again. I'm posting both
> > > cluster.conf and the error that happens at the command line.
> > >
> > > <cluster.conf>
> > > cluster:
> > > node_count = 2
> > > name = xport1
> > >
> > > node:
> > > ip_port = 7777
> > > ip_address = 10.8.4.81
> > > number = 1
> > > name = wings
> > > cluster = xport1
> > > node:
> > > ip_port = 7777
> > > ip_address = 10.8.4.82
> > > number = 2
> > > name = xtc
> > > cluster = xport1
> > >
> > > cluster:
> > > node_count = 2
> > > name = xport2
> > >
> > > node:
> > > ip_port = 7778
> > > ip_address = 10.8.4.81
> > > number = 1
> > > name = wings
> > > cluster = xport2
> > > node:
> > > ip_port = 7778
> > > ip_address = 10.8.4.82
> > > number = 2
> > > name = xtc
> > > cluster = xport2
> > >
> > > cluster:
> > > node_count = 2
> > > name = xport3
> > >
> > > node:
> > > ip_port = 7779
> > > ip_address = 10.8.4.81
> > > number = 1
> > > name = wings
> > > cluster = xport3
> > > node:
> > > ip_port = 7779
> > > ip_address = 10.8.4.82
> > > number = 2
> > > name = xtc
> > > cluster = xport3
> > > </cluster.conf>
> > >
> > > If I comment out the second and third "cluster" I don't hit this
> > > error, but then I can't load multiple clusters on one machine.
> > >
> > > Command line:
> > >
> > > root at wings:/var/log# /etc/init.d/o2cb start
> > > Loading filesystem "configfs": OK
> > > Mounting configfs filesystem at /sys/kernel/config: OK
> > > Loading stack plugin "o2cb": OK
> > > Loading filesystem "ocfs2_dlmfs": OK
> > > Mounting ocfs2_dlmfs filesystem at /dlm: OK
> > > Setting cluster stack "o2cb": OK
> > > Starting O2CB cluster xport1: *** glibc detected *** o2cb_ctl:
> > > free(): invalid pointer: 0x0000000001179080 ***
> > > ======= Backtrace: =========
> > > /lib/libc.so.6(+0x774b6)[0x7fab33f234b6]
> > > /lib/libc.so.6(cfree+0x73)[0x7fab33f29c83]
> > > o2cb_ctl[0x40511a]
> > > o2cb_ctl[0x403a22]
> > > /lib/libc.so.6(__libc_start_main+0xfe)[0x7fab33ecad8e]
> > > o2cb_ctl[0x402b59]
> > > ======= Memory map: ========
> > > 00400000-00411000 r-xp 00000000 08:01 131365
> > > /sbin/o2cb_ctl
> > > 00610000-00611000 r--p 00010000 08:01 131365
> > > /sbin/o2cb_ctl
> > > 00611000-00612000 rw-p 00011000 08:01 131365
> > > /sbin/o2cb_ctl
> > > 01178000-01199000 rw-p 00000000 00:00 0
> > > [heap]
> > > 7fab2c000000-7fab2c021000 rw-p 00000000 00:00 0
> > > 7fab2c021000-7fab30000000 ---p 00000000 00:00 0
> > > 7fab33848000-7fab3385d000 r-xp 00000000 08:01 917566
> > > /lib/libgcc_s.so.1
> > > 7fab3385d000-7fab33a5c000 ---p 00015000 08:01 917566
> > > /lib/libgcc_s.so.1
> > > 7fab33a5c000-7fab33a5d000 r--p 00014000 08:01 917566
> > > /lib/libgcc_s.so.1
> > > 7fab33a5d000-7fab33a5e000 rw-p 00015000 08:01 917566
> > > /lib/libgcc_s.so.1
> > > 7fab33a5e000-7fab33a76000 r-xp 00000000 08:01 921986
> > > /lib/libpthread-2.12.1.so <http://libpthread-2.12.1.so>
> > > 7fab33a76000-7fab33c75000 ---p 00018000 08:01 921986
> > > /lib/libpthread-2.12.1.so <http://libpthread-2.12.1.so>
> > > 7fab33c75000-7fab33c76000 r--p 00017000 08:01 921986
> > > /lib/libpthread-2.12.1.so <http://libpthread-2.12.1.so>
> > > 7fab33c76000-7fab33c77000 rw-p 00018000 08:01 921986
> > > /lib/libpthread-2.12.1.so <http://libpthread-2.12.1.so>
> > > 7fab33c77000-7fab33c7b000 rw-p 00000000 00:00 0
> > > 7fab33c7b000-7fab33cab000 r-xp 00000000 08:01 917607
> > > /lib/libpcre.so.3.12.1
> > > 7fab33cab000-7fab33eaa000 ---p 00030000 08:01 917607
> > > /lib/libpcre.so.3.12.1
> > > 7fab33eaa000-7fab33eab000 r--p 0002f000 08:01 917607
> > > /lib/libpcre.so.3.12.1
> > > 7fab33eab000-7fab33eac000 rw-p 00030000 08:01 917607
> > > /lib/libpcre.so.3.12.1
> > > 7fab33eac000-7fab34026000 r-xp 00000000 08:01 921984
> > > /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> > > 7fab34026000-7fab34225000 ---p 0017a000 08:01 921984
> > > /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> > > 7fab34225000-7fab34229000 r--p 00179000 08:01 921984
> > > /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> > > 7fab34229000-7fab3422a000 rw-p 0017d000 08:01 921984
> > > /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> > > 7fab3422a000-7fab3422f000 rw-p 00000000 00:00 0
> > > 7fab3422f000-7fab34232000 r-xp 00000000 08:01 917517
> > > /lib/libcom_err.so.2.1
> > > 7fab34232000-7fab34431000 ---p 00003000 08:01 917517
> > > /lib/libcom_err.so.2.1
> > > 7fab34431000-7fab34432000 r--p 00002000 08:01 917517
> > > /lib/libcom_err.so.2.1
> > > 7fab34432000-7fab34433000 rw-p 00003000 08:01 917517
> > > /lib/libcom_err.so.2.1
> > > 7fab34433000-7fab34513000 r-xp 00000000 08:01 917576
> > > /lib/libglib-2.0.so.0.2600.1
> > > 7fab34513000-7fab34712000 ---p 000e0000 08:01 917576
> > > /lib/libglib-2.0.so.0.2600.1
> > > 7fab34712000-7fab34713000 r--p 000df000 08:01 917576
> > > /lib/libglib-2.0.so.0.2600.1
> > > 7fab34713000-7fab34714000 rw-p 000e0000 08:01 917576
> > > /lib/libglib-2.0.so.0.2600.1
> > > 7fab34714000-7fab34715000 rw-p 00000000 00:00 0
> > > 7fab34715000-7fab34735000 r-xp 00000000 08:01 921992
> > > /lib/ld-2.12.1.so <http://ld-2.12.1.so>
> > > 7fab3492a000-7fab3492e000 rw-p 00000000 00:00 0
> > > 7fab34933000-7fab34935000 rw-p 00000000 00:00 0
> > > 7fab34935000-7fab34936000 r--p 00020000 08:01 921992
> > > /lib/ld-2.12.1.so <http://ld-2.12.1.so>
> > > 7fab34936000-7fab34937000 rw-p 00021000 08:01 921992
> > > /lib/ld-2.12.1.so <http://ld-2.12.1.so>
> > > 7fab34937000-7fab34938000 rw-p 00000000 00:00 0
> > > 7fff14f37000-7fff14f58000 rw-p 00000000 00:00 0
> > > [stack]
> > > 7fff14fff000-7fff15000000 r-xp 00000000 00:00 0
> > > [vdso]
> > > ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
> > > [vsyscall]
> > > Failed
> > > Cluster xport1 created
> > > Node wings added
> > > Node xtc added
> > > Stopping O2CB cluster xport1: *** glibc detected *** o2cb_ctl:
> > > free(): invalid pointer: 0x00000000012daf00 ***
> > > ======= Backtrace: =========
> > > /lib/libc.so.6(+0x774b6)[0x7f922e12b4b6]
> > > /lib/libc.so.6(cfree+0x73)[0x7f922e131c83]
> > > o2cb_ctl[0x40511a]
> > > o2cb_ctl[0x403a22]
> > > /lib/libc.so.6(__libc_start_main+0xfe)[0x7f922e0d2d8e]
> > > o2cb_ctl[0x402b59]
> > > ======= Memory map: ========
> > > 00400000-00411000 r-xp 00000000 08:01 131365
> > > /sbin/o2cb_ctl
> > > 00610000-00611000 r--p 00010000 08:01 131365
> > > /sbin/o2cb_ctl
> > > 00611000-00612000 rw-p 00011000 08:01 131365
> > > /sbin/o2cb_ctl
> > > 012da000-012fb000 rw-p 00000000 00:00 0
> > > [heap]
> > > 7f9228000000-7f9228021000 rw-p 00000000 00:00 0
> > > 7f9228021000-7f922c000000 ---p 00000000 00:00 0
> > > 7f922da50000-7f922da65000 r-xp 00000000 08:01 917566
> > > /lib/libgcc_s.so.1
> > > 7f922da65000-7f922dc64000 ---p 00015000 08:01 917566
> > > /lib/libgcc_s.so.1
> > > 7f922dc64000-7f922dc65000 r--p 00014000 08:01 917566
> > > /lib/libgcc_s.so.1
> > > 7f922dc65000-7f922dc66000 rw-p 00015000 08:01 917566
> > > /lib/libgcc_s.so.1
> > > 7f922dc66000-7f922dc7e000 r-xp 00000000 08:01 921986
> > > /lib/libpthread-2.12.1.so <http://libpthread-2.12.1.so>
> > > 7f922dc7e000-7f922de7d000 ---p 00018000 08:01 921986
> > > /lib/libpthread-2.12.1.so <http://libpthread-2.12.1.so>
> > > 7f922de7d000-7f922de7e000 r--p 00017000 08:01 921986
> > > /lib/libpthread-2.12.1.so <http://libpthread-2.12.1.so>
> > > 7f922de7e000-7f922de7f000 rw-p 00018000 08:01 921986
> > > /lib/libpthread-2.12.1.so <http://libpthread-2.12.1.so>
> > > 7f922de7f000-7f922de83000 rw-p 00000000 00:00 0
> > > 7f922de83000-7f922deb3000 r-xp 00000000 08:01 917607
> > > /lib/libpcre.so.3.12.1
> > > 7f922deb3000-7f922e0b2000 ---p 00030000 08:01 917607
> > > /lib/libpcre.so.3.12.1
> > > 7f922e0b2000-7f922e0b3000 r--p 0002f000 08:01 917607
> > > /lib/libpcre.so.3.12.1
> > > 7f922e0b3000-7f922e0b4000 rw-p 00030000 08:01 917607
> > > /lib/libpcre.so.3.12.1
> > > 7f922e0b4000-7f922e22e000 r-xp 00000000 08:01 921984
> > > /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> > > 7f922e22e000-7f922e42d000 ---p 0017a000 08:01 921984
> > > /lib/libc-2.12.1.so <http://libc-2.12.1.so>
> > > 7f922e42d000-7f922e431000 r--p 00179000 08:01 921984
> > > /lib/libc-2.12.1.soFailed
> > >
> > >
> > > _______________________________________________
> > > Ocfs2-users mailing
> > > listOcfs2-users at oss.oracle.comhttp://oss.oracle.com/mailman/listinfo/ocfs2-users <http://oss.oracle.com/mailman/listinfo/ocfs2-users>
> > >
> > >
> > >
>
>
>
> --
> .:''''':.
> .:' ` Sérgio Surkamp | Gerente de Rede
> :: ........ sergio at gruposinternet.com.br <mailto:sergio at gruposinternet.com.br>
> `:. .:'
> `:, ,.:' *Grupos Internet S.A.*
> `: :' R. Lauro Linhares, 2123 Torre B - Sala 201
> : : Trindade - Florianópolis - SC
> :.'
> :: +55 48 3234-4109 <tel:%2B55%2048%203234-4109>
> :
> ' http://www.gruposinternet.com.br
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com <mailto:Ocfs2-users at oss.oracle.com>
> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>
>
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110628/3e647799/attachment-0001.html
More information about the Ocfs2-users
mailing list