[Ocfs2-users] error mounting the OCFS2 filesystem

Wed Dec 12 08:34:36 PST 2007

Hi.
I need help on fixing this issue, Im sorry about sending this long email, but I'll try to give as much information as possible.

Im trying to stabilish a OCFS2 cluster with the Slackware 12 and and kernel 2.6.21.5-smp.
My goal is to run OCFS2 over the DRBD layer.

DRBD is configured and tested, im able to mount the device with the role Primary/Primary with no trouble.

The OCFS2 tools were compiled and the modules loaded, the modules came already compiled with the kernel.

clusteroot at apolo1:~# cat /etc/ocfs2/cluster.conf
node_count = 2
name = cldisk
node:
ip_port = 7777
ip_address = 10.10.1.1
number = 1
name = apolo1
cluster = cldisk
node:
ip_port = 7777
ip_address = 10.10.1.2
number = 2
name = apolo2 
cluster = cldisk

root at apolo1:~# cat /etc/default/o2cb 
#
# This is a configuration file for automatic startup of the O2CB
# driver. It is generated by running /etc/init.d/o2cb configure.
# Please use that method to modify this file
#
# O2CB_ENABELED: 'true' means to load the driver on boot.
O2CB_ENABLED=true
# O2CB_BOOTCLUSTER: If not empty, the name of a cluster to start.
O2CB_BOOTCLUSTER=cldisk
# O2CB_HEARTBEAT_THRESHOLD: Iterations before a node is considered dead.
O2CB_HEARTBEAT_THRESHOLD=
# O2CB_IDLE_TIMEOUT_MS: Time in ms before a network connection is considered dead.
O2CB_IDLE_TIMEOUT_MS=
# O2CB_KEEPALIVE_DELAY_MS: Max time in ms before a keepalive packet is sent
O2CB_KEEPALIVE_DELAY_MS=
# O2CB_RECONNECT_DELAY_MS: Min time in ms between connection attempts
O2CB_RECONNECT_DELAY_MS=

root at apolo1:~# /etc/init.d/o2cb status
Module "configfs": Loaded
Filesystem "configfs": Mounted
Module "ocfs2_nodemanager": Loaded
Module "ocfs2_dlm": Loaded
Module "ocfs2_dlmfs": Loaded
Filesystem "ocfs2_dlmfs": Mounted
Checking O2CB cluster cldisk: Online
Heartbeat dead threshold = 7
  Network idle timeout: 10000
  Network keepalive delay: 5000
  Network reconnect delay: 2000
Checking O2CB heartbeat: Not active

I'm able to create the filesystem but when I try to mount it, the operation ends with an error message.

root at apolo1:~# drbdadm state r0
Primary/Primary
root at apolo1:~# 
root at apolo1:~# mkfs.ocfs2 -b 4k -C 32k -N 4 -L oracle /dev/drbd0
mkfs.ocfs2 1.3.9
Filesystem label=oracle
Block size=4096 (bits=12)
Cluster size=32768 (bits=15)
Volume size=239701950464 (7315123 clusters) (58520984 blocks)
227 cluster groups (tail covers 25267 clusters, rest cover 32256 clusters)
Journal size=268435456
Initial number of node slots: 4
Creating bitmaps: done
Initializing superblock: done
Writing system files: done
Writing superblock: done
Writing backup superblock: 4 block(s)
Formatting Journals: done
Writing lost+found: done
mkfs.ocfs2 successful
root at apolo1:~# mount -t ocfs2 /dev/drbd0 /clusterdisk
mount.ocfs2: Invalid argument while mounting /dev/drbd0 on /clusterdisk. Check 'dmesg' for more information on this error.

root at apolo1:~# dmesg | tail
ocfs2_dlm: Nodes in domain ("B6DE7123640A47FFA77A6C5F33A9302A"): 1 
(25796,3):ocfs2_initialize_super:1367 ERROR: couldn't mount because of unsupported optional features (10).
(25796,3):ocfs2_fill_super:568 ERROR: status = -22
ocfs2: Unmounting device (147,0) on (node local)
(25802,3):ocfs2_initialize_super:1367 ERROR: couldn't mount because of unsupported optional features (10).
(25802,3):ocfs2_fill_super:568 ERROR: status = -22
ocfs2: Unmounting device (147,0) on (node local)
(26462,3):ocfs2_initialize_super:1367 ERROR: couldn't mount because of unsupported optional features (10).
(26462,3):ocfs2_fill_super:568 ERROR: status = -22
ocfs2: Unmounting device (147,0) on (node 255)

root at apolo1:~# debugfs.ocfs2 -R stats /dev/drbd0
Revision: 0.90
Mount Count: 0 Max Mount Count: 20
State: 0 Errors: 0
Check Interval: 0 Last Check: Tue Dec 11 13:13:42 2007
Creator OS: 0
Feature Compat: 1 BackupSuper 
Feature Incompat: 16 Sparse 
Tunefs Incomplete: 0 None
Feature RO compat: 0 None
Root Blknum: 17 System Dir Blknum: 18
First Cluster Group Blknum: 8
Block Size Bits: 12 Cluster Size Bits: 15
Max Node Slots: 4
Label: oracle
UUID: E288BE802E7A4DCB816B080C376C74D6
Inode: 2 Mode: 00 Generation: 1074052683 (0x4004be4b)
FS Generation: 1074052683 (0x4004be4b)
Type: Unknown Attr: 0x0 Flags: Valid System Superblock 
User: 0 (root) Group: 0 (root) Size: 0
Links: 0 Clusters: 7315123
ctime: 0x475ea926 -- Tue Dec 11 13:13:42 2007
atime: 0x0 -- Wed Dec 31 21:00:00 1969
mtime: 0x475ea926 -- Tue Dec 11 13:13:42 2007
dtime: 0x0 -- Wed Dec 31 21:00:00 1969
ctime_nsec: 0x00000000 -- 0
atime_nsec: 0x00000000 -- 0
mtime_nsec: 0x00000000 -- 0
Last Extblk: 0
Sub Alloc Slot: Global Sub Alloc Bit: 65535

As I read at the OCFS2 man pages the filesystem can be mounted as local, I changed the DRBD role to be primary/secondary and reformated the device.

root at apolo1:~# drbdadm state r0
Primary/Secondary
root at apolo1:~# 
root at apolo1:~# mkfs.ocfs2 -b 4k -C 32k -N 4 -L oracle -M local /dev/drbd0
mkfs.ocfs2 1.3.9
Overwriting existing ocfs2 partition.
Proceed (y/N): y
Filesystem label=oracle
Block size=4096 (bits=12)
Cluster size=32768 (bits=15)
Volume size=239701950464 (7315123 clusters) (58520984 blocks)
227 cluster groups (tail covers 25267 clusters, rest cover 32256 clusters)
Journal size=268435456
Initial number of node slots: 4
Creating bitmaps: done
Initializing superblock: done
Writing system files: done
Writing superblock: done
Writing backup superblock: 4 block(s)
Formatting Journals: done
Writing lost+found: done
mkfs.ocfs2 successful
root at apolo1:~# mount -t ocfs2 /dev/drbd0 /clusterdisk
mount.ocfs2: Invalid argument while mounting /dev/drbd0 on /clusterdisk. Check 'dmesg' for more information on this error.

root at apolo1:~# dmesg | tail
drbd0: Handshake successful: Agreed network protocol version 87
drbd0: data-integrity-alg: <not-used>
drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> Connected ) pdsk( DUnknown -> UpToDate ) 
drbd0: Writing meta data super block now.
drbd0: role( Secondary -> Primary ) 
drbd0: Writing meta data super block now.
ocfs2_dlm: Nodes in domain ("E288BE802E7A4DCB816B080C376C74D6"): 1 
(26496,3):ocfs2_initialize_super:1367 ERROR: couldn't mount because of unsupported optional features (10).
(26496,3):ocfs2_fill_super:568 ERROR: status = -22
ocfs2: Unmounting device (147,0) on (node local)

root at apolo1:~# debugfs.ocfs2 -R stats /dev/drbd0
Revision: 0.90
Mount Count: 0 Max Mount Count: 20
State: 0 Errors: 0
Check Interval: 0 Last Check: Wed Dec 12 12:32:43 2007
Creator OS: 0
Feature Compat: 1 BackupSuper 
Feature Incompat: 24 Local Sparse 
Tunefs Incomplete: 0 None
Feature RO compat: 0 None
Root Blknum: 17 System Dir Blknum: 18
First Cluster Group Blknum: 8
Block Size Bits: 12 Cluster Size Bits: 15
Max Node Slots: 4
Label: oracle
UUID: EA7E2A9C9D9A41ECB314CBD3F73B6460
Inode: 2 Mode: 00 Generation: 3568206262 (0xd4ae81b6)
FS Generation: 3568206262 (0xd4ae81b6)
Type: Unknown Attr: 0x0 Flags: Valid System Superblock 
User: 0 (root) Group: 0 (root) Size: 0
Links: 0 Clusters: 7315123
ctime: 0x475ff10b -- Wed Dec 12 12:32:43 2007
atime: 0x0 -- Wed Dec 31 21:00:00 1969
mtime: 0x475ff10b -- Wed Dec 12 12:32:43 2007
dtime: 0x0 -- Wed Dec 31 21:00:00 1969
ctime_nsec: 0x00000000 -- 0
atime_nsec: 0x00000000 -- 0
mtime_nsec: 0x00000000 -- 0
Last Extblk: 0
Sub Alloc Slot: Global Sub Alloc Bit: 65535

Since i still have got the same error i decided to shutdown the DRBD module and create the filesystem directily on the device /dev/sda6
root at apolo1:~# drbdadm secondary r0
root at apolo1:~# drbdadm down r0
root at apolo1:~# drbdadm state r0
Unconfigured
root at apolo1:~#
root at apolo1:~# 
root at apolo1:~# mkfs.ocfs2 -b 4k -C 32k -N 4 -L oracle -M local /dev/sda6 
mkfs.ocfs2 1.3.9
Overwriting existing ocfs2 partition.
Proceed (y/N): y
Filesystem label=oracle
Block size=4096 (bits=12)
Cluster size=32768 (bits=15)
Volume size=239709290496 (7315347 clusters) (58522776 blocks)
227 cluster groups (tail covers 25491 clusters, rest cover 32256 clusters)
Journal size=268435456
Initial number of node slots: 4
Creating bitmaps: done
Initializing superblock: done
Writing system files: done
Writing superblock: done
Writing backup superblock: 4 block(s)
Formatting Journals: done
Writing lost+found: done
mkfs.ocfs2 successful
root at apolo1:~# 
root at apolo1:~# 
root at apolo1:~# mount -t ocfs2 /dev/sda6 /clusterdisk
mount.ocfs2: Invalid argument while mounting /dev/sda6 on /clusterdisk. Check 'dmesg' for more information on this error.
root at apolo1:~# 
root at apolo1:~# dmesg | tail
drbd0: Connection closed
drbd0: Writing meta data super block now.
drbd0: conn( Disconnecting -> StandAlone ) 
drbd0: receiver terminated
drbd0: disk( UpToDate -> Diskless ) 
drbd0: drbd_bm_resize called with capacity == 0
drbd0: worker terminated
(26534,3):ocfs2_initialize_super:1367 ERROR: couldn't mount because of unsupported optional features (10).
(26534,3):ocfs2_fill_super:568 ERROR: status = -22
ocfs2: Unmounting device (8,6) on (node local)
root at apolo1:~# 
root at apolo1:~# 
root at apolo1:~# debugfs.ocfs2 -R stats /dev/sda6 
Revision: 0.90
Mount Count: 0 Max Mount Count: 20
State: 0 Errors: 0
Check Interval: 0 Last Check: Wed Dec 12 12:51:16 2007
Creator OS: 0
Feature Compat: 1 BackupSuper 
Feature Incompat: 24 Local Sparse 
Tunefs Incomplete: 0 None
Feature RO compat: 0 None
Root Blknum: 17 System Dir Blknum: 18
First Cluster Group Blknum: 8
Block Size Bits: 12 Cluster Size Bits: 15
Max Node Slots: 4
Label: oracle
UUID: D409B8E2BD764F3295961ABCCE126C56
Inode: 2 Mode: 00 Generation: 1965226685 (0x7522fabd)
FS Generation: 1965226685 (0x7522fabd)
Type: Unknown Attr: 0x0 Flags: Valid System Superblock 
User: 0 (root) Group: 0 (root) Size: 0
Links: 0 Clusters: 7315347
ctime: 0x475ff564 -- Wed Dec 12 12:51:16 2007
atime: 0x0 -- Wed Dec 31 21:00:00 1969
mtime: 0x475ff564 -- Wed Dec 12 12:51:16 2007
dtime: 0x0 -- Wed Dec 31 21:00:00 1969
ctime_nsec: 0x00000000 -- 0
atime_nsec: 0x00000000 -- 0
mtime_nsec: 0x00000000 -- 0
Last Extblk: 0
Sub Alloc Slot: Global Sub Alloc Bit: 65535

Also i have the output of the strace to the mount command that one may want to take a look.

strace -ff mount -t ocfs2 /dev/drbd0 /clusterdisk

strace -ff mount -t ocfs2 /dev/sda6 /clusterdisk

All the tests I did point to be a issue related to OCFS2 and not to DRBD, but i wasnt able to find out what is wrong.

Please, could you take a look at this and point me the actions I have to take to solve this trouble?

Regards,
Carlos.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20071212/7b03cc93/attachment.html