[Ocfs2-users] ocfs2_read_locked_inode:376 ERROR: Invalid dinode #0: signature =

Sunil Mushran Sunil.Mushran at oracle.com
Mon Nov 12 10:27:14 PST 2007


Always partition the device. Everytime I hear about superblock
corruption, I always notice that that device had not been partitioned.

The mount issue is perplexing. The said mount failed because it found
a _corrupted_ system file. Specifically local_alloc:0000. Infact it
appears to be all zeroes. Scanning the list I see 5 other such sysfile
inodes. These inodes are initialized during mkfs. So either mkfs is not
detecting write failures (I seriously doubt that), or the backend is
_flaky_. As I said, it is perplexing. :)

56  ----------   0     0     0   0 1-Jan-1970 01:00 extent_alloc:0012
57  ----------   0     0     0   0 1-Jan-1970 01:00 extent_alloc:0013
71  ----------   0     0     0   0 1-Jan-1970 01:00 inode_alloc:0007
77  ----------   0     0     0   0 1-Jan-1970 01:00 inode_alloc:0013
78  ----------   0     0     0   0 1-Jan-1970 01:00 inode_alloc:0014
104 ----------   0     0     0   0 1-Jan-1970 01:00 local_alloc:0000

You can dump these inodes using dd.

dd if=/dev/sdX of=/tmp/inode56 bs=? count=1 skip=56
dd if=/dev/sdX of=/tmp/inode57 bs=? count=1 skip=57
etc.
And then view them in a binary editor. Or email to me.

Or attempt to view them them in debufs.ocfs2.
debugfs.ocfs2 -R "stat <56>" /dev/sdX

Sunil


paul fretter (TOC) wrote:
> This morning one of my OCFS2 volumes (called oracle) fell over.  I have
> another volume (LUN) on the same (shared fibrechannel) device and it
> works fine.
>
> I was unable to remount 'oracle' (superblock corrupt etc) and so I bit
> the bullet and reformatted it (it needed it anyway as there were some
> faulty inode refs that I hadn't been able to get rid of), and for good
> measure I thought I'd upgrade to 1.2.7.
>
> Format went OK, but I still can't mount the 'oracle' volume (device =
> /dev/sdf).  Same problem if I use "mount -L oracle".
> The error message I get is this:
> mount.ocfs2: Invalid argument while mounting /dev/sdf on /common. Check
> 'dmesg' for more information on this error.
>
>
> Can anyone give me a hint as to what's happening?
>
> Kind regards
> Paul Fretter
>
>
>
> System is RHEL4 (AS)
>
> [root at jic55123 ~]# uname -a
> Linux jic55123 2.6.9-42.ELsmp #1 SMP Wed Jul 12 23:32:02 EDT 2006 x86_64
> x86_64 x86_64 GNU/Linux
>
> [root at jic55123 ~]# rpm -qa | grep ocfs2
> ocfs2console-1.2.7-1.el4
> ocfs2-tools-1.2.7-1.el4
> ocfs2-2.6.9-42.ELsmp-1.2.7-1.el4
>
> [root at jic55123 ~]# mount -t ocfs2 /dev/sdf /common
> mount.ocfs2: Invalid argument while mounting /dev/sdf on /common. Check
> 'dmesg' for more information on this error.
>
> [root at jic55123 ~]# dmesg
> ocfs2_dlm: Nodes in domain ("8FB2E06AF16940F89A577A46776270D4"): 9
> (8570,1):ocfs2_read_locked_inode:376 ERROR: Invalid dinode #0: signature
> =
> (8570,1):_ocfs2_get_system_file_inode:122 ERROR: status = -116
> (8570,1):ocfs2_init_local_system_inodes:280 ERROR: status=-22,
> sysfile=9, slot=0
> (8570,1):ocfs2_mount_volume:1163 ERROR: status = -22
> ocfs2: Unmounting device (8,80) on (node 9)
>
> [root at jic55123 ~]# debugfs.ocfs2 -R "slotmap" /dev/sdf
>         Slot#   Node#
>
>
> [root at jic55123 ~]# debugfs.ocfs2 /dev/sdf
> debugfs.ocfs2 1.2.7
> debugfs: stats
>         Revision: 0.90
>         Mount Count: 0   Max Mount Count: 20
>         State: 0   Errors: 0
>         Check Interval: 0   Last Check: Mon Nov 12 14:06:27 2007
>         Creator OS: 0
>         Feature Compat: 1 BackupSuper
>         Feature Incompat: 0 None
>         Tunefs Incomplete: 0 None
>         Feature RO compat: 0 None
>         Root Blknum: 17   System Dir Blknum: 18
>         First Cluster Group Blknum: 8
>         Block Size Bits: 12   Cluster Size Bits: 15
>         Max Node Slots: 20
>         Label: oracle
>         UUID: 8FB2E06AF16940F89A577A46776270D4
>         Inode: 2   Mode: 00   Generation: 2864805674 (0xaac1772a)
>         FS Generation: 2864805674 (0xaac1772a)
>         Type: Unknown   Attr: 0x0   Flags: Valid System Superblock
>         User: 0 (root)   Group: 0 (root)   Size: 0
>         Links: 0   Clusters: 30491392
>         ctime: 0x47385de3 -- Mon Nov 12 14:06:27 2007
>         atime: 0x0 -- Thu Jan  1 01:00:00 1970
>         mtime: 0x47385de3 -- Mon Nov 12 14:06:27 2007
>         dtime: 0x0 -- Thu Jan  1 01:00:00 1970
>         ctime_nsec: 0x00000000 -- 0
>         atime_nsec: 0x00000000 -- 0
>         mtime_nsec: 0x00000000 -- 0
>         Last Extblk: 0
>         Sub Alloc Slot: Global   Sub Alloc Bit: 65535
> debugfs: ls -l
>         17              drwxr-xr-x   3     0     0            4096
> 12-Nov-2007 14:06 .
>         17              drwxr-xr-x   3     0     0            4096
> 12-Nov-2007 14:06 ..
>         1311441         drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:13 lost+found
> debugfs: ls -l //
>         18              drwxr-xr-x  22     0     0            4096
> 12-Nov-2007 14:06 .
>         18              drwxr-xr-x  22     0     0            4096
> 12-Nov-2007 14:06 ..
>         19              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 bad_blocks
>         20              -rw-r--r--   1     0     0          851968
> 12-Nov-2007 14:06 global_inode_alloc
>         21              -rw-r--r--   1     0     0           32768
> 12-Nov-2007 14:06 slot_map
>         22              -rw-r--r--   1     0     0         1048576
> 12-Nov-2007 14:06 heartbeat
>         23              -rw-r--r--   1     0     0    999141933056
> 12-Nov-2007 14:06 global_bitmap
>         24              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0000
>         25              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0001
>         26              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0002
>         27              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0003
>         28              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0004
>         29              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0005
>         30              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0006
>         31              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0007
>         32              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0008
>         33              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0009
>         34              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0010
>         35              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0011
>         36              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0012
>         37              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0013
>         38              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0014
>         39              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0015
>         40              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0016
>         41              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0017
>         42              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0018
>         43              drwxr-xr-x   2     0     0            4096
> 12-Nov-2007 14:06 orphan_dir:0019
>         44              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0000
>         45              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0001
>         46              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0002
>         47              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0003
>         48              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0004
>         49              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0005
>         50              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0006
>         51              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0007
>         52              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0008
>         53              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0009
>         54              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0010
>         55              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0011
>         56              ----------   0     0     0               0
> 1-Jan-1970 01:00 extent_alloc:0012
>         57              ----------   0     0     0               0
> 1-Jan-1970 01:00 extent_alloc:0013
>         58              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0014
>         59              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0015
>         60              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0016
>         61              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0017
>         62              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0018
>         63              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 extent_alloc:0019
>         64              -rw-r--r--   1     0     0         4194304
> 12-Nov-2007 14:06 inode_alloc:0000
>         65              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0001
>         66              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0002
>         67              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0003
>         68              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0004
>         69              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0005
>         70              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0006
>         71              ----------   0     0     0               0
> 1-Jan-1970 01:00 inode_alloc:0007
>         72              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0008
>         73              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0009
>         74              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0010
>         75              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0011
>         76              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0012
>         77              ----------   0     0     0               0
> 1-Jan-1970 01:00 inode_alloc:0013
>         78              ----------   0     0     0               0
> 1-Jan-1970 01:00 inode_alloc:0014
>         79              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0015
>         80              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0016
>         81              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0017
>         82              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0018
>         83              -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 inode_alloc:0019
>         84              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:06 journal:0000
>         85              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:07 journal:0001
>         86              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:07 journal:0002
>         87              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:07 journal:0003
>         88              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:08 journal:0004
>         89              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:08 journal:0005
>         90              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:08 journal:0006
>         91              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:09 journal:0007
>         92              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:09 journal:0008
>         93              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:09 journal:0009
>         94              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:09 journal:0010
>         95              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:10 journal:0011
>         96              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:10 journal:0012
>         97              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:10 journal:0013
>         98              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:10 journal:0014
>         99              -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:11 journal:0015
>         100             -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:11 journal:0016
>         101             -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:11 journal:0017
>         102             -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:12 journal:0018
>         103             -rw-r--r--   1     0     0       268435456
> 12-Nov-2007 14:12 journal:0019
>         104             ----------   0     0     0               0
> 1-Jan-1970 01:00 local_alloc:0000
>         105             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0001
>         106             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0002
>         107             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0003
>         108             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0004
>         109             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0005
>         110             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0006
>         111             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0007
>         112             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0008
>         113             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0009
>         114             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0010
>         115             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0011
>         116             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0012
>         117             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0013
>         118             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0014
>         119             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0015
>         120             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0016
>         121             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0017
>         122             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0018
>         123             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 local_alloc:0019
>         124             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0000
>         125             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0001
>         126             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0002
>         127             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0003
>         128             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0004
>         129             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0005
>         130             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0006
>         131             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0007
>         132             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0008
>         133             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0009
>         134             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0010
>         135             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0011
>         136             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0012
>         137             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0013
>         138             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0014
>         139             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0015
>         140             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0016
>         141             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0017
>         142             -rw-r--r--   1     0     0               0
> 12-Nov-2007 14:06 truncate_log:0018
> debugfs: hb
>         node: node              seq       generation checksum
>            8:    8 000000004738647f 0000000000000000 b1ae1598
>            9:    9 0000000047386c77 0000000000000000 7b54bed2
> debugfs:
>
>
>
> [root at jic55123 ~]# cat /etc/ocfs2/cluster.conf
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.1
>         number = 0
>         name = node1
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.2
>         number = 1
>         name = node2
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.3
>         number = 2
>         name = node3
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.4
>         number = 3
>         name = node4
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.5
>         number = 4
>         name = node5
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.6
>         number = 5
>         name = node6
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.7
>         number = 6
>         name = node7
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.8
>         number = 7
>         name = node8
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.100
>         number = 8
>         name = jic55124
>         cluster = ocfs2
>
> node:
>         ip_port = 7777
>         ip_address = 10.10.10.110
>         number = 9
>         name = jic55123
>         cluster = ocfs2
>
> cluster:
>         node_count = 10
>         name = ocfs2
>
> [root at jic55123 ~]#
>
> _______________________________________________
> Ocfs2-users mailing list
> Ocfs2-users at oss.oracle.com
> http://oss.oracle.com/mailman/listinfo/ocfs2-users
>   




More information about the Ocfs2-users mailing list