[Ocfs2-users] OCFS2 cluster won't come up and stay up
Tony Rios
tony at tonyrios.com
Thu Dec 1 16:55:15 PST 2011
I'm having an issue today where I just can't seem to keep all the servers in the cluster online.
They aren't losing network connectivity and I can ping the iSCSI host just fine and the host is logged in.
These are the errors form the dmesg when I try to mount the filesystem:
root at pedge36:~# dmesg
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Linux version 2.6.38-10-generic (buildd at yellow) (gcc version 4.5.2 (Ubuntu/Linaro 4.5.2-8ubuntu4) ) #46-Ubuntu SMP Tue Jun 28 15:07:17 UTC 2011 (Ubuntu 2.6.38-10.46-generic 2.6.38.7)
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-2.6.38-10-generic root=UUID=3cd859b8-2605-4a38-8767-a6d1f99d53bd ro debug ignore_loglevel
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
[ 0.000000] BIOS-e820: 0000000000100000 - 00000000effc0000 (usable)
[ 0.000000] BIOS-e820: 00000000effc0000 - 00000000effcfc00 (ACPI data)
[ 0.000000] BIOS-e820: 00000000effcfc00 - 00000000effff000 (reserved)
[ 0.000000] BIOS-e820: 00000000f0000000 - 00000000f4000000 (reserved)
[ 0.000000] BIOS-e820: 00000000fec00000 - 00000000fed00400 (reserved)
[ 0.000000] BIOS-e820: 00000000fed13000 - 00000000feda0000 (reserved)
[ 0.000000] BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
[ 0.000000] BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
[ 0.000000] BIOS-e820: 0000000100000000 - 00000001ffffe000 (usable)
[ 0.000000] BIOS-e820: 00000001ffffe000 - 0000000200000000 (reserved)
[ 0.000000] BIOS-e820: 0000000200000000 - 0000000210000000 (usable)
[ 0.000000] debug: ignoring loglevel setting.
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] DMI 2.3 present.
[ 0.000000] DMI: Dell Computer Corporation PowerEdge 850/0Y8628, BIOS A04 08/22/2006
[ 0.000000] e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
[ 0.000000] e820 remove range: 00000000000a0000 - 0000000000100000 (usable)
[ 0.000000] No AGP bridge found
[ 0.000000] last_pfn = 0x210000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR default type: uncachable
[ 0.000000] MTRR fixed ranges enabled:
[ 0.000000] 00000-9FFFF write-back
[ 0.000000] A0000-BFFFF uncachable
[ 0.000000] C0000-CBFFF write-protect
[ 0.000000] CC000-EBFFF uncachable
[ 0.000000] EC000-FFFFF write-protect
[ 0.000000] MTRR variable ranges enabled:
[ 0.000000] 0 base 000000000 mask E00000000 write-back
[ 0.000000] 1 base 200000000 mask FF0000000 write-back
[ 0.000000] 2 base 0F0000000 mask FF0000000 uncachable
[ 0.000000] 3 disabled
[ 0.000000] 4 disabled
[ 0.000000] 5 disabled
[ 0.000000] 6 disabled
[ 0.000000] 7 disabled
[ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[ 0.000000] e820 update range: 00000000f0000000 - 0000000100000000 (usable) ==> (reserved)
[ 0.000000] last_pfn = 0xeffc0 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[ 0.000000] initial memory mapped : 0 - 20000000
[ 0.000000] init_memory_mapping: 0000000000000000-00000000effc0000
[ 0.000000] 0000000000 - 00efe00000 page 2M
[ 0.000000] 00efe00000 - 00effc0000 page 4k
[ 0.000000] kernel direct mapping tables up to effc0000 @ 1fffa000-20000000
[ 0.000000] init_memory_mapping: 0000000100000000-0000000210000000
[ 0.000000] 0100000000 - 0210000000 page 2M
[ 0.000000] kernel direct mapping tables up to 210000000 @ effb6000-effc0000
[ 0.000000] RAMDISK: 366d0000 - 37360000
[ 0.000000] ACPI: RSDP 00000000000fd160 00014 (v00 DELL )
[ 0.000000] ACPI: RSDT 00000000000fd174 00038 (v01 DELL PE850 00000001 MSFT 0100000A)
[ 0.000000] ACPI: FACP 00000000000fd1b8 00074 (v01 DELL PE850 00000001 MSFT 0100000A)
[ 0.000000] ACPI: DSDT 00000000effc0000 01C19 (v01 DELL PE830 00000001 MSFT 0100000E)
[ 0.000000] ACPI: FACS 00000000effcfc00 00040
[ 0.000000] ACPI: APIC 00000000000fd22c 00074 (v01 DELL PE850 00000001 MSFT 0100000A)
[ 0.000000] ACPI: SPCR 00000000000fd2a0 00050 (v01 DELL PE850 00000001 MSFT 0100000A)
[ 0.000000] ACPI: HPET 00000000000fd2f0 00038 (v01 DELL PE830 00000001 MSFT 0100000A)
[ 0.000000] ACPI: MCFG 00000000000fd328 0003C (v01 DELL PE830 00000001 MSFT 0100000A)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at 0000000000000000-0000000210000000
[ 0.000000] Initmem setup node 0 0000000000000000-0000000210000000
[ 0.000000] NODE_DATA [00000001ffff9000 - 00000001ffffdfff]
[ 0.000000] [ffffea0000000000-ffffea00073fffff] PMD -> [ffff8801f7e00000-ffff8801feffffff] on node 0
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000010 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x00210000
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[4] active PFN ranges
[ 0.000000] 0: 0x00000010 -> 0x000000a0
[ 0.000000] 0: 0x00000100 -> 0x000effc0
[ 0.000000] 0: 0x00100000 -> 0x001ffffe
[ 0.000000] 0: 0x00200000 -> 0x00210000
[ 0.000000] On node 0 totalpages: 2096974
[ 0.000000] DMA zone: 56 pages used for memmap
[ 0.000000] DMA zone: 7 pages reserved
[ 0.000000] DMA zone: 3921 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 14280 pages used for memmap
[ 0.000000] DMA32 zone: 964600 pages, LIFO batch:31
[ 0.000000] Normal zone: 15232 pages used for memmap
[ 0.000000] Normal zone: 1098878 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x808
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[ 0.000000] ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: IOAPIC (id[0x03] address[0xfec10000] gsi_base[32])
[ 0.000000] IOAPIC[1]: apic_id 3, version 32, address 0xfec10000, GSI 32-55
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: IRQ0 used by override.
[ 0.000000] ACPI: IRQ2 used by override.
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0xffffffff base: 0xfed00000
[ 0.000000] SMP: Allowing 2 CPUs, 0 hotplug CPUs
[ 0.000000] nr_irqs_gsi: 72
[ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[ 0.000000] PM: Registered nosave memory: 00000000effc0000 - 00000000effcf000
[ 0.000000] PM: Registered nosave memory: 00000000effcf000 - 00000000effd0000
[ 0.000000] PM: Registered nosave memory: 00000000effd0000 - 00000000effff000
[ 0.000000] PM: Registered nosave memory: 00000000effff000 - 00000000f0000000
[ 0.000000] PM: Registered nosave memory: 00000000f0000000 - 00000000f4000000
[ 0.000000] PM: Registered nosave memory: 00000000f4000000 - 00000000fec00000
[ 0.000000] PM: Registered nosave memory: 00000000fec00000 - 00000000fed00000
[ 0.000000] PM: Registered nosave memory: 00000000fed00000 - 00000000fed13000
[ 0.000000] PM: Registered nosave memory: 00000000fed13000 - 00000000feda0000
[ 0.000000] PM: Registered nosave memory: 00000000feda0000 - 00000000fee00000
[ 0.000000] PM: Registered nosave memory: 00000000fee00000 - 00000000fee10000
[ 0.000000] PM: Registered nosave memory: 00000000fee10000 - 00000000ffb00000
[ 0.000000] PM: Registered nosave memory: 00000000ffb00000 - 0000000100000000
[ 0.000000] PM: Registered nosave memory: 00000001ffffe000 - 0000000200000000
[ 0.000000] Allocating PCI resources starting at f4000000 (gap: f4000000:ac00000)
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:2 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 28 pages/cpu @ffff8800efc00000 s84416 r8192 d22080 u1048576
[ 0.000000] pcpu-alloc: s84416 r8192 d22080 u1048576 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 0 1
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 2067399
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-2.6.38-10-generic root=UUID=3cd859b8-2605-4a38-8767-a6d1f99d53bd ro debug ignore_loglevel
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
[ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.000000] Memory: 8178472k/8650752k available (5941k kernel code, 262856k absent, 209424k reserved, 5016k data, 956k init)
[ 0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] RCU dyntick-idle grace-period acceleration is enabled.
[ 0.000000] RCU-based detection of stalled CPUs is disabled.
[ 0.000000] NR_IRQS:16640 nr_irqs:512 16
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] allocated 83886080 bytes of page_cgroup
[ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[ 0.000000] hpet clockevent registered
[ 0.000000] Fast TSC calibration using PIT
[ 0.000000] Detected 3000.094 MHz processor.
[ 0.010004] Calibrating delay loop (skipped), value calculated using timer frequency.. 6000.18 BogoMIPS (lpj=30000940)
[ 0.010017] pid_max: default: 32768 minimum: 301
[ 0.010056] Security Framework initialized
[ 0.010082] AppArmor: AppArmor initialized
[ 0.010088] Yama: becoming mindful.
[ 0.012092] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.022482] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 0.024244] Mount-cache hash table entries: 256
[ 0.024453] Initializing cgroup subsys ns
[ 0.024463] ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup.
[ 0.024472] Initializing cgroup subsys cpuacct
[ 0.024481] Initializing cgroup subsys memory
[ 0.024495] Initializing cgroup subsys devices
[ 0.024501] Initializing cgroup subsys freezer
[ 0.024507] Initializing cgroup subsys net_cls
[ 0.024512] Initializing cgroup subsys blkio
[ 0.024574] CPU: Physical Processor ID: 0
[ 0.024580] CPU: Processor Core ID: 0
[ 0.024586] mce: CPU supports 4 MCE banks
[ 0.024603] CPU0: Thermal monitoring enabled (TM1)
[ 0.024612] using mwait in idle threads.
[ 0.027748] ACPI: Core revision 20110112
[ 0.029308] ftrace: allocating 24323 entries in 96 pages
[ 0.030085] Setting APIC routing to flat
[ 0.030516] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.136419] CPU0: Intel(R) Pentium(R) D CPU 3.00GHz stepping 04
[ 0.140000] Performance Events: Netburst events, Netburst P4/Xeon PMU driver.
[ 0.140000] ... version: 0
[ 0.140000] ... bit width: 40
[ 0.140000] ... generic registers: 18
[ 0.140000] ... value mask: 000000ffffffffff
[ 0.140000] ... max period: 0000007fffffffff
[ 0.140000] ... fixed-purpose events: 0
[ 0.140000] ... event mask: 000000000003ffff
[ 0.140000] Booting Node 0, Processors #1 Ok.
[ 0.300021] Brought up 2 CPUs
[ 0.300030] Total of 2 processors activated (12000.49 BogoMIPS).
[ 0.300847] devtmpfs: initialized
[ 0.302451] print_constraints: dummy:
[ 0.302485] Time: 0:41:31 Date: 12/02/11
[ 0.302546] NET: Registered protocol family 16
[ 0.302672] Trying to unpack rootfs image as initramfs...
[ 0.310474] ACPI: bus type pci registered
[ 0.310570] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf0000000-0xf3ffffff] (base 0xf0000000)
[ 0.310580] PCI: MMCONFIG at [mem 0xf0000000-0xf3ffffff] reserved in E820
[ 0.340577] PCI: Using configuration type 1 for base access
[ 0.342112] bio: create slab <bio-0> at 0
[ 0.342934] ACPI: EC: Look up EC in DSDT
[ 0.345243] ACPI: Interpreter enabled
[ 0.345252] ACPI: (supports S0 S4 S5)
[ 0.345278] ACPI: Using IOAPIC for interrupt routing
[ 0.349231] ACPI: No dock devices found.
[ 0.349239] HEST: Table not found.
[ 0.349246] PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
[ 0.349794] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.350838] pci_root PNP0A03:00: host bridge window [io 0x0000-0x0cf7] (ignored)
[ 0.350848] pci_root PNP0A03:00: host bridge window [io 0x0d00-0xffff] (ignored)
[ 0.350856] pci_root PNP0A03:00: host bridge window [mem 0x000a0000-0x000bffff] (ignored)
[ 0.350864] pci_root PNP0A03:00: host bridge window [mem 0xf0000000-0xfebfffff] (ignored)
[ 0.350884] pci 0000:00:00.0: [8086:2778] type 0 class 0x000600
[ 0.350946] pci 0000:00:01.0: [8086:2779] type 1 class 0x000604
[ 0.350996] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[ 0.351005] pci 0000:00:01.0: PME# disabled
[ 0.351066] pci 0000:00:1c.0: [8086:27d0] type 1 class 0x000604
[ 0.351137] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 0.351145] pci 0000:00:1c.0: PME# disabled
[ 0.351178] pci 0000:00:1c.4: [8086:27e0] type 1 class 0x000604
[ 0.351248] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[ 0.351256] pci 0000:00:1c.4: PME# disabled
[ 0.351285] pci 0000:00:1c.5: [8086:27e2] type 1 class 0x000604
[ 0.351355] pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold
[ 0.351363] pci 0000:00:1c.5: PME# disabled
[ 0.351391] pci 0000:00:1d.0: [8086:27c8] type 0 class 0x000c03
[ 0.351443] pci 0000:00:1d.0: reg 20: [io 0xbce0-0xbcff]
[ 0.351484] pci 0000:00:1d.1: [8086:27c9] type 0 class 0x000c03
[ 0.351537] pci 0000:00:1d.1: reg 20: [io 0xbcc0-0xbcdf]
[ 0.351577] pci 0000:00:1d.2: [8086:27ca] type 0 class 0x000c03
[ 0.351629] pci 0000:00:1d.2: reg 20: [io 0xbca0-0xbcbf]
[ 0.351680] pci 0000:00:1d.7: [8086:27cc] type 0 class 0x000c03
[ 0.351707] pci 0000:00:1d.7: reg 10: [mem 0xfeb00400-0xfeb007ff]
[ 0.351792] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[ 0.351800] pci 0000:00:1d.7: PME# disabled
[ 0.351824] pci 0000:00:1e.0: [8086:244e] type 1 class 0x000604
[ 0.351903] pci 0000:00:1f.0: [8086:27b8] type 0 class 0x000601
[ 0.352002] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f)
[ 0.352011] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f)
[ 0.352020] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e8 (mask 0003)
[ 0.352063] pci 0000:00:1f.1: [8086:27df] type 0 class 0x000101
[ 0.352083] pci 0000:00:1f.1: reg 10: [io 0x0000-0x0007]
[ 0.352097] pci 0000:00:1f.1: reg 14: [io 0x0000-0x0003]
[ 0.352111] pci 0000:00:1f.1: reg 18: [io 0x0000-0x0007]
[ 0.352125] pci 0000:00:1f.1: reg 1c: [io 0x0000-0x0003]
[ 0.352139] pci 0000:00:1f.1: reg 20: [io 0xfc00-0xfc0f]
[ 0.352184] pci 0000:00:1f.2: [8086:27c0] type 0 class 0x000101
[ 0.352205] pci 0000:00:1f.2: reg 10: [io 0xbc98-0xbc9f]
[ 0.352218] pci 0000:00:1f.2: reg 14: [io 0xbc90-0xbc93]
[ 0.352231] pci 0000:00:1f.2: reg 18: [io 0xbc80-0xbc87]
[ 0.352244] pci 0000:00:1f.2: reg 1c: [io 0xbc78-0xbc7b]
[ 0.352257] pci 0000:00:1f.2: reg 20: [io 0xbc60-0xbc6f]
[ 0.352269] pci 0000:00:1f.2: reg 24: [mem 0xfeb00000-0xfeb003ff]
[ 0.352301] pci 0000:00:1f.2: PME# supported from D3hot
[ 0.352308] pci 0000:00:1f.2: PME# disabled
[ 0.352327] pci 0000:00:1f.3: [8086:27da] type 0 class 0x000c05
[ 0.352389] pci 0000:00:1f.3: reg 20: [io 0x08c0-0x08df]
[ 0.352469] pci 0000:00:01.0: PCI bridge to [bus 01-01]
[ 0.352477] pci 0000:00:01.0: bridge window [io 0xf000-0x0000] (disabled)
[ 0.352485] pci 0000:00:01.0: bridge window [mem 0xfff00000-0x000fffff] (disabled)
[ 0.352496] pci 0000:00:01.0: bridge window [mem 0xfff00000-0x000fffff pref] (disabled)
[ 0.352561] pci 0000:02:00.0: [8086:032c] type 1 class 0x000604
[ 0.352592] pci 0000:02:00.0: PXH quirk detected; SHPC device MSI disabled
[ 0.352673] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[ 0.352682] pci 0000:02:00.0: PME# disabled
[ 0.352716] pci 0000:02:00.0: disabling ASPM on pre-1.1 PCIe device. You can enable it with 'pcie_aspm=force'
[ 0.352733] pci 0000:00:1c.0: PCI bridge to [bus 02-03]
[ 0.352741] pci 0000:00:1c.0: bridge window [io 0xf000-0x0000] (disabled)
[ 0.352750] pci 0000:00:1c.0: bridge window [mem 0xfea00000-0xfeafffff]
[ 0.352761] pci 0000:00:1c.0: bridge window [mem 0xfff00000-0x000fffff pref] (disabled)
[ 0.352865] pci 0000:02:00.0: PCI bridge to [bus 03-03]
[ 0.352874] pci 0000:02:00.0: bridge window [io 0xf000-0x0000] (disabled)
[ 0.352883] pci 0000:02:00.0: bridge window [mem 0xfff00000-0x000fffff] (disabled)
[ 0.352896] pci 0000:02:00.0: bridge window [mem 0xfff00000-0x000fffff pref] (disabled)
[ 0.352980] pci 0000:04:00.0: [14e4:1659] type 0 class 0x000200
[ 0.353011] pci 0000:04:00.0: reg 10: [mem 0xfe8f0000-0xfe8fffff 64bit]
[ 0.353120] pci 0000:04:00.0: PME# supported from D3hot D3cold
[ 0.353129] pci 0000:04:00.0: PME# disabled
[ 0.353150] pci 0000:04:00.0: disabling ASPM on pre-1.1 PCIe device. You can enable it with 'pcie_aspm=force'
[ 0.353167] pci 0000:00:1c.4: PCI bridge to [bus 04-04]
[ 0.353175] pci 0000:00:1c.4: bridge window [io 0xe000-0xefff]
[ 0.353183] pci 0000:00:1c.4: bridge window [mem 0xfe800000-0xfe9fffff]
[ 0.353194] pci 0000:00:1c.4: bridge window [mem 0xfff00000-0x000fffff pref] (disabled)
[ 0.353272] pci 0000:05:00.0: [14e4:1659] type 0 class 0x000200
[ 0.353304] pci 0000:05:00.0: reg 10: [mem 0xfe6f0000-0xfe6fffff 64bit]
[ 0.353414] pci 0000:05:00.0: PME# supported from D3hot D3cold
[ 0.353423] pci 0000:05:00.0: PME# disabled
[ 0.353444] pci 0000:05:00.0: disabling ASPM on pre-1.1 PCIe device. You can enable it with 'pcie_aspm=force'
[ 0.353461] pci 0000:00:1c.5: PCI bridge to [bus 05-05]
[ 0.353469] pci 0000:00:1c.5: bridge window [io 0xd000-0xdfff]
[ 0.353477] pci 0000:00:1c.5: bridge window [mem 0xfe600000-0xfe7fffff]
[ 0.353488] pci 0000:00:1c.5: bridge window [mem 0xfff00000-0x000fffff pref] (disabled)
[ 0.353540] pci 0000:06:05.0: [18ca:0020] type 0 class 0x000300
[ 0.353564] pci 0000:06:05.0: reg 10: [mem 0xfd000000-0xfdffffff pref]
[ 0.353579] pci 0000:06:05.0: reg 14: [mem 0xfe4c0000-0xfe4fffff]
[ 0.353594] pci 0000:06:05.0: reg 18: [io 0xcc80-0xccff]
[ 0.353656] pci 0000:06:05.0: supports D1 D2
[ 0.353706] pci 0000:00:1e.0: PCI bridge to [bus 06-06] (subtractive decode)
[ 0.353715] pci 0000:00:1e.0: bridge window [io 0xc000-0xcfff]
[ 0.353723] pci 0000:00:1e.0: bridge window [mem 0xfe400000-0xfe5fffff]
[ 0.353734] pci 0000:00:1e.0: bridge window [mem 0xfd000000-0xfdffffff 64bit pref]
[ 0.353742] pci 0000:00:1e.0: bridge window [io 0x0000-0xffff] (subtractive decode)
[ 0.353750] pci 0000:00:1e.0: bridge window [mem 0x00000000-0xfffffffff] (subtractive decode)
[ 0.353783] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[ 0.354019] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PES1._PRT]
[ 0.354114] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEP0._PRT]
[ 0.354211] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEP0.PXHA._PRT]
[ 0.354354] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEP1._PRT]
[ 0.354452] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEP2._PRT]
[ 0.354545] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCIS._PRT]
[ 0.354647] pci0000:00: Requesting ACPI _OSC control (0x1d)
[ 0.357077] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 9 10 11 12)
[ 0.357181] ACPI: PCI Interrupt Link [LNKB] (IRQs *3 4 5 6 7 9 10 11 12)
[ 0.357280] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 11 12) *0, disabled.
[ 0.357381] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 12) *0, disabled.
[ 0.357483] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11 12)
[ 0.357581] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 *10 11 12)
[ 0.357679] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 *6 7 9 10 11 12)
[ 0.357775] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12) *0, disabled.
[ 0.357962] vgaarb: device added: PCI:0000:06:05.0,decodes=io+mem,owns=io+mem,locks=none
[ 0.357972] vgaarb: loaded
[ 0.358262] SCSI subsystem initialized
[ 0.370152] libata version 3.00 loaded.
[ 0.370242] usbcore: registered new interface driver usbfs
[ 0.370264] usbcore: registered new interface driver hub
[ 0.370331] usbcore: registered new device driver usb
[ 0.370529] wmi: Mapper loaded
[ 0.370534] PCI: Using ACPI for IRQ routing
[ 0.370541] PCI: pci_cache_line_size set to 64 bytes
[ 0.370646] reserve RAM buffer: 00000000effc0000 - 00000000efffffff
[ 0.370653] reserve RAM buffer: 00000001ffffe000 - 00000001ffffffff
[ 0.370809] NetLabel: Initializing
[ 0.370816] NetLabel: domain hash size = 128
[ 0.370820] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.370841] NetLabel: unlabeled traffic allowed by default
[ 0.370899] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[ 0.370909] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 0.370919] hpet0: 3 comparators, 64-bit 14.318180 MHz counter
[ 0.380440] Switching to clocksource hpet
[ 0.389557] Switched to NOHz mode on CPU #0
[ 0.389696] Switched to NOHz mode on CPU #1
[ 0.402328] AppArmor: AppArmor Filesystem Enabled
[ 0.402389] pnp: PnP ACPI init
[ 0.402422] ACPI: bus type pnp registered
[ 0.403011] pnp 00:00: [bus 00-ff]
[ 0.403019] pnp 00:00: [io 0x0000-0x0cf7 window]
[ 0.403025] pnp 00:00: [io 0x0cf8-0x0cff]
[ 0.403030] pnp 00:00: [io 0x0d00-0xffff window]
[ 0.403036] pnp 00:00: [mem 0x000a0000-0x000bffff window]
[ 0.403042] pnp 00:00: [mem 0xf0000000-0xfebfffff window]
[ 0.403118] pnp 00:00: Plug and Play ACPI device, IDs PNP0a03 (active)
[ 0.403161] pnp 00:01: [io 0x0080-0x009f]
[ 0.403167] pnp 00:01: [io 0x0000-0x001f]
[ 0.403172] pnp 00:01: [io 0x00c0-0x00df]
[ 0.403177] pnp 00:01: [dma 4]
[ 0.403223] pnp 00:01: Plug and Play ACPI device, IDs PNP0200 (active)
[ 0.403260] pnp 00:02: [io 0x00f0-0x00ff]
[ 0.403278] pnp 00:02: [irq 13]
[ 0.403319] pnp 00:02: Plug and Play ACPI device, IDs PNP0c04 (active)
[ 0.403359] pnp 00:03: [io 0x0061]
[ 0.403407] pnp 00:03: Plug and Play ACPI device, IDs PNP0800 (active)
[ 0.403447] pnp 00:04: [io 0x0070-0x007f]
[ 0.403458] pnp 00:04: [irq 8]
[ 0.403501] pnp 00:04: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 0.403676] pnp 00:05: Plug and Play ACPI device, IDs PNP0700 (disabled)
[ 0.404615] pnp 00:06: [io 0x03f8-0x03ff]
[ 0.404626] pnp 00:06: [irq 4]
[ 0.404713] pnp 00:06: Plug and Play ACPI device, IDs PNP0501 (active)
[ 0.405469] pnp 00:07: [io 0x0800-0x087f]
[ 0.405476] pnp 00:07: [io 0x0880-0x08bf]
[ 0.405482] pnp 00:07: [io 0x08c0-0x08df]
[ 0.405493] pnp 00:07: [io 0x08e0-0x08e3]
[ 0.405497] pnp 00:07: [io 0x0c00-0x0c0f]
[ 0.405502] pnp 00:07: [io 0x0c10-0x0c1f]
[ 0.405507] pnp 00:07: [io 0x0ca0-0x0ca7]
[ 0.405511] pnp 00:07: [io 0x0ca9-0x0cab]
[ 0.405516] pnp 00:07: [io 0x0cad-0x0caf]
[ 0.405521] pnp 00:07: [io 0x0c20-0x0c3f]
[ 0.405525] pnp 00:07: [io 0x00e0-0x00e7]
[ 0.405530] pnp 00:07: [io 0x0060]
[ 0.405534] pnp 00:07: [io 0x0064]
[ 0.405627] system 00:07: [io 0x0800-0x087f] has been reserved
[ 0.405635] system 00:07: [io 0x0880-0x08bf] has been reserved
[ 0.405641] system 00:07: [io 0x08c0-0x08df] has been reserved
[ 0.405647] system 00:07: [io 0x08e0-0x08e3] has been reserved
[ 0.405653] system 00:07: [io 0x0c00-0x0c0f] has been reserved
[ 0.405660] system 00:07: [io 0x0c10-0x0c1f] has been reserved
[ 0.405666] system 00:07: [io 0x0ca0-0x0ca7] has been reserved
[ 0.405672] system 00:07: [io 0x0ca9-0x0cab] has been reserved
[ 0.405678] system 00:07: [io 0x0cad-0x0caf] has been reserved
[ 0.405684] system 00:07: [io 0x0c20-0x0c3f] has been reserved
[ 0.405693] system 00:07: Plug and Play ACPI device, IDs PNP0c01 (active)
[ 0.405776] pnp 00:08: [io 0x0ca8]
[ 0.405782] pnp 00:08: [io 0x0cac]
[ 0.405828] pnp 00:08: Plug and Play ACPI device, IDs IPI0001 (active)
[ 0.405865] pnp 00:09: [mem 0xf0000000-0xf3ffffff]
[ 0.405941] system 00:09: [mem 0xf0000000-0xf3ffffff] has been reserved
[ 0.405950] system 00:09: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 0.405973] pnp 00:0a: [mem 0xfed00000-0xfed003ff]
[ 0.406029] pnp 00:0a: Plug and Play ACPI device, IDs PNP0103 (active)
[ 0.406298] pnp: PnP ACPI: found 11 devices
[ 0.406304] ACPI: ACPI bus type pnp unregistered
[ 0.413711] pci 0000:00:01.0: PCI bridge to [bus 01-01]
[ 0.413720] pci 0000:00:01.0: bridge window [io disabled]
[ 0.413728] pci 0000:00:01.0: bridge window [mem disabled]
[ 0.413735] pci 0000:00:01.0: bridge window [mem pref disabled]
[ 0.413745] pci 0000:02:00.0: PCI bridge to [bus 03-03]
[ 0.413750] pci 0000:02:00.0: bridge window [io disabled]
[ 0.413759] pci 0000:02:00.0: bridge window [mem disabled]
[ 0.413767] pci 0000:02:00.0: bridge window [mem pref disabled]
[ 0.413778] pci 0000:00:1c.0: PCI bridge to [bus 02-03]
[ 0.413784] pci 0000:00:1c.0: bridge window [io disabled]
[ 0.413793] pci 0000:00:1c.0: bridge window [mem 0xfea00000-0xfeafffff]
[ 0.413802] pci 0000:00:1c.0: bridge window [mem pref disabled]
[ 0.413812] pci 0000:00:1c.4: PCI bridge to [bus 04-04]
[ 0.413819] pci 0000:00:1c.4: bridge window [io 0xe000-0xefff]
[ 0.413828] pci 0000:00:1c.4: bridge window [mem 0xfe800000-0xfe9fffff]
[ 0.413836] pci 0000:00:1c.4: bridge window [mem pref disabled]
[ 0.413847] pci 0000:00:1c.5: PCI bridge to [bus 05-05]
[ 0.413855] pci 0000:00:1c.5: bridge window [io 0xd000-0xdfff]
[ 0.413865] pci 0000:00:1c.5: bridge window [mem 0xfe600000-0xfe7fffff]
[ 0.413873] pci 0000:00:1c.5: bridge window [mem pref disabled]
[ 0.413884] pci 0000:00:1e.0: PCI bridge to [bus 06-06]
[ 0.413891] pci 0000:00:1e.0: bridge window [io 0xc000-0xcfff]
[ 0.413900] pci 0000:00:1e.0: bridge window [mem 0xfe400000-0xfe5fffff]
[ 0.413909] pci 0000:00:1e.0: bridge window [mem 0xfd000000-0xfdffffff 64bit pref]
[ 0.413939] pci 0000:00:01.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[ 0.413949] pci 0000:00:01.0: setting latency timer to 64
[ 0.413967] pci 0000:00:1c.0: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[ 0.413976] pci 0000:00:1c.0: setting latency timer to 64
[ 0.413990] pci 0000:02:00.0: setting latency timer to 64
[ 0.414008] pci 0000:00:1c.4: PCI INT B -> GSI 22 (level, low) -> IRQ 22
[ 0.414017] pci 0000:00:1c.4: setting latency timer to 64
[ 0.414035] pci 0000:00:1c.5: PCI INT C -> GSI 23 (level, low) -> IRQ 23
[ 0.414044] pci 0000:00:1c.5: setting latency timer to 64
[ 0.414057] pci 0000:00:1e.0: setting latency timer to 64
[ 0.414067] pci_bus 0000:00: resource 0 [io 0x0000-0xffff]
[ 0.414073] pci_bus 0000:00: resource 1 [mem 0x00000000-0xfffffffff]
[ 0.414080] pci_bus 0000:02: resource 1 [mem 0xfea00000-0xfeafffff]
[ 0.414087] pci_bus 0000:04: resource 0 [io 0xe000-0xefff]
[ 0.414092] pci_bus 0000:04: resource 1 [mem 0xfe800000-0xfe9fffff]
[ 0.414099] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff]
[ 0.414104] pci_bus 0000:05: resource 1 [mem 0xfe600000-0xfe7fffff]
[ 0.414111] pci_bus 0000:06: resource 0 [io 0xc000-0xcfff]
[ 0.414116] pci_bus 0000:06: resource 1 [mem 0xfe400000-0xfe5fffff]
[ 0.414123] pci_bus 0000:06: resource 2 [mem 0xfd000000-0xfdffffff 64bit pref]
[ 0.414130] pci_bus 0000:06: resource 4 [io 0x0000-0xffff]
[ 0.414136] pci_bus 0000:06: resource 5 [mem 0x00000000-0xfffffffff]
[ 0.414194] NET: Registered protocol family 2
[ 0.414741] IP route cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.418161] TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
[ 0.422134] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.422617] TCP: Hash tables configured (established 524288 bind 65536)
[ 0.422626] TCP reno registered
[ 0.422673] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[ 0.422768] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[ 0.422962] NET: Registered protocol family 1
[ 0.423105] pci 0000:02:00.0: rerouting interrupts for [8086:032c]
[ 0.423127] pci 0000:06:05.0: Boot video device
[ 0.423135] PCI: CLS 64 bytes, default 64
[ 0.423141] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 0.423148] Placing 64MB software IO TLB between ffff8800ebc00000 - ffff8800efc00000
[ 0.423155] software IO TLB at phys 0xebc00000 - 0xefc00000
[ 0.423647] audit: initializing netlink socket (disabled)
[ 0.423665] type=2000 audit(1322786490.420:1): initialized
[ 0.439950] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.442643] VFS: Disk quotas dquot_6.5.2
[ 0.442738] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.443765] fuse init (API version 7.16)
[ 0.443906] msgmni has been set to 15973
[ 0.444272] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[ 0.444317] io scheduler noop registered
[ 0.444323] io scheduler deadline registered
[ 0.444395] io scheduler cfq registered (default)
[ 0.444558] pcieport 0000:00:01.0: setting latency timer to 64
[ 0.444617] pcieport 0000:00:01.0: irq 72 for MSI/MSI-X
[ 0.444691] pcieport 0000:00:1c.0: setting latency timer to 64
[ 0.444744] pcieport 0000:00:1c.0: irq 73 for MSI/MSI-X
[ 0.444830] pcieport 0000:00:1c.4: setting latency timer to 64
[ 0.444881] pcieport 0000:00:1c.4: irq 74 for MSI/MSI-X
[ 0.444962] pcieport 0000:00:1c.5: setting latency timer to 64
[ 0.445013] pcieport 0000:00:1c.5: irq 75 for MSI/MSI-X
[ 0.445144] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 0.445188] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[ 0.445389] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 0.445401] ACPI: Power Button [PWRF]
[ 0.445530] ACPI: acpi_idle registered with cpuidle
[ 0.447443] ERST: Table is not found!
[ 0.447551] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 0.447673] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a NS16550A
[ 0.714001] Freeing initrd memory: 12864k freed
[ 1.040261] 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a NS16550A
[ 1.050299] Linux agpgart interface v0.103
[ 1.052077] brd: module loaded
[ 1.052884] loop: module loaded
[ 1.053034] i2c-core: driver [adp5520] using legacy suspend method
[ 1.053041] i2c-core: driver [adp5520] using legacy resume method
[ 1.053192] ata_piix 0000:00:1f.1: version 2.13
[ 1.053207] ata_piix 0000:00:1f.1: enabling device (0000 -> 0001)
[ 1.053218] ata_piix 0000:00:1f.1: can't derive routing for PCI INT A
[ 1.053270] ata_piix 0000:00:1f.1: setting latency timer to 64
[ 1.053782] scsi0 : ata_piix
[ 1.053916] scsi1 : ata_piix
[ 1.053980] ata1: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0xfc00 irq 14
[ 1.053987] ata2: PATA max UDMA/100 cmd 0x170 ctl 0x376 bmdma 0xfc08 irq 15
[ 1.054050] ata_piix 0000:00:1f.2: PCI INT C -> GSI 20 (level, low) -> IRQ 20
[ 1.054061] ata1: port disabled. ignoring.
[ 1.054065] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[ 1.054121] ata2: port disabled. ignoring.
[ 1.210034] ata_piix 0000:00:1f.2: setting latency timer to 64
[ 1.210486] scsi2 : ata_piix
[ 1.210587] scsi3 : ata_piix
[ 1.210655] ata3: SATA max UDMA/133 cmd 0xbc98 ctl 0xbc90 bmdma 0xbc60 irq 20
[ 1.210662] ata4: SATA max UDMA/133 cmd 0xbc80 ctl 0xbc78 bmdma 0xbc68 irq 20
[ 1.211216] Fixed MDIO Bus: probed
[ 1.211267] PPP generic driver version 2.4.2
[ 1.211350] tun: Universal TUN/TAP device driver, 1.6
[ 1.211356] tun: (C) 1999-2004 Max Krasnyansky <maxk at qualcomm.com>
[ 1.211492] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 1.211518] ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 20 (level, low) -> IRQ 20
[ 1.211558] ehci_hcd 0000:00:1d.7: setting latency timer to 64
[ 1.211567] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[ 1.211629] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
[ 1.220064] ehci_hcd 0000:00:1d.7: using broken periodic workaround
[ 1.220081] ehci_hcd 0000:00:1d.7: debug port 1
[ 1.223978] ehci_hcd 0000:00:1d.7: cache line size of 64 is not supported
[ 1.223990] ehci_hcd 0000:00:1d.7: irq 20, io mem 0xfeb00400
[ 1.240019] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[ 1.240191] hub 1-0:1.0: USB hub found
[ 1.240201] hub 1-0:1.0: 6 ports detected
[ 1.240319] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 1.240343] uhci_hcd: USB Universal Host Controller Interface driver
[ 1.240433] uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
[ 1.240447] uhci_hcd 0000:00:1d.0: setting latency timer to 64
[ 1.240455] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[ 1.240519] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 1.250055] uhci_hcd 0000:00:1d.0: irq 20, io base 0x0000bce0
[ 1.250229] hub 2-0:1.0: USB hub found
[ 1.250239] hub 2-0:1.0: 2 ports detected
[ 1.250337] uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 21 (level, low) -> IRQ 21
[ 1.250348] uhci_hcd 0000:00:1d.1: setting latency timer to 64
[ 1.250355] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[ 1.250418] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
[ 1.250492] uhci_hcd 0000:00:1d.1: irq 21, io base 0x0000bcc0
[ 1.250672] hub 3-0:1.0: USB hub found
[ 1.250682] hub 3-0:1.0: 2 ports detected
[ 1.250777] uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 22 (level, low) -> IRQ 22
[ 1.250789] uhci_hcd 0000:00:1d.2: setting latency timer to 64
[ 1.250796] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[ 1.250853] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
[ 1.260063] uhci_hcd 0000:00:1d.2: irq 22, io base 0x0000bca0
[ 1.260245] hub 4-0:1.0: USB hub found
[ 1.260255] hub 4-0:1.0: 2 ports detected
[ 1.260440] i8042: PNP: No PS/2 controller found. Probing ports directly.
[ 1.263232] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 1.263248] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 1.263502] mousedev: PS/2 mouse device common for all mice
[ 1.263668] rtc_cmos 00:04: RTC can wake from S4
[ 1.263771] rtc_cmos 00:04: rtc core: registered rtc_cmos as rtc0
[ 1.263803] rtc0: alarms up to one day, 242 bytes nvram, hpet irqs
[ 1.263991] device-mapper: uevent: version 1.0.3
[ 1.264109] device-mapper: ioctl: 4.19.1-ioctl (2011-01-07) initialised: dm-devel at redhat.com
[ 1.264222] device-mapper: multipath: version 1.2.0 loaded
[ 1.264229] device-mapper: multipath round-robin: version 1.0.0 loaded
[ 1.264407] cpuidle: using governor ladder
[ 1.264413] cpuidle: using governor menu
[ 1.264837] TCP cubic registered
[ 1.265026] NET: Registered protocol family 10
[ 1.265786] NET: Registered protocol family 17
[ 1.265816] Registering the dns_resolver key type
[ 1.266018] PM: Hibernation image not present or could not be loaded.
[ 1.266039] registered taskstats version 1
[ 1.266340] Magic number: 7:315:657
[ 1.266367] block ram10: hash matches
[ 1.266448] rtc_cmos 00:04: setting system clock to 2011-12-02 00:41:32 UTC (1322786492)
[ 1.266457] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 1.266462] EDD information not available.
[ 1.390145] ata3.00: ATA-7: WDC WD1600YD-01NVB1, 10.02E01, max UDMA/133
[ 1.390153] ata3.00: 321672960 sectors, multi 8: LBA48 NCQ (depth 0/1)
[ 1.390372] ata4.00: ATA-7: WDC WD1600YD-01NVB1, 10.02E01, max UDMA/133
[ 1.390379] ata4.00: 321672960 sectors, multi 8: LBA48 NCQ (depth 0/1)
[ 1.410139] ata4.00: configured for UDMA/133
[ 1.410283] ata3.00: configured for UDMA/133
[ 1.410443] scsi 2:0:0:0: Direct-Access ATA WDC WD1600YD-01N 10.0 PQ: 0 ANSI: 5
[ 1.410671] sd 2:0:0:0: Attached scsi generic sg0 type 0
[ 1.410804] sd 2:0:0:0: [sda] 321672960 512-byte logical blocks: (164 GB/153 GiB)
[ 1.410895] scsi 3:0:0:0: Direct-Access ATA WDC WD1600YD-01N 10.0 PQ: 0 ANSI: 5
[ 1.410904] sd 2:0:0:0: [sda] Write Protect is off
[ 1.410910] sd 2:0:0:0: [sda] Mode Sense: 00 3a 00 00
[ 1.410948] sd 2:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 1.411194] sd 3:0:0:0: Attached scsi generic sg1 type 0
[ 1.411309] sd 3:0:0:0: [sdb] 321672960 512-byte logical blocks: (164 GB/153 GiB)
[ 1.411447] sd 3:0:0:0: [sdb] Write Protect is off
[ 1.411454] sd 3:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[ 1.411494] sd 3:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 1.420028] Refined TSC clocksource calibration: 3000.106 MHz.
[ 1.420039] Switching to clocksource tsc
[ 1.431939] sdb: sdb1
[ 1.432233] sd 3:0:0:0: [sdb] Attached SCSI disk
[ 1.452052] sda: sda1 sda2 < sda5 >
[ 1.452453] sd 2:0:0:0: [sda] Attached SCSI disk
[ 1.455037] Freeing unused kernel memory: 956k freed
[ 1.455480] Write protecting the kernel read-only data: 10240k
[ 1.456558] Freeing unused kernel memory: 184k freed
[ 1.463585] Freeing unused kernel memory: 1440k freed
[ 1.493495] <30>udev[69]: starting version 167
[ 1.608917] Floppy drive(s): fd0 is 1.44M
[ 1.621739] tg3.c:v3.116 (December 3, 2010)
[ 1.621764] tg3 0000:04:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[ 1.621781] tg3 0000:04:00.0: setting latency timer to 64
[ 1.738076] tg3 0000:04:00.0: eth0: Tigon3 [partno(BCM95721) rev 4101] (PCI Express) MAC address 00:14:22:7c:4f:c3
[ 1.738092] tg3 0000:04:00.0: eth0: attached PHY is 5750 (10/100/1000Base-T Ethernet) (WireSpeed[1])
[ 1.738102] tg3 0000:04:00.0: eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[ 1.738110] tg3 0000:04:00.0: eth0: dma_rwctrl[76180000] dma_mask[64-bit]
[ 1.738153] tg3 0000:05:00.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
[ 1.738169] tg3 0000:05:00.0: setting latency timer to 64
[ 1.798238] EXT4-fs (sda1): INFO: recovery required on readonly filesystem
[ 1.798250] EXT4-fs (sda1): write access will be enabled during recovery
[ 1.846134] tg3 0000:05:00.0: eth1: Tigon3 [partno(BCM95721) rev 4101] (PCI Express) MAC address 00:14:22:7c:4f:c4
[ 1.846150] tg3 0000:05:00.0: eth1: attached PHY is 5750 (10/100/1000Base-T Ethernet) (WireSpeed[1])
[ 1.846160] tg3 0000:05:00.0: eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[ 1.846168] tg3 0000:05:00.0: eth1: dma_rwctrl[76180000] dma_mask[64-bit]
[ 2.850307] EXT4-fs (sda1): orphan cleanup on readonly fs
[ 2.850325] EXT4-fs (sda1): ext4_orphan_cleanup: deleting unreferenced inode 5899000
[ 2.850370] EXT4-fs (sda1): ext4_orphan_cleanup: deleting unreferenced inode 5898771
[ 2.850392] EXT4-fs (sda1): ext4_orphan_cleanup: deleting unreferenced inode 5898772
[ 2.850412] EXT4-fs (sda1): ext4_orphan_cleanup: deleting unreferenced inode 5898848
[ 2.850432] EXT4-fs (sda1): ext4_orphan_cleanup: deleting unreferenced inode 5899001
[ 2.850450] EXT4-fs (sda1): ext4_orphan_cleanup: deleting unreferenced inode 5898847
[ 2.850466] EXT4-fs (sda1): 6 orphan inodes deleted
[ 2.850473] EXT4-fs (sda1): recovery complete
[ 3.419173] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[ 4.630060] floppy0: no floppy controllers found
[ 8.823074] <30>udev[257]: starting version 167
[ 8.879916] lp: driver loaded but no devices found
[ 8.892181] Adding 6567932k swap on /dev/sda5. Priority:-1 extents:1 across:6567932k
[ 8.968140] type=1400 audit(1322786500.192:2): apparmor="STATUS" operation="profile_load" name="/sbin/dhclient" pid=357 comm="apparmor_parser"
[ 8.969167] type=1400 audit(1322786500.192:3): apparmor="STATUS" operation="profile_load" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=357 comm="apparmor_parser"
[ 8.969817] type=1400 audit(1322786500.192:4): apparmor="STATUS" operation="profile_load" name="/usr/lib/connman/scripts/dhclient-script" pid=357 comm="apparmor_parser"
[ 8.992360] intel_rng: FWH not detected
[ 9.043261] netconsole: local port 6666
[ 9.043273] netconsole: local IP 10.77.0.36
[ 9.043278] netconsole: interface 'eth0'
[ 9.043283] netconsole: remote port 6666
[ 9.043287] netconsole: remote IP 10.77.0.35
[ 9.043293] netconsole: remote ethernet address 00:11:43:fd:56:43
[ 9.061381] ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 9.078614] xgifb: module is from the staging directory, the quality is unknown, you have been warned.
[ 9.079454] EDAC MC: Ver: 2.1.0 Jun 28 2011
[ 9.079737] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 9.083205] leds_ss4200: no LED devices found
[ 9.085290]
[ 9.085293] XGIfb_init_module
[ 9.085303] XGIfb: Mode 'none' not supported anymore. Using default.
[ 9.085312] XGIfb: Options (null)
[ 9.085352] XGIfb: Relocate IO address: cc80 [00000000]
[ 9.085373] XGIfb:chipid = 30
[ 9.085377] XGIfb: Video ROM usage disabled
[ 9.085394] XGIfb: SR14=41 DramSzie 1000000 ChannelNum 1
[ 9.086682] EDAC MC0: Giving out device to 'i3000_edac' 'i3000': DEV 0000:00:00.0
[ 9.086725] EDAC PCI0: Giving out device to module 'i3000_edac' controller 'EDAC PCI controller': DEV '0000:00:00.0' (POLLED)
[ 9.091690] XGIfb: Framebuffer at 0xfd000000, mapped to 0xffffc90005a00000, size 16384k
[ 9.091703] XGIfb: MMIO at 0xfe4c0000, mapped to 0xffffc90006a80000, size 256k
[ 9.091710] XGIfb: XGIInitNew() ...12345678910111215171818118218319202122232425OK
[ 9.099029] XGIfb: Memory heap starting at 8192K
[ 9.099035] XGIfb: Using MMIO queue mode
[ 9.114605] console [netcon0] enabled
[ 9.114614] netconsole: network logging started
[ 9.139558] Loading iSCSI transport class v2.0-870.
[ 9.148697] XGIfb: No or unknown bridge type detected
[ 9.148721] XGIfb: Default mode is 800x600x16 (60Hz)
[ 9.148747] mtrr: type mismatch for fd000000,1000000 old: write-back new: write-combining
[ 9.148757] XGIfb: Added MTRRs
[ 9.148943] fbcon: (fb0) is primary device
[ 9.149051] XGIfb: var->pixclock=25000, htotal=1056, vtotal=1256
[ 9.149055] XGIfb: Change mode to 800x600x16-60Hz
[ 9.160105] Console: switching to colour frame buffer device 100x37
[ 9.189319] iscsi: registered transport (tcp)
[ 9.198844] fb0: frame buffer device, Version 0.8.01
[ 9.275784] ADDRCONF(NETDEV_UP): eth1: link is not ready
[ 9.313232] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[ 9.337784] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[ 9.350971] iscsi: registered transport (iser)
[ 9.381863] iscsid (529): /proc/529/oom_adj is deprecated, please use /proc/529/oom_score_adj instead.
[ 9.585568] RPC: Registered udp transport module.
[ 9.585571] RPC: Registered tcp transport module.
[ 9.585573] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 9.661689] type=1400 audit(1322786500.892:5): apparmor="STATUS" operation="profile_replace" name="/sbin/dhclient" pid=631 comm="apparmor_parser"
[ 9.717983] type=1400 audit(1322786500.942:6): apparmor="STATUS" operation="profile_load" name="/usr/sbin/tcpdump" pid=632 comm="apparmor_parser"
[ 9.730697] Floppy drive(s): fd0 is 1.44M
[ 9.731204] FS-Cache: Loaded
[ 9.811913] type=1400 audit(1322786501.042:7): apparmor="STATUS" operation="profile_replace" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=631 comm="apparmor_parser"
[ 9.856225] type=1400 audit(1322786501.082:8): apparmor="STATUS" operation="profile_replace" name="/usr/lib/connman/scripts/dhclient-script" pid=631 comm="apparmor_parser"
[ 9.934721] FS-Cache: Netfs 'nfs' registered for caching
[ 9.956426] XGIfb_check_var: pixclock = 25000 ,htotal=1056, vtotal=1256
[ 9.956428] XGIfb_check_var: drate=40000, hrate=37878, refresh_rate=60
[ 9.956433] XGIfb: var->pixclock=25000, htotal=1056, vtotal=1256
[ 9.956436] XGIfb: Change mode to 800x600x32-60Hz
[ 10.015808] Installing knfsd (copyright (C) 1996 okir at monad.swb.de).
[ 10.249600] XGIfb_check_var: pixclock = 25000 ,htotal=1056, vtotal=1256
[ 10.249603] XGIfb_check_var: drate=40000, hrate=37878, refresh_rate=60
[ 10.249606] XGIfb: 800x600x24 is no valid mode
[ 10.249609] XGIfb: Failed to find similar mode to 800x600x24
[ 10.428296] XGIfb_check_var: pixclock = 25000 ,htotal=1056, vtotal=1256
[ 10.428298] XGIfb_check_var: drate=40000, hrate=37878, refresh_rate=60
[ 10.428302] XGIfb: var->pixclock=25000, htotal=1056, vtotal=1256
[ 10.428304] XGIfb: Change mode to 800x600x16-60Hz
[ 10.678305] OCFS2 Node Manager 1.5.0
[ 10.686300] OCFS2 DLM 1.5.0
[ 10.689172] ocfs2: Registered cluster interface o2cb
[ 10.706056] OCFS2 DLMFS 1.5.0
[ 10.707401] OCFS2 User DLM kernel interface loaded
[ 11.486599] tg3 0000:04:00.0: eth0: Link is up at 1000 Mbps, full duplex
[ 11.487367] tg3 0000:04:00.0: eth0: Flow control is off for TX and off for RX
[ 11.489212] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[ 11.715056] tg3 0000:05:00.0: eth1: Link is up at 1000 Mbps, full duplex
[ 11.715825] tg3 0000:05:00.0: eth1: Flow control is off for TX and off for RX
[ 11.717677] ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[ 12.820256] floppy0: no floppy controllers found
[ 22.070009] eth1: no IPv6 routers present
[ 22.113023] eth0: no IPv6 routers present
[ 47.772814] scsi4 : iSCSI Initiator over TCP/IP
[ 48.308779] scsi 4:0:0:0: Direct-Access IFT DS S16E-G2240 386C PQ: 0 ANSI: 5
[ 48.331591] sd 4:0:0:0: Attached scsi generic sg2 type 0
[ 48.354691] sd 4:0:0:0: [sdc] 70315401216 512-byte logical blocks: (36.0 TB/32.7 TiB)
[ 48.376901] scsi 4:0:0:1: Enclosure IFT DS S16E-G2240 386C PQ: 0 ANSI: 4
[ 48.398906] scsi 4:0:0:1: Attached scsi generic sg3 type 13
[ 48.420471] sd 4:0:0:0: [sdc] Write Protect is off
[ 48.441262] sd 4:0:0:0: [sdc] Mode Sense: 83 00 00 08
[ 48.464711] sd 4:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 48.517255] sdc: unknown partition table
[ 48.558697] sd 4:0:0:0: [sdc] Attached SCSI disk
[ 48.593578] ses 4:0:0:1: Attached Enclosure device
[ 52.730453] o2net: connected to node pedge33 (num 1) at 10.88.0.33:7777
[ 54.492390] o2net: accepted connection from node pedge38 (num 4) at 10.88.0.38:7777
[ 54.591610] o2net: accepted connection from node pedge37 (num 5) at 10.88.0.37:7777
[ 56.826741] OCFS2 1.5.0
[ 56.861336] o2dlm: Nodes in domain A3AA504BE42E4D3D8A15248D8FCD49BB: 1 3 4 5
[ 240.430039] INFO: task mount.ocfs2:1112 blocked for more than 120 seconds.
[ 240.449920] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 240.470172] mount.ocfs2 D 0000000000000000 0 1112 1110 0x00000000
[ 240.490623] ffff8801f5581988 0000000000000082 ffff8801f5581fd8 ffff8801f5580000
[ 240.511268] 0000000000013d00 ffff8801f55f5f38 ffff8801f5581fd8 0000000000013d00
[ 240.531927] ffff8802034296e0 ffff8801f55f5b80 0000000000000032 7fffffffffffffff
[ 240.552722] Call Trace:
[ 240.573130] [<ffffffff815c14dd>] schedule_timeout+0x26d/0x2e0
[ 240.593981] [<ffffffffa0304f39>] ? dlm_lockres_put+0x19/0x20 [ocfs2_dlm]
[ 240.615170] [<ffffffffa030f299>] ? dlmlock+0x89/0xd90 [ocfs2_dlm]
[ 240.635932] [<ffffffff815c0f99>] wait_for_common+0xd9/0x180
[ 240.656182] [<ffffffff8105f600>] ? default_wake_function+0x0/0x20
[ 240.676075] [<ffffffff815c111d>] wait_for_completion+0x1d/0x20
[ 240.696007] [<ffffffffa035618d>] __ocfs2_cluster_lock.clone.20+0x26d/0xad0 [ocfs2]
[ 240.716298] [<ffffffff815c2216>] ? down_write+0x16/0x40
[ 240.736539] [<ffffffffa0351d2d>] ? ocfs2_add_lockres_tracking+0x6d/0xd0 [ocfs2]
[ 240.756960] [<ffffffffa03572c3>] ocfs2_super_lock+0xe3/0x470 [ocfs2]
[ 240.777117] [<ffffffffa039bca3>] ocfs2_mount_volume.clone.23+0xb3/0x500 [ocfs2]
[ 240.797253] [<ffffffffa039e6ef>] ocfs2_fill_super+0x72f/0xc50 [ocfs2]
[ 240.817058] [<ffffffff811cc32a>] ? disk_name+0xba/0xc0
[ 240.836651] [<ffffffff81167cc3>] mount_bdev+0x1c3/0x210
[ 240.856094] [<ffffffffa039dfc0>] ? ocfs2_fill_super+0x0/0xc50 [ocfs2]
[ 240.875844] [<ffffffffa0397c55>] ocfs2_mount+0x15/0x20 [ocfs2]
[ 240.895309] [<ffffffff8116747d>] vfs_kern_mount+0x8d/0x280
[ 240.914307] [<ffffffff811676e4>] do_kern_mount+0x54/0x110
[ 240.933247] [<ffffffff81184cca>] do_mount+0x1ea/0x230
[ 240.952058] [<ffffffff811850f0>] sys_mount+0x90/0xe0
[ 240.970714] [<ffffffff8100c002>] system_call_fastpath+0x16/0x1b
[ 360.980054] INFO: task mount.ocfs2:1112 blocked for more than 120 seconds.
[ 360.999030] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 361.018243] mount.ocfs2 D 0000000000000000 0 1112 1110 0x00000000
[ 361.037572] ffff8801f5581988 0000000000000082 ffff8801f5581fd8 ffff8801f5580000
[ 361.056836] 0000000000013d00 ffff8801f55f5f38 ffff8801f5581fd8 0000000000013d00
[ 361.076439] ffff8802034296e0 ffff8801f55f5b80 0000000000000032 7fffffffffffffff
[ 361.095850] Call Trace:
[ 361.114731] [<ffffffff815c14dd>] schedule_timeout+0x26d/0x2e0
[ 361.133805] [<ffffffffa0304f39>] ? dlm_lockres_put+0x19/0x20 [ocfs2_dlm]
[ 361.152703] [<ffffffffa030f299>] ? dlmlock+0x89/0xd90 [ocfs2_dlm]
[ 361.171202] [<ffffffff815c0f99>] wait_for_common+0xd9/0x180
[ 361.189288] [<ffffffff8105f600>] ? default_wake_function+0x0/0x20
[ 361.207321] [<ffffffff815c111d>] wait_for_completion+0x1d/0x20
[ 361.225290] [<ffffffffa035618d>] __ocfs2_cluster_lock.clone.20+0x26d/0xad0 [ocfs2]
[ 361.243486] [<ffffffff815c2216>] ? down_write+0x16/0x40
[ 361.261356] [<ffffffffa0351d2d>] ? ocfs2_add_lockres_tracking+0x6d/0xd0 [ocfs2]
[ 361.279467] [<ffffffffa03572c3>] ocfs2_super_lock+0xe3/0x470 [ocfs2]
[ 361.297509] [<ffffffffa039bca3>] ocfs2_mount_volume.clone.23+0xb3/0x500 [ocfs2]
[ 361.315689] [<ffffffffa039e6ef>] ocfs2_fill_super+0x72f/0xc50 [ocfs2]
[ 361.333816] [<ffffffff811cc32a>] ? disk_name+0xba/0xc0
[ 361.351819] [<ffffffff81167cc3>] mount_bdev+0x1c3/0x210
[ 361.369716] [<ffffffffa039dfc0>] ? ocfs2_fill_super+0x0/0xc50 [ocfs2]
[ 361.387674] [<ffffffffa0397c55>] ocfs2_mount+0x15/0x20 [ocfs2]
[ 361.405398] [<ffffffff8116747d>] vfs_kern_mount+0x8d/0x280
[ 361.422948] [<ffffffff811676e4>] do_kern_mount+0x54/0x110
[ 361.440369] [<ffffffff81184cca>] do_mount+0x1ea/0x230
[ 361.457545] [<ffffffff811850f0>] sys_mount+0x90/0xe0
[ 361.474504] [<ffffffff8100c002>] system_call_fastpath+0x16/0x1b
[ 481.490037] INFO: task mount.ocfs2:1112 blocked for more than 120 seconds.
[ 481.507496] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 481.525345] mount.ocfs2 D 0000000000000000 0 1112 1110 0x00000000
[ 481.543477] ffff8801f5581988 0000000000000082 ffff8801f5581fd8 ffff8801f5580000
[ 481.561837] 0000000000013d00 ffff8801f55f5f38 ffff8801f5581fd8 0000000000013d00
[ 481.580341] ffff8802034296e0 ffff8801f55f5b80 0000000000000032 7fffffffffffffff
[ 481.599078] Call Trace:
[ 481.617603] [<ffffffff815c14dd>] schedule_timeout+0x26d/0x2e0
[ 481.636685] [<ffffffffa0304f39>] ? dlm_lockres_put+0x19/0x20 [ocfs2_dlm]
[ 481.655685] [<ffffffffa030f299>] ? dlmlock+0x89/0xd90 [ocfs2_dlm]
[ 481.674279] [<ffffffff815c0f99>] wait_for_common+0xd9/0x180
[ 481.692451] [<ffffffff8105f600>] ? default_wake_function+0x0/0x20
[ 481.710578] [<ffffffff815c111d>] wait_for_completion+0x1d/0x20
[ 481.728654] [<ffffffffa035618d>] __ocfs2_cluster_lock.clone.20+0x26d/0xad0 [ocfs2]
[ 481.746949] [<ffffffff815c2216>] ? down_write+0x16/0x40
[ 481.764912] [<ffffffffa0351d2d>] ? ocfs2_add_lockres_tracking+0x6d/0xd0 [ocfs2]
[ 481.783107] [<ffffffffa03572c3>] ocfs2_super_lock+0xe3/0x470 [ocfs2]
[ 481.801215] [<ffffffffa039bca3>] ocfs2_mount_volume.clone.23+0xb3/0x500 [ocfs2]
[ 481.819487] [<ffffffffa039e6ef>] ocfs2_fill_super+0x72f/0xc50 [ocfs2]
[ 481.837711] [<ffffffff811cc32a>] ? disk_name+0xba/0xc0
[ 481.855834] [<ffffffff81167cc3>] mount_bdev+0x1c3/0x210
[ 481.873850] [<ffffffffa039dfc0>] ? ocfs2_fill_super+0x0/0xc50 [ocfs2]
[ 481.891915] [<ffffffffa0397c55>] ocfs2_mount+0x15/0x20 [ocfs2]
[ 481.909743] [<ffffffff8116747d>] vfs_kern_mount+0x8d/0x280
[ 481.927390] [<ffffffff811676e4>] do_kern_mount+0x54/0x110
[ 481.944867] [<ffffffff81184cca>] do_mount+0x1ea/0x230
[ 481.962136] [<ffffffff811850f0>] sys_mount+0x90/0xe0
[ 481.979192] [<ffffffff8100c002>] system_call_fastpath+0x16/0x1b
[ 601.990040] INFO: task mount.ocfs2:1112 blocked for more than 120 seconds.
[ 602.007578] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 602.025530] mount.ocfs2 D 0000000000000000 0 1112 1110 0x00000000
[ 602.043769] ffff8801f5581988 0000000000000082 ffff8801f5581fd8 ffff8801f5580000
[ 602.062253] 0000000000013d00 ffff8801f55f5f38 ffff8801f5581fd8 0000000000013d00
[ 602.080861] ffff8802034296e0 ffff8801f55f5b80 0000000000000032 7fffffffffffffff
[ 602.099744] Call Trace:
[ 602.099756] [<ffffffff815c14dd>] schedule_timeout+0x26d/0x2e0
[ 602.099771] [<ffffffffa0304f39>] ? dlm_lockres_put+0x19/0x20 [ocfs2_dlm]
[ 602.099781] [<ffffffffa030f299>] ? dlmlock+0x89/0xd90 [ocfs2_dlm]
[ 602.099786] [<ffffffff815c0f99>] wait_for_common+0xd9/0x180
[ 602.099792] [<ffffffff8105f600>] ? default_wake_function+0x0/0x20
[ 602.099797] [<ffffffff815c111d>] wait_for_completion+0x1d/0x20
[ 602.099819] [<ffffffffa035618d>] __ocfs2_cluster_lock.clone.20+0x26d/0xad0 [ocfs2]
[ 602.099824] [<ffffffff815c2216>] ? down_write+0x16/0x40
[ 602.099841] [<ffffffffa0351d2d>] ? ocfs2_add_lockres_tracking+0x6d/0xd0 [ocfs2]
[ 602.099859] [<ffffffffa03572c3>] ocfs2_super_lock+0xe3/0x470 [ocfs2]
[ 602.099880] [<ffffffffa039bca3>] ocfs2_mount_volume.clone.23+0xb3/0x500 [ocfs2]
[ 602.099960] [<ffffffffa039e6ef>] ocfs2_fill_super+0x72f/0xc50 [ocfs2]
[ 602.099968] [<ffffffff811cc32a>] ? disk_name+0xba/0xc0
[ 602.099974] [<ffffffff81167cc3>] mount_bdev+0x1c3/0x210
[ 602.099993] [<ffffffffa039dfc0>] ? ocfs2_fill_super+0x0/0xc50 [ocfs2]
[ 602.100013] [<ffffffffa0397c55>] ocfs2_mount+0x15/0x20 [ocfs2]
[ 602.100030] [<ffffffff8116747d>] vfs_kern_mount+0x8d/0x280
[ 602.100035] [<ffffffff811676e4>] do_kern_mount+0x54/0x110
[ 602.100041] [<ffffffff81184cca>] do_mount+0x1ea/0x230
[ 602.100046] [<ffffffff811850f0>] sys_mount+0x90/0xe0
[ 602.100052] [<ffffffff8100c002>] system_call_fastpath+0x16/0x1b
[ 722.100041] INFO: task mount.ocfs2:1112 blocked for more than 120 seconds.
[ 722.116968] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.134284] mount.ocfs2 D 0000000000000000 0 1112 1110 0x00000000
[ 722.151884] ffff8801f5581988 0000000000000082 ffff8801f5581fd8 ffff8801f5580000
[ 722.169618] 0000000000013d00 ffff8801f55f5f38 ffff8801f5581fd8 0000000000013d00
[ 722.187504] ffff8802034296e0 ffff8801f55f5b80 0000000000000032 7fffffffffffffff
[ 722.205620] Call Trace:
[ 722.223573] [<ffffffff815c14dd>] schedule_timeout+0x26d/0x2e0
[ 722.223590] [<ffffffffa0304f39>] ? dlm_lockres_put+0x19/0x20 [ocfs2_dlm]
[ 722.223600] [<ffffffffa030f299>] ? dlmlock+0x89/0xd90 [ocfs2_dlm]
[ 722.223605] [<ffffffff815c0f99>] wait_for_common+0xd9/0x180
[ 722.223610] [<ffffffff8105f600>] ? default_wake_function+0x0/0x20
[ 722.223614] [<ffffffff815c111d>] wait_for_completion+0x1d/0x20
[ 722.223637] [<ffffffffa035618d>] __ocfs2_cluster_lock.clone.20+0x26d/0xad0 [ocfs2]
[ 722.223642] [<ffffffff815c2216>] ? down_write+0x16/0x40
[ 722.223658] [<ffffffffa0351d2d>] ? ocfs2_add_lockres_tracking+0x6d/0xd0 [ocfs2]
[ 722.223675] [<ffffffffa03572c3>] ocfs2_super_lock+0xe3/0x470 [ocfs2]
[ 722.223696] [<ffffffffa039bca3>] ocfs2_mount_volume.clone.23+0xb3/0x500 [ocfs2]
[ 722.223716] [<ffffffffa039e6ef>] ocfs2_fill_super+0x72f/0xc50 [ocfs2]
[ 722.223722] [<ffffffff811cc32a>] ? disk_name+0xba/0xc0
[ 722.223728] [<ffffffff81167cc3>] mount_bdev+0x1c3/0x210
[ 722.223747] [<ffffffffa039dfc0>] ? ocfs2_fill_super+0x0/0xc50 [ocfs2]
[ 722.223766] [<ffffffffa0397c55>] ocfs2_mount+0x15/0x20 [ocfs2]
[ 722.223771] [<ffffffff8116747d>] vfs_kern_mount+0x8d/0x280
[ 722.223775] [<ffffffff811676e4>] do_kern_mount+0x54/0x110
[ 722.223780] [<ffffffff81184cca>] do_mount+0x1ea/0x230
[ 722.223784] [<ffffffff811850f0>] sys_mount+0x90/0xe0
[ 722.223789] [<ffffffff8100c002>] system_call_fastpath+0x16/0x1b
[ 722.223799] INFO: task mount.ocfs2:2389 blocked for more than 120 seconds.
[ 722.223801] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.223804] mount.ocfs2 D 0000000000000001 0 2389 2388 0x00000000
[ 722.223809] ffff8802041a7c48 0000000000000086 ffff8802041a7fd8 ffff8802041a6000
[ 722.223812] 0000000000013d00 ffff8801f6e9c858 ffff8802041a7fd8 0000000000013d00
[ 722.223816] ffff880206d00000 ffff8801f6e9c4a0 0000000000000083 ffff8801f6e9c4a0
[ 722.223820] Call Trace:
[ 722.223826] [<ffffffff815c2e7d>] rwsem_down_failed_common+0xcd/0x170
[ 722.223830] [<ffffffff815c2f33>] rwsem_down_write_failed+0x13/0x20
[ 722.223836] [<ffffffff812e69e3>] call_rwsem_down_write_failed+0x13/0x20
[ 722.223840] [<ffffffff815c2232>] ? down_write+0x32/0x40
[ 722.223845] [<ffffffff81166940>] ? test_bdev_super+0x0/0x20
[ 722.223849] [<ffffffff81166940>] ? test_bdev_super+0x0/0x20
[ 722.223853] [<ffffffff8116789b>] sget+0xfb/0x250
[ 722.223856] [<ffffffff81166900>] ? set_bdev_super+0x0/0x40
[ 722.223860] [<ffffffff81167be9>] mount_bdev+0xe9/0x210
[ 722.223880] [<ffffffffa039dfc0>] ? ocfs2_fill_super+0x0/0xc50 [ocfs2]
[ 722.223899] [<ffffffffa0397c55>] ocfs2_mount+0x15/0x20 [ocfs2]
[ 722.223903] [<ffffffff8116747d>] vfs_kern_mount+0x8d/0x280
[ 722.223907] [<ffffffff811676e4>] do_kern_mount+0x54/0x110
[ 722.223911] [<ffffffff81184cca>] do_mount+0x1ea/0x230
[ 722.223915] [<ffffffff811850f0>] sys_mount+0x90/0xe0
[ 722.223918] [<ffffffff8100c002>] system_call_fastpath+0x16/0x1b
root at pedge36:~#
On another server which doesn't seem to be having issues talking to the domain, here are it's messages:
[ 9157.453868] (dlm_reco_thread,1256,1):dlm_get_lock_resource:870 A3AA504BE42E4D3D8A15248D8FCD49BB: recovery map is not empty, but must master $RECOVERY lock now
[ 9157.593074] (dlm_reco_thread,1256,1):dlm_do_recovery:523 (1256) Node 5 is the Recovery Master for the Dead Node 3 for Domain A3AA504BE42E4D3D8A15248D8FCD49BB
[ 9170.697458] o2dlm: Node 4 leaves domain A3AA504BE42E4D3D8A15248D8FCD49BB
[ 9170.722456] o2dlm: Nodes in domain A3AA504BE42E4D3D8A15248D8FCD49BB: 1 5
[ 9170.916997] o2net: connection to node pedge38 (num 4) at 10.88.0.38:7777 shutdown, state 8
[ 9170.942430] o2net: no longer connected to node pedge38 (num 4) at 10.88.0.38:7777
[ 9260.991298] o2net: connection to node pedge38 (num 4) at 10.88.0.38:7777 shutdown, state 7
[ 9262.990274] o2net: connection to node pedge38 (num 4) at 10.88.0.38:7777 shutdown, state 7
[ 9264.990333] o2net: connected to node pedge38 (num 4) at 10.88.0.38:7777
[ 9267.048985] o2net: connection to node pedge36 (num 3) at 10.88.0.36:7777 shutdown, state 8
[ 9267.073554] o2net: connection to node pedge36 (num 3) at 10.88.0.36:7777 shutdown, state 7
[ 9269.040329] o2net: connected to node pedge36 (num 3) at 10.88.0.36:7777
[ 9271.028466] o2dlm: Node 4 joins domain A3AA504BE42E4D3D8A15248D8FCD49BB
[ 9271.052289] o2dlm: Nodes in domain A3AA504BE42E4D3D8A15248D8FCD49BB: 1 4 5
[ 9271.263349] o2dlm: Node 3 joins domain A3AA504BE42E4D3D8A15248D8FCD49BB
[ 9271.286720] o2dlm: Nodes in domain A3AA504BE42E4D3D8A15248D8FCD49BB: 1 3 4 5
More information about the Ocfs2-users
mailing list