서버가 가끔씩 Holding 되는 현상..

잘 쓰던 서버가 가끔씩 Hoding 되는 현상이 일어납니다.
Rebooting 은 안되나, PING 이나 TELNET 이 되지않습니다.

그 때 당시의 task 가 남긴 로그를 보면 동작중이던
모든 task 동일한 시간대에 Hoding 이 되어있습니다.
top 으로 주기적으로 저장하는 로그 역시 동작이 멈춰있구요

콘솔까지 확인하면 좋았을텐데.. 콘솔까지 확실할 시간이
안되서 일단 원격으로 Rebooting 만 했습니다. ㅡ.ㅜ

서버내에 tcp/ip 통신하는 task 가 100여개 정도되구요
내부적으로 unix socket 통신과 공유메모리를 사용합니다.

그 때 당시의 dmesg 로그를 올립니다

서버는 IBM XSeries 440 이고, 4CPU, RAM 4G 입니다.
커널 버전은 2.4.21-4.ELsmp #1 SMP Redhat AS 3.0

Linux version 2.4.21-4.ELsmp (bhcompile@daffy.perf.redhat.com) (gcc version 3.2.3 20030502 (Red Hat Linux 3.2.3-20)) #1 SMP Fri Oct 3 17:52:56 EDT 2003
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000009c000 (usable)
 BIOS-e820: 000000000009c000 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000dffb6f40 (usable)
 BIOS-e820: 00000000dffb6f40 - 00000000dffbf800 (ACPI data)
 BIOS-e820: 00000000dffbf800 - 00000000e0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000120000000 (usable)
3712MB HIGHMEM available.
896MB LOWMEM available.
found SMP MP-table at 0009c140
hm, page 0009c000 reserved twice.
hm, page 0009d000 reserved twice.
hm, page 0009c000 reserved twice.
hm, page 0009d000 reserved twice.
On node 0 totalpages: 1179648
zone(0): 4096 pages.
zone(1): 225280 pages.
zone(2): 950272 pages.
ACPI: Searched entire block, no RSDP was found.
ACPI: RSDP located at physical address c00fdba0
RSD PTR  v0 [IBM   ]
__va_range(0xdffbf780, 0x68): idx=33 mapped at fffdd000
ACPI table found: RSDT v1 [IBM    SERVIGIL 0.4096]
__va_range(0xdffbf700, 0x24): idx=33 mapped at fffdd000
__va_range(0xdffbf700, 0x74): idx=33 mapped at fffdd000
ACPI table found: FACP v1 [IBM    SERVIGIL 0.4096]
__va_range(0xdffbf600, 0x24): idx=33 mapped at fffdd000
__va_range(0xdffbf600, 0xd2): idx=33 mapped at fffdd000
ACPI table found: APIC v1 [IBM    SERVIGIL 0.4096]
__va_range(0xdffbf600, 0xd2): idx=33 mapped at fffdd000
LAPIC (acpi_id[0x0000] id[0x0] enabled[1])
CPU 0 (0x0000) enabledProcessor #0 Pentium 4(tm) XEON(tm) APIC version 20

LAPIC (acpi_id[0x0001] id[0x12] enabled[1])
CPU 1 (0x1200) enabledProcessor #18 Pentium 4(tm) XEON(tm) APIC version 20

LAPIC (acpi_id[0x0002] id[0x20] enabled[1])
CPU 2 (0x2000) enabledProcessor #32 Pentium 4(tm) XEON(tm) APIC version 20

LAPIC (acpi_id[0x0003] id[0x32] enabled[1])
CPU 3 (0x3200) enabledProcessor #50 Pentium 4(tm) XEON(tm) APIC version 20

LAPIC (acpi_id[0x0004] id[0x1] enabled[1])
CPU 4 (0x0100) enabledProcessor #1 Pentium 4(tm) XEON(tm) APIC version 20

LAPIC (acpi_id[0x0005] id[0x13] enabled[1])
CPU 5 (0x1300) enabledProcessor #19 Pentium 4(tm) XEON(tm) APIC version 20

LAPIC (acpi_id[0x0006] id[0x21] enabled[1])
CPU 6 (0x2100) enabledProcessor #33 Pentium 4(tm) XEON(tm) APIC version 20

LAPIC (acpi_id[0x0007] id[0x33] enabled[1])
CPU 7 (0x3300) enabledProcessor #51 Pentium 4(tm) XEON(tm) APIC version 20

IOAPIC (id[0xe] address[0xfec00000] global_irq_base[0x0])
IOAPIC (id[0xd] address[0xfec01000] global_irq_base[0x33])
INT_SRC_OVR (bus[0] irq[0x8] global_irq[0x8] polarity[0x3] trigger[0x1])
INT_SRC_OVR (bus[0] irq[0xe] global_irq[0xe] polarity[0x1] trigger[0x0])
INT_SRC_OVR (bus[0] irq[0x9] global_irq[0x24] polarity[0x0] trigger[0x0])
LAPIC_NMI (acpi_id[0x0000] polarity[0x0] trigger[0x0] lint[0x1])
LAPIC_NMI (acpi_id[0x0001] polarity[0x0] trigger[0x0] lint[0x1])
LAPIC_NMI (acpi_id[0x0002] polarity[0x0] trigger[0x0] lint[0x1])
LAPIC_NMI (acpi_id[0x0003] polarity[0x0] trigger[0x0] lint[0x1])
LAPIC_NMI (acpi_id[0x0004] polarity[0x0] trigger[0x0] lint[0x1])
LAPIC_NMI (acpi_id[0x0005] polarity[0x0] trigger[0x0] lint[0x1])
LAPIC_NMI (acpi_id[0x0006] polarity[0x0] trigger[0x0] lint[0x1])
LAPIC_NMI (acpi_id[0x0007] polarity[0x0] trigger[0x0] lint[0x1])
8 CPUs total
Local APIC address fee00000
__va_range(0xdffbf4c0, 0x24): idx=33 mapped at fffdd000
__va_range(0xdffbf4c0, 0x128): idx=33 mapped at fffdd000
ACPI table found: SRAT v1 [IBM    SERVIGIL 0.4096]
Enabling the CPU's according to the ACPI table
Intel MultiProcessor Specification v1.4
    Virtual Wire compatibility mode.
OEM ID: IBM ENSW Product ID: VIGIL SMP    APIC at: 0xFEE00000
I/O APIC #14 Version 17 at 0xFEC00000.
I/O APIC #13 Version 17 at 0xFEC01000.
Processors: 8
xAPIC support is present
Enabling APIC mode: Physical.	Using 2 I/O APICs
IBM machine detected. Enabling interrupts during APM calls.
Kernel command line: ro root=LABEL=/
Initializing CPU#0
Summit chipset: Starting Cyclone Counter.
Detected 2395.194 MHz processor.
Console: colour VGA+ 80x25
Calibrating delay loop... 198.65 BogoMIPS
Memory: 4115156k/4718592k available (1683k kernel code, 74228k reserved, 1318k data, 224k init, 3276504k highmem)
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode cache hash table entries: 524288 (order: 10, 4194304 bytes)
Mount cache hash table entries: 512 (order: 0, 4096 bytes)
Buffer cache hash table entries: 524288 (order: 9, 2097152 bytes)
Page-cache hash table entries: 1048576 (order: 10, 4194304 bytes)
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... OK.
POSIX conformance testing by UNIFIX
mtrr: v1.40 (20010327) Richard Gooch (rgooch@atnf.csiro.au)
mtrr: detected mtrr type: Intel
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
Intel machine check reporting enabled on CPU#0.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
CPU0: Intel(R) Xeon(TM) CPU 2.40GHz stepping 07
per-CPU timeslice cutoff: 1462.93 usecs.
task migration cache decay timeout: 10 msecs.
enabled ExtINT on CPU#0
Leaving ESR disabled.
Booting processor 1/18 eip 2000
Initializing CPU#1
masked ExtINT on CPU#1
Leaving ESR disabled.
Calibrating delay loop... 0.81 BogoMIPS
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
ACPI tables and CPU MSR values mismatch about cpu number 
CPU: Physical Processor ID: 9
Intel machine check reporting enabled on CPU#1.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
CPU1: Intel(R) Xeon(TM) CPU 2.40GHz stepping 07
Booting processor 2/32 eip 2000
Initializing CPU#2
masked ExtINT on CPU#2
Leaving ESR disabled.
Calibrating delay loop... 199.47 BogoMIPS
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 16
Intel machine check reporting enabled on CPU#2.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
CPU2: Intel(R) Xeon(TM) CPU 2.40GHz stepping 07
Booting processor 3/50 eip 2000
Initializing CPU#3
masked ExtINT on CPU#3
Leaving ESR disabled.
Calibrating delay loop... 199.47 BogoMIPS
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 25
Intel machine check reporting enabled on CPU#3.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
CPU3: Intel(R) Xeon(TM) CPU 2.40GHz stepping 07
Booting processor 4/1 eip 2000
Initializing CPU#4
masked ExtINT on CPU#4
Leaving ESR disabled.
Calibrating delay loop... 3.27 BogoMIPS
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
Intel machine check reporting enabled on CPU#4.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
CPU4: Intel(R) Xeon(TM) CPU 2.40GHz stepping 07
Booting processor 5/19 eip 2000
Initializing CPU#5
masked ExtINT on CPU#5
Leaving ESR disabled.
Calibrating delay loop... 52.32 BogoMIPS
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 9
Intel machine check reporting enabled on CPU#5.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
CPU5: Intel(R) Xeon(TM) CPU 2.40GHz stepping 07
Booting processor 6/33 eip 2000
Initializing CPU#6
masked ExtINT on CPU#6
Leaving ESR disabled.
Calibrating delay loop... 199.47 BogoMIPS
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 16
Intel machine check reporting enabled on CPU#6.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
CPU6: Intel(R) Xeon(TM) CPU 2.40GHz stepping 07
Booting processor 7/51 eip 2000
Initializing CPU#7
masked ExtINT on CPU#7
Leaving ESR disabled.
Calibrating delay loop... 199.47 BogoMIPS
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 25
Intel machine check reporting enabled on CPU#7.
CPU:     After generic, caps: bfebfbff 00000000 00000000 00000000
CPU:             Common caps: bfebfbff 00000000 00000000 00000000
CPU7: Intel(R) Xeon(TM) CPU 2.40GHz stepping 07
Total of 8 processors activated (1052.97 BogoMIPS).
ENABLING IO-APIC IRQs
Setting 14 in the phys_id_present_map
...changing IO-APIC physical APIC ID to 14 ... ok.
Setting 13 in the phys_id_present_map
...changing IO-APIC physical APIC ID to 13 ... ok.
init IO_APIC IRQs
 IO-APIC (apicid-pin) 14-2, 14-3, 14-4, 14-5, 14-7, 14-9, 14-10, 14-11, 14-15, 14-17, 14-20, 14-21, 14-22, 14-23, 14-24, 14-25, 14-26, 14-27, 14-28, 14-29, 14-30, 14-31, 14-32, 14-33, 14-34, 14-35, 14-36, 14-37, 14-38, 14-43, 14-44, 14-45, 14-46, 14-47, 14-48, 14-49, 14-50, 13-24, 13-25, 13-26, 13-27, 13-28, 13-29, 13-30, 13-31, 13-32, 13-33, 13-34, 13-35, 13-36, 13-37, 13-38, 13-39, 13-40, 13-41, 13-42, 13-43, 13-44, 13-45, 13-46, 13-47, 13-48, 13-49, 13-50 not connected.
..TIMER: vector=0x31 pin1=0 pin2=-1
number of MP IRQ sources: 38.
number of IO-APIC #14 registers: 51.
number of IO-APIC #13 registers: 51.
testing the IO APIC.......................

IO APIC #14......
.... register #00: 0E000000
.......    : physical APIC id: 0E
.......    : Delivery Type: 0
.......    : LTS          : 0
.... register #01: 00320011
.......     : max redirection entries: 0032
An unexpected IO-APIC was found. If this kernel release is less than
three months old please report this to linux-smp@vger.kernel.org
.......     : PRQ implemented: 0
.......     : IO APIC version: 0011
.... register #02: 00000000
.......     : arbitration: 00
.... IRQ redirection table:
 NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
 00 012 02  0    0    0   0   0    0    0    31
 01 020 00  0    0    0   0   0    0    0    39
 02 000 00  1    0    0   0   0    0    0    00
 03 000 00  1    0    0   0   0    0    0    00
 04 000 00  1    0    0   0   0    0    0    00
 05 000 00  1    0    0   0   0    0    0    00
 06 033 03  0    0    0   0   0    0    0    41
 07 000 00  1    0    0   0   0    0    0    00
 08 012 02  0    0    0   1   0    0    0    49
 09 000 00  1    0    0   0   0    0    0    00
 0a 000 00  1    0    0   0   0    0    0    00
 0b 000 00  1    0    0   0   0    0    0    00
 0c 013 03  0    0    0   0   0    0    0    51
 0d 021 01  0    0    0   0   0    0    0    59
 0e 033 03  0    0    0   0   0    0    0    61
 0f 000 00  1    0    0   0   0    0    0    00
 10 012 02  1    1    0   1   0    0    0    69
 11 000 00  1    0    0   0   0    0    0    00
 12 032 02  1    1    0   1   0    0    0    71
 13 001 01  1    1    0   1   0    0    0    79
 14 000 00  1    0    0   0   0    0    0    00
 15 000 00  1    0    0   0   0    0    0    00
 16 000 00  1    0    0   0   0    0    0    00
 17 000 00  1    0    0   0   0    0    0    00
 18 000 00  1    0    0   0   0    0    0    00
 19 000 00  1    0    0   0   0    0    0    00
 1a 000 00  1    0    0   0   0    0    0    00
 1b 000 00  1    0    0   0   0    0    0    00
 1c 000 00  1    0    0   0   0    0    0    00
 1d 000 00  1    0    0   0   0    0    0    00
 1e 000 00  1    0    0   0   0    0    0    00
 1f 000 00  1    0    0   0   0    0    0    00
 20 000 00  1    0    0   0   0    0    0    00
 21 000 00  1    0    0   0   0    0    0    00
 22 000 00  1    0    0   0   0    0    0    00
 23 000 00  1    0    0   0   0    0    0    00
 24 000 00  1    0    0   0   0    0    0    00
 25 000 00  1    0    0   0   0    0    0    00
 26 000 00  1    0    0   0   0    0    0    00
 27 000 00  1    1    0   1   0    0    0    81
 28 012 02  1    1    0   1   0    0    0    89
 29 020 00  1    1    0   1   0    0    0    91
 2a 032 02  1    1    0   1   0    0    0    99
 2b 000 00  1    0    0   0   0    0    0    00
 2c 000 00  1    0    0   0   0    0    0    00
 2d 000 00  1    0    0   0   0    0    0    00
 2e 000 00  1    0    0   0   0    0    0    00
 2f 000 00  1    0    0   0   0    0    0    00
 30 000 00  1    0    0   0   0    0    0    00
 31 000 00  1    0    0   0   0    0    0    00
 32 000 00  1    0    0   0   0    0    0    00

IO APIC #13......
.... register #00: 0D000000
.......    : physical APIC id: 0D
.......    : Delivery Type: 0
.......    : LTS          : 0
.... register #01: 00320011
.......     : max redirection entries: 0032
An unexpected IO-APIC was found. If this kernel release is less than
three months old please report this to linux-smp@vger.kernel.org
.......     : PRQ implemented: 0
.......     : IO APIC version: 0011
.... register #02: 00000000
.......     : arbitration: 00
.... IRQ redirection table:
 NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
 00 001 01  1    1    0   1   0    0    0    A1
 01 013 03  1    1    0   1   0    0    0    A9
 02 021 01  1    1    0   1   0    0    0    B1
 03 033 03  1    1    0   1   0    0    0    B9
 04 000 00  1    1    0   1   0    0    0    C1
 05 012 02  1    1    0   1   0    0    0    C9
 06 020 00  1    1    0   1   0    0    0    D1
 07 032 02  1    1    0   1   0    0    0    D9
 08 001 01  1    1    0   1   0    0    0    E1
 09 013 03  1    1    0   1   0    0    0    E9
 0a 021 01  1    1    0   1   0    0    0    32
 0b 033 03  1    1    0   1   0    0    0    3A
 0c 000 00  1    1    0   1   0    0    0    42
 0d 012 02  1    1    0   1   0    0    0    4A
 0e 020 00  1    1    0   1   0    0    0    52
 0f 032 02  1    1    0   1   0    0    0    5A
 10 001 01  1    1    0   1   0    0    0    62
 11 013 03  1    1    0   1   0    0    0    6A
 12 021 01  1    1    0   1   0    0    0    72
 13 033 03  1    1    0   1   0    0    0    7A
 14 000 00  1    1    0   1   0    0    0    82
 15 012 02  1    1    0   1   0    0    0    8A
 16 020 00  1    1    0   1   0    0    0    92
 17 032 02  1    1    0   1   0    0    0    9A
 18 000 00  1    0    0   0   0    0    0    00
 19 000 00  1    0    0   0   0    0    0    00
 1a 000 00  1    0    0   0   0    0    0    00
 1b 000 00  1    0    0   0   0    0    0    00
 1c 000 00  1    0    0   0   0    0    0    00
 1d 000 00  1    0    0   0   0    0    0    00
 1e 000 00  1    0    0   0   0    0    0    00
 1f 000 00  1    0    0   0   0    0    0    00
 20 000 00  1    0    0   0   0    0    0    00
 21 000 00  1    0    0   0   0    0    0    00
 22 000 00  1    0    0   0   0    0    0    00
 23 000 00  1    0    0   0   0    0    0    00
 24 000 00  1    0    0   0   0    0    0    00
 25 000 00  1    0    0   0   0    0    0    00
 26 000 00  1    0    0   0   0    0    0    00
 27 000 00  1    0    0   0   0    0    0    00
 28 000 00  1    0    0   0   0    0    0    00
 29 000 00  1    0    0   0   0    0    0    00
 2a 000 00  1    0    0   0   0    0    0    00
 2b 000 00  1    0    0   0   0    0    0    00
 2c 000 00  1    0    0   0   0    0    0    00
 2d 000 00  1    0    0   0   0    0    0    00
 2e 000 00  1    0    0   0   0    0    0    00
 2f 000 00  1    0    0   0   0    0    0    00
 30 000 00  1    0    0   0   0    0    0    00
 31 000 00  1    0    0   0   0    0    0    00
 32 000 00  1    0    0   0   0    0    0    00
IRQ to pin mappings:
IRQ0 -> 0:0
IRQ1 -> 0:1
IRQ6 -> 0:6
IRQ8 -> 0:8
IRQ12 -> 0:12
IRQ13 -> 0:13
IRQ14 -> 0:14
IRQ16 -> 0:16
IRQ18 -> 0:18
IRQ19 -> 0:19
IRQ39 -> 0:39
IRQ40 -> 0:40
IRQ41 -> 0:41
IRQ42 -> 0:42
IRQ51 -> 1:0
IRQ52 -> 1:1
IRQ53 -> 1:2
IRQ54 -> 1:3
IRQ55 -> 1:4
IRQ56 -> 1:5
IRQ57 -> 1:6
IRQ58 -> 1:7
IRQ59 -> 1:8
IRQ60 -> 1:9
IRQ61 -> 1:10
IRQ62 -> 1:11
IRQ63 -> 1:12
IRQ64 -> 1:13
IRQ65 -> 1:14
IRQ66 -> 1:15
IRQ67 -> 1:16
IRQ68 -> 1:17
IRQ69 -> 1:18
IRQ70 -> 1:19
IRQ71 -> 1:20
IRQ72 -> 1:21
IRQ73 -> 1:22
IRQ74 -> 1:23
.................................... done.
Using local APIC timer interrupts.
calibrating APIC timer ...
..... CPU clock speed is 2394.8938 MHz.
..... host bus clock speed is 99.7870 MHz.
cpu: 0, clocks: 997870, slice: 110874
CPU0<T0:997856,T1:886976,D:6,S:110874,C:997870>
cpu: 4, clocks: 997870, slice: 110874
cpu: 5, clocks: 997870, slice: 110874
cpu: 1, clocks: 997870, slice: 110874
cpu: 7, clocks: 997870, slice: 110874
cpu: 2, clocks: 997870, slice: 110874
cpu: 6, clocks: 997870, slice: 110874
cpu: 3, clocks: 997870, slice: 110874
CPU1<T0:997856,T1:776096,D:12,S:110874,C:997870>
CPU2<T0:997856,T1:665232,D:2,S:110874,C:997870>
CPU3<T0:997856,T1:554352,D:8,S:110874,C:997870>
CPU4<T0:997856,T1:443472,D:14,S:110874,C:997870>
CPU5<T0:997856,T1:332608,D:4,S:110874,C:997870>
CPU6<T0:997856,T1:221728,D:10,S:110874,C:997870>
CPU7<T0:997856,T1:110864,D:0,S:110874,C:997870>
cpu_sibling_map[0] = 4
cpu_sibling_map[1] = 5
cpu_sibling_map[2] = 6
cpu_sibling_map[3] = 7
cpu_sibling_map[4] = 0
cpu_sibling_map[5] = 1
cpu_sibling_map[6] = 2
cpu_sibling_map[7] = 3
mapping CPU#0's runqueue to CPU#4's runqueue.
mapping CPU#1's runqueue to CPU#5's runqueue.
mapping CPU#2's runqueue to CPU#6's runqueue.
mapping CPU#3's runqueue to CPU#7's runqueue.
zapping low mappings.
Process timing init...done.
Starting migration thread for cpu 0
Starting migration thread for cpu 1
Starting migration thread for cpu 2
Starting migration thread for cpu 3
Starting migration thread for cpu 4
Starting migration thread for cpu 5
Starting migration thread for cpu 6
Starting migration thread for cpu 7
PCI: PCI BIOS revision 2.10 entry at 0xfd30d, last bus=11
PCI: Using configuration type 1
PCI: Probing PCI hardware
PCI: Discovered peer bus 01
PCI: Discovered peer bus 02
PCI: Discovered peer bus 05
PCI: Discovered peer bus 07
PCI: Discovered peer bus 09
PCI->APIC IRQ transform: (B0,I3,P0) -> 39
PCI->APIC IRQ transform: (B0,I4,P0) -> 16
PCI->APIC IRQ transform: (B0,I5,P3) -> 18
PCI->APIC IRQ transform: (B0,I5,P3) -> 18
PCI->APIC IRQ transform: (B1,I3,P0) -> 40
PCI->APIC IRQ transform: (B1,I3,P1) -> 41
PCI->APIC IRQ transform: (B1,I4,P0) -> 42
PCI->APIC IRQ transform: (B2,I2,P0) -> 55
PCI->APIC IRQ transform: (B9,I1,P0) -> 59
PCI: Enabling Via external APIC routing
PCI: Via IRQ fixup for 00:05.2, from 11 to 2
PCI: Via IRQ fixup for 00:05.3, from 11 to 2
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Linux NET4.0 for Linux 2.4
Based upon Swansea University Computer Society NET3.039
Initializing RT netlink socket
apm: BIOS not found.
Total HugeTLB memory allocated, 0
Starting kswapd
allocated 32 pages and 32 bhs reserved for the highmem bounces
VFS: Disk quotas vdquot_6.5.1
aio_setup: num_physpages = 294912
aio_setup: sizeof(struct page) = 60
Hugetlbfs mounted.
pty: 2048 Unix98 ptys configured
Serial driver version 5.05c (2001-07-08) with MANY_PORTS MULTIPORT SHARE_IRQ SERIAL_PCI ISAPNP enabled
Real Time Clock Driver v1.10e
NET4: Frame Diverter 0.46
RAMDISK driver initialized: 256 RAM disks of 8192K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00beta4-2.4
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
VP_IDE: IDE controller at PCI slot 00:05.1
VP_IDE: chipset revision 6
VP_IDE: not 100% native mode: will probe irqs later
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
VP_IDE: VIA vt82c686b (rev 40) IDE UDMA100 controller on pci00:05.1
    ide0: BM-DMA at 0x0700-0x0707, BIOS settings: hda:pio, hdb:pio
    ide1: BM-DMA at 0x0708-0x070f, BIOS settings: hdc:pio, hdd:pio
hda: CD-224E, ATAPI CD/DVD-ROM drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
ide-floppy driver 0.99.newide
ide-floppy driver 0.99.newide
md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Initializing Cryptographic API
NET4: Linux TCP/IP 1.0 for NET4.0
IP: routing cache hash table of 65536 buckets, 512Kbytes
TCP: Hash tables configured (established 524288 bind 65536)
Linux IP multicast router 0.06 plus PIM-SM
Initializing IPsec netlink socket
NET4: Unix domain sockets 1.0/SMP for Linux NET4.0.
RAMDISK: Compressed image found at block 0
Freeing initrd memory: 329k freed
VFS: Mounted root (ext2 filesystem).
SCSI subsystem driver Revision: 1.00
scsi0 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
        <Adaptec aic7899 Ultra160 SCSI adapter>
        aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs

scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
        <Adaptec aic7899 Ultra160 SCSI adapter>
        aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs

Starting timer : 0 0
blk: queue f7fc4a18, I/O limit 524287Mb (mask 0x7fffffffff)
(scsi0:A:9): 80.000MB/s transfers (40.000MHz, offset 32, 16bit)
  Vendor: SEAGATE   Model: DAT    9SP40-000  Rev: 9070
  Type:   Sequential-Access                  ANSI SCSI revision: 03
Starting timer : 0 0
blk: queue f7fc4818, I/O limit 524287Mb (mask 0x7fffffffff)
Starting timer : 0 0
  Vendor: IBM       Model: GNHv1 S2          Rev: 0   
  Type:   Processor                          ANSI SCSI revision: 02
Starting timer : 0 0
blk: queue f7fc7c18, I/O limit 524287Mb (mask 0x7fffffffff)
Warning ! ! ! ServeRAID Version Mismatch
Bios = 7.10.18, Firmware = 7.10.18, Device Driver = 6.00.26 
These levels should match to avoid possible compatibility problems.
Warning ! ! ! ServeRAID Version Mismatch
Bios = 7.10.18, Firmware = 7.10.18, Device Driver = 6.00.26 
These levels should match to avoid possible compatibility problems.
scsi2 : IBM PCI ServeRAID 6.00.26  <ServeRAID 4Lx>
Starting timer : 0 0
  Vendor: IBM       Model: SERVERAID         Rev: 1.00
  Type:   Direct-Access                      ANSI SCSI revision: 02
Starting timer : 0 0
  Vendor: IBM       Model: SERVERAID         Rev: 1.00
  Type:   Processor                          ANSI SCSI revision: 02
Starting timer : 0 0
  Vendor: IBM       Model: EXP300   S160     Rev: D014
  Type:   Processor                          ANSI SCSI revision: 03
Starting timer : 0 0
Attached scsi disk sda at scsi2, channel 0, id 0, lun 0
SCSI device sda: 71096320 512-byte hdwr sectors (36401 MB)
Partition check:
 sda: sda1 sda2
Journalled Block Device driver loaded
EXT3-fs: INFO: recovery required on readonly filesystem.
EXT3-fs: write access will be enabled during recovery.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: sd(8,1): orphan cleanup on readonly fs
ext3_orphan_cleanup: deleting unreferenced inode 2606027
ext3_orphan_cleanup: deleting unreferenced inode 2606034
ext3_orphan_cleanup: deleting unreferenced inode 2606037
ext3_orphan_cleanup: deleting unreferenced inode 2606040
ext3_orphan_cleanup: deleting unreferenced inode 2606049
ext3_orphan_cleanup: deleting unreferenced inode 2606046
ext3_orphan_cleanup: deleting unreferenced inode 2606043
ext3_orphan_cleanup: deleting unreferenced inode 2606031
ext3_orphan_cleanup: deleting unreferenced inode 2606026
ext3_orphan_cleanup: deleting unreferenced inode 2868169
ext3_orphan_cleanup: deleting unreferenced inode 2606052
ext3_orphan_cleanup: deleting unreferenced inode 2606053
ext3_orphan_cleanup: deleting unreferenced inode 2606042
ext3_orphan_cleanup: deleting unreferenced inode 2606025
ext3_orphan_cleanup: deleting unreferenced inode 2606051
ext3_orphan_cleanup: deleting unreferenced inode 2606050
ext3_orphan_cleanup: deleting unreferenced inode 2606048
ext3_orphan_cleanup: deleting unreferenced inode 2606047
ext3_orphan_cleanup: deleting unreferenced inode 2606045
ext3_orphan_cleanup: deleting unreferenced inode 2606044
ext3_orphan_cleanup: deleting unreferenced inode 2606041
ext3_orphan_cleanup: deleting unreferenced inode 2606039
ext3_orphan_cleanup: deleting unreferenced inode 2606038
ext3_orphan_cleanup: deleting unreferenced inode 2606036
ext3_orphan_cleanup: deleting unreferenced inode 2606035
ext3_orphan_cleanup: deleting unreferenced inode 2606033
ext3_orphan_cleanup: deleting unreferenced inode 2606032
ext3_orphan_cleanup: deleting unreferenced inode 2606030
ext3_orphan_cleanup: deleting unreferenced inode 2606029
ext3_orphan_cleanup: deleting unreferenced inode 2606028
ext3_orphan_cleanup: deleting unreferenced inode 2606024
ext3_orphan_cleanup: deleting unreferenced inode 2606023
ext3_orphan_cleanup: deleting unreferenced inode 2606022
ext3_orphan_cleanup: deleting unreferenced inode 2606021
ext3_orphan_cleanup: deleting unreferenced inode 2606020
ext3_orphan_cleanup: deleting unreferenced inode 2606019
ext3_orphan_cleanup: deleting unreferenced inode 2606018
ext3_orphan_cleanup: deleting unreferenced inode 2606017
ext3_orphan_cleanup: deleting unreferenced inode 2606016
ext3_orphan_cleanup: deleting unreferenced inode 2606015
ext3_orphan_cleanup: deleting unreferenced inode 2606014
ext3_orphan_cleanup: deleting unreferenced inode 2606013
ext3_orphan_cleanup: deleting unreferenced inode 2606012
ext3_orphan_cleanup: deleting unreferenced inode 2606011
ext3_orphan_cleanup: deleting unreferenced inode 2606010
ext3_orphan_cleanup: deleting unreferenced inode 2606009
ext3_orphan_cleanup: deleting unreferenced inode 2606008
ext3_orphan_cleanup: deleting unreferenced inode 2606007
ext3_orphan_cleanup: deleting unreferenced inode 2606006
ext3_orphan_cleanup: deleting unreferenced inode 2606005
ext3_orphan_cleanup: deleting unreferenced inode 2606004
ext3_orphan_cleanup: deleting unreferenced inode 2606003
ext3_orphan_cleanup: deleting unreferenced inode 2606002
ext3_orphan_cleanup: deleting unreferenced inode 2605929
ext3_orphan_cleanup: deleting unreferenced inode 2605928
ext3_orphan_cleanup: deleting unreferenced inode 2605927
ext3_orphan_cleanup: deleting unreferenced inode 2605926
ext3_orphan_cleanup: deleting unreferenced inode 2605925
ext3_orphan_cleanup: deleting unreferenced inode 2605924
ext3_orphan_cleanup: deleting unreferenced inode 2605923
ext3_orphan_cleanup: deleting unreferenced inode 2605922
ext3_orphan_cleanup: deleting unreferenced inode 2605921
ext3_orphan_cleanup: deleting unreferenced inode 2605920
ext3_orphan_cleanup: deleting unreferenced inode 2605918
ext3_orphan_cleanup: deleting unreferenced inode 2605917
ext3_orphan_cleanup: deleting unreferenced inode 2605916
ext3_orphan_cleanup: deleting unreferenced inode 2605915
ext3_orphan_cleanup: deleting unreferenced inode 2605914
ext3_orphan_cleanup: deleting unreferenced inode 2605913
ext3_orphan_cleanup: deleting unreferenced inode 2605912
ext3_orphan_cleanup: deleting unreferenced inode 2605911
EXT3-fs: sd(8,1): 71 orphan inodes deleted
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
Freeing unused kernel memory: 224k freed
usb.c: registered new driver usbdevfs
usb.c: registered new driver hub
usb-uhci.c: $Revision: 1.275 $ time 18:08:43 Oct  3 2003
usb-uhci.c: High bandwidth mode enabled
usb-uhci.c: USB UHCI at I/O 0x1880, IRQ 18
usb-uhci.c: Detected 2 ports
usb.c: new USB bus registered, assigned bus number 1
hub.c: USB hub found
hub.c: 2 ports detected
usb-uhci.c: USB UHCI at I/O 0x18a0, IRQ 18
usb-uhci.c: Detected 2 ports
usb.c: new USB bus registered, assigned bus number 2
hub.c: USB hub found
hub.c: 2 ports detected
usb-uhci.c: v1.275:USB Universal Host Controller Interface driver
usb.c: registered new driver hiddev
usb.c: registered new driver hid
hid-core.c: v1.8.1 Andreas Gal, Vojtech Pavlik <vojtech@suse.cz>
hid-core.c: USB HID support drivers
mice: PS/2 mouse device common for all mice
EXT3 FS 2.4-0.9.19, 19 August 2002 on sd(8,1), internal journal
Adding Swap: 4096504k swap-space (priority -1)
st: Version 20030406, bufsize 32768, max init. bufs 4, s/g segs 16
Attached scsi tape st0 at scsi0, channel 0, id 9, lun 0

An unexpected IO-APIC was found

이 부분이 제일 의심가기는 한데.. 영어가 짧아서 ㅠㅠ