Subject: Re: Getting "TLB IPI rendezvous failed..."
To: Frank van der Linden <fvdl@netbsd.org>
From: Manuel Bouyer <bouyer@antioche.lip6.fr>
List: tech-kern
Date: 01/27/2005 15:09:17
On Wed, Jan 26, 2005 at 10:19:25AM +0100, Frank van der Linden wrote:
> On Tue, Jan 25, 2005 at 04:52:38PM +0100, Manuel Bouyer wrote:
> > CPU 0 interrupt level 0xd pending 0x0 depth 1
> > panic: TLB IPI ...
> > CPU 0 interrupt level 0xd pending 0x2000c400 depth 1
> > CPU 1 interrupt level 0x0 pending 0x0 depth 0
> 
> Hi Manuel,
> 
> Can you also add INTRDEBUG to the kernel, so that we can interpret
> the "pending" field? It doesn't look like there is anything special
> in there, but it may be important anyway.
> 
> INTRDEBUG should print out a bunch of interrupt source information
> at bootup, if you could send the output of that, that'd be great.

Sure, here it is:

NetBSD 2.99.14 (RAI.MP) #3: Thu Jan 27 13:14:54 CET 2005
	bouyer@pop.lip6.fr:/local/pop1/bouyer/tmp/i386/obj/local/pop1/bouyer/current-clean/src/sys/arch/i386/compile/RAI.MP
total memory = 767 MB
avail memory = 739 MB
BIOS32 rev. 0 found at 0xfdae0
mainbus0 (root)
mainbus0: Intel MP Specification (Version 1.1) (VIA      VT3075      )
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel Pentium III (686-class), 996.63 MHz, id 0x686
cpu0: features 383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu0: features 383fbff<PGE,MCA,CMOV,PAT,PSE36,MMX>
cpu0: features 383fbff<FXSR,SSE>
cpu0: I-cache 16 KB 32B/line 4-way, D-cache 16 KB 32B/line 4-way
cpu0: L2 cache 256 KB 32B/line 8-way
cpu0: ITLB 32 4 KB entries 4-way, 2 4 MB entries fully associative
cpu0: DTLB 64 4 KB entries 4-way, 8 4 MB entries 4-way
cpu0: calibrating local timer
cpu0: apic clock running at 132 MHz
cpu0: 8 page colors
cpu1 at mainbus0: apid 1 (application processor)
cpu1: starting
cpu1: Intel Pentium III (686-class), 996.55 MHz, id 0x686
cpu1: features 383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu1: features 383fbff<PGE,MCA,CMOV,PAT,PSE36,MMX>
cpu1: features 383fbff<FXSR,SSE>
cpu1: I-cache 16 KB 32B/line 4-way, D-cache 16 KB 32B/line 4-way
cpu1: L2 cache 256 KB 32B/line 8-way
cpu1: ITLB 32 4 KB entries 4-way, 2 4 MB entries fully associative
cpu1: DTLB 64 4 KB entries 4-way, 8 4 MB entries 4-way
mpbios: bus 0 is type PCI   
mpbios: bus 1 is type PCI   
mpbios: bus 2 is type ISA   
ioapic0 at mainbus0 apid 2 (I/O APIC)
ioapic0: pa 0xfec00000, version 11, 24 pins
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
pchb0 at pci0 dev 0 function 0
pchb0: VIA Technologies VT82C691 (Apollo Pro) Host-PCI (rev. 0xc4)
agp0 at pchb0: aperture at 0xe0000000, size 0x10000000
ppb0 at pci0 dev 1 function 0: VIA Technologies VT82C598 (Apollo MVP3) CPU-AGP Bridge (rev. 0x00)
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled
vga0 at pci1 dev 0 function 0: ATI Technologies Rage XL (AGP) (rev. 0x27)
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation)
wsmux1: connecting to wsdisplay0
pcib0 at pci0 dev 7 function 0
pcib0: VIA Technologies VT82C686A PCI-ISA Bridge (rev. 0x22)
viaide0 at pci0 dev 7 function 1
viaide0: VIA Technologies VT82C686A (Apollo KX133) ATA66 controller
viaide0: bus-master DMA support present
viaide0: primary channel configured to compatibility mode
allocated pic ioapic0 type edge pin 14 level 6 to cpu0 slot 14 idt entry 96
viaide0: primary channel interrupting at ioapic0 pin 14 (irq 14)
atabus0 at viaide0 channel 0
viaide0: secondary channel configured to compatibility mode
allocated pic ioapic0 type edge pin 15 level 6 to cpu0 slot 15 idt entry 97
viaide0: secondary channel interrupting at ioapic0 pin 15 (irq 15)
atabus1 at viaide0 channel 1
uhci0 at pci0 dev 7 function 2: VIA Technologies VT83C572 USB Controller (rev. 0x10)
allocated pic ioapic0 type level pin 19 level 6 to cpu0 slot 10 idt entry 98
uhci0: interrupting at ioapic0 pin 19 (irq 10)
usb0 at uhci0: USB revision 1.0
uhub0 at usb0
uhub0: VIA Technologies UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1 at pci0 dev 7 function 3: VIA Technologies VT83C572 USB Controller (rev. 0x10)
allocated pic ioapic0 type level pin 19 level 6 to cpu0 slot 10 idt entry 98
uhci1: interrupting at ioapic0 pin 19 (irq 10)
usb1 at uhci1: USB revision 1.0
uhub1 at usb1
uhub1: VIA Technologies UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
viapm0 at pci0 dev 7 function 4
viaenv0 at viapm0
puc0 at pci0 dev 9 function 0: Titan PCI-800H (com, com, com, com)
com2 at puc0 port 0allocated pic ioapic0 type level pin 17 level 13 to cpu0 slot 9 idt entry 208
: interrupting at ioapic0 pin 17 (irq 9)
com2: ns16550a, working fifo
com3 at puc0 port 1allocated pic ioapic0 type level pin 17 level 13 to cpu0 slot 9 idt entry 208
: interrupting at ioapic0 pin 17 (irq 9)
com3: ns16550a, working fifo
com4 at puc0 port 2allocated pic ioapic0 type level pin 17 level 13 to cpu0 slot 9 idt entry 208
: interrupting at ioapic0 pin 17 (irq 9)
com4: ns16550a, working fifo
com5 at puc0 port 3allocated pic ioapic0 type level pin 17 level 13 to cpu0 slot 9 idt entry 208
: interrupting at ioapic0 pin 17 (irq 9)
com5: ns16550a, working fifo
puc1 at pci0 dev 9 function 1: Titan PCI-800H (com, com, com, com)
com6 at puc1 port 0allocated pic ioapic0 type level pin 17 level 13 to cpu0 slot 9 idt entry 208
: interrupting at ioapic0 pin 17 (irq 9)
com6: ns16550a, working fifo
com7 at puc1 port 1allocated pic ioapic0 type level pin 17 level 13 to cpu0 slot 9 idt entry 208
: interrupting at ioapic0 pin 17 (irq 9)
com7: ns16550a, working fifo
com8 at puc1 port 2allocated pic ioapic0 type level pin 17 level 13 to cpu0 slot 9 idt entry 208
: interrupting at ioapic0 pin 17 (irq 9)
com8: ns16550a, working fifo
com9 at puc1 port 3allocated pic ioapic0 type level pin 17 level 13 to cpu0 slot 9 idt entry 208
: interrupting at ioapic0 pin 17 (irq 9)
com9: ns16550a, working fifo
puc2 at pci0 dev 10 function 0: Titan PCI-800H (com, com, com, com)
com10 at puc2 port 0allocated pic ioapic0 type level pin 18 level 13 to cpu0 slot 12 idt entry 209
: interrupting at ioapic0 pin 18 (irq 12)
com10: ns16550a, working fifo
com11 at puc2 port 1allocated pic ioapic0 type level pin 18 level 13 to cpu0 slot 12 idt entry 209
: interrupting at ioapic0 pin 18 (irq 12)
com11: ns16550a, working fifo
com12 at puc2 port 2allocated pic ioapic0 type level pin 18 level 13 to cpu0 slot 12 idt entry 209
: interrupting at ioapic0 pin 18 (irq 12)
com12: ns16550a, working fifo
com13 at puc2 port 3allocated pic ioapic0 type level pin 18 level 13 to cpu0 slot 12 idt entry 209
: interrupting at ioapic0 pin 18 (irq 12)
com13: ns16550a, working fifo
puc3 at pci0 dev 10 function 1: Titan PCI-800H (com, com, com, com)
com14 at puc3 port 0allocated pic ioapic0 type level pin 18 level 13 to cpu0 slot 12 idt entry 209
: interrupting at ioapic0 pin 18 (irq 12)
com14: ns16550a, working fifo
com15 at puc3 port 1allocated pic ioapic0 type level pin 18 level 13 to cpu0 slot 12 idt entry 209
: interrupting at ioapic0 pin 18 (irq 12)
com15: ns16550a, working fifo
com16 at puc3 port 2allocated pic ioapic0 type level pin 18 level 13 to cpu0 slot 12 idt entry 209
: interrupting at ioapic0 pin 18 (irq 12)
com16: ns16550a, working fifo
com17 at puc3 port 3allocated pic ioapic0 type level pin 18 level 13 to cpu0 slot 12 idt entry 209
: interrupting at ioapic0 pin 18 (irq 12)
com17: ns16550a, working fifo
ex0 at pci0 dev 11 function 0: 3Com 3c905C-TX 10/100 Ethernet with mngmt (rev. 0x78)
allocated pic ioapic0 type level pin 19 level 7 to cpu0 slot 10 idt entry 98
ex0: interrupting at ioapic0 pin 19 (irq 10)
ex0: MAC address 00:04:76:24:5f:7f
exphy0 at ex0 phy 24: 3Com internal media interface
exphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
isa0 at pcib0
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
allocated pic ioapic0 type edge pin 4 level 13 to cpu0 slot 4 idt entry 210
com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, working fifo
allocated pic ioapic0 type edge pin 3 level 13 to cpu0 slot 3 idt entry 211
pckbc0 at isa0 port 0x60-0x64
pckbd0 at pckbc0 (kbd slot)
allocated pic ioapic0 type edge pin 1 level 9 to cpu0 slot 1 idt entry 144
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
sysbeep0 at pcppi0
isapnp0 at isa0 port 0x279: ISA Plug 'n Play device support
npx0 at isa0 port 0xf0-0xff: using exception 16
fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
allocated pic ioapic0 type edge pin 6 level 6 to cpu0 slot 6 idt entry 99
isapnp0: no ISA Plug 'n Play devices found
cpu0: interrupt masks:
IPL 0 mask 7ff29a5 unmask f800d65a
IPL 1 mask 7ff29a5 unmask f800d65a
IPL 2 mask 7ff29a5 unmask f800d65a
IPL 3 mask 7ff29a5 unmask f800d65a
IPL 4 mask 27ff29a5 unmask d800d65a
IPL 5 mask 37ff29a5 unmask c800d65a
IPL 6 mask 37ffede5 unmask c800121a
IPL 7 mask 37ffede5 unmask c800121a
IPL 8 mask 3fffede5 unmask c000121a
IPL 9 mask 3fffede7 unmask c0001218
IPL 10 mask 3fffede7 unmask c0001218
IPL 11 mask 3fffede7 unmask c0001218
IPL 12 mask 7fffede7 unmask 80001218
IPL 13 mask 7fffffff unmask 80000000
IPL 14 mask ffffffff unmask 0
IPL 15 mask ffffffff unmask 0
cpu0 source 1 is pin 1 from pic ioapic0 maxlevel 9
	handler 0xc029579c level 9
cpu0 source 3 is pin 3 from pic ioapic0 maxlevel 13
	handler 0xc016bee8 level 13
cpu0 source 4 is pin 4 from pic ioapic0 maxlevel 13
	handler 0xc016bee8 level 13
cpu0 source 6 is pin 6 from pic ioapic0 maxlevel 6
	handler 0xc029579c level 6
cpu0 source 9 is pin 17 from pic ioapic0 maxlevel 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
cpu0 source 10 is pin 19 from pic ioapic0 maxlevel 7
	handler 0xc029579c level 7
	handler 0xc029579c level 6
	handler 0xc029579c level 6
cpu0 source 12 is pin 18 from pic ioapic0 maxlevel 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
	handler 0xc016bee8 level 13
cpu0 source 14 is pin 14 from pic ioapic0 maxlevel 6
	handler 0xc029579c level 6
cpu0 source 15 is pin 15 from pic ioapic0 maxlevel 6
	handler 0xc029579c level 6
cpu0 source 27 is pin 0 from pic softintr_fakepic maxlevel 8
	handler 0x0 level 8
cpu0 source 28 is pin 0 from pic softintr_fakepic maxlevel 5
	handler 0x0 level 5
cpu0 source 29 is pin 0 from pic softintr_fakepic maxlevel 4
	handler 0x0 level 4
cpu0 source 30 is pin 0 from pic lapic maxlevel 12
	handler 0x0 level 12
cpu0 source 31 is pin 0 from pic lapic maxlevel 14
	handler 0x0 level 14
cpu1: interrupt masks:
IPL 0 mask 7ffffff unmask f8000000
IPL 1 mask 7ffffff unmask f8000000
IPL 2 mask 7ffffff unmask f8000000
IPL 3 mask 7ffffff unmask f8000000
IPL 4 mask 27ffffff unmask d8000000
IPL 5 mask 37ffffff unmask c8000000
IPL 6 mask 37ffffff unmask c8000000
IPL 7 mask 37ffffff unmask c8000000
IPL 8 mask 3fffffff unmask c0000000
IPL 9 mask 3fffffff unmask c0000000
IPL 10 mask 3fffffff unmask c0000000
IPL 11 mask 3fffffff unmask c0000000
IPL 12 mask 7fffffff unmask 80000000
IPL 13 mask 7fffffff unmask 80000000
IPL 14 mask ffffffff unmask 0
IPL 15 mask ffffffff unmask 0
cpu1 source 27 is pin 0 from pic softintr_fakepic maxlevel 8
	handler 0x0 level 8
cpu1 source 28 is pin 0 from pic softintr_fakepic maxlevel 5
	handler 0x0 level 5
cpu1 source 29 is pin 0 from pic softintr_fakepic maxlevel 4
	handler 0x0 level 4
cpu1 source 30 is pin 0 from pic lapic maxlevel 12
	handler 0x0 level 12
cpu1 source 31 is pin 0 from pic lapic maxlevel 14
	handler 0x0 level 14
ioapic0: enabling
fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
Kernelized RAIDframe activated
wd0 at atabus0 drive 0: <QUANTUM FIREBALL CX6.4A>
wd0: drive supports 16-sector PIO transfers, LBA addressing
wd0: 6149 MB, 13328 cyl, 15 head, 63 sec, 512 bytes/sect x 12594960 sectors
wd0: 32-bit data port
wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 4 (Ultra/66)
wd0(viaide0:0:0): using PIO mode 4, Ultra-DMA mode 4 (Ultra/66) (using DMA)
wd1 at atabus1 drive 0: <QUANTUM FIREBALL CX6.4A>
wd1: drive supports 16-sector PIO transfers, LBA addressing
wd1: 6149 MB, 13328 cyl, 15 head, 63 sec, 512 bytes/sect x 12594960 sectors
wd1: 32-bit data port
wd1: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 4 (Ultra/66)
wd1(viaide0:1:0): using PIO mode 4, Ultra-DMA mode 4 (Ultra/66) (using DMA)
raid0: RAID Level 1
raid0: Components: /dev/wd1a /dev/wd0a
raid0: Total Sectors: 614144 (299 MB)
raid1: RAID Level 1
raid1: Components: /dev/wd1e /dev/wd0e
raid1: Total Sectors: 11979648 (5849 MB)
boot device: raid0
root on raid0a dumps on raid0b
root file system type: ffs
cc_microset[0]: delta 1563031616, resetting state
cpu1: CPU 1 running
wsdisplay0: screen 1 added (80x25, vt100 emulation)
wsdisplay0: screen 2 added (80x25, vt100 emulation)
wsdisplay0: screen 3 added (80x25, vt100 emulation)
wsdisplay0: screen 4 added (80x25, vt100 emulation)
wsdisplay0: screen 5 added (80x25, vt100 emulation)
wsdisplay0: screen 6 added (80x25, vt100 emulation)
wsdisplay0: screen 7 added (80x25, vt100 emulation)
-- 
Manuel Bouyer <bouyer@antioche.eu.org>
     NetBSD: 26 ans d'experience feront toujours la difference
--