NetBSD-Bugs archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: kern/56291: XEN3_DOM0 nvme abysmal performance - very slow boot



Yes, there seems to be trouble with interrupts overall.

Even without nvme the system is slow. (I had to boot with -a as the

root device was not recognized correctly - different issue):

Interrupts in a non Xen environment are at a rate of ~120. On Xen

without nvme they are around ~2100.

Seems that high interrupt rates occur with the bge driver (20 on an idle interface (bge0), 800 on

an enabled interface (bge1))

The two files contain two sets of statistics 10 seconds apart.

Unfortunately xentools411/413 don't compile out of the box on -current.

many of:
sed: 1: "s/\.o\s*:/_DEPS +=/": RE error: trailing backslash (\)
gmake[7]: *** Deleting file 'bin/deps/libgcc/__divmoddi4.c.d'
  [DEPS] libgcc/__divdi3.c
sed: 1: "s/\.o\s*:/_DEPS +=/": RE error: trailing backslash (\)
gmake[7]: *** Deleting file 'bin/deps/libgcc/__divdi3.c.d'

and finally
  [BUILD] bin/implicit.o
  [BUILD] bin/acpi.o
In file included from include/ipxe/uaccess.h:27,
                 from core/acpi.c:28:
./config/ioapi.h:17:10: fatal error: config/local/ioapi.h: No such file or directory
   17 | #include <config/local/ioapi.h>
      |          ^~~~~~~~~~~~~~~~~~~~~~
compilation terminated.


Frank

On 07/02/21 01:50, Joerg Sonnenberger wrote:
The following reply was made to PR kern/56291; it has been noted by GNATS.

From: Joerg Sonnenberger <joerg%bec.de@localhost>
To: gnats-bugs%netbsd.org@localhost
Cc: kern-bug-people%netbsd.org@localhost, gnats-admin%netbsd.org@localhost,
	netbsd-bugs%netbsd.org@localhost
Subject: Re: kern/56291: XEN3_DOM0 nvme abysmal performance - very slow boot
Date: Fri, 2 Jul 2021 01:47:52 +0200

  On Thu, Jul 01, 2021 at 05:20:00PM +0000, kardel%netbsd.org@localhost wrote:
  > >Description:
  > 	On a Dell R740 9.99.85 GENERIC boots normally and can access ld0@nvme0.
  > 	The XEN3_DOM0 kernel under XEN 4.15 boots very slowly when nvme is enabled.
  > 	Disabling nvme allows the kernel to boot normally.
  > 	A similar issue was observed in PR kern/55667 initially before the
  > 	hypervisor problems started there.
Can you check if you are running into interrupt storms? Joerg

Fri Jul  2 07:24:03 UTC 2021
 7:24AM  up 4 mins, 1 user, load averages: 0.02, 0.02, 0.00
NetBSD kebne-new 9.99.85 NetBSD 9.99.85 (GENERIC) #4: Tue Jun 29 11:47:28 CEST 2021  kardel@pip:/src/NetBSD/cur/src/obj.amd64/sys/arch/amd64/compile/GENERIC amd64
interrupt      total rate
TLB shootdown    156    0
cpu0 timer     21813   99
msi1 vec 0       132    0
msi2 vec 0        39    0
msix3 vec 0        1    0
bge0 intr          1    0
msix4 vec 0       39    0
bge1 intr         39    0
ioapic0 pin 4   2862   13
msix5 vec 1       12    0
msix5 vec 2       38    0
msix5 vec 4        6    0
msix5 vec 10       3    0
ioapic3 pin 2   2510   11
Total          27651  125

interrupt                    total rate type
bus_dma bounces                  2    0 misc
bus_dma loads                 2766   12 misc
bus_dma nbouncebufs           1957    8 misc
vmcmd kills                    558    2 misc
vmcmd extends                  254    1 misc
vmcmd calls                   2630   11 misc
entropy notify                   3    0 misc
entropy consolidate              1    0 misc
entropy immediate                2    0 misc
pserialize exclusive access    102    0 misc
vmem static_bt_inuse           200    0 misc
vmem static_bt_count           200    0 misc
TLB shootdown                  156    0 intr
cpu0 cprng_strong reseed         2    0 misc
cpu0 cprng_strong reseed         2    0 misc
softint net/0                  258    1 misc
softint net block/0              2    0 misc
softint bio/0                 2548   11 misc
softint bio block/0              1    0 misc
softint clk/0                 3307   15 misc
softint ser/0                 2572   11 misc
callout late/0                   6    0 misc
crosscall unicast               90    0 misc
crosscall broadcast              1    0 misc
cpu0 timer                   21813   99 intr
cpu0 AST IPI                    52    0 misc
cpu0 generic IPI                 8    0 misc
cpu0 xcall IPI                2256   10 misc
cpu1 cprng_strong reseed         2    0 misc
cpu1 cprng_strong reseed         2    0 misc
softint net/1                  243    1 misc
softint bio/1                   38    0 misc
softint clk/1                 1826    8 misc
softint ser/1                 2148    9 misc
callout late/1                   5    0 misc
cpu1 timer                   21812   99 misc
cpu1 AST IPI                   605    2 misc
cpu1 xcall IPI                 231    1 misc
cpu1 kpreempt IPI                7    0 misc
cpu2 cprng_strong reseed         2    0 misc
cpu2 cprng_strong reseed         1    0 misc
softint net/2                  226    1 misc
softint clk/2                 1478    6 misc
softint ser/2                 2148    9 misc
cpu2 timer                   21811   99 misc
cpu2 AST IPI                    15    0 misc
cpu2 xcall IPI                2271   10 misc
cpu3 cprng_strong reseed         1    0 misc
cpu3 cprng_strong reseed         1    0 misc
softint net/3                  226    1 misc
softint bio/3                    6    0 misc
softint clk/3                  540    2 misc
softint ser/3                 2148    9 misc
cpu3 timer                   21809   99 misc
cpu3 AST IPI                     3    0 misc
cpu3 xcall IPI                2364   10 misc
cpu4 cprng_strong reseed         1    0 misc
cpu4 cprng_strong reseed         1    0 misc
softint net/4                  226    1 misc
softint clk/4                  104    0 misc
softint ser/4                 2148    9 misc
cpu4 timer                   21810   99 misc
cpu4 AST IPI                     6    0 misc
cpu4 xcall IPI                2370   10 misc
cpu5 cprng_strong reseed         1    0 misc
softint net/5                  226    1 misc
softint clk/5                  195    0 misc
softint ser/5                 2147    9 misc
cpu5 timer                   21809   99 misc
cpu5 xcall IPI                2373   10 misc
softint net/6                  226    1 misc
softint clk/6                   35    0 misc
softint ser/6                 2147    9 misc
cpu6 timer                   21808   99 misc
cpu6 xcall IPI                2373   10 misc
softint net/7                  226    1 misc
softint ser/7                 2147    9 misc
cpu7 timer                   21808   99 misc
cpu7 xcall IPI                2373   10 misc
cpu8 cprng_strong reseed         1    0 misc
softint net/8                  226    1 misc
softint clk/8                  663    3 misc
softint ser/8                 2148    9 misc
cpu8 timer                   21807   99 misc
cpu8 xcall IPI                2373   10 misc
softint net/9                  226    1 misc
softint bio/9                    3    0 misc
softint clk/9                  100    0 misc
softint ser/9                 2147    9 misc
cpu9 timer                   21806   99 misc
cpu9 xcall IPI                2373   10 misc
softint net/10                 226    1 misc
softint clk/10                 102    0 misc
softint ser/10                2147    9 misc
cpu10 timer                  21805   99 misc
cpu10 xcall IPI               2373   10 misc
softint net/11                 226    1 misc
softint clk/11                   1    0 misc
softint ser/11                2147    9 misc
cpu11 timer                  21805   99 misc
cpu11 xcall IPI               2373   10 misc
msi1 vec 0                     132    0 intr
msi2 vec 0                      39    0 intr
msix3 vec 0                      1    0 intr
bge0 intr                        1    0 intr
msix4 vec 0                     39    0 intr
bge1 intr                       39    0 intr
ioapic0 pin 4                 2862   13 intr
msix5 vec 1                     12    0 intr
msix5 vec 2                     38    0 intr
msix5 vec 4                      6    0 intr
msix5 vec 10                     3    0 intr
ioapic3 pin 2                 2510   11 intr
acpicpu0 C1 (MWAIT)          29554  134 misc
acpicpu1 C1 (MWAIT)          25104  114 misc
acpicpu2 C1 (MWAIT)          25763  117 misc
acpicpu3 C1 (MWAIT)          24211  110 misc
acpicpu4 C1 (MWAIT)          24264  110 misc
acpicpu5 C1 (MWAIT)          24420  111 misc
acpicpu6 C1 (MWAIT)          24343  110 misc
acpicpu7 C1 (MWAIT)          24319  110 misc
acpicpu8 C1 (MWAIT)          24381  110 misc
acpicpu9 C1 (MWAIT)          24381  110 misc
acpicpu10 C1 (MWAIT)         24440  111 misc
acpicpu11 C1 (MWAIT)         24367  110 misc
cpu0 cprng_fast reseed           1    0 misc
cpu1 cprng_fast reseed           1    0 misc
cpu2 cprng_fast reseed           1    0 misc
cpu3 cprng_fast reseed           1    0 misc
cpu4 cprng_fast reseed           1    0 misc
cpu8 cprng_fast reseed           1    0 misc
kpreempt defer: kernel_lock     14    0 misc
kpreempt immediate               3    0 misc
cpu0 entropy softint           163    0 misc

interrupt id   CPU0  CPU1  CPU2  CPU3  CPU4  CPU5  CPU6  CPU7  CPU8  CPU9  CPU10  CPU11  device name(s)
ioapic0 pin 9     0*    0     0     0     0     0     0     0     0     0      0      0  acpi SCI
msi0 vec 0        0*    0     0     0     0     0     0     0     0     0      0      0  ahcisata0
msi1 vec 0      132*    0     0     0     0     0     0     0     0     0      0      0  xhci0
msi2 vec 0       39*    0     0     0     0     0     0     0     0     0      0      0  ahcisata1
msix3 vec 0       1*    0     0     0     0     0     0     0     0     0      0      0  bge0
msix4 vec 0      39*    0     0     0     0     0     0     0     0     0      0      0  bge1
ioapic0 pin 16    0*    0     0     0     0     0     0     0     0     0      0      0  ichsmb0
ioapic0 pin 4  2862*    0     0     0     0     0     0     0     0     0      0      0  com0
ioapic0 pin 3     0*    0     0     0     0     0     0     0     0     0      0      0  com1
msix5 vec 0       0*    0     0     0     0     0     0     0     0     0      0      0  nvme0 adminq
msix5 vec 1      12*    0     0     0     0     0     0     0     0     0      0      0  nvme0 ioq1
msix5 vec 2       0    38*    0     0     0     0     0     0     0     0      0      0  nvme0 ioq2
msix5 vec 3       0     0     0*    0     0     0     0     0     0     0      0      0  nvme0 ioq3
msix5 vec 4       0     0     0     6*    0     0     0     0     0     0      0      0  nvme0 ioq4
msix5 vec 5       0     0     0     0     0*    0     0     0     0     0      0      0  nvme0 ioq5
msix5 vec 6       0     0     0     0     0     0*    0     0     0     0      0      0  nvme0 ioq6
msix5 vec 7       0     0     0     0     0     0     0*    0     0     0      0      0  nvme0 ioq7
msix5 vec 8       0     0     0     0     0     0     0     0*    0     0      0      0  nvme0 ioq8
msix5 vec 9       0     0     0     0     0     0     0     0     0*    0      0      0  nvme0 ioq9
msix5 vec 10      0     0     0     0     0     0     0     0     0     3*     0      0  nvme0 ioq10
msix5 vec 11      0     0     0     0     0     0     0     0     0     0      0*     0  nvme0 ioq11
msix5 vec 12      0     0     0     0     0     0     0     0     0     0      0      0* nvme0 ioq12
ioapic3 pin 2  2511*    0     0     0     0     0     0     0     0     0      0      0  mfii0
bge1: flags=0x8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	capabilities=0x3f80<TSO4,IP4CSUM_Rx,IP4CSUM_Tx,TCP4CSUM_Rx,TCP4CSUM_Tx>
	capabilities=0x3f80<UDP4CSUM_Rx,UDP4CSUM_Tx>
	enabled=0
	ec_capabilities=0x7<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU>
	ec_enabled=0x2<VLAN_HWTAGGING>
	media: Ethernet autoselect (1000baseT full-duplex)
	status: active
	input: 20 packets, 2048 bytes, 16 multicasts
	output: 16 packets, 1250 bytes, 6 multicasts
	...
Fri Jul  2 07:24:13 UTC 2021
 7:24AM  up 4 mins, 1 user, load averages: 0.01, 0.02, 0.00
NetBSD kebne-new 9.99.85 NetBSD 9.99.85 (GENERIC) #4: Tue Jun 29 11:47:28 CEST 2021  kardel@pip:/src/NetBSD/cur/src/obj.amd64/sys/arch/amd64/compile/GENERIC amd64
interrupt      total rate
TLB shootdown    160    0
cpu0 timer     22815   99
msi1 vec 0       132    0
msi2 vec 0        39    0
msix3 vec 0        1    0
bge0 intr          1    0
msix4 vec 0       39    0
bge1 intr         39    0
ioapic0 pin 4   2862   12
msix5 vec 1       12    0
msix5 vec 2       38    0
msix5 vec 4        6    0
msix5 vec 10       3    0
ioapic3 pin 2   2514   10
Total          28661  124

interrupt                    total rate type
bus_dma bounces                  2    0 misc
bus_dma loads                 2770   12 misc
bus_dma nbouncebufs           1957    8 misc
vmcmd kills                    574    2 misc
vmcmd extends                  262    1 misc
vmcmd calls                   2711   11 misc
entropy notify                   3    0 misc
entropy consolidate              1    0 misc
entropy immediate                2    0 misc
pserialize exclusive access    102    0 misc
vmem static_bt_inuse           200    0 misc
vmem static_bt_count           200    0 misc
TLB shootdown                  160    0 intr
cpu0 cprng_strong reseed         2    0 misc
cpu0 cprng_strong reseed         2    0 misc
softint net/0                  277    1 misc
softint net block/0              2    0 misc
softint bio/0                 2552   11 misc
softint bio block/0              1    0 misc
softint clk/0                 3360   14 misc
softint ser/0                 2572   11 misc
callout late/0                   6    0 misc
crosscall unicast               90    0 misc
crosscall broadcast              1    0 misc
cpu0 timer                   22815   99 intr
cpu0 AST IPI                    52    0 misc
cpu0 generic IPI                 8    0 misc
cpu0 xcall IPI                2256    9 misc
cpu1 cprng_strong reseed         2    0 misc
cpu1 cprng_strong reseed         2    0 misc
softint net/1                  262    1 misc
softint bio/1                   38    0 misc
softint clk/1                 1909    8 misc
softint ser/1                 2148    9 misc
callout late/1                   5    0 misc
cpu1 timer                   22814   99 misc
cpu1 AST IPI                   605    2 misc
cpu1 xcall IPI                 250    1 misc
cpu1 kpreempt IPI                7    0 misc
cpu2 cprng_strong reseed         2    0 misc
cpu2 cprng_strong reseed         1    0 misc
softint net/2                  245    1 misc
softint clk/2                 1550    6 misc
softint ser/2                 2148    9 misc
cpu2 timer                   22813   99 misc
cpu2 AST IPI                    15    0 misc
cpu2 xcall IPI                2290    9 misc
cpu3 cprng_strong reseed         1    0 misc
cpu3 cprng_strong reseed         1    0 misc
softint net/3                  245    1 misc
softint bio/3                    6    0 misc
softint clk/3                  561    2 misc
softint ser/3                 2148    9 misc
cpu3 timer                   22812   99 misc
cpu3 AST IPI                     3    0 misc
cpu3 xcall IPI                2383   10 misc
cpu4 cprng_strong reseed         1    0 misc
cpu4 cprng_strong reseed         1    0 misc
softint net/4                  245    1 misc
softint clk/4                  104    0 misc
softint ser/4                 2148    9 misc
cpu4 timer                   22812   99 misc
cpu4 AST IPI                     6    0 misc
cpu4 xcall IPI                2389   10 misc
cpu5 cprng_strong reseed         1    0 misc
softint net/5                  245    1 misc
softint clk/5                  201    0 misc
softint ser/5                 2147    9 misc
cpu5 timer                   22811   99 misc
cpu5 xcall IPI                2392   10 misc
softint net/6                  245    1 misc
softint clk/6                   35    0 misc
softint ser/6                 2147    9 misc
cpu6 timer                   22811   99 misc
cpu6 xcall IPI                2392   10 misc
softint net/7                  245    1 misc
softint ser/7                 2147    9 misc
cpu7 timer                   22810   99 misc
cpu7 xcall IPI                2392   10 misc
cpu8 cprng_strong reseed         1    0 misc
softint net/8                  245    1 misc
softint clk/8                  703    3 misc
softint ser/8                 2148    9 misc
cpu8 timer                   22809   99 misc
cpu8 xcall IPI                2392   10 misc
softint net/9                  245    1 misc
softint bio/9                    3    0 misc
softint clk/9                  100    0 misc
softint ser/9                 2147    9 misc
cpu9 timer                   22808   99 misc
cpu9 xcall IPI                2392   10 misc
softint net/10                 245    1 misc
softint clk/10                 102    0 misc
softint ser/10                2147    9 misc
cpu10 timer                  22808   99 misc
cpu10 xcall IPI               2392   10 misc
softint net/11                 245    1 misc
softint clk/11                   1    0 misc
softint ser/11                2147    9 misc
cpu11 timer                  22807   99 misc
cpu11 xcall IPI               2392   10 misc
msi1 vec 0                     132    0 intr
msi2 vec 0                      39    0 intr
msix3 vec 0                      1    0 intr
bge0 intr                        1    0 intr
msix4 vec 0                     39    0 intr
bge1 intr                       39    0 intr
ioapic0 pin 4                 2862   12 intr
msix5 vec 1                     12    0 intr
msix5 vec 2                     38    0 intr
msix5 vec 4                      6    0 intr
msix5 vec 10                     3    0 intr
ioapic3 pin 2                 2514   10 intr
acpicpu0 C1 (MWAIT)          30777  133 misc
acpicpu1 C1 (MWAIT)          26138  113 misc
acpicpu2 C1 (MWAIT)          26808  116 misc
acpicpu3 C1 (MWAIT)          25237  109 misc
acpicpu4 C1 (MWAIT)          25289  109 misc
acpicpu5 C1 (MWAIT)          25445  110 misc
acpicpu6 C1 (MWAIT)          25369  110 misc
acpicpu7 C1 (MWAIT)          25345  110 misc
acpicpu8 C1 (MWAIT)          25405  110 misc
acpicpu9 C1 (MWAIT)          25406  110 misc
acpicpu10 C1 (MWAIT)         25466  110 misc
acpicpu11 C1 (MWAIT)         25392  110 misc
cpu0 cprng_fast reseed           1    0 misc
cpu1 cprng_fast reseed           1    0 misc
cpu2 cprng_fast reseed           1    0 misc
cpu3 cprng_fast reseed           1    0 misc
cpu4 cprng_fast reseed           1    0 misc
cpu8 cprng_fast reseed           1    0 misc
kpreempt defer: kernel_lock     14    0 misc
kpreempt immediate               3    0 misc
cpu0 entropy softint           163    0 misc

interrupt id   CPU0  CPU1  CPU2  CPU3  CPU4  CPU5  CPU6  CPU7  CPU8  CPU9  CPU10  CPU11  device name(s)
ioapic0 pin 9     0*    0     0     0     0     0     0     0     0     0      0      0  acpi SCI
msi0 vec 0        0*    0     0     0     0     0     0     0     0     0      0      0  ahcisata0
msi1 vec 0      132*    0     0     0     0     0     0     0     0     0      0      0  xhci0
msi2 vec 0       39*    0     0     0     0     0     0     0     0     0      0      0  ahcisata1
msix3 vec 0       1*    0     0     0     0     0     0     0     0     0      0      0  bge0
msix4 vec 0      39*    0     0     0     0     0     0     0     0     0      0      0  bge1
ioapic0 pin 16    0*    0     0     0     0     0     0     0     0     0      0      0  ichsmb0
ioapic0 pin 4  2862*    0     0     0     0     0     0     0     0     0      0      0  com0
ioapic0 pin 3     0*    0     0     0     0     0     0     0     0     0      0      0  com1
msix5 vec 0       0*    0     0     0     0     0     0     0     0     0      0      0  nvme0 adminq
msix5 vec 1      12*    0     0     0     0     0     0     0     0     0      0      0  nvme0 ioq1
msix5 vec 2       0    38*    0     0     0     0     0     0     0     0      0      0  nvme0 ioq2
msix5 vec 3       0     0     0*    0     0     0     0     0     0     0      0      0  nvme0 ioq3
msix5 vec 4       0     0     0     6*    0     0     0     0     0     0      0      0  nvme0 ioq4
msix5 vec 5       0     0     0     0     0*    0     0     0     0     0      0      0  nvme0 ioq5
msix5 vec 6       0     0     0     0     0     0*    0     0     0     0      0      0  nvme0 ioq6
msix5 vec 7       0     0     0     0     0     0     0*    0     0     0      0      0  nvme0 ioq7
msix5 vec 8       0     0     0     0     0     0     0     0*    0     0      0      0  nvme0 ioq8
msix5 vec 9       0     0     0     0     0     0     0     0     0*    0      0      0  nvme0 ioq9
msix5 vec 10      0     0     0     0     0     0     0     0     0     3*     0      0  nvme0 ioq10
msix5 vec 11      0     0     0     0     0     0     0     0     0     0      0*     0  nvme0 ioq11
msix5 vec 12      0     0     0     0     0     0     0     0     0     0      0      0* nvme0 ioq12
ioapic3 pin 2  2514*    0     0     0     0     0     0     0     0     0      0      0  mfii0
bge1: flags=0x8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	capabilities=0x3f80<TSO4,IP4CSUM_Rx,IP4CSUM_Tx,TCP4CSUM_Rx,TCP4CSUM_Tx>
	capabilities=0x3f80<UDP4CSUM_Rx,UDP4CSUM_Tx>
	enabled=0
	ec_capabilities=0x7<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU>
	ec_enabled=0x2<VLAN_HWTAGGING>
	media: Ethernet autoselect (1000baseT full-duplex)
	status: active
	input: 20 packets, 2048 bytes, 16 multicasts
	output: 16 packets, 1250 bytes, 6 multicasts
	...
Fri Jul  2 06:40:09 UTC 2021
 6:40AM  up 12 mins, 1 user, load averages: 0.15, 0.33, 0.30
NetBSD kebne-new 9.99.85 NetBSD 9.99.85 (XEN3_DOM0_DEBUG) #1: Thu Jul  1 14:04:18 CEST 2021  kardel@pip:/src/NetBSD/cur/src/obj.amd64/sys/arch/amd64/compile/XEN3_DOM0_DEBUG amd64
interrupt                total rate
TLB shootdown             5273    7
vcpu0 xenev0 chan 2        921    1
vcpu0 xenev0 chan 3        562    0
vcpu0 msi1 vec 0           130    0
vcpu0 msi2 vec 0            22    0
vcpu0 msi3 vec 0         62601   88
bge0 intr                63888   89
vcpu0 msi4 vec 0        568738  799
bge1 intr               568900  800
vcpu0 ioapic3 pin 2       1234    1
vcpu0 xenev0 chan 13     70949   99
vcpu1 xenev0 chan 14      2762    3
vcpu1 missed hardclock    1435    2
vcpu1 xenev0 chan 15     69504   97
vcpu2 xenev0 chan 16      1355    1
vcpu2 missed hardclock      89    0
vcpu2 xenev0 chan 17     70850   99
vcpu3 xenev0 chan 18      2138    3
vcpu3 missed hardclock     248    0
vcpu3 xenev0 chan 19     70691   99
Total                   1562290 2197

interrupt                          total rate type
bus_dma bounces                        3    0 misc
bus_dma loads                       2999    4 misc
bus_dma nbouncebufs                 1957    2 misc
vmcmd kills                          762    1 misc
vmcmd extends                        348    0 misc
vmcmd calls                         3576    5 misc
entropy notify                         2    0 misc
entropy consolidate                    1    0 misc
entropy immediate                      1    0 misc
entropy discretionary                  1    0 misc
pserialize exclusive access          105    0 misc
vmem static_bt_inuse                 200    0 misc
vmem static_bt_count                 200    0 misc
TLB shootdown                       5273    7 intr
cpu0 cprng_strong reseed               2    0 misc
cpu0 cprng_strong reseed               2    0 misc
softint net/0                        457    0 misc
softint net block/0                    8    0 misc
softint bio/0                       1696    2 misc
softint bio block/0                    1    0 misc
softint clk/0                       4715    6 misc
softint ser/0                       1693    2 misc
callout late/0                         2    0 misc
crosscall unicast                     21    0 misc
crosscall broadcast                    1    0 misc
vcpu0 xcall IPI                      300    0 misc
vcpu0 AST IPI                        622    0 misc
vcpu0 xenev0 chan 2                  921    1 intr
cpu1 cprng_strong reseed               2    0 misc
cpu1 cprng_strong reseed               1    0 misc
softint net/1                        246    0 misc
softint clk/1                       1610    2 misc
softint ser/1                        114    0 misc
callout late/1                         5    0 misc
vcpu1 xcall IPI                      226    0 misc
vcpu1 AST IPI                       2525    3 misc
vcpu1 kpreempt IPI                    12    0 misc
cpu2 cprng_strong reseed               2    0 misc
cpu2 cprng_strong reseed               2    0 misc
softint net/2                        246    0 misc
softint clk/2                       5713    8 misc
softint ser/2                        115    0 misc
callout late/2                         5    0 misc
vcpu2 xcall IPI                      241    0 misc
vcpu2 AST IPI                       1115    1 misc
cpu3 cprng_strong reseed               2    0 misc
cpu3 cprng_strong reseed               1    0 misc
softint net/3                        245    0 misc
softint clk/3                       6587    9 misc
softint ser/3                        115    0 misc
callout late/3                         2    0 misc
vcpu3 xcall IPI                      265    0 misc
vcpu3 AST IPI                       1874    2 misc
vcpu0 xenev0 chan 3                  562    0 intr
vcpu0 msi1 vec 0                     130    0 intr
vcpu0 msi2 vec 0                      22    0 intr
vcpu0 msi3 vec 0                   62606   88 intr
bge0 intr                          63893   89 intr
vcpu0 msi4 vec 0                  568738  799 intr
bge1 intr                         568900  800 intr
vcpu0 ioapic3 pin 2                 1234    1 intr
cpu0 cprng_fast reseed                 1    0 misc
cpu1 cprng_fast reseed                 1    0 misc
cpu2 cprng_fast reseed                 1    0 misc
cpu3 cprng_fast reseed                 1    0 misc
vcpu0 xenev0 chan 13               70949   99 intr
kpreempt defer: critical section       4    0 misc
kpreempt defer: kernel_lock            8    0 misc
kpreempt immediate                     9    0 misc
vcpu1 xenev0 chan 14                2763    3 intr
vcpu1 missed hardclock              1435    2 intr
vcpu1 xenev0 chan 15               69505   97 intr
vcpu2 xenev0 chan 16                1355    1 intr
vcpu2 missed hardclock                89    0 intr
vcpu2 xenev0 chan 17               70851   99 intr
vcpu3 xenev0 chan 18                2139    3 intr
vcpu3 missed hardclock               248    0 intr
vcpu3 xenev0 chan 19               70692   99 intr
cpu0 entropy softint                 168    0 misc
cpu1 entropy softint                  11    0 misc
cpu2 entropy softint                  12    0 misc
cpu3 entropy softint                  12    0 misc

interrupt id     CPU0   CPU1   CPU2   CPU3  device name(s)
xenev0 chan 2     922*     0      0      0  vcpu0 ipi
xenev0 chan 3     562*     0      0      0  xencons0
ioapic0 pin 9       0*     0      0      0  acpi SCI
msi0 vec 0          0*     0      0      0  ahcisata0
msi1 vec 0        130*     0      0      0  xhci0
msi2 vec 0         22*     0      0      0  ahcisata1
msi3 vec 0      62612*     0      0      0  bge0
msi4 vec 0     568738*     0      0      0  bge1
ioapic0 pin 16      0*     0      0      0  ichsmb0
ioapic0 pin 3       0*     0      0      0  com1
ioapic3 pin 2    1234*     0      0      0  mfii0
xenev0 chan 13  70950*     0      0      0  vcpu0 clock
xenev0 chan 14      0   2764*     0      0  vcpu1 ipi
xenev0 chan 15      0  69505*     0      0  vcpu1 clock
xenev0 chan 16      0      0   1355*     0  vcpu2 ipi
xenev0 chan 17      0      0  70851*     0  vcpu2 clock
xenev0 chan 18      0      0      0   2139* vcpu3 ipi
xenev0 chan 19      0      0      0  70692* vcpu3 clock
xenev0 chan 20      0*     0      0      0  xenbus0
xenev0 chan 21      0*     0      0      0  xenevt
bge1: flags=0x8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	capabilities=0x3f80<TSO4,IP4CSUM_Rx,IP4CSUM_Tx,TCP4CSUM_Rx,TCP4CSUM_Tx>
	capabilities=0x3f80<UDP4CSUM_Rx,UDP4CSUM_Tx>
	enabled=0
	ec_capabilities=0x7<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU>
	ec_enabled=0x2<VLAN_HWTAGGING>
	media: Ethernet autoselect (1000baseT full-duplex)
	status: active
	input: 194 packets, 14458 bytes, 131 multicasts
	output: 82 packets, 6912 bytes, 10 multicasts
	...
Fri Jul  2 06:40:19 UTC 2021
 6:40AM  up 12 mins, 1 user, load averages: 0.13, 0.32, 0.29
NetBSD kebne-new 9.99.85 NetBSD 9.99.85 (XEN3_DOM0_DEBUG) #1: Thu Jul  1 14:04:18 CEST 2021  kardel@pip:/src/NetBSD/cur/src/obj.amd64/sys/arch/amd64/compile/XEN3_DOM0_DEBUG amd64
interrupt                total rate
TLB shootdown             5275    7
vcpu0 xenev0 chan 2        946    1
vcpu0 xenev0 chan 3        562    0
vcpu0 msi1 vec 0           130    0
vcpu0 msi2 vec 0            22    0
vcpu0 msi3 vec 0         64892   90
bge0 intr                66189   91
vcpu0 msi4 vec 0        576452  799
bge1 intr               576617  799
vcpu0 ioapic3 pin 2       1235    1
vcpu0 xenev0 chan 13     71954   99
vcpu1 xenev0 chan 14      2787    3
vcpu1 missed hardclock    1435    1
vcpu1 xenev0 chan 15     70509   97
vcpu2 xenev0 chan 16      1375    1
vcpu2 missed hardclock      89    0
vcpu2 xenev0 chan 17     71855   99
vcpu3 xenev0 chan 18      2212    3
vcpu3 missed hardclock     248    0
vcpu3 xenev0 chan 19     71696   99
Total                   1586480 2200

interrupt                          total rate type
bus_dma bounces                        3    0 misc
bus_dma loads                       3001    4 misc
bus_dma nbouncebufs                 1957    2 misc
vmcmd kills                          778    1 misc
vmcmd extends                        356    0 misc
vmcmd calls                         3657    5 misc
entropy notify                         2    0 misc
entropy consolidate                    1    0 misc
entropy immediate                      1    0 misc
entropy discretionary                  1    0 misc
pserialize exclusive access          105    0 misc
vmem static_bt_inuse                 200    0 misc
vmem static_bt_count                 200    0 misc
TLB shootdown                       5275    7 intr
cpu0 cprng_strong reseed               2    0 misc
cpu0 cprng_strong reseed               2    0 misc
softint net/0                        479    0 misc
softint net block/0                    8    0 misc
softint bio/0                       1697    2 misc
softint bio block/0                    1    0 misc
softint clk/0                       4749    6 misc
softint ser/0                       1704    2 misc
callout late/0                         2    0 misc
crosscall unicast                     21    0 misc
crosscall broadcast                    1    0 misc
vcpu0 xcall IPI                      319    0 misc
vcpu0 AST IPI                        629    0 misc
vcpu0 xenev0 chan 2                  947    1 intr
cpu1 cprng_strong reseed               2    0 misc
cpu1 cprng_strong reseed               1    0 misc
softint net/1                        265    0 misc
softint clk/1                       1630    2 misc
softint ser/1                        114    0 misc
callout late/1                         5    0 misc
vcpu1 xcall IPI                      245    0 misc
vcpu1 AST IPI                       2530    3 misc
vcpu1 kpreempt IPI                    12    0 misc
cpu2 cprng_strong reseed               2    0 misc
cpu2 cprng_strong reseed               2    0 misc
softint net/2                        265    0 misc
softint clk/2                       5794    8 misc
softint ser/2                        115    0 misc
callout late/2                         5    0 misc
vcpu2 xcall IPI                      260    0 misc
vcpu2 AST IPI                       1117    1 misc
cpu3 cprng_strong reseed               2    0 misc
cpu3 cprng_strong reseed               1    0 misc
softint net/3                        264    0 misc
softint clk/3                       6687    9 misc
softint ser/3                        115    0 misc
callout late/3                         2    0 misc
vcpu3 xcall IPI                      265    0 misc
vcpu3 AST IPI                       1947    2 misc
vcpu0 xenev0 chan 3                  562    0 intr
vcpu0 msi1 vec 0                     130    0 intr
vcpu0 msi2 vec 0                      22    0 intr
vcpu0 msi3 vec 0                   64892   90 intr
bge0 intr                          66189   91 intr
vcpu0 msi4 vec 0                  576456  799 intr
bge1 intr                         576621  799 intr
vcpu0 ioapic3 pin 2                 1235    1 intr
cpu0 cprng_fast reseed                 1    0 misc
cpu1 cprng_fast reseed                 1    0 misc
cpu2 cprng_fast reseed                 1    0 misc
cpu3 cprng_fast reseed                 1    0 misc
vcpu0 xenev0 chan 13               71954   99 intr
kpreempt defer: critical section       4    0 misc
kpreempt defer: kernel_lock            8    0 misc
kpreempt immediate                     9    0 misc
vcpu1 xenev0 chan 14                2787    3 intr
vcpu1 missed hardclock              1435    1 intr
vcpu1 xenev0 chan 15               70510   97 intr
vcpu2 xenev0 chan 16                1376    1 intr
vcpu2 missed hardclock                89    0 intr
vcpu2 xenev0 chan 17               71856   99 intr
vcpu3 xenev0 chan 18                2212    3 intr
vcpu3 missed hardclock               248    0 intr
vcpu3 xenev0 chan 19               71697   99 intr
cpu0 entropy softint                 168    0 misc
cpu1 entropy softint                  11    0 misc
cpu2 entropy softint                  12    0 misc
cpu3 entropy softint                  12    0 misc

interrupt id     CPU0   CPU1   CPU2   CPU3  device name(s)
xenev0 chan 2     947*     0      0      0  vcpu0 ipi
xenev0 chan 3     562*     0      0      0  xencons0
ioapic0 pin 9       0*     0      0      0  acpi SCI
msi0 vec 0          0*     0      0      0  ahcisata0
msi1 vec 0        130*     0      0      0  xhci0
msi2 vec 0         22*     0      0      0  ahcisata1
msi3 vec 0      64892*     0      0      0  bge0
msi4 vec 0     576461*     0      0      0  bge1
ioapic0 pin 16      0*     0      0      0  ichsmb0
ioapic0 pin 3       0*     0      0      0  com1
ioapic3 pin 2    1235*     0      0      0  mfii0
xenev0 chan 13  71955*     0      0      0  vcpu0 clock
xenev0 chan 14      0   2788*     0      0  vcpu1 ipi
xenev0 chan 15      0  70510*     0      0  vcpu1 clock
xenev0 chan 16      0      0   1377*     0  vcpu2 ipi
xenev0 chan 17      0      0  71856*     0  vcpu2 clock
xenev0 chan 18      0      0      0   2212* vcpu3 ipi
xenev0 chan 19      0      0      0  71697* vcpu3 clock
xenev0 chan 20      0*     0      0      0  xenbus0
xenev0 chan 21      0*     0      0      0  xenevt
bge1: flags=0x8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	capabilities=0x3f80<TSO4,IP4CSUM_Rx,IP4CSUM_Tx,TCP4CSUM_Rx,TCP4CSUM_Tx>
	capabilities=0x3f80<UDP4CSUM_Rx,UDP4CSUM_Tx>
	enabled=0
	ec_capabilities=0x7<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU>
	ec_enabled=0x2<VLAN_HWTAGGING>
	media: Ethernet autoselect (1000baseT full-duplex)
	status: active
	input: 197 packets, 14668 bytes, 133 multicasts
	output: 83 packets, 7002 bytes, 10 multicasts
	...


Home | Main Index | Thread Index | Old Index