Re: High system times on Scaleway Cloud server

[Alexander Nasonov <alnsn%yandex.ru@localhost>]

Masanobu SAITOH wrote:
> On 2018/12/26 8:35, Alexander Nasonov wrote:
> > Jason Thorpe wrote:
> > > You should be able to use lockstat(1) to narrow down which one.
> > 
> > # lockstat sleep 30
> > lockstat: cannot enable tracing: Operation not supported by device
> > 
> > I guess I should compile a new kernel with LOCKDEBUG.
> > 
> 
> Have you checked interrupt stuff? e.g. vmstat -e or intrctl list

# vmstat -e | awk 'NR==1||NF<3||$(NF-1)>1000'
interrupt                                         total rate type
pmap pages remapped                             1380170 1231 misc
pmap pages mapped (including remapped)         10246280 9140 misc
pmap managed pages mapped                      10048848 8964 misc
pmap user pages mapped                          9148349 8160 misc
pmap pmap_protect non-exists pages              1831620 1633 misc
pmap pv_entry free and unlink                   9008786 8036 misc
pmap pv_entry allocate and link                 9134553 8148 misc

Are those numbers too high?

# intrctl list; sleep 60; intrctl list

I mixed the outputs of the above two 'intrctl list' commands for
easy comparison:

gicv3 irq 0       1326*    984*   1061*   1099*   1039*   1175*   1161*   1369* IPI ast
gicv3 irq 0       1407*   1042*   1079*   1124*   1063*   1215*   1221*   1388* IPI ast

gicv3 irq 1         86*     98*    110*    115*    107*    101*     91*    104* IPI xcall
gicv3 irq 1         92*    104*    116*    121*    113*    107*     91*    110* IPI xcall

gicv3 irq 2      19707*  20704*  22745*  18069*  29204*  31125*  29382*  84521* IPI nop
gicv3 irq 2      20047*  21031*  22975*  18387*  29476*  31409*  29882*  84828* IPI nop

gicv3 irq 3          0*      0*      0*      0*      0*      0*      0*      0* IPI shootdown
gicv3 irq 3          0*      0*      0*      0*      0*      0*      0*      0* IPI shootdown

gicv3 irq 4          0*      0*      0*      0*      0*      0*      0*      0* IPI ddb                                                  
gicv3 irq 4          0*      0*      0*      0*      0*      0*      0*      0* IPI ddb

gicv3 irq 5        503*    225*    267*    245*    251*    229*    253*    258* IPI generic                                           
gicv3 irq 5        521*    240*    276*    254*    258*    241*    272*    272* IPI generic

gicv3 irq 23         0*      0*      0*      0*      0*      0*      0*      0* pmu                                                  
gicv3 irq 23         0*      0*      0*      0*      0*      0*      0*      0* pmu

gicv3 irq 27    119387* 119392* 119380* 119398* 119399* 119409* 119378* 119362* gtmr0                                              
gicv3 irq 27    125409* 125411* 125397* 125419* 125419* 125430* 125399* 125383* gtmr0

gicv3 irq 33       128*      0       0       0       0       0       0       0  plcom0                                             
gicv3 irq 33       128*      0       0       0       0       0       0       0  plcom0

gicv3 irq 39         0*      0       0       0       0       0       0       0  plgpio0                                          
gicv3 irq 39         0*      0       0       0       0       0       0       0  plgpio0

gicv3-lpi irq 0      0*      0       0       0       0       0       0       0  virtio32                                           
gicv3-lpi irq 0      0*      0       0       0       0       0       0       0  virtio32

gicv3-lpi irq 1  26500*      0       0       0       0       0       0       0  virtio32                                          
gicv3-lpi irq 1  27243*      0       0       0       0       0       0       0  virtio32

gicv3-lpi irq 2      0*      0       0       0       0       0       0       0  virtio33                                         
gicv3-lpi irq 2      0*      0       0       0       0       0       0       0  virtio33

gicv3-lpi irq 3  41702*      0       0       0       0       0       0       0  virtio33                                          
gicv3-lpi irq 3  42129*      0       0       0       0       0       0       0  virtio33

gicv3-lpi irq 4      0*      0       0       0       0       0       0       0  virtio34                                           
gicv3-lpi irq 4      0*      0       0       0       0       0       0       0  virtio34

gicv3-lpi irq 5 266675*      0       0       0       0       0       0       0  virtio34
gicv3-lpi irq 5 267313*      0       0       0       0       0       0       0  virtio34


I don't see anything high enough.

-- 
Alex