NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
Re: kern/54818: 9.0_RC1 pagedaemon spins
The following reply was made to PR kern/54818; it has been noted by GNATS.
From: Izumi Tsutsui <tsutsui%ceres.dti.ne.jp@localhost>
To: ad%netbsd.org@localhost
Cc: gnats-bugs%netbsd.org@localhost, tsutsui%ceres.dti.ne.jp@localhost
Subject: Re: kern/54818: 9.0_RC1 pagedaemon spins
Date: Thu, 2 Jan 2020 06:42:39 +0900
> If it happens again could you please collect the output of "vmstat -s", wait
> a few seconds, and then capture "vmstat -s" again? That could be useful.
Here is output of "vmstat -s 1" 10 times:
---
4096 bytes per page
8 page colors
832700 pages managed
117235 pages free
342925 pages active
183082 pages inactive
0 pages paging
65844 pages wired
97392 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118567 kernel pool pages
361159 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458503384 total faults taken
458961173 traps
9552277 device interrupts
96460867 CPU context switches
15626258 software interrupts
930547937 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121049 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
370962565 pagealloc desired color avail
21949517 pagealloc desired color not avail
316537267 pagealloc local cpu avail
76374815 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25034954 anon page faults
155001 anon retry faults
31940079 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98755999 locked pager get faults
149720 unlocked pager get faults
16939718 anon faults
8095274 anon copy on write faults
76579891 object faults
22173678 promote copy faults
150460952 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523823913 total name lookups
494694075 good hits
27128967 negative hits
279115 bad hits
21338 false hits
1293870 miss
406548 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118948 pages free
341224 pages active
183069 pages inactive
0 pages paging
65844 pages wired
97392 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118569 kernel pool pages
359445 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458503461 total faults taken
458961250 traps
9552377 device interrupts
96461807 CPU context switches
15626634 software interrupts
930553597 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121049 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
370962612 pagealloc desired color avail
21949517 pagealloc desired color not avail
316537314 pagealloc local cpu avail
76374815 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25034992 anon page faults
155001 anon retry faults
31940083 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98755999 locked pager get faults
149720 unlocked pager get faults
16939756 anon faults
8095274 anon copy on write faults
76579891 object faults
22173678 promote copy faults
150460952 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523823920 total name lookups
494694080 good hits
27128969 negative hits
279115 bad hits
21338 false hits
1293870 miss
406548 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118674 pages free
341431 pages active
183042 pages inactive
0 pages paging
65932 pages wired
97201 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118572 kernel pool pages
359713 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458519831 total faults taken
458977623 traps
9552530 device interrupts
96465487 CPU context switches
15627043 software interrupts
930580429 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121240 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
370979690 pagealloc desired color avail
21949517 pagealloc desired color not avail
316553121 pagealloc local cpu avail
76376086 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25035040 anon page faults
155001 anon retry faults
31940098 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98756001 locked pager get faults
149720 unlocked pager get faults
16939804 anon faults
8095274 anon copy on write faults
76579893 object faults
22173678 promote copy faults
150461140 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523824179 total name lookups
494694307 good hits
27128984 negative hits
279115 bad hits
21338 false hits
1293870 miss
406565 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118635 pages free
341498 pages active
183020 pages inactive
0 pages paging
65916 pages wired
97141 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118576 kernel pool pages
359742 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458534252 total faults taken
458992045 traps
9552732 device interrupts
96471307 CPU context switches
15627559 software interrupts
930617318 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121300 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
370994701 pagealloc desired color avail
21949517 pagealloc desired color not avail
316568114 pagealloc local cpu avail
76376104 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25035240 anon page faults
155001 anon retry faults
31940112 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98756001 locked pager get faults
149720 unlocked pager get faults
16940004 anon faults
8095274 anon copy on write faults
76579893 object faults
22173678 promote copy faults
150461200 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523824315 total name lookups
494694427 good hits
27128987 negative hits
279115 bad hits
21338 false hits
1293870 miss
406578 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118715 pages free
341514 pages active
183006 pages inactive
0 pages paging
65828 pages wired
97138 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118559 kernel pool pages
359656 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458539603 total faults taken
458997396 traps
9552915 device interrupts
96472810 CPU context switches
15628005 software interrupts
930625317 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121303 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
371000164 pagealloc desired color avail
21949517 pagealloc desired color not avail
316573576 pagealloc local cpu avail
76376105 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25035272 anon page faults
155001 anon retry faults
31940117 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98756001 locked pager get faults
149720 unlocked pager get faults
16940036 anon faults
8095274 anon copy on write faults
76579893 object faults
22173678 promote copy faults
150461202 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523824315 total name lookups
494694427 good hits
27128987 negative hits
279115 bad hits
21338 false hits
1293870 miss
406578 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118712 pages free
341528 pages active
182995 pages inactive
0 pages paging
65828 pages wired
97131 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118556 kernel pool pages
359659 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458543032 total faults taken
459000826 traps
9553020 device interrupts
96473904 CPU context switches
15628384 software interrupts
930631548 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121310 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
371003665 pagealloc desired color avail
21949517 pagealloc desired color not avail
316577073 pagealloc local cpu avail
76376109 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25035300 anon page faults
155001 anon retry faults
31940129 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98756001 locked pager get faults
149720 unlocked pager get faults
16940064 anon faults
8095274 anon copy on write faults
76579893 object faults
22173678 promote copy faults
150461205 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523824321 total name lookups
494694432 good hits
27128987 negative hits
279115 bad hits
21338 false hits
1293870 miss
406579 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118732 pages free
341522 pages active
182981 pages inactive
0 pages paging
65828 pages wired
97127 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118572 kernel pool pages
359639 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458546595 total faults taken
459004389 traps
9553143 device interrupts
96474875 CPU context switches
15628773 software interrupts
930636950 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121314 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
371007257 pagealloc desired color avail
21949517 pagealloc desired color not avail
316580661 pagealloc local cpu avail
76376113 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25035312 anon page faults
155001 anon retry faults
31940132 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98756001 locked pager get faults
149720 unlocked pager get faults
16940076 anon faults
8095274 anon copy on write faults
76579893 object faults
22173678 promote copy faults
150461205 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523824321 total name lookups
494694432 good hits
27128987 negative hits
279115 bad hits
21338 false hits
1293870 miss
406579 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118676 pages free
341557 pages active
182949 pages inactive
0 pages paging
65884 pages wired
97116 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118547 kernel pool pages
359698 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458551558 total faults taken
459009353 traps
9553301 device interrupts
96476981 CPU context switches
15629214 software interrupts
930649540 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121325 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
371012340 pagealloc desired color avail
21949517 pagealloc desired color not avail
316585739 pagealloc local cpu avail
76376118 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25035356 anon page faults
155001 anon retry faults
31940155 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98756001 locked pager get faults
149720 unlocked pager get faults
16940120 anon faults
8095274 anon copy on write faults
76579893 object faults
22173678 promote copy faults
150461212 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523824436 total name lookups
494694535 good hits
27128989 negative hits
279115 bad hits
21338 false hits
1293870 miss
406589 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118701 pages free
341601 pages active
182932 pages inactive
0 pages paging
65828 pages wired
97074 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118536 kernel pool pages
359669 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458565635 total faults taken
459023432 traps
9553487 device interrupts
96481705 CPU context switches
15629681 software interrupts
930679821 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121367 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
371026749 pagealloc desired color avail
21949517 pagealloc desired color not avail
316600142 pagealloc local cpu avail
76376124 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25035392 anon page faults
155001 anon retry faults
31940161 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98756001 locked pager get faults
149720 unlocked pager get faults
16940156 anon faults
8095274 anon copy on write faults
76579893 object faults
22173678 promote copy faults
150461250 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523824436 total name lookups
494694535 good hits
27128989 negative hits
279115 bad hits
21338 false hits
1293870 miss
406589 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
4096 bytes per page
8 page colors
832700 pages managed
118702 pages free
341620 pages active
182917 pages inactive
0 pages paging
65828 pages wired
97064 zero pages
1 reserve pagedaemon pages
20 reserve kernel pages
13825 boot kernel pages
118509 kernel pool pages
359673 anonymous pages
180316 cached file pages
50376 cached executable pages
1024 minimum free pages
1365 target free pages
277566 maximum wired pages
1 swap devices
2296837 swap pages
139630 swap pages in use
159606 swap allocations
458571475 total faults taken
459029274 traps
9553585 device interrupts
96482704 CPU context switches
15630064 software interrupts
930685464 system calls
155893 pagein requests
17376 pageout requests
0 pages swapped in
276978 pages swapped out
887490 forks total
520251 forks blocked parent
520251 forks shared address space with parent
57121377 pagealloc zero wanted and avail
99809329 pagealloc zero wanted and not avail
6630 aborts of idle page zeroing
371032625 pagealloc desired color avail
21949517 pagealloc desired color not avail
316604666 pagealloc local cpu avail
76377476 pagealloc local cpu not avail
133 faults with no memory
0 faults with no anons
31 faults had to wait on pages
0 faults found released page
305643 faults relock (302934 ok)
25035443 anon page faults
155001 anon retry faults
31940173 amap copy faults
19191744 neighbour anon page faults
389315776 neighbour object page faults
98756001 locked pager get faults
149720 unlocked pager get faults
16940207 anon faults
8095274 anon copy on write faults
76579893 object faults
22173678 promote copy faults
150461254 promote zero fill faults
1085 times daemon wokeup
71617 revolutions of the clock hand
4994032 pages freed by daemon
13125360 pages scanned by daemon
269619 anonymous pages scanned by daemon
4724413 object pages scanned by daemon
2215383 pages reactivated
167 pages found busy by daemon
259601 total pending pageouts
14625650 pages deactivated
523824436 total name lookups
494694535 good hits
27128989 negative hits
279115 bad hits
21338 false hits
1293870 miss
406589 too long
295970 pass2 hits
446837 2passes
cache hits (94% pos + 5% neg) system 0% per-process
deletions 0%, falsehits 0%, toolong 0%
---
More data is here:
https://gist.github.com/tsutsui/d5d671fbd9361db222f44be968463d8c
> Hmm, I wonder if backporting a change from -current to use marker pages when
> scanning the inactive queue in uvmpdpol_selectvictim() could help here.
Note I forgot to note in the first mail, it happened also on NetBSD 8.1.
I'll try your suggested patch later. (not so easy to reproduce)
---
Izumi Tsutsui
Home |
Main Index |
Thread Index |
Old Index