NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
Re: PR/55707 CVS commit: src/external/cddl/osnet/dist/uts/common/fs/zfs
The following reply was made to PR kern/55707; it has been noted by GNATS.
From: Frank Kardel <kardel%netbsd.org@localhost>
To: gnats-bugs%netbsd.org@localhost, kern-bug-people <kern-bug-people%netbsd.org@localhost>
Cc:
Subject: Re: PR/55707 CVS commit:
src/external/cddl/osnet/dist/uts/common/fs/zfs
Date: Sat, 7 May 2022 20:54:13 +0200
Further testing gives:
- xcalls do not appear in significant counts
- pgdaemon runs all the time after a while
- zfs kernel pools (pool(9)) require a lot of memory (> 50% on a
64G machine) - somewhat expected ZFS behavior but seems not be limited
- processes using ZFS pools slow down and wait on vmem and
zio_buf... and other zfs waitchannels
- zfs pools (zfs abstraction) are unusable at this stage
So, while this fix looked good at start it brings the ZFS system down
after a while.
Looks like this needs more investigation.
Maybe this fix should be backed out until then.
Best regards,
Frank
vmstat -m
Memory resource pool statistics
Name Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg
Maxpg Idle
amappl 88 348824 0 315902 865 132 733 735 0
inf 0
anonpl 40 8704909 0 4079863 52358 6398 45960 48565 0
inf 0
arc_buf_hdr_t_f 208 6907754 0 4497447 130397 3538 126859 126861 0
inf 0
arc_buf_t 40 2504702 0 2499075 3956 3815 141 656 0
inf 0
ataspl 160 161409436 0 161409436 1139 1138 1 3 0 inf 1
biopl 280 2144448 21 2144438 23004 23003 1 1136 0
inf 0
buf16k 16896 13776 0 13203 1692 1494 198 281 0
inf 0
buf1k 1536 168 0 168 83 82 1 83 0
inf 1
buf2k 2560 1668 0 1668 1650 1649 1 957 0
inf 1
buf32k 33280 643163 442 448649 414253 219738 194515 201563 0
inf 1
buf4k 4096 777170 0 665295 527831 415955 111876 140565 0
inf 1
buf512b 1024 16428 0 16427 1108 1107 1 930 0
inf 0
buf64k 65536 12 0 0 13 0 13 13 0
inf 1
buf8k 8704 26445 0 26122 925 876 49 131 0
inf 0
bufpl 280 355070 0 47772 23653 103 23550 23551 0
inf 0
cgdcpl 88 3076 0 3076 53 53 0 2 0 inf 0
cwdi 192 11265 0 10887 23 4 19 19 0
inf 0
dmu_buf_impl_t 216 8421890 0 8399719 130037 127513 2524 17241 0
inf 0
dnode_t 640 6484618 0 6467510 425627 421251 4376 49015 0
inf 0
execargs 262144 14923 0 14923 1126 1125 1 16 0
16 1
extent 48 68 0 27 1 0 1 1 0 inf 0
fcrpl 184 422 0 410 4 0 4 4 4 inf 3
fdfile 64 225465 0 213580 334 112 222 296 0
inf 0
ffsdino1 136 1458285 0 1458285 16421 16421 0 4393 0
inf 0
ffsdino2 264 20330927 0 20182146 75494 65542 9952 14695 0
inf 0
ffsino 280 21285904 0 21137123 63225 52565 10660 15745 0
inf 0
file 128 136397 0 133647 92 0 92 92 0
inf 0
filedesc 832 11245 0 10867 182 87 95 97 0
inf 0
fstlwp 128 27298 0 25867 48 1 47 47 0
inf 0
icmp 32 1693 0 1693 525 525 0 1 0 inf 0
icmp6 32 2609 0 2609 857 857 0 1 0 inf 0
igmppl 40 1 0 0 1 0 1 1 0 inf 0
in6pcbpl 296 2985970 0 2985919 97 93 4 5 0 inf 0
inmltpl 56 256 0 244 1 0 1 1 0 inf 0
inpcbpl 256 3136768 0 3136472 46 24 22 30 0
inf 0
kcpuset 64 21769 0 20881 15 0 15 15 0
inf 0
kcredpl 192 33317 0 32207 69 3 66 69 0
inf 0
kmem-00016 16 4031533 0 4001321 1519 1093 426 696 0
inf 0
kmem-00032 32 2975151 0 2957902 3766 3256 510 1189 0
inf 0
kmem-00064 128 6945586 0 6922587 27679 26212 1467 5814 0
inf 0
kmem-00128 192 4411922 0 4378652 23929 21347 2582 7658 0
inf 0
kmem-00192 256 3737248 0 3729453 40482 39292 1190 9243 0
inf 0
kmem-00256 320 2644706 0 2641925 21832 21462 370 2495 0
inf 0
kmem-00320 384 75860 0 71438 507 5 502 507 0
inf 0
kmem-00384 448 4936259 0 4919108 176119 174123 1996 9637 0
inf 0
kmem-00448 512 31893 0 30949 240 70 170 230 0
inf 0
kmem-00512 576 17429 0 16819 134 6 128 134 0
inf 0
kmem-00768 832 56191 0 44784 3372 515 2857 2865 0
inf 0
kmem-01024 1088 231485 0 195622 15212 3216 11996 12993 0
inf 0
kmem-02048 2112 510788 0 493001 225514 207725 17789 29465 0
inf 2
kmem-04096 4096 47753 0 47020 7331 6595 736 1483 0
inf 3
ksiginfo 136 62868 0 62865 165 164 1 14 0
inf 0
ktrace 128 1165 0 1165 38 38 0 37 0
inf 0
kva-12288 12288 1918 0 1901 4 1 3 4 0 inf 0
kva-16384 16384 630073 2404 564606 6162 2067 4095 4095 0
inf 0
kva-20480 20480 766 0 730 16 12 4 7 0 inf 0
kva-24576 24576 37 0 2 4 0 4 4 0 inf 0
kva-28672 28672 519 0 496 24 21 3 7 0 inf 0
kva-32768 32768 332243 130 292975 18232 13314 4918 4919 0
inf 0
kva-36864 36864 269 0 3 39 1 38 39 0
inf 0
kva-49152 49152 4 0 2 1 0 1 1 0 inf 0
kva-65536 65536 450540 38 413939 56288 47120 9168 14358 0
inf 0
kva-8192 8192 365573 9 246580 4797 1076 3721 3722 0
inf 0
llentrypl 280 1052 0 1039 2 1 1 2 0 inf 0
lockf 112 12985 0 12920 8 2 6 8 0 inf 0
lwppl 1088 18321 0 17038 585 127 458 567 0
inf 0
mbpl 520 1066408 0 1064010 2051 1635 416 580 0
inf 0
mclpl 2112 661475 0 659893 92254 90656 1598 2471 0
2094276 16
metaslab_alloc_ 72 1416870 0 1416870 6925 6925 0 23 0
inf 0
mutex 64 23895026 0 23744290 7072 4672 2400 3522 0
inf 0
namecache 192 20339689 0 20189973 10680 3541 7139 7161 0
inf 0
nfsnodepl 280 4 0 0 1 0 1 1 0 inf 0
nfsvapl 184 4 0 0 1 0 1 1 0 inf 0
npfcn4pl 144 14500 0 14493 238 237 1 100 0
inf 0
npfcn6pl 192 735 0 735 384 384 0 4 0 inf 0
npftblpl 48 2 0 0 1 0 1 1 0 inf 0
pcache 2752 208 0 4 204 0 204 204 0
inf 0
pcachecpu 128 6541 0 0 211 0 211 211 0
inf 0
pcglarge 1088 1517560 0 1517544 120376 120367 9 2593 0
inf 1
pcgnormal 320 48193604 0 48193514 367200 367189 11 5892 0
inf 0
pdict16 80 630 0 566 2 0 2 2 0 inf 0
pdict32 96 15 0 2 1 0 1 1 0 inf 0
pdppl 4096 11260 0 10902 5538 5178 360 374 0
inf 2
phpool-128 72 3766 0 3256 26 4 22 22 0
inf 0
tmpfs_node 232 38115 0 37964 57 46 11 57 0
inf 0
tstile 128 18321 0 17038 55 0 55 55 0
inf 0
uaoeltpl 104 1106 0 76 29 0 29 29 0
inf 0
uarea 24576 11079 0 10338 5043 4300 743 860 0
inf 2
uareasys 24576 8912 0 8370 6692 6150 542 1122 0
inf 0
ufsdir 272 1705 0 1704 629 628 1 2 0 inf 0
ufsdq 88 58 0 28 1 0 1 1 0 inf 0
vcachepl 640 23829477 0 23679536 139899 114898 25001 36871 0
inf 0
vmembt 64 3048084 0 2701999 6422 0 6422 6422 0
inf 0
vmmpepl 192 4391031 0 4332352 4595 1781 2814 2903 0
inf 9
vmsppl 352 11179 0 10822 41 7 34 34 0
inf 0
vndxpl 288 3081 0 3081 50 50 0 1 0 inf 0
wapbldealloc 40 4494 0 4400 366 365 1 2 0 inf 0
wapblentrypl 48 13636 0 13636 197 197 0 1 0 inf 0
wapblinopl 40 14138 0 14135 1 0 1 1 0 inf 0
xhcixfer 320 7 0 3 1 0 1 1 0 inf 0
xhcixfer 320 15 0 3 2 0 2 2 0 inf 0
xhcixfer 320 5 0 3 1 0 1 1 0 inf 0
zfs_znode_cache 248 4064949 0 4064639 82052 81955 97 8726 0
inf 0
zil_lwb_cache 208 14905 0 14874 259 257 2 45 0
inf 0
zio_buf_1024 1536 647135 1 464116 157658 66120 91538 98121 0
inf 0
zio_buf_10240 12288 92448 7 87488 32867 27907 4960 12109 0
inf 0
zio_buf_114688 118784 15195 1 15195 6536 6536 0 330 0
inf 0
zio_buf_12288 14336 87236 12 86034 28051 26849 1202 5257 0
inf 0
zio_buf_131072 131072 570625 14 570368 69254 68997 257 1072 0
inf 0
zio_buf_14336 16384 68628 10 67743 27309 26424 885 10181 0
inf 0
zio_buf_1536 2048 496380 2 371712 86587 24202 62385 63619 0
inf 0
zio_buf_16384 16384 989387 1571 986806 358824 356243 2581 13831 0
inf 0
zio_buf_2048 2560 576027 2 479449 245068 148490 96578 97788 0
inf 0
zio_buf_20480 24576 83274 33 82470 24472 23668 804 3309 0
inf 0
zio_buf_24576 28672 83183 39 82399 20161 19377 784 1065 0
inf 0
zio_buf_2560 3072 372835 3 286967 167567 81699 85868 109667 0
inf 0
zio_buf_28672 32768 61214 22 60860 18234 17880 354 615 0
inf 0
zio_buf_3072 3584 310332 9 155587 193755 39010 154745 155714 0
inf 0
zio_buf_32768 32768 57565 51 57206 17773 17414 359 660 0
inf 0
zio_buf_3584 4096 419924 3 189075 275481 44632 230849 232440 0
inf 0
zio_buf_4096 4096 570671 108 498494 200689 128512 72177 75547 0
inf 0
zio_buf_40960 45056 70018 18 69620 18892 18494 398 645 0
inf 0
zio_buf_49152 53248 63271 35 53681 23738 14148 9590 9749 0
inf 0
zio_buf_512 1024 6873852 0 6191358 434084 243580 190504 222715 0
inf 0
zio_buf_5120 6144 179047 20 170924 55403 47280 8123 12460 0
inf 0
zio_buf_57344 61440 50685 7 50391 16366 16072 294 585 0
inf 0
zio_buf_6144 7168 100309 11 95804 27781 23276 4505 6375 0
inf 0
zio_buf_512 1024 6873852 0 6191358 434084 243580 190504 222715 0
inf 0
zio_buf_5120 6144 179047 20 170924 55403 47280 8123 12460 0
inf 0
zio_buf_57344 61440 50685 7 50391 16366 16072 294 585 0
inf 0
zio_buf_6144 7168 100309 11 95804 27781 23276 4505 6375 0
inf 0
zio_buf_65536 65536 1639850 7 1639850 84010 84010 0 741 0
inf 0
zio_buf_7168 8192 100042 13 89334 32608 21900 10708 11389 0
inf 0
zio_buf_8192 8192 100777 12 91716 37259 28198 9061 9568 0
inf 0
zio_buf_81920 86016 24692 0 24692 8580 8580 0 270 0
inf 0
zio_buf_98304 102400 15669 0 15669 6950 6950 0 320 0
inf 0
zio_cache 992 3890686 0 3890594 90299 90247 52 1247 0
inf 0
zio_data_buf_10 1536 320653 0 279563 128878 108271 20607 20664 0
inf 0
zio_data_buf_10 12288 109129 0 88203 64760 43834 20926 20938 0
inf 0
zio_data_buf_11 118784 65455 0 64648 38245 37438 807 4384 0
inf 0
zio_data_buf_12 14336 89334 0 74479 51705 36850 14855 14866 0
inf 0
zio_data_buf_13 131072 2460355 0 2394583 667611 601839 65772 118796 0
inf 0
zio_data_buf_14 16384 73563 0 62210 42336 30983 11353 11365 0
inf 0
zio_data_buf_15 2048 199308 0 151679 76082 52267 23815 23815 0
inf 0
zio_data_buf_16 16384 62453 0 53757 33598 24902 8696 8713 0
inf 0
zio_data_buf_20 2560 172828 0 117171 133365 77708 55657 55661 0
inf 0
zio_data_buf_20 24576 115344 0 101825 74640 61121 13519 13530 0
inf 0
zio_data_buf_24 28672 120288 0 109807 85262 74781 10481 10517 0
inf 0
zio_data_buf_25 3072 135280 0 91557 100274 56551 43723 43726 0
inf 0
zio_data_buf_28 32768 84945 0 77602 55752 48409 7343 7353 0
inf 0
zio_data_buf_30 3584 106880 0 73745 75474 42339 33135 33139 0
inf 0
zio_data_buf_32 32768 82947 0 77325 55995 50373 5622 19870 0
inf 0
zio_data_buf_35 4096 91374 0 65481 64707 38814 25893 25896 0
inf 0
zio_data_buf_40 4096 77072 0 56626 52575 32129 20446 20446 0
inf 0
zio_data_buf_40 45056 152006 0 143329 110362 101685 8677 32285 0
inf 0
zio_data_buf_49 53248 114182 0 106732 75836 68386 7450 10019 0
inf 0
zio_data_buf_51 1024 807255 0 730101 169098 149800 19298 19298 0
inf 0
zio_data_buf_51 6144 118021 0 86095 81130 49204 31926 31928 0
inf 0
zio_data_buf_57 61440 101030 0 94940 71166 65076 6090 12156 0
inf 0
zio_data_buf_61 7168 97202 0 73880 63247 39925 23322 23330 0
inf 0
zio_data_buf_65 65536 116590 0 112490 92774 88674 4100 24211 0
inf 0
zio_data_buf_71 8192 79791 0 62525 47807 30541 17266 17276 0
inf 0
zio_data_buf_81 8192 72922 0 58911 41948 27937 14011 14017 0
inf 0
zio_data_buf_81 86016 104931 0 101590 67907 64566 3341 12569 0
inf 0
zio_data_buf_98 102400 73099 0 70443 41308 38652 2656 8877 0
inf 0
zio_link_cache 56 4359198 0 4359180 4159 4153 6 73 0
inf 0
Totals 2611133762 5065 2597562150 9387208 7128911 2258297
In use 26266313K, total allocated 34255628K; utilization 76.7%
On 05/04/22 17:50, Chuck Silvers wrote:
> The following reply was made to PR kern/55707; it has been noted by GNATS.
>
> From: "Chuck Silvers" <chs%netbsd.org@localhost>
> To: gnats-bugs%gnats.NetBSD.org@localhost
> Cc:
> Subject: PR/55707 CVS commit: src/external/cddl/osnet/dist/uts/common/fs/zfs
> Date: Wed, 4 May 2022 15:49:55 +0000
>
> Module Name: src
> Committed By: chs
> Date: Wed May 4 15:49:55 UTC 2022
>
> Modified Files:
> src/external/cddl/osnet/dist/uts/common/fs/zfs: arc.c
>
> Log Message:
> fix ARC checks for available memory:
> there's an extra check that we inherited from FreeBSD that tries to
> detect KVA exhaustion on platforms with limited KVA, but the condition
> that decided whether to use the extra check was using a FreeBSDism
> that doesn't exist on NetBSD, resulting in this check being used on
> all platforms. on amd64 systems with lots of memory, this extra check
> would result in the ARC thinking that it constantly needed to reclaim memory,
> resulting in all the xcall threads running all the time but not doing
> anything useful. change this condition so that this extra check for
> KVA exhaustion is only used on 32-bit platforms. fixes PR 55707.
>
>
> To generate a diff of this commit:
> cvs rdiff -u -r1.20 -r1.21 \
> src/external/cddl/osnet/dist/uts/common/fs/zfs/arc.c
>
> Please note that diffs are not public domain; they are subject to the
> copyright notices on the relevant files.
>
Home |
Main Index |
Thread Index |
Old Index