Subject: Re: server locking up
To: Juergen Hannken-Illjes <hannken@eis.cs.tu-bs.de>
From: Mark Davies <mark@mcs.vuw.ac.nz>
List: current-users
Date: 07/07/2006 09:57:16
On Friday 07 July 2006 04:28, Juergen Hannken-Illjes wrote:
> Looks like an "out of memory situation". WCHAN == "temp" is waiting for
> memory (malloc type M_TEMP) to become available. What gives
> `vmstat -N /netbsd -M core -s' for "pages free"?
37893 pages free
> Do you use tempfs?
no. (/tmp is mfs).
The machine did it again last night so here is the pages free and ps for that
core:
2554 pages free
UID PID PPID CPU PRI NI VSZ RSS WCHAN STAT TTY TIME COMMAND
0 0 0 0 -18 0 0 0 schedule RWKs ? 0:00.00 [swapper]
0 1 0 0 10 0 68 0 wait RWs ? 0:00.00 init
0 2 0 0 14 0 0 0 crypto_w RWK ? 0:00.00
[cryptoret
0 3 0 0 -6 0 0 0 sccomp RWK ? 0:00.00
[scsibus0]
0 4 0 0 -6 0 0 0 sccomp RWK ? 0:00.00
[scsibus1]
0 5 0 0 10 0 0 0 usbevt RWK ? 0:00.00 [usb0]
0 6 0 0 10 0 0 0 usbtsk RWK ? 0:00.00 [usbtask]
0 7 0 0 -6 0 0 0 atath RWK ? 0:00.00 [atabus0]
0 8 0 0 -6 0 0 0 atath RWK ? 0:00.00 [atabus1]
0 9 0 0 10 0 0 0 pmsreset RWK ? 0:00.00 [pms0]
0 10 0 0 -6 0 0 0 sccomp RWK ? 0:00.00
[atapibus0
0 11 0 0 -18 0 0 0 pgdaemon RWK ? 0:00.00
[pagedaemo
0 12 0 0 18 0 0 0 syncer RWK ? 0:00.00 [ioflush]
0 13 0 0 -18 0 0 0 - RWK ? 0:00.00
[aiodoned]
0 50 0 0 -6 0 0 0 physiod RWK ? 0:00.00 [physiod]
0 146 0 0 2 0 52 0 nfsd RWL ? 0:00.00 (nfsd)
0 160 0 0 2 0 52 0 nfsd RWL ? 0:00.00 ssh -e
non
0 161 0 0 -20 0 52 0 temp RWL ? 0:00.00 (nfsd)
0 162 0 0 -20 0 52 0 temp RWL ? 0:00.00 (nfsd)
0 163 0 0 2 0 52 0 nfsd RWL ? 0:00.00 (nfsd)
0 164 0 0 2 0 52 0 nfsd RWL ? 0:00.00 nfsd:
mast
0 167 0 0 2 0 52 0 nfsd RWL ? 0:00.00 nfsd:
serv
0 168 0 0 -2 0 52 0 vnlock RWL ? 0:00.00 nfsd:
serv
0 169 0 0 -2 0 52 0 vnlock RWL ? 0:00.00 (nfsd)
0 170 0 0 2 0 52 0 nfsd RWL ? 0:00.00 (nfsd)
0 171 0 0 -20 0 52 0 temp RWL ? 0:00.00 (nfsd)
0 172 0 0 2 0 52 0 nfsd RWL ? 0:00.00 (nfsd)
0 376 0 0 10 0 0 0 nfsidl RWK ? 0:00.00 [nfsio]
0 399 0 0 2 0 184 0 - RWs ? 0:00.00 (syslogd)
0 442 0 0 2 0 340 0 poll RWs ? 0:00.00 (rpcbind)
0 444 0 0 18 0 7924 0 sigwait RWsa ? 0:00.00 (named)
0 447 0 0 2 0 172 0 poll RWs ? 0:00.00 (nfsd)
0 473 0 0 10 0 220 0 mfsidl RWs ? 0:00.00
(mount_mfs
0 474 0 0 2 0 608 0 select RWs ?
0:00.00 /usr/sbin/
0 510 0 0 2 0 632 0 select RWs ?
0:00.00 /usr/sbin/
0 529 0 0 -22 0 0 0 actwat RWK ? 0:00.00
[acctwatch
0 560 0 0 10 0 0 0 nfsidl RWK ? 0:00.00 [nfsio]
0 563 0 0 10 0 0 0 nfsidl RWK ? 0:00.00 [nfsio]
0 565 0 0 10 0 0 0 nfsidl RWK ? 0:00.00 [nfsio]
0 594 0 0 2 0 440 0 select RWs ? 0:00.00 (sshd)
0 598 0 0 2 0 52 0 nfsd RWL ? 0:00.00 (nfsd)
0 613 0 0 2 0 508 0 select RW ? 0:00.00 (afpd)
0 635 0 0 -20 0 52 0 temp RWL ? 0:00.00 (nfsd)
0 656 0 0 2 0 52 0 nfsd RWL ? 0:00.00 (nfsd)
0 659 0 0 2 0 216 0 select RWs ? 0:00.00
(rpc.statd
0 661 0 0 2 0 224 0 select RWs ? 0:00.00
(rpc.lockd
0 664 0 1207 2 0 304 0 select RWs ? 20:07.00 (sshd)
0 689 0 0 2 0 52 0 nfsd RWL ? 0:00.00 (nfsd)
0 695 0 0 18 0 1052 0 pause RWs ? 0:00.00 (ntpd)
0 860 0 61381 2 0 72 0 select RWs ? 1023:01.06
(mntauthd)
0 919 0 49642 18 0 3120 0 pause RW ? 827:22.05 (smbd)
0 957 0 1935 2 0 3132 0 select RWs ? 32:15.00 (smbd)
0 980 0 0 2 0 1064 0 select RWs ? 0:00.00 (nmbd)
0 1051 0 0 10 0 232 0 nanoslee RWs ? 0:00.00 (cron)
0 1076 0 0 2 0 208 0 kqread RWs ? 0:00.00 (inetd)
0 7752 0 0 2 0 4684 0 select RW ? 0:00.00 (smbd)
0 8479 0 0 2 0 440 0 select RWs ? 0:00.00 (sshd)
0 15340 0 0 2 0 440 0 select RWs ? 0:00.00 (sshd)
0 22082 0 0 10 0 148 0 ppwait RWs ? 0:00.00 (sh)
0 23243 0 0 -20 0 148 0 temp RWV ? 0:00.00 (sh)
0 25253 0 0 2 0 248 0 piperd RW ? 0:00.00 (cron)
0 28157 0 0 2 0 440 0 select RWs ? 0:00.00 (sshd)
0 1109 0 0 3 0 1240 0 ttyin RWs+ ttyp0 0:00.00 (tcsh)
0 1133 0 0 10 0 156 0 ppwait RW ttyp0 0:00.00 (sh)
0 23901 0 0 -20 0 156 0 temp RWV ttyp0 0:00.00 (sh)
1111 15595 0 1972 18 0 1172 0 pause RWs ttyp1 32:52.00 (tcsh)
0 16441 0 0 3 0 1172 0 ttyin RW+ ttyp1 0:00.00 (tcsh)
0 29002 0 0 10 0 64 0 - TW ttyp2 0:00.00 (man)
0 29044 0 0 3 0 1348 0 ttyin RWs+ ttyp2 0:00.00 (tcsh)
0 29153 0 0 10 0 152 0 - TW ttyp2 0:00.00 (sh)
0 29240 0 0 28 0 180 0 - TW ttyp2 0:00.00 (more)
1002 12726 0 0 3 0 1336 0 ttyin RWs+ ttyp3 0:00.00 (tcsh)
0 1007 0 50966 3 0 52 0 ttyin RWs+ ttyE0 849:26.05 (getty)
cheers
mark