Subject: More on kernel hangs -- gcc
To: None <port-sgimips@netbsd.org>
From: sgimips NetBSD list <sgimips@mrynet.com>
List: port-sgimips
Date: 02/16/2002 10:28:51
I'm now realising that the hangs I'm experiencing on my INDYs are
provoked more when building profiled libraries.

I've captured the following trace from the debugger--perhaps this
will offer up some suggestion to someone about the cause.  A kernel
namelist is available upon request (95k).

Considering the infancy of the sgimips port, and the problems I'm
having just getting a build completed for a release snapshot, I
think I'll go back to building without profiled libraries (editorial
about providing profiled libraries by default ommitted :).

-scott

mod80 (14)#    			<--- NetBSD hung -- no ICMP response
telnet> send break		<--- Break to the terminal server

MRYConSrv 19> send brk		<--- Send a break to the INDY
MRYConSrv 19> fg		

Stopped in pid 364 (cc1) at     cpu_Debugger+0x4:       jr      ra
                bdslot: nop
db> trace
cpu_Debugger+4 (100,bfbd9830,0,10) ra 88187024 sz 0
88186f54+d0 (100,bfbd9830,0,10) ra 881888b0 sz 48
zsc_intr_hard+114 (100,bfbd9830,0,10) ra 88187d14 sz 32
88187cb0+64 (100,bfbd9830,0,10) ra 88189a20 sz 40
ip22_mappable_intr+cc (100,bfbd9830,0,10) ra 88189c20 sz 48
ip22_local1_intr+b0 (100,bfbd9830,0,10) ra 881898c0 sz 48
ip22_intr+d0 (100,bfbd9830,0,10) ra 8818d570 sz 64
cpu_intr+48 (100,bfbd9830,0,10) ra 8806a208 sz 32
mips3_KernIntr+84 (7fff805e,37d59e,0,37d59e) ra 8817ed1c sz 128
pmap_enter+6ac (7fff805e,37d59e,0,37d59e) ra 88165c3c sz 80
uvm_fault+c58 (88cb5d48,7fff8000,0,2) ra 88181360 sz 280
trap+4e4 (2000ff13,20c,0,2) ra 88069ec4 sz 72
mips3_UserGenException+cc (2000ff13,20c,0,5f7ffc) ra 0 sz 0
User-level: pid 364
db> ps
 PID             PPID       PGRP        UID S   FLAGS          COMMAND    WAIT
>364              362        236          0 7  0x4006              cc1
 362              361        236          0 3  0x4086 mipseb--netbsd-g    wait
 361              236        236          0 3  0x4086               sh    wait
 236              202        236          0 3  0x4086             make    wait
 202              201        202          0 3  0x4086              csh   pause
 201              187        187          0 3    0x84             sshd  select
 200                1        200          0 3  0x4086              csh   ttyin
 198                1        198          0 3    0x84             cron nanosle
 194                1        194          0 3    0x84            inetd  select
 187                1        187          0 3    0x84             sshd  select
 147                1        142          0 3    0x84             nfsd    nfsd
 146                1        142          0 3    0x84             nfsd    nfsd
 145                1        142          0 3    0x84             nfsd    nfsd
 144                1        142          0 3    0x84             nfsd    nfsd
 133                1        133          0 3    0x84           mountd  select
 107                0          0          0 3 0x20284            nfsio  nfsidl
 106                0          0          0 3 0x20284            nfsio  nfsidl
 105                0          0          0 3 0x20284            nfsio  nfsidl
 104                0          0          0 3 0x20284            nfsio  nfsidl
 89                 1         89          0 3    0x84          rpcbind  select
 77                 1         77          0 3    0x84          syslogd  select
 6                  0          0          0 3 0x20204         aiodoned aiodone
 5                  0          0          0 3 0x20204          ioflush  syncer
 4                  0          0          0 3 0x20204           reaper  reaper
 3                  0          0          0 3 0x20204       pagedaemon pgdaemo
 2                  0          0          0 3 0x20204          wdsc0:0  sccomp
 1                  0          1          0 3  0x4084             init    wait
 0                 -1          0          0 3 0x20204          swapper schedul
db> callout
bucket 9 (hint c409):
0x881ed5e0: time c409 arg 0x0 flags 3 func 0x880d82e4: if_slowtimo
0x881cefb8: time c409 arg 0x0 flags 3 func 0x88091a1c: schedcpu
bucket 10 (hint c40a):
0x881ec7b0: time c40a arg 0x0 flags 3 func 0x880ad45c: pfslowtimo
bucket 56 (hint c438):
0x88cb0818: time c438 arg 0x88cb07a0 flags 3 func 0x88092114: endtsleep
bucket 207 (hint cccf):
0x8aa5fbf8: time cccf arg 0x8aa5fb80 flags 3 func 0x88092114: endtsleep
bucket 228 (hint 10ce4):
0x881eda80: time 10ce4 arg 0x0 flags 3 func 0x880e0b7c: arp_drain+0x124
bucket 266 (hint bbd0a):
0x8a486588: time bbd0a arg 0x8a486540 flags 3 func 0x880f8418: tcp_timer_keep
bucket 409 (hint 5a999):
0x8aa5fa40: time 5a999 arg 0x8aa5f998 flags 3 func 0x880973c0: realitexpire
bucket 752 (hint d2f0):
0xc00404b8: time d2f0 arg 0xc0040400 flags 3 func 0x881a640c: wd33c93_watchdog
bucket 999 (hint c3e7):
0x881cff78: time c3e7 arg 0x0 flags 3 func 0x8811bed8: nfs_timer
bucket 1014 (hint c3f6):
0x881ec790: time c3f6 arg 0x0 flags 3 func 0x880ad524: pffasttimo
db> reboot
syncing disks... 1 1 done
unmounting /sgimips (mod2:/mondo/sgimips)...
unmounting /ousr (/dev/sd1g)...
unmounting /work (/dev/sd2g)...
unmounting /image (/dev/sd2f)...
unmounting /tmp (/dev/sd3e)...
unmounting /usr (/dev/sd3g)...
unmounting /var (/dev/sd3f)...
unmounting / (/dev/sd3a)...
setclock: 2002/2/16/16/10/47
rebooting...


The particular compilation that hung NetBSD this time was:

/sgimips/src/tools/obj/tools.NetBSD-1.5Z-mipseb/bin/mipseb--netbsd-gcc -O2   -Werror  -Dlibcrypto -I.  -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto -DOPENSSLDIR=\"/etc/openssl\" -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/asn1 -DBF_PTR -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/bf -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/bio -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/bn -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/buffer -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/cast -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/comp -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/conf -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto -DDES_UNROLL -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/des -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/dh -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/dsa -I/usr/src/lib/libcrypto/../../c!
 rypto/dist/openssl/crypto/dso -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/err -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/evp -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/hmac -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/lhash -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/md2 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/md4 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/md5 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/mdc2 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/objects -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/pem -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/pkcs12 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/pkcs7 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/rand -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/rc2 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/rc4 -I/usr/src/lib!
 /libcrypto/../../crypto/dist/openssl/crypto/ripemd -I/usr/src/lib/libc
rypto/../../crypto/dist/openssl/crypto/rsa -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/sha -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/stack -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/txt_db -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/x509 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/x509v3 -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/idea -I/usr/src/lib/libcrypto/../../crypto/dist/openssl/crypto/rc5 -nostdinc -isystem /sgimips/dist/usr/include  -c -pg /sgimips/src/lib/libcrypto/../../crypto/dist/openssl/crypto/pkcs12/p12_attr.c -o p12_attr.po

And, yes, I'm using a 1.5Z kernel build December 2 -- The 1.5ZA kernel 
hangs much more frequently, and on more than just .po's..