NetBSD-Bugs archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: kern/22646 (Panic in ohci_add_done())



The following reply was made to PR kern/22646; it has been noted by GNATS.

From: Andreas Gustafsson <gson%gson.org@localhost>
To: Nick Hudson <skrll%netbsd.org@localhost>
Cc: gnats-bugs%NetBSD.org@localhost
Subject: Re: kern/22646 (Panic in ohci_add_done())
Date: Sun, 24 Apr 2016 12:42:20 +0300

 Nick Hudson wrote:
 > Can you generate usbhist logs with a OHCI_DEBUG kernel and
 > 
 >      sysctl -w hw.ohci.debug=10
 > 
 > You can extract the logs using
 > 
 >      vmstat -u usbhist
 
 For clarity, I'm providing the information you requested in the order
 it was produced rather than the order it was requested, so the usbhist
 data will be at the end.  First, a backtrace from the hung OCHI_DEBUG
 kernel:
 
 db{0}> bt
 breakpoint() at netbsd:breakpoint+0x5
 comintr() at netbsd:comintr+0x59a
 Xintr_ioapic_edge9() at netbsd:Xintr_ioapic_edge9+0xea
 --- interrupt ---
 bus_space_read_4() at netbsd:bus_space_read_4+0xa
 bintime() at netbsd:bintime+0x11
 microtime() at netbsd:microtime+0x15
 ohci_softintr() at netbsd:ohci_softintr+0x7a8
 usb_soft_intr() at netbsd:usb_soft_intr+0x1f
 softint_dispatch() at netbsd:softint_dispatch+0xd3
 DDB lost frame for netbsd:Xsoftintr+0x4f, trying 0xfffffe8044f4eff0
 Xsoftintr() at netbsd:Xsoftintr+0x4f
 --- interrupt ---
 
 > ps/w output as well please
 
 db{0}> ps
 PID    LID S CPU     FLAGS       STRUCT LWP *               NAME WAIT
 275      1 3   2   1000000   fffffe8046788420            gphoto2 usbxfer
 74       1 3   2        80   fffffe80465ed360                 sh wait
 41       1 3   2        80   fffffe80465edba0                 sh wait
 612      1 3   3        80   fffffe8046363760              getty ttyraw
 622      1 3   0        80   fffffe8046162320              getty ttyraw
 573      1 3   1        80   fffffe8046363b80              getty ttyraw
 623      1 3   2        80   fffffe8045e57200              login wait
 601      1 3   1        80   fffffe80ab2864c0               cron nanoslp
 582      1 3   1        80   fffffe80ab485900              inetd kqueue
 561      1 3   0        80   fffffe80ad69b060               qmgr kqueue
 566      1 3   2        80   fffffe80ad69b480             pickup kqueue
 575      1 3   2        80   fffffe80ab2860a0             master kqueue
 357      1 3   0        80   fffffe80ada2d040               sshd select
 343      1 3   1        80   fffffe80ada2d880             powerd kqueue
 180      1 2   2         0   fffffe8046788000            syslogd
 1        1 3   2        80   fffffe8045f3aae0               init wait
 0       87 3   2       200   fffffe8045fdc720            physiod physiod
 0       86 3   3       200   fffffe8046162740           aiodoned aiodoned
 0       85 3   3       200   fffffe8046162b60            ioflush syncer
 0       84 3   3       200   fffffe8045fdc300           pgdaemon pgdaemon
 0       81 3   3       200   fffffe8045fdcb40          atapibus0 sccomp
 0       78 3   3       200   fffffe8045e19a80              usb12 usbevt
 0       77 3   3       200   fffffe8045e98a60              usb13 usbevt
 0       76 3   3       200   fffffe8045e98220              usb11 usbevt
 0       75 3   3       200   fffffe8045e57620               usb8 usbevt
 0       74 3   3       200   fffffe8045e57a40              usb10 usbevt
 0       73 3   3       200   fffffe8045e98640               usb9 tstile
 0       72 3   3       200   fffffe8045edb2e0               usb4 usbevt
 0       71 3   1       200   fffffe8045edb700               usb5 usbevt
 0       70 3   1       200   fffffe8045edbb20               usb6 usbevt
 0       69 3   1       200   fffffe8045f0d2c0               usb7 usbevt
 0       68 3   0       200   fffffe8045f0d6e0               usb3 usbevt
 0       67 3   1       200   fffffe8045f0db00               usb1 usbevt
 0       66 3   0       200   fffffe8045f3a2a0               usb0 usbevt
 0       65 3   0       200   fffffe8045f3a6c0               usb2 usbevt
 0       64 3   3       200   fffffe8045ede280              unpgc unpgc
 0       63 3   3       200   fffffe8045ede6a0        vmem_rehash vmem_rehash
 0       62 3   3       200   fffffe8045edeac0          coretemp3 coretemp3
 0       61 3   2       200   fffffe8045e9c260          coretemp2 coretemp2
 0       60 3   0       200   fffffe8045e9c680          coretemp1 coretemp1
 0       59 3   1       200   fffffe8045e9caa0          coretemp0 coretemp0
 0       58 3   2       200   fffffe8045e19240              aibs0 aibs0
 0       49 3   2       200   fffffe8045e361e0            atabus6 atath
 0       48 3   1       200   fffffe8045e36600            atabus5 atath
 0       47 3   0       200   fffffe8045e36a20               iic0 iicintr
 0       46 3   3       200   fffffe80459f31c0            atabus4 atath
 0       45 3   0       200   fffffe80459f35e0            atabus3 atath
 0       44 3   1       280   fffffe80459f3a00           fw0probe ieee1394
 0       43 3   1       200   fffffe80457341a0            atabus2 atath
 0       42 3   0       200   fffffe80457345c0            atabus1 atath
 0       41 3   2       200   fffffe80457349e0            atabus0 atath
 0       40 3   0       200   fffffe804564f180         usbtask-dr usbtsk
 0       39 2   0       200   fffffe804564f5a0         usbtask-hc
 0       38 3   0       200   fffffe804564f9c0            intelfb intelfb
 0       37 3   0       200   fffffe8045040160               i915 i915
 0       36 3   3       200   fffffe8045040580            xcall/3 xcall
 0       35 1   3       200   fffffe80450409a0          softser/3
 0       34 1   3       200   fffffe8044fbe140          softclk/3
 0       33 1   3       200   fffffe8044fbe560          softbio/3
 0       32 1   3       200   fffffe8044fbe980          softnet/3
 0    >  31 7   3       201   fffffe8044ffd120             idle/3
 0       30 3   2       200   fffffe8044ffd540            xcall/2 xcall
 0       29 1   2       200   fffffe8044ffd960          softser/2
 0       28 1   2       200   fffffe8044ffb100          softclk/2
 0       27 1   2       200   fffffe8044ffb520          softbio/2
 0       26 1   2       200   fffffe8044ffb940          softnet/2
 0    >  25 7   2       201   fffffe8044fb30e0             idle/2
 0       24 3   1       200   fffffe8044fb3500            xcall/1 xcall
 0       23 1   1       200   fffffe8044fb3920          softser/1
 0       22 1   1       200   fffffe8044fb10c0          softclk/1
 0       21 1   1       200   fffffe8044fb14e0          softbio/1
 0       20 1   1       200   fffffe8044fb1900          softnet/1
 0    >  19 7   1       201   fffffe80ae63c0a0             idle/1
 0       18 3   0       200   fffffe80ae63c4c0           lnxsyswq lnxsyswq
 0       17 3   0       200   fffffe80ae63c8e0          cryptoret crypto_w
 0       16 3   0       200   fffffe80ae639080             sysmon smtaskq
 0       15 3   0       200   fffffe80ae6394a0         pmfsuspend pmfsuspend
 0       14 3   0       200   fffffe80ae6398c0           pmfevent pmfevent
 0       13 3   0       200   fffffe80aec53060         sopendfree sopendfr
 0       12 3   0       200   fffffe80aec53480           nfssilly nfssilly
 0       11 3   0       200   fffffe80aec538a0            cachegc cachegc
 0       10 3   0       200   fffffe80af260040              vrele vrele
 0        9 3   0       200   fffffe80af260460             vdrain vdrain
 0        8 3   0       200   fffffe80af260880          modunload mod_unld
 0        7 3   0       200   fffffe80af265020            xcall/0 xcall
 0        6 1   0       200   fffffe80af265440          softser/0
 0        5 1   0       200   fffffe80af265860          softclk/0
 0        4 1   0       200   fffffe80af272000          softbio/0
 0    >   3 7   0       200   fffffe80af272420          softnet/0
 0    >   2 7   0       201   fffffe80af272840             idle/0
 0        1 3   2       200   ffffffff812779e0            swapper uvm
 
 db{0}> ps/w
 PID   LID          COMMAND     EMUL  PRI WAIT-MSG    WAIT-CHANNEL
 275      1          gphoto2   netbsd   43 usbxfer      fffffe8045f8b720
 74       1               sh   netbsd   43 wait         fffffe804662b800
 41       1               sh   netbsd   43 wait         fffffe804662bd30
 612      1            getty   netbsd   43 ttyraw       fffffe80ae406950
 622      1            getty   netbsd   43 ttyraw       fffffe804658ca50
 573      1            getty   netbsd   43 ttyraw       fffffe80ae413a10
 623      1            login   netbsd   43 wait         fffffe8045eb2a90
 601      1             cron   netbsd   43 nanoslp      fffffe80ab2864c0
 582      1            inetd   netbsd   42 kqueue       fffffe80ade71770
 561      1             qmgr   netbsd   43 kqueue       fffffe80aba07280
 566      1           pickup   netbsd   43 kqueue       fffffe80ade714f0
 575      1           master   netbsd   43 kqueue       fffffe80ade71450
 357      1             sshd   netbsd   43 select       fffffe80af4d6b80
 343      1           powerd   netbsd   43 kqueue       fffffe80ae3996c8
 180      1          syslogd   netbsd   43              0
 1        1             init   netbsd   43 wait         fffffe8045eb2d28
 0       87           system   netbsd  123 physiod      fffffe8045ff6c08
 0       86           system   netbsd  125 aiodoned     fffffe8045ff6d08
 0       85           system   netbsd  124 syncer       fffffe8046162b60
 0       84           system   netbsd  126 pgdaemon     ffffffff817cacb4
 0       81           system   netbsd   96 sccomp       fffffe80457265b8
 0       78           system   netbsd   96 usbevt       ffff8000051c9450
 0       77           system   netbsd   96 usbevt       fffffe804580e490
 0       76           system   netbsd   96 usbevt       ffff8000051c7450
 0       75           system   netbsd   96 usbevt       ffff8000051c1450
 0       74           system   netbsd   96 usbevt       fffffe80457c8490
 0       73           system   netbsd   96 tstile       ffff8000051c34b8
 0       72           system   netbsd   96 usbevt       ffff8000051b9450
 0       71           system   netbsd   96 usbevt       ffff8000051bb450
 0       70           system   netbsd   96 usbevt       fffffe80457c2490
 0       69           system   netbsd   96 usbevt       ffff8000051bf450
 0       68           system   netbsd   96 usbevt       ffff8000051b7450
 0       67           system   netbsd   96 usbevt       ffff8000051b1450
 0       66           system   netbsd   96 usbevt       ffff8000051af450
 0       65           system   netbsd   96 usbevt       fffffe8045675490
 0       64           system   netbsd   96 unpgc        ffffffff8183e520
 0       63           system   netbsd  125 vmem_rehash  fffffe8045e21948
 0       62           system   netbsd   43 coretemp3    fffffe80459d2188
 0       61           system   netbsd   43 coretemp2    fffffe80459d2248
 0       60           system   netbsd   43 coretemp1    fffffe80459d2348
 0       59           system   netbsd   43 coretemp0    fffffe80459d2408
 0       58           system   netbsd   43 aibs0        fffffe80459d2508
 0       49           system   netbsd   96 atath        fffffe8045df75f0
 0       48           system   netbsd   96 atath        fffffe8045df7368
 0       47           system   netbsd   96 iicintr      fffffe80459d25a0
 0       46           system   netbsd   96 atath        fffffe8045a3c5f0
 0       45           system   netbsd   96 atath        fffffe8045a3c368
 0       44           system   netbsd   96 ieee1394     ffff8000061fc870
 0       43           system   netbsd   96 atath        fffffe80457265f0
 0       42           system   netbsd   96 atath        ffff8000061a68a0
 0       41           system   netbsd   96 atath        ffff8000061a6398
 0       40           system   netbsd   96 usbtsk       ffffffff81304ed8
 0       39           system   netbsd   96              0
 0       38           system   netbsd   43 intelfb      fffffe8045332cc8
 0       37           system   netbsd   43 i915         fffffe80af26a248
 0       36           system   netbsd  127 xcall        fffffe8044fda0d8
 0       35           system   netbsd  223              0
 0       34           system   netbsd  220              0
 0       33           system   netbsd  221              0
 0       32           system   netbsd  222              0
 0    >  31           system   netbsd    0              0
 0       30           system   netbsd  127 xcall        fffffe8044fb80d8
 0       29           system   netbsd  223              0
 0       28           system   netbsd  220              0
 0       27           system   netbsd  221              0
 0       26           system   netbsd  222              0
 0    >  25           system   netbsd    0              0
 0       24           system   netbsd  127 xcall        fffffe80ae62b0d8
 0       23           system   netbsd  223              0
 0       22           system   netbsd  220              0
 0       21           system   netbsd  221              0
 0       20           system   netbsd  222              0
 0    >  19           system   netbsd    0              0
 0       18           system   netbsd   43 lnxsyswq     fffffe80af26abc8
 0       17           system   netbsd   96 crypto_w     ffffffff817acfe0
 0       16           system   netbsd   96 smtaskq      ffffffff817ad880
 0       15           system   netbsd   43 pmfsuspend   fffffe80af26acc8
 0       14           system   netbsd   43 pmfevent     fffffe80af26ad88
 0       13           system   netbsd   96 sopendfr     ffffffff8183e490
 0       12           system   netbsd   43 nfssilly     fffffe80af26ae88
 0       11           system   netbsd  125 cachegc      fffffe80aec538a0
 0       10           system   netbsd  125 vrele        ffffffff812bb700
 0        9           system   netbsd  125 vdrain       ffffffff812bb7c0
 0        8           system   netbsd  125 mod_unld     ffffffff818301b0
 0        7           system   netbsd  127 xcall        ffffffff811f65d8
 0        6           system   netbsd  223              0
 0        5           system   netbsd  220              0
 0        4           system   netbsd  221              0
 0    >   3           system   netbsd  222              0
 0    >   2           system   netbsd    0              0
 0        1           system   netbsd  125 uvm          ffffffff812779e0
 db{0}>  
 
 > bt/a fffffe80ab6ec4e0
 
 In this run, gphoto2 is lwp fffffe8046788420:
 
 db{0}> bt/a fffffe8046788420
 trace: pid 275 lid 1 at 0xfffffe80463bc7d0
 sleepq_block() at netbsd:sleepq_block+0x97
 cv_wait() at netbsd:cv_wait+0xfb
 usbd_transfer() at netbsd:usbd_transfer+0x795
 usbd_do_request_flags() at netbsd:usbd_do_request_flags+0xd9
 usbd_get_string_desc() at netbsd:usbd_get_string_desc+0x83
 usbd_get_string0() at netbsd:usbd_get_string0+0x175
 usbd_devinfo_vp() at netbsd:usbd_devinfo_vp+0x12e
 usbd_fill_deviceinfo() at netbsd:usbd_fill_deviceinfo+0x64
 usbioctl() at netbsd:usbioctl+0x479
 cdev_ioctl() at netbsd:cdev_ioctl+0x88
 VOP_IOCTL() at netbsd:VOP_IOCTL+0x3b
 vn_ioctl() at netbsd:vn_ioctl+0xa6
 sys_ioctl() at netbsd:sys_ioctl+0x101
 syscall() at netbsd:syscall+0x15b
 --- syscall (number 54) ---
 7a96850e88fa:
 db{0}> 
 
 > > bt/a fffffe8045e49660
 
 In this run, usb9 is lwp fffffe8045e98640:
 
 db{0}> bt/a fffffe8045e98640
 trace: pid 0 lid 73 at 0xfffffe8045facda0
 sleepq_block() at netbsd:sleepq_block+0x97
 turnstile_block() at netbsd:turnstile_block+0x35c
 mutex_vector_enter() at netbsd:mutex_vector_enter+0x29c
 cv_timedwait() at netbsd:cv_timedwait+0x10e
 usb_event_thread() at netbsd:usb_event_thread+0x9d
 
 > (in fact  backtrace from all the "tstile"d lwps is probably best)
 
 That was the only lwp in tstile in this run.
 
 To get the usbhist data, I did:
 
 db{0}> reboot 0x100
 [...reboot and savecore...]
 # gunzip /var/crash/netbsd.3.*
 # vmstat -M /var/crash/netbsd.3.core -u usbhist >usbhist.txt
 
 The file usbhist.txt is too large to include here, but you can
 download it from
 
   http://www.gson.org/netbsd/bugs/22646/usbhist.txt
 
 -- 
 Andreas Gustafsson, gson%gson.org@localhost
 


Home | Main Index | Thread Index | Old Index