Subject: Re: #32287 Processes hang in "mclpl" - feedback
To: Christos Zoulas <christos@astron.com>
From: Jorgen Lundman <lundman@lundman.net>
List: netbsd-users
Date: 08/24/2006 09:38:56
Christos Zoulas wrote:
> In article <44EAEE0A.8010005@lundman.net>,
> Jorgen Lundman  <lundman@lundman.net> wrote:
> 
> Compile a kernel with options MBUFTRACE and then use netstat to check
> where the leak is.

Done, (and thanks Pavel, nice pre-emptive).

I should mention we have a rediculously large value for 
"net.inet.tcp.send|recv-space", which certainly decreases the frequency of the 
issue when set lower, albeit at a price in speed for those far away.

But I put on the trace kernel just incase there was a rare bug triggered in the 
interest of finding it. Normally it takes no more than a few hours for it to 
happen, but very annoyingly, after booting the trace kernel, it has not happened 
in 24 hours. Isn't that always the case.

The old familiar:
ex0: uplistptr was 0

.. showed up, which we used to get on the 1.6Z kernel.

Anyway, currently mbuf trace reports:



 
  Thu Aug 24 01:05:00 CEST 2006
65571 mbufs in use: 
         65500 mbufs allocated to data
         71 mbufs allocated to packet headers
4502 calls to protocol drain routines



                                              small        ext    cluster
            route               inuse             0          0          0
                                claims           19          0          0
                                releases         19          0          0
              arp               inuse             0          0          0
                                claims          165        120        120
                                releases        165        120        120
             unix               inuse             0          0          0
                                claims        96560       5524       3201
                                releases      96560       5524       3201
              tcp               inuse            69          0          0
                                claims       165020          0          0
                                releases     164951          0          0
              tcp rx            inuse           935        935        935
                                claims    145488314  145457621  145457621
                                releases  145487379  145456686  145456686
              tcp tx            inuse         63998      34110      34110
                                claims    926100542  447945504  447945504
                                releases  926036544  447911394  447911394
              udp               inuse             0          0          0
                                claims         8507          0          0
                                releases       8507          0          0
              udp rx            inuse             0          0          0
                                claims        22535      14955      14955
                                releases      22535      14955      14955
                                              small        ext    cluster
              udp tx            inuse             0          0          0
                                claims         8234          0          0
                                releases       8234          0          0
         internet rx            inuse             0          0          0
                                claims    145495134  145465256  145465256
                                releases  145495134  145465256  145465256
         internet tx            inuse             0          0          0
                                claims    209955061          2          2
                                releases  209955061          2          2
              lo0               inuse             0          0          0
                                claims        29882          0          0
                                releases      29882          0          0
              ex0 rx            inuse             0          0          0
                                claims    145465376  145465376  145465376
                                releases  145465376  145465376  145465376
              ex0 tx            inuse             0          0          0
                                claims    631659543  304594008  304594008
                                releases  631659543  304594008  304594008
          unknown data          inuse           128        128        128
                                claims    861719915  145465632  145465632
                                releases  861719787  145465504  145465504
          unknown header        inuse             0          0          0
                                claims    209950121          0          0
                                releases  209950121          0          0
                                              small        ext    cluster
          unknown soname        inuse             0          0          0
                                claims       181940          0          0
                                releases     181940          0          0
          unknown soopts        inuse             0          0          0
                                claims        31449          0          0
                                releases      31449          0          0
          unknown control       inuse             0          0          0
                                claims            4          0          0
                                releases          4          0          0





-- 
Jorgen Lundman       | <lundman@lundman.net>
Unix Administrator   | +81 (0)3 -5456-2687 ext 1017 (work)
Shibuya-ku, Tokyo    | +81 (0)90-5578-8500          (cell)
Japan                | +81 (0)3 -3375-1767          (home)