NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
kern/46822: NetBSD 5.1.2 seems to deadlock in the filesystem (or other kernel parts) "sometimes"
>Number: 46822
>Category: kern
>Synopsis: NetBSD 5.1.2 seems to deadlock in the filesystem (or other
>kernel parts) "sometimes"
>Confidential: no
>Severity: serious
>Priority: high
>Responsible: kern-bug-people
>State: open
>Class: sw-bug
>Submitter-Id: net
>Arrival-Date: Mon Aug 20 14:40:00 +0000 2012
>Originator: Wolfgang Stukenbrock
>Release: NetBSD 5.1.2
>Organization:
Dr. Nagler & Company GmbH
>Environment:
System: NetBSD e003 5.1.2 NetBSD 5.1.2 (NSW-E003) #28: Tue Apr 24 11:13:06 CEST
2012
wgstuken@s012:/export/NetBSD-5.1.2/N+C-build/.OBJDIR_amd64/export/NetBSD-5.1.2/src/sys/arch/amd64/compile/NSW-E003
amd64
Architecture: x86_64
Machine: amd64
>Description:
Our productive webserver locks up from time to time.
All the time I've had a look at it the backupsystem (amanda) and
"/etc/daily" are running.
This has happend 5 or 6 times till now - the system has been upgraded
to 5.1.2 in 04.2012.
The 4.0 system before does not show this behaviour.
(The following analyses - as far as I've been able to do it till now -
is very long. sorry.)
In order to track the problem, I've added 3 cron-jobs to monitor the
system state:
# some debugging - into /var/log/horde .....
0,30 * * * * vmstat -c 3 1 | logger -t vmstat -p
local1.info
1,31 * * * * /bin/ps -axwwo "uid pid ppid nlwp wchan
state time rsz vsz command" | logger -t ps -p local1.info
2,32 * * * * /bin/df -ak | logger -t df -p
local1.info
They have reported the following:
Aug 17 23:00:00 e003 vmstat: procs memory page
disks faults cpu
Aug 17 23:00:00 e003 vmstat: r b w avm fre flt re pi po fr sr
c0 w0 in sy cs us sy id
Aug 17 23:00:00 e003 vmstat: 0 0 0 2196352 168328 70 0 0 0 0 0
0 3 6 298 60 0 0 100
Aug 17 23:00:01 e003 vmstat: 0 0 0 2196380 168300 10 0 0 0 0 0
0 0 0 1032 77 0 0 100
Aug 17 23:00:02 e003 vmstat: 0 0 0 2196380 168300 0 0 0 0 0 0
0 0 0 37 30 0 0 100
Aug 17 23:01:00 e003 ps: UID PID PPID NLWP WCHAN STAT TIME RSZ
VSZ COMMAND
Aug 17 23:01:00 e003 ps: 0 0 0 45 - OKl 39:51.46 18996
0 [system]
Aug 17 23:01:00 e003 ps: 0 1 0 1 wait Is 0:00.01 1048
6520 init
Aug 17 23:01:00 e003 ps: 0 117 1 5 sigwait Isl 1:46.37 66956
98012 /usr/sbin/named -c /var/named/named.conf -4
Aug 17 23:01:00 e003 ps: 0 165 1 1 kqueue Ss 0:02.32 1068
6544 /usr/sbin/syslogd -s
Aug 17 23:01:00 e003 ps: 0 172 1 1 nanoslp Ss 0:09.05 968
6504 /usr/sbin/ipmon -Dps
Aug 17 23:01:00 e003 ps: 0 188 1 1 select Is 0:00.59 1292
6536 /usr/sbin/rpcbind -l
Aug 17 23:01:00 e003 ps: 0 201 1 1 select Ss 0:08.76 1144
5464 /usr/sbin/ypbind
Aug 17 23:01:00 e003 ps: 0 306 1 1 pause Ss 0:13.43 5420
11320 /usr/sbin/ntpd
Aug 17 23:01:00 e003 ps: 0 324 1 1 select Is 0:00.01 2080
24808 /usr/sbin/sshd
Aug 17 23:01:00 e003 ps: 500 332 21422 1 - O 0:00.00 932
6552 /bin/ps -axwwo uid pid ppid nlwp wchan state time rsz vsz command
Aug 17 23:01:00 e003 ps: 12 376 499 1 kqueue I 0:01.43 2536
12144 qmgr -l -t unix -u
Aug 17 23:01:00 e003 ps: 0 420 324 1 netio Is 0:00.02 4508
35760 sshd: wgstuken [priv]
Aug 17 23:01:00 e003 ps: 0 499 1 1 kqueue Is 0:02.52 2368
12028 /usr/libexec/postfix/master
Aug 17 23:01:00 e003 ps: 500 542 1 1 wait Is 0:00.00 796
4416 /etc/pkg/sbin/watch_server -b -p /var/run/nswSW.pid -c
/etc/pkg/watch-server.cfg
Aug 17 23:01:00 e003 ps: 500 547 542 1 select I 0:00.04 956
4416 /etc/pkg/sbin/watch_server -b -p /var/run/nswSW.pid -c
/etc/pkg/watch-server.cfg
Aug 17 23:01:00 e003 ps: 0 557 1 1 select Ss 0:06.05 17852
176944 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 0 593 1 1 kqueue Is 0:00.01 1544
7616 /usr/sbin/inetd -l
Aug 17 23:01:00 e003 ps: 1002 614 420 1 select I 0:00.15 3428
35760 sshd: wgstuken@ttyp0
Aug 17 23:01:00 e003 ps: 0 618 1 1 nanoslp Ss 0:01.64 1064
5468 /usr/sbin/cron
Aug 17 23:01:00 e003 ps: 0 951 1 3 select Ssl 0:02.78 6296
36080 /usr/pkg/sbin/bacula-fd -c /etc/pkg/bacula/bacula-fd.conf -g bacula
Aug 17 23:01:00 e003 ps: 1002 1042 1406 1 select I 0:00.63 3376
35760 sshd: wgstuken@ttyp1
Aug 17 23:01:00 e003 ps: 0 1406 324 1 netio Is 0:00.01 4588
35760 sshd: wgstuken [priv]
Aug 17 23:01:00 e003 ps: 1002 2074 3033 1 select I 0:00.00 3376
35760 sshd: wgstuken@ttyp3
Aug 17 23:01:00 e003 ps: 1002 2335 2361 1 select I 0:00.06 3376
35760 sshd: wgstuken@ttyp2
Aug 17 23:01:00 e003 ps: 1002 2351 2893 1 select I 0:00.00 3376
35760 sshd: wgstuken@ttyp4
Aug 17 23:01:00 e003 ps: 0 2361 324 1 netio Is 0:00.01 4592
35760 sshd: wgstuken [priv]
Aug 17 23:01:00 e003 ps: 0 2893 324 1 netio Is 0:00.01 4592
35760 sshd: wgstuken [priv]
Aug 17 23:01:00 e003 ps: 0 3033 324 1 netio Is 0:00.01 4592
35760 sshd: wgstuken [priv]
Aug 17 23:01:00 e003 ps: 500 3243 21422 1 piperd S 0:00.00 804
4328 logger -t ps -p local1.info
Aug 17 23:01:00 e003 ps: 802 4329 557 1 semwait I 0:01.02 9920
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 5917 557 1 semwait I 0:01.57 9964
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 0 7545 618 1 piperd S 0:00.00 1196
5468 cron: running job
Aug 17 23:01:00 e003 ps: 802 8912 557 1 semwait I 0:01.12 10072
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 13013 557 1 semwait I 0:00.98 9996
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 16832 557 1 semwait I 0:01.63 9960
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 20447 557 1 semwait I 0:01.77 9960
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 500 21422 7545 1 wait Ss 0:00.00 1140
6664 /bin/sh -c /bin/ps -axwwo "uid pid ppid nlwp wchan state time rsz vsz
command" | logger -t ps -p local1.info
Aug 17 23:01:00 e003 ps: 802 23366 557 1 semwait I 0:01.61 9932
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 23714 557 1 kqueue S 0:01.64 9976
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 24002 557 1 semwait I 0:01.64 10016
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 24217 557 1 socket I 0:00.00 4416
115164 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 12 24387 499 1 kqueue I 0:00.01 2468
12088 pickup -l -t fifo -u
Aug 17 23:01:00 e003 ps: 802 24699 557 1 semwait I 0:01.62 9932
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 25243 557 1 semwait I 0:01.55 9988
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 25291 557 1 semwait I 0:01.56 10004
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 25393 557 1 semwait I 0:01.60 9908
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 26115 557 1 semwait I 0:01.71 10104
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 28084 557 1 semwait I 0:01.62 9980
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 28773 557 1 semwait I 0:01.10 10064
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 802 29565 557 1 semwait I 0:00.45 9840
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:01:00 e003 ps: 1002 391 614 1 pause Is 0:00.01 1248
4508 -csh
Aug 17 23:01:00 e003 ps: 0 1243 391 1 ttyraw I+ 0:00.02 1272
4508 -csh -m
Aug 17 23:01:00 e003 ps: 0 1304 1535 1 ttyraw I+ 0:00.02 1272
4512 -csh -m
Aug 17 23:01:00 e003 ps: 1002 1535 1042 1 pause Is 0:00.00 1232
4508 -csh
Aug 17 23:01:00 e003 ps: 0 26675 1304 1 kqueue I 0:00.14 772
4336 tail -f /var/log/horde
Aug 17 23:01:00 e003 ps: 1002 1413 2335 1 pause Is 0:00.00 1276
4508 -csh
Aug 17 23:01:00 e003 ps: 0 1926 1413 1 ttyraw I+ 0:00.01 1232
4508 -csh -m
Aug 17 23:01:00 e003 ps: 0 1134 2934 1 ttyraw I+ 0:00.01 1204
4508 -csh -m
Aug 17 23:01:00 e003 ps: 1002 2934 2074 1 pause Is 0:00.00 1232
4508 -csh
Aug 17 23:01:00 e003 ps: 1002 1547 2351 1 pause Is 0:00.00 1232
4508 -csh
Aug 17 23:01:00 e003 ps: 0 3003 1547 1 ttyraw I+ 0:00.01 1204
4508 -csh -m
Aug 17 23:01:00 e003 ps: 0 552 1 1 wait I 0:00.00 1180
6664 /bin/sh /usr/pkg/bin/mysqld_safe --user=mysql --datadir=/var/mysql
--pid-file=/var/mysql/e003.pid --skip-thread-priority
Aug 17 23:01:00 e003 ps: 801 918 552 10 select Il 2:54.07 20044
82068 /usr/pkg/libexec/mysqld --basedir=/usr/pkg --datadir=/var/mysql
--user=mysql --skip-thread-priority --log-error=/var/mysql/e003.err
--pid-file=/var/mysql/e003.pid
Aug 17 23:01:00 e003 ps: 0 2122 1 1 ttyraw Is+ 0:00.00 1136
6500 /usr/libexec/getty std.38400 console
Aug 17 23:02:01 e003 df: Filesystem 1K-blocks Used Avail %Cap
Mounted on
Aug 17 23:02:01 e003 df: /dev/raid0a 96247 41014 50421 44% /
Aug 17 23:02:01 e003 df: /dev/raid0f 16264494 59820 15391450 0% /var
Aug 17 23:02:01 e003 df: /dev/raid0e 8132206 5872266 1853330 76% /usr
Aug 17 23:02:01 e003 df: /dev/raid0g 30497948 164 28972888 0%
/nc-www
Aug 17 23:02:01 e003 df: /dev/raid0h 18737934 58 17800980 0%
/home.stand
Aug 17 23:02:01 e003 df: procfs 4 4 0 100%
/proc
Aug 17 23:02:01 e003 df: kernfs 1 1 0 100%
/kern
Aug 17 23:02:01 e003 df: tmpfs 1048576 1220 1047356 0% /tmp
This is the output before backup starts ... Next output is this:
Aug 17 23:30:00 e003 vmstat: procs memory page
disks faults cpu
Aug 17 23:30:00 e003 vmstat: r b w avm fre flt re pi po fr sr
c0 w0 in sy cs us sy id
Aug 17 23:30:00 e003 vmstat: 2 0 0 2196564 168044 70 0 0 0 0 0
0 3 6 298 60 0 0 100
Aug 17 23:30:01 e003 vmstat: 0 0 0 2197504 166868 1265 0 0 0 0 0
0 1 13 2082 136 0 0 100
Aug 17 23:30:02 e003 vmstat: 1 0 0 2202448 161624 8161 0 0 0 0 0
0 51 96 614293 949 17 42 42
Aug 17 23:31:00 e003 ps: UID PID PPID NLWP WCHAN STAT TIME RSZ
VSZ COMMAND
Aug 17 23:31:00 e003 ps: 0 0 0 45 - OKl 39:55.25 17148
0 [system]
Aug 17 23:31:00 e003 ps: 0 1 0 1 wait Is 0:00.01 1048
6520 init
Aug 17 23:31:00 e003 ps: 0 117 1 5 sigwait Ssl 1:46.43 66956
98012 /usr/sbin/named -c /var/named/named.conf -4
Aug 17 23:31:00 e003 ps: 0 165 1 1 kqueue Ss 0:02.32 1068
6544 /usr/sbin/syslogd -s
Aug 17 23:31:00 e003 ps: 0 172 1 1 nanoslp Ss 0:09.06 968
6504 /usr/sbin/ipmon -Dps
Aug 17 23:31:00 e003 ps: 0 188 1 1 select Ss 0:00.59 1292
6536 /usr/sbin/rpcbind -l
Aug 17 23:31:00 e003 ps: 0 201 1 1 select Ss 0:08.77 1144
5464 /usr/sbin/ypbind
Aug 17 23:31:00 e003 ps: 0 306 1 1 pause Ss 0:13.45 5420
11320 /usr/sbin/ntpd
Aug 17 23:31:00 e003 ps: 0 324 1 1 select Is 0:00.01 2080
24808 /usr/sbin/sshd
Aug 17 23:31:00 e003 ps: 12 376 499 1 kqueue I 0:01.43 2536
12144 qmgr -l -t unix -u
Aug 17 23:31:00 e003 ps: 0 420 324 1 netio Is 0:00.02 4508
35760 sshd: wgstuken [priv]
Aug 17 23:31:00 e003 ps: 0 499 1 1 kqueue Ss 0:02.52 2368
12028 /usr/libexec/postfix/master
Aug 17 23:31:00 e003 ps: 500 542 1 1 wait Is 0:00.00 796
4416 /etc/pkg/sbin/watch_server -b -p /var/run/nswSW.pid -c
/etc/pkg/watch-server.cfg
Aug 17 23:31:00 e003 ps: 500 547 542 1 select I 0:00.04 956
4416 /etc/pkg/sbin/watch_server -b -p /var/run/nswSW.pid -c
/etc/pkg/watch-server.cfg
Aug 17 23:31:00 e003 ps: 0 557 1 1 select Ss 0:06.06 17852
176944 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:00 e003 ps: 800 588 3439 1 piperd I 0:00.00 1404
10192 /usr/pkg/libexec/sendsize amandad bsdtcp
Aug 17 23:31:00 e003 ps: 0 593 1 1 kqueue Is 0:00.01 1544
7616 /usr/sbin/inetd -l
Aug 17 23:31:00 e003 ps: 1002 614 420 1 select I 0:00.15 3428
35760 sshd: wgstuken@ttyp0
Aug 17 23:31:00 e003 ps: 0 618 1 1 nanoslp Ss 0:01.65 1064
5468 /usr/sbin/cron
Aug 17 23:31:00 e003 ps: 0 951 1 3 select Isl 0:02.78 6296
36080 /usr/pkg/sbin/bacula-fd -c /etc/pkg/bacula/bacula-fd.conf -g bacula
Aug 17 23:31:00 e003 ps: 1002 1042 1406 1 select I 0:00.63 3376
35760 sshd: wgstuken@ttyp1
Aug 17 23:31:00 e003 ps: 0 1406 324 1 netio Is 0:00.01 4588
35760 sshd: wgstuken [priv]
Aug 17 23:31:00 e003 ps: 800 1840 3439 1 piperd I 0:00.00 1404
10192 /usr/pkg/libexec/sendsize amandad bsdtcp
Aug 17 23:31:00 e003 ps: 1002 2074 3033 1 select I 0:00.00 3376
35760 sshd: wgstuken@ttyp3
Aug 17 23:31:00 e003 ps: 0 2308 5731 1 tstile D 0:00.00 1252
10124 runtar NSW-backup /usr/pkg/bin/gtar --create --file /dev/null --directory
/usr/pkgsrc --one-file-system --listed-incremental
/var/amanda/gnutar-lists/e003_usr_pkgsrc_1.new --s
parse --ignore-failed-read --totals --exclude-from
/tmp/amanda/sendsize._usr_pkgsrc.20120817233019.exclude .
Aug 17 23:31:00 e003 ps: 1002 2335 2361 1 select I 0:00.06 3376
35760 sshd: wgstuken@ttyp2
Aug 17 23:31:00 e003 ps: 1002 2351 2893 1 select I 0:00.00 3376
35760 sshd: wgstuken@ttyp4
Aug 17 23:31:00 e003 ps: 0 2361 324 1 netio Is 0:00.01 4592
35760 sshd: wgstuken [priv]
Aug 17 23:31:00 e003 ps: 0 2365 1840 1 tstile D 0:00.04 1424
10132 runtar NSW-backup /usr/pkg/bin/gtar --create --file /dev/null --directory
/var/cron --one-file-system --listed-incremental
/var/amanda/gnutar-lists/e003_var_cron_1.new --spars
e --ignore-failed-read --totals --exclude-from
/tmp/amanda/sendsize._var_cron.20120817233001.exclude .
Aug 17 23:31:00 e003 ps: 0 2893 324 1 netio Is 0:00.01 4592
35760 sshd: wgstuken [priv]
Aug 17 23:31:00 e003 ps: 0 3033 324 1 netio Is 0:00.01 4592
35760 sshd: wgstuken [priv]
Aug 17 23:31:00 e003 ps: 800 3439 3850 1 wait I 0:00.00 1576
10160 /usr/pkg/libexec/sendsize amandad bsdtcp
Aug 17 23:31:00 e003 ps: 800 3850 593 1 select I 0:00.01 1592
9156 amandad bsdtcp amdump amindexd amidxtaped
Aug 17 23:31:00 e003 ps: 500 4293 4449 1 wait Ss 0:00.00 1140
6664 /bin/sh -c /bin/ps -axwwo "uid pid ppid nlwp wchan state time rsz vsz
command" | logger -t ps -p local1.info
Aug 17 23:31:00 e003 ps: 802 4329 557 1 semwait I 0:01.02 9920
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:00 e003 ps: 0 4449 618 1 piperd S 0:00.00 1196
5468 cron: running job
Aug 17 23:31:01 e003 ps: 800 5731 3439 1 piperd I 0:00.02 1420
10192 /usr/pkg/libexec/sendsize amandad bsdtcp
Aug 17 23:31:01 e003 ps: 802 5917 557 1 semwait I 0:01.57 9964
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 0 5975 28943 1 - ZW 0:00.00 0
0 (sh)
Aug 17 23:31:01 e003 ps: 802 8912 557 1 semwait I 0:01.13 10072
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 0 9402 2365 1 - ZW 0:00.00 0
0 (sh)
Aug 17 23:31:01 e003 ps: 802 13013 557 1 semwait I 0:00.98 9996
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 16832 557 1 semwait I 0:01.63 9960
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 20447 557 1 kqueue S 0:01.77 9960
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 500 21108 4293 1 - O 0:00.00 932
6552 /bin/ps -axwwo uid pid ppid nlwp wchan state time rsz vsz command
Aug 17 23:31:01 e003 ps: 12 21863 499 1 kqueue S 0:00.00 2436
12080 flush -z -t unix -u
Aug 17 23:31:01 e003 ps: 802 23366 557 1 semwait I 0:01.61 9932
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 500 23548 4293 1 piperd S 0:00.00 804
4328 logger -t ps -p local1.info
Aug 17 23:31:01 e003 ps: 802 23714 557 1 semwait I 0:01.66 9976
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 24002 557 1 semwait I 0:01.64 10016
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 24217 557 1 socket I 0:00.00 4416
115164 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 12 24387 499 1 kqueue I 0:00.01 2468
12088 pickup -l -t fifo -u
Aug 17 23:31:01 e003 ps: 802 24699 557 1 semwait I 0:01.62 9932
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 25243 557 1 semwait I 0:01.55 9988
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 25291 557 1 semwait I 0:01.56 10004
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 25393 557 1 semwait I 0:01.60 9908
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 26115 557 1 semwait I 0:01.71 10104
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 28084 557 1 semwait I 0:01.62 9980
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 802 28773 557 1 semwait I 0:01.10 10064
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 0 28943 588 1 tstile D 0:00.04 1424
10132 runtar NSW-backup /usr/pkg/bin/gtar --create --file /dev/null --directory
/usr/pkg/etc --one-file-system --listed-incremental
/var/amanda/gnutar-lists/e003_usr_pkg_etc_1.new -
-sparse --ignore-failed-read --totals --exclude-from
/tmp/amanda/sendsize._usr_pkg_etc.20120817233001.exclude .
Aug 17 23:31:01 e003 ps: 802 29565 557 1 semwait I 0:00.45 9840
177968 /usr/pkg/sbin/httpd -k start
Aug 17 23:31:01 e003 ps: 1002 391 614 1 pause Is 0:00.01 1248
4508 -csh
Aug 17 23:31:01 e003 ps: 0 1243 391 1 ttyraw I+ 0:00.02 1272
4508 -csh -m
Aug 17 23:31:01 e003 ps: 0 1304 1535 1 ttyraw I+ 0:00.02 1272
4512 -csh -m
Aug 17 23:31:01 e003 ps: 1002 1535 1042 1 pause Is 0:00.00 1232
4508 -csh
Aug 17 23:31:01 e003 ps: 0 26675 1304 1 kqueue I 0:00.14 772
4336 tail -f /var/log/horde
Aug 17 23:31:01 e003 ps: 1002 1413 2335 1 pause Is 0:00.00 1276
4508 -csh
Aug 17 23:31:01 e003 ps: 0 1926 1413 1 ttyraw I+ 0:00.01 1232
4508 -csh -m
Aug 17 23:31:01 e003 ps: 0 1134 2934 1 ttyraw I+ 0:00.01 1204
4508 -csh -m
Aug 17 23:31:01 e003 ps: 1002 2934 2074 1 pause Is 0:00.00 1232
4508 -csh
Aug 17 23:31:01 e003 ps: 1002 1547 2351 1 pause Is 0:00.00 1232
4508 -csh
Aug 17 23:31:01 e003 ps: 0 3003 1547 1 ttyraw I+ 0:00.01 1204
4508 -csh -m
Aug 17 23:31:01 e003 ps: 0 552 1 1 wait I 0:00.00 1180
6664 /bin/sh /usr/pkg/bin/mysqld_safe --user=mysql --datadir=/var/mysql
--pid-file=/var/mysql/e003.pid --skip-thread-priority
Aug 17 23:31:01 e003 ps: 801 918 552 10 select Il 2:54.31 20044
82068 /usr/pkg/libexec/mysqld --basedir=/usr/pkg --datadir=/var/mysql
--user=mysql --skip-thread-priority --log-error=/var/mysql/e003.err
--pid-file=/var/mysql/e003.pid
Aug 17 23:31:01 e003 ps: 0 2122 1 1 ttyraw Is+ 0:00.00 1136
6500 /usr/libexec/getty std.38400 console
Aug 17 23:32:00 e003 df: Filesystem 1K-blocks Used Avail %Cap
Mounted on
Aug 17 23:32:00 e003 df: /dev/raid0a 96247 41014 50421 44% /
Aug 17 23:32:00 e003 df: /dev/raid0f 16264494 66112 15385158 0% /var
Aug 17 23:32:00 e003 df: /dev/raid0e 8132206 5872266 1853330 76% /usr
Aug 17 23:32:00 e003 df: /dev/raid0g 30497948 164 28972888 0%
/nc-www
Aug 17 23:32:00 e003 df: /dev/raid0h 18737934 58 17800980 0%
/home.stand
Aug 17 23:32:00 e003 df: procfs 4 4 0 100%
/proc
Aug 17 23:32:00 e003 df: kernfs 1 1 0 100%
/kern
Aug 17 23:32:00 e003 df: tmpfs 1048576 1328 1047248 0% /tmp
There are 7 filesystems paths that should be backed up: / /home.stand
/nc-www /usr/pkg/etc /usr/pkgsrc /var/cron /var/log.
Some of them seems to have already finished, 3 are still active.
(/usr/pkg/etc /usr/pkgsrc and /var/cron)
But there is no "gtar" process (????) and the generated files looks
complete as far as I can see after the reboot.
The contents of /var/cron is small, so it should have been finished
long time ago ... (see ls -lR below)
/var/cron:
total 4
drwx------ 2 root wheel 512 Aug 6 11:08 tabs
/var/cron/tabs:
total 12
-rw------- 1 root wheel 770 Aug 6 11:08 ncadmin
-rw------- 1 root wheel 1701 Apr 24 12:29 root
-rw------- 1 root wheel 223 May 23 11:09 wgstuken
The output of the debug-cron-jobs will show the same scenario till "Aug
18 03:02:00".
After this no output is appended to the log file anymore. The "vmstat"
was the last cron-job added to the syslog.
As long as no new processes needs to be started, the main function
(webserver) still works, so
we don't recognize the problem over some time.
I've parked some logins as root on the system to get some information
... "exec ps alxww" shows this:
e003: {18} exec /bin/ps alxww
UID PID PPID CPU PRI NI VSZ RSS WCHAN STAT TTY TIME COMMAND
0 0 0 0 125 0 0 31888 schedul OKl ? 47:30.96 [system]
0 1 0 0 85 0 6520 1048 wait Is ? 0:00.01 init
0 15 16398 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 100 9315 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 117 1 3870 85 0 98012 66964 sigwait Ssl ? 1:59.09
/usr/sbin/named -c /var/named/named.conf -4
0 165 1 0 85 0 6544 1068 kqueue Is ? 0:02.68
/usr/sbin/syslogd -s
0 172 1 0 85 0 6504 968 nanoslp Ss ? 0:10.35
/usr/sbin/ipmon -Dps
0 188 1 0 85 0 6536 1292 select Ss ? 0:00.70
/usr/sbin/rpcbind -l
0 201 1 0 85 0 5464 1144 select Ss ? 0:10.46
/usr/sbin/ypbind
0 293 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 300 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 306 1 0 85 0 11320 5420 pause Ss ? 0:16.05
/usr/sbin/ntpd
0 316 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 324 1 0 85 0 24808 2128 select Is ? 0:00.01
/usr/sbin/sshd
0 329 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 356 6499 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 357 1892 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
12 376 499 0 85 0 12144 2536 kqueue I ? 0:01.72 qmgr -l
-t unix -u
0 381 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 384 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 385 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 386 384 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 399 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 420 324 0 85 0 35760 4508 netio Is ? 0:00.02 sshd:
wgstuken [priv]
0 484 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 499 1 0 85 0 12032 2376 kqueue Is ? 0:03.30
/usr/libexec/postfix/master
0 501 22388 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 509 25340 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 519 2054 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
500 542 1 976 85 0 4416 796 wait Is ? 0:00.00
/etc/pkg/sbin/watch_server -b -p /var/run/nswSW.pid -c
/etc/pkg/watch-server.cfg
500 547 542 0 85 0 4416 956 select I ? 0:00.05
/etc/pkg/sbin/watch_server -b -p /var/run/nswSW.pid -c
/etc/pkg/watch-server.cfg
0 548 931 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 549 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 556 5419 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 557 1 0 85 0 176944 17852 select Ss ? 0:07.16
/usr/pkg/sbin/httpd -k start
0 562 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 572 3899 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 580 25667 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 585 11336 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
800 588 1 120 85 0 10192 1404 piperd I ? 0:00.00
/usr/pkg/libexec/sendsize amandad bsdtcp
0 593 1 0 85 0 7616 1544 kqueue Is ? 0:00.01
/usr/sbin/inetd -l
0 612 6241 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 613 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
1002 614 420 0 85 0 35760 3428 select I ? 0:00.15 sshd:
wgstuken@ttyp0
0 618 1 0 85 0 5468 1064 nanoslp Is ? 0:01.92
/usr/sbin/cron
0 627 3954 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 637 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 640 2431 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 641 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 642 641 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 647 2182 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 655 16014 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 676 1187 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
800 690 593 40 117 0 9088 1232 tstile D ? 0:00.00 amandad
-auth=bsdtcp amdump amindexd amidxtaped
0 708 24130 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 740 7907 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 755 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 757 4594 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 760 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 765 25852 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 768 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 769 768 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 770 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 783 16142 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 787 1544 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 820 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 885 22644 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 926 6301 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 931 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 933 24482 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 936 10151 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 940 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 941 4651 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 951 1 6 85 0 36080 6368 select Dsl ? 0:03.36
/usr/pkg/sbin/bacula-fd -c /etc/pkg/bacula/bacula-fd.conf -g bacula
0 956 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 969 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 972 25419 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 977 9040 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 997 6627 203 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 998 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1002 4457 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1031 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
1002 1042 1406 0 85 0 35760 3376 select I ? 0:00.63 sshd:
wgstuken@ttyp1
0 1043 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1046 1426 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1054 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1059 5153 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1060 25120 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1061 24610 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1064 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1068 5163 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1069 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1074 27185 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1076 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1079 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1084 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1092 27203 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1097 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1100 12872 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1105 10832 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1126 613 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1130 5225 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1132 25411 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1139 11377 21 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1152 2175 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1153 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1154 1153 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1159 3718 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1171 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1174 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1182 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1187 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1188 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1192 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1197 940 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1202 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1220 24770 15 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1228 969 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1254 29413 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1258 5097 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1269 22772 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1272 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1274 26922 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1281 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1282 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1287 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1299 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1310 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1315 24098 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1320 549 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1325 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1342 5601 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1343 4757 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1356 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1361 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1382 29541 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1386 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1395 4210 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1397 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1402 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1406 324 0 85 0 35760 4588 netio Is ? 0:00.01 sshd:
wgstuken [priv]
0 1426 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1430 2962 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1438 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1443 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1445 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1448 10663 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1452 29610 17 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1453 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1458 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1468 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1481 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1484 27595 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1510 10722 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1514 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1516 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1518 1516 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1528 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1536 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1537 1536 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1538 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1544 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1560 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1598 2621 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1599 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1653 5746 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1658 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1662 29821 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1663 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1669 3460 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1682 3729 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1688 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1701 1188 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1708 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1724 4795 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1726 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1727 1726 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1737 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1758 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1772 3819 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1774 4077 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1791 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1814 5141 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1829 2852 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1836 6955 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
800 1840 1 360 85 0 10192 1404 piperd I ? 0:00.00
/usr/pkg/libexec/sendsize amandad bsdtcp
0 1842 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1847 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1852 11066 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1860 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1865 11592 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1886 16733 95 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1892 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1900 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1902 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1912 28023 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1920 3967 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1922 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1927 2438 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1928 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1931 4234 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 1935 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1939 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 1956 1443 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2011 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2035 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2037 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2042 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2045 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2053 1791 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2054 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2055 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2056 1031 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2059 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2066 7185 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2067 4112 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2070 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2072 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
1002 2074 3033 0 85 0 35760 3376 select I ? 0:00.00 sshd:
wgstuken@ttyp3
0 2078 9245 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2083 6177 83 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2084 24608 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2085 27682 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2088 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2092 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2093 2092 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2096 2607 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2098 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2103 8246 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2108 4153 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2110 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2111 2110 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2116 26691 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2121 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2124 5194 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2129 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2139 10252 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2142 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2168 4442 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2170 9337 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2174 637 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2175 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2181 3204 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2182 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2187 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2194 4241 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2200 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2224 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2238 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2239 2238 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2270 18141 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2284 2794 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2286 4331 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2303 3838 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2308 5731 5094 116 0 10124 1252 tstile D ? 0:00.00 runtar
NSW-backup /usr/pkg/bin/gtar --create --file /dev/null --directory /usr/pkgsrc
--one-file-system --listed-incremental
/var/amanda/gnutar-lists/e003_usr_pkgsrc_1.new --sparse --ignore-failed-read
--totals --exclude-from /tmp/amanda/sendsize._usr_pkgsrc.20120817233019.exclude
.
0 2309 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2312 1287 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2326 1299 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
1002 2335 2361 0 43 0 35760 3376 - S ? 0:00.06 sshd:
wgstuken@ttyp2
0 2340 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
1002 2351 2893 0 85 0 35760 3376 select I ? 0:00.00 sshd:
wgstuken@ttyp4
0 2352 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2359 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2361 324 0 85 0 35760 4592 netio Is ? 0:00.01 sshd:
wgstuken [priv]
0 2365 1840 360 117 0 10132 1424 tstile D ? 0:00.04 runtar
NSW-backup /usr/pkg/bin/gtar --create --file /dev/null --directory /var/cron
--one-file-system --listed-incremental
/var/amanda/gnutar-lists/e003_var_cron_1.new --sparse --ignore-failed-read
--totals --exclude-from /tmp/amanda/sendsize._var_cron.20120817233001.exclude .
0 2395 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2398 18269 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2412 5993 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2414 3437 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2431 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2438 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2440 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2443 5514 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2451 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2456 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2458 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2494 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2495 2494 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2506 329 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2522 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2523 4058 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2526 2011 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2536 3509 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2554 9721 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2576 5703 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2578 29711 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2582 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2588 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2591 1310 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2598 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2607 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2617 4405 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2621 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2648 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2668 4715 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2670 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2680 29303 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2692 385 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2704 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2707 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2710 5269 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2714 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2718 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2719 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2728 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2733 1708 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2735 300 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2743 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2749 316 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2762 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2764 25803 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2778 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2779 4824 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2792 23271 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2794 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2810 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2822 2309 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2823 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2840 7959 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2842 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2846 6429 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2851 25378 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2852 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2861 28458 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2878 4411 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2879 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2890 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2892 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2893 324 0 85 0 35760 4592 netio Is ? 0:00.01 sshd:
wgstuken [priv]
0 2897 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2922 4968 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2925 25609 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2931 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2938 11129 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2942 381 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2949 1922 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2962 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 2982 293 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2992 3503 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 2994 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3032 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3033 324 0 85 0 35760 4592 netio Is ? 0:00.01 sshd:
wgstuken [priv]
0 3052 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3054 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3064 29175 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3071 4094 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3072 25006 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3073 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3074 3073 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3088 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3103 1054 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3110 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3119 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3129 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3131 9530 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3133 1084 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3149 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3160 7767 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3161 3032 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3179 24700 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3181 1900 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3190 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3204 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3208 24935 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3226 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3228 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3231 2718 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3238 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3247 24238 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3257 4777 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3259 10170 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3274 1737 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3289 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3290 4825 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3304 23783 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3309 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3318 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3326 12529 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3334 3845 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3339 4100 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3344 10508 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3345 1663 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3346 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3354 24857 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3356 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3366 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3402 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3405 2892 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3410 2588 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3416 6231 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3432 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3437 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3446 1397 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3460 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3472 399 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3473 2704 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3484 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3487 1182 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3494 1445 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3503 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3504 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3509 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3513 25528 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3515 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3517 956 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3538 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3544 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3545 3544 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3563 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3589 4612 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3601 14862 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3610 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3632 3119 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3637 28212 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3658 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3666 1361 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3675 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3678 17501 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3718 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3720 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3723 3720 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3729 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3765 26545 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3789 17472 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3794 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3819 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3823 3563 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3826 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3838 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3844 1281 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3845 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3848 2823 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3858 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3881 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3887 24366 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3897 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3899 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3901 3897 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3931 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3947 1386 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 3954 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3967 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3992 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 3994 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4030 10682 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4031 1468 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4042 1481 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4045 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4058 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4062 17885 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4072 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4077 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4086 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4094 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4100 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4112 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4113 3088 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4134 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4137 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4143 24622 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4149 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4153 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4155 13370 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4157 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4173 2121 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4178 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4184 9303 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4186 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4192 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4200 2045 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4207 3228 133 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4210 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4234 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4241 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4277 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4301 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4306 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 4329 557 0 85 0 177968 9932 semwait I ? 0:01.46
/usr/pkg/sbin/httpd -k start
0 4331 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4335 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4338 13041 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4385 22702 0 85 0 4328 736 piperd I ? 0:00.00 tee
/var/log/daily.out
0 4405 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4411 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4442 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4457 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4459 25447 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4463 1902 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4523 3826 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4557 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4576 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4589 3052 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4591 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4594 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4598 2037 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4612 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4618 29839 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4641 23584 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4651 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4667 26168 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4685 3658 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4692 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4697 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4698 4697 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4712 23655 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4713 3432 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4715 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4757 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4764 2200 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4769 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4774 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4777 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4779 28074 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4793 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4795 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4824 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4825 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4832 20703 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4845 5865 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4854 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4874 26377 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4881 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4885 1171 88 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4892 25883 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4902 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4946 2897 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4952 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4954 6487 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4960 2142 117 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 4968 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 4996 27011 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5002 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5008 1935 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5020 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5023 1438 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5033 1192 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5045 29620 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5049 26040 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5053 3515 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5074 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5076 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5097 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5099 1514 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5125 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5126 5125 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5128 2055 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5130 27145 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5141 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5146 27673 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5153 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5163 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5168 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5182 4157 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5183 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5194 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5211 7258 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5225 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5269 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5281 23712 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5289 2728 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5291 27818 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5332 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5344 22239 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5386 26889 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5389 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5397 4881 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5419 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5445 2598 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5460 10323 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5465 6549 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5472 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5514 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5545 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5588 12243 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5601 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5609 4072 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5645 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5673 1064 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5703 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5729 4576 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
800 5731 1 5094 84 0 10192 1420 piperd I ? 0:00.02
/usr/pkg/libexec/sendsize amandad bsdtcp
0 5743 2670 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5746 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5770 26761 156 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5825 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5829 5953 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5831 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5865 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 5917 557 0 85 0 177968 9968 semwait I ? 0:02.03
/usr/pkg/sbin/httpd -k start
0 5921 23840 74 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5941 820 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5953 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5975 28943 0 0 0 0 0 - ZW ? 0:00.00 (sh)
0 5977 4952 86 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 5993 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 5999 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6029 26249 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6059 5545 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6112 20959 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6115 10210 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6127 3054 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6154 26633 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6157 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6165 8212 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6173 3356 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6177 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6209 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6231 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6241 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6243 10338 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6295 5825 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6301 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6337 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6341 6337 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6343 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6359 27350 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6369 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6371 10466 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6384 618 0 85 0 5468 1196 piperd I ? 0:00.00 cron:
running job
0 6423 6676 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6429 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6471 23622 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6487 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6497 16989 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6499 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6512 3309 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6541 10636 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6548 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6549 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6593 17088 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6597 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6599 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6627 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6676 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6677 7188 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6710 11612 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6768 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6804 1939 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
800 6838 593 0 117 0 9088 1232 tstile D ? 0:00.00 amandad
-auth=bsdtcp amdump amindexd amidxtaped
0 6868 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6925 12044 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6955 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 6981 1860 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 6996 10579 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7061 2451 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7063 1174 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7069 3484 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7073 25504 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7127 28118 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7152 4591 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7172 29699 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7185 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7188 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7196 26651 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7209 2088 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7221 1076 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7222 4149 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7237 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7250 2129 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7258 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7280 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7316 2707 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7350 4277 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7444 1043 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7478 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7575 8084 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7581 5020 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7606 27315 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7639 29654 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7664 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7745 19008 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7749 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7767 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7821 10892 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7837 3226 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7895 27862 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7907 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 7920 4335 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 7959 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 8007 23878 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 8033 5472 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 8035 12130 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 8048 5999 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 8084 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 8129 18368 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 8133 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 8135 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 8212 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 8215 4186 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 8246 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 8727 2582 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 8825 11080 3538 117 0 6488 2064 tstile D ? 0:04.47 find / (
! -fstype local -o -fstype rdonly -o -fstype fdesc -o -fstype null -o -fstype
kernfs -o -fstype procfs -o -fstype ptyfs ) -prune -o -name lost+found -prune
-o ( -name *.core -o -name core ) -type f -print
802 8912 557 0 85 0 177968 10080 kqueue S ? 0:01.49
/usr/pkg/sbin/httpd -k start
0 8980 3858 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9040 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9209 760 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9229 13324 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9245 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9281 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9287 24646 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9300 13395 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9303 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9315 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9337 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9356 22702 0 85 0 12068 2380 piperd I ? 0:00.00 sendmail
-t
0 9402 2365 0 0 0 0 0 - ZW ? 0:00.00 (sh)
0 9424 11471 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9465 1528 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9530 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9552 11599 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9593 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9680 10959 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9721 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 9767 4192 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9786 1847 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9826 6548 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 9939 9356 0 85 0 12040 2352 netio I ? 0:00.00 postdrop
-r
0 10067 3538 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10124 5002 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10151 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10170 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10210 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10252 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10279 3110 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10298 3129 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10319 3881 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10320 7237 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10323 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10338 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10407 3238 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10451 4306 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10466 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10508 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10535 3366 64 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10579 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10594 21343 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10609 4692 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10636 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10663 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10682 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10703 11982 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10707 3794 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10722 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10832 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10865 6768 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10892 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 10938 4793 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 10959 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11001 1272 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11066 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11080 22702 172 85 0 6664 1240 wait I ? 0:00.00 /bin/sh
/etc/daily
0 11087 1356 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11129 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11216 12239 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11287 2070 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11336 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11377 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11464 5831 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11471 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11592 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11598 2522 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11599 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11612 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11740 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11788 2059 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11854 3149 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11855 12366 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11859 4178 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11868 2395 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11943 4774 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 11982 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 11996 2778 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 12002 6369 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 12044 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 12071 4902 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 12130 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 12232 6599 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 12239 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 12243 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 12366 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 12380 3675 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 12494 4301 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 12529 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 12744 8135 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 12750 4045 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 12872 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 13000 6343 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
802 13013 557 0 85 0 177968 10028 semwait I ? 0:01.40
/usr/pkg/sbin/httpd -k start
0 13041 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 13141 5076 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 13148 3931 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 13297 7664 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 13324 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 13351 4134 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 13370 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 13391 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 13392 13391 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 13395 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 13397 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 13525 6868 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 13653 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 13781 5332 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 14286 4557 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 14421 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 14478 26966 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 14606 5389 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 14862 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 14933 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 15246 2187 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 15317 5074 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 15374 6157 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 15438 26699 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 16014 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 16142 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 16398 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 16605 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 16733 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 16832 557 0 85 0 177968 9960 semwait I ? 0:02.04
/usr/pkg/sbin/httpd -k start
0 16989 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 17088 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 17373 3289 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 17472 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 17501 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 17728 1599 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 17885 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 18141 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 18269 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 18368 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 18496 5183 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 19008 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 19264 2879 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
802 20447 557 0 85 0 177968 9960 semwait I ? 0:02.15
/usr/pkg/sbin/httpd -k start
0 20575 11740 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 20703 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 20959 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 21343 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 22239 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 22260 16605 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 22388 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 22644 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 22702 6384 0 85 0 6664 1136 wait Is ? 0:00.00 /bin/sh
-c /bin/sh /etc/daily 2>&1 | tee /var/log/daily.out | sendmail -t
0 22772 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 22830 27306 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 22900 2931 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23015 1758 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23028 755 4 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23086 1325 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23143 998 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23200 2648 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23271 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 23328 2719 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
802 23366 557 0 85 0 177968 10000 semwait I ? 0:02.03
/usr/pkg/sbin/httpd -k start
0 23584 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 23598 1069 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23622 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 23655 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 23712 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 23714 557 0 85 0 177968 10020 semwait I ? 0:02.14
/usr/pkg/sbin/httpd -k start
0 23750 25795 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23783 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 23840 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 23842 4769 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 23878 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 24002 557 0 85 0 177968 10016 semwait I ? 0:02.12
/usr/pkg/sbin/httpd -k start
0 24098 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24130 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24180 7280 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
802 24217 557 27 85 0 115164 4416 socket I ? 0:00.00
/usr/pkg/sbin/httpd -k start
0 24238 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24258 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24345 1688 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24366 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24376 27511 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24482 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24518 6597 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24551 484 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24564 2035 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24601 1560 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24608 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24610 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24622 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24632 7478 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24646 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 24699 557 0 85 0 177968 9948 semwait I ? 0:02.06
/usr/pkg/sbin/httpd -k start
0 24700 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24729 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24760 1079 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24770 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24857 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24888 2359 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24898 6209 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 24935 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 24985 2456 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25006 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25030 8133 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25083 1402 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25084 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25120 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25158 7749 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
802 25243 557 0 85 0 177968 10036 semwait I ? 0:01.90
/usr/pkg/sbin/httpd -k start
0 25286 27331 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
802 25291 557 0 85 0 177968 10004 semwait I ? 0:01.96
/usr/pkg/sbin/httpd -k start
0 25339 2042 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25340 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25371 2458 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25378 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 25393 557 0 85 0 177968 9916 semwait I ? 0:02.00
/usr/pkg/sbin/httpd -k start
0 25411 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25419 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25447 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25467 1658 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25468 9593 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25504 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25518 1453 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25528 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25538 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25609 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25627 2842 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25667 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25675 2890 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25755 24729 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25777 2224 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25795 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25803 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25851 2810 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25852 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25883 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25905 2352 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25923 26434 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25931 3402 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25979 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 25980 25979 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 25993 1928 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26011 2714 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26040 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26059 2762 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
802 26115 557 0 85 0 177968 10104 semwait I ? 0:02.17
/usr/pkg/sbin/httpd -k start
0 26137 2072 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26168 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26235 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26236 26235 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26249 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26296 2743 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26377 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26434 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26499 29668 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26521 3992 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26545 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26563 24258 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26627 1538 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26633 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26651 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26673 2340 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26691 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26699 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26761 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26883 770 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 26889 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26922 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 26966 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27011 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27057 3504 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
800 27059 593 0 117 0 9088 1232 tstile D ? 0:00.00 amandad
-auth=bsdtcp amdump amindexd amidxtaped
0 27075 25538 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27145 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27163 3610 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27178 4137 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27185 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27203 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27211 1097 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27222 13397 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27306 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27313 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27315 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27331 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27350 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27443 562 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27511 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27529 2440 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27547 3994 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27595 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27673 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27682 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27714 9281 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27734 14933 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27767 3190 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27779 3346 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27818 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27827 1202 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27862 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 27895 3318 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 27955 1842 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 28023 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 28074 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 28084 557 0 85 0 177968 10000 semwait I ? 0:02.06
/usr/pkg/sbin/httpd -k start
0 28118 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 28211 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 28212 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 28340 1458 6 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 28419 1282 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 28458 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 28502 13653 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 28595 2994 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 28663 4086 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 28724 28211 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 28758 14421 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
802 28773 557 0 85 0 177968 10064 semwait I ? 0:01.51
/usr/pkg/sbin/httpd -k start
0 28852 27313 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 28943 588 240 117 0 10132 1424 tstile D ? 0:00.04 runtar
NSW-backup /usr/pkg/bin/gtar --create --file /dev/null --directory /usr/pkg/etc
--one-file-system --listed-incremental
/var/amanda/gnutar-lists/e003_usr_pkg_etc_1.new --sparse --ignore-failed-read
--totals --exclude-from
/tmp/amanda/sendsize._usr_pkg_etc.20120817233001.exclude .
0 29157 29796 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 29175 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29199 5645 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 29303 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29413 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29431 4854 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 29541 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
802 29565 557 0 85 0 177968 9912 semwait I ? 0:00.93
/usr/pkg/sbin/httpd -k start
0 29610 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29620 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29654 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29668 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29699 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29711 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29745 5168 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 29747 2098 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
0 29796 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29821 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29839 618 0 85 0 5468 1144 wait D ? 0:00.00 cron:
running job
0 29949 25084 0 117 0 5468 1144 tstile DVs ? 0:00.00 cron:
running job
1002 391 614 0 85 0 4508 1248 pause Is ttyp0 0:00.01 -csh
0 1243 391 0 85 0 4508 1272 ttyraw I+ ttyp0 0:00.02 -csh -m
0 1304 1535 0 85 0 4512 1272 ttyraw I+ ttyp1 0:00.02 -csh -m
1002 1535 1042 0 85 0 4508 1232 pause Is ttyp1 0:00.00 -csh
0 26675 1304 0 85 0 4336 772 kqueue I ttyp1 0:00.14 tail -f
/var/log/horde
1002 1413 2335 0 85 0 4508 1276 pause Is ttyp2 0:00.00 -csh
0 1926 1413 0 42 0 6556 1608 - O+ ttyp2 0:00.02 /bin/ps
-alxww
0 1134 2934 0 85 0 4508 1204 ttyraw I+ ttyp3 0:00.01 -csh -m
1002 2934 2074 0 85 0 4508 1232 pause Is ttyp3 0:00.00 -csh
1002 1547 2351 0 85 0 4508 1232 pause Is ttyp4 0:00.00 -csh
0 3003 1547 0 85 0 4508 1204 ttyraw I+ ttyp4 0:00.01 -csh -m
0 552 1 913 85 0 6664 1180 wait I tty00- 0:00.00 /bin/sh
/usr/pkg/bin/mysqld_safe --user=mysql --datadir=/var/mysql
--pid-file=/var/mysql/e003.pid --skip-thread-priority
801 918 552 544 85 0 82068 20044 select Il tty00- 3:34.02
/usr/pkg/libexec/mysqld --basedir=/usr/pkg --datadir=/var/mysql --user=mysql
--skip-thread-priority --log-error=/var/mysql/e003.err
--pid-file=/var/mysql/e003.pid
0 2122 1 0 85 0 6500 1136 ttyraw Ss+ tty00 0:00.00
/usr/libexec/getty std.38400 console
The prog-table is full with "D"-processes either waiting on "wait" or
"tstile".
There is a "/etc/daily" process, that will also traverse the filesystem
and that may have been block on a vnode still
locked by the amanda-processes. But I don't know a way to verify this
till now ...
But at least / and /bin are not locked, because I could get the
processlisting above.
The console output is added below ...
remark: the error from stupid gtar happens if any file just backing up
changed while reading it - this can be ignored
for this problem.
Aug 11 00:22:06 e003 sendbackup[3993]: error [dump (26566) /usr/pkg/bin/gtar
returned 2]
Aug 11 00:23:06 e003 sendbackup[4299]: error [dump (26999) /usr/pkg/bin/gtar
returned 2]
Aug 13 13:20:43 e003 su: snhipke to root on /dev/ttyp5
Aug 14 00:21:39 e003 sendbackup[10279]: error [dump (4037) /usr/pkg/bin/gtar
returned 2]
Aug 14 00:22:55 e003 sendbackup[4887]: error [dump (26231) /usr/pkg/bin/gtar
returned 2]
Aug 14 10:40:42 e003 su: knmuelle to root on /dev/ttyp5
Aug 14 11:28:51 e003 su: tsdauche to root on /dev/ttyp6
Aug 15 00:22:35 e003 sendbackup[6803]: error [dump (17352) /usr/pkg/bin/gtar
returned 2]
Aug 15 00:22:44 e003 sendbackup[9661]: error [dump (558) /usr/pkg/bin/gtar
returned 2]
Aug 16 00:22:42 e003 sendbackup[25585]: error [dump (10282) /usr/pkg/bin/gtar
returned 2]
Aug 16 00:22:57 e003 sendbackup[17522]: error [dump (8700) /usr/pkg/bin/gtar
returned 2]
Aug 16 09:47:43 e003 su: tsdauche to root on /dev/ttyp5
Aug 17 00:22:47 e003 sendbackup[24026]: error [dump (24173) /usr/pkg/bin/gtar
returned 2]
Aug 17 00:22:58 e003 sendbackup[17208]: error [dump (2376) /usr/pkg/bin/gtar
returned 2]
Aug 19 05:19:01 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
Aug 19 05:20:00 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
Aug 19 05:30:01 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
Aug 19 05:40:00 e003 last message repeated 4 times
Aug 19 05:50:00 e003 last message repeated 6 times
Aug 19 06:00:01 e003 last message repeated 11 times
....... (lot more times "last message repeated" lines deleted here)
Aug 20 14:58:28 e003 last message repeated 11 times
Aug 20 15:02:30 e003 last message repeated 7 times
Aug 20 15:02:35 e003 sshd[324]: error: fork: Resource temporarily unavailable
Aug 20 15:02:43 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
Aug 20 15:02:43 e003 sshd[324]: error: fork: Resource temporarily unavailable
Aug 20 15:02:59 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
Aug 20 15:02:59 e003 sshd[324]: error: fork: Resource temporarily unavailable
Aug 20 15:03:30 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
Aug 20 15:03:46 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
Aug 20 15:03:46 e003 sshd[324]: error: fork: Resource temporarily unavailable
Aug 20 15:04:30 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
Aug 20 15:05:30 e003 /netbsd: proc: table is full - increase kern.maxproc or
NPROC
The lines at the end are comes fron the aproach to log into the system
...
It looks like that from "Aug 18 00:00:02" till "Aug 19 05:19:01" the
cron-jobs cannot proceed anymore.
The first one missing is the "/bin/ps" call.
Accedently I've failed to get a core from the system till now.
"exec reboot" will lock up in unmounting the filesystems - next time I
will try "exec reboot -dnql".
It is not a total lockup of the filesystem, because the named continues
to write data into syslog via syslogd
(messages file) all the time: (the lines are taken by random from the
file, just to show the timestamp.)
Aug 20 08:59:29 e003 named[117]: error (FORMERR) resolving
'inplay-rcv15.tubemogul.com/AAAA/IN': 8.20.243.2#53
Aug 20 08:59:30 e003 named[117]: DNS format error from 8.20.241.1#53 resolving
inplay-rcv15.tubemogul.com/AAAA for client 62.153.101.242#53: reply has no
answer
Aug 20 08:59:30 e003 named[117]: error (FORMERR) resolving
'inplay-rcv15.tubemogul.com/AAAA/IN': 8.20.241.1#53
Aug 20 08:59:30 e003 named[117]: DNS format error from 8.20.243.2#53 resolving
inplay-rcv15.tubemogul.com/AAAA for client 62.153.101.242#53: reply has no
answer
Aug 20 08:59:30 e003 named[117]: error (FORMERR) resolving
'inplay-rcv15.tubemogul.com/AAAA/IN': 8.20.243.2#53
Has anybody an idea where to go on with further debugging?
With this behavior, the system cannot be called stable.
The system currently runs without DDB, because it is a productive
system and the console is on a serial line, that is connected
to another system running misc/screen from pkgsrc as console-server.
A break-signal on this line would force the system into DDB, so this
must be turned off for productive systems.
I'm willing to enable DDB, but it may not drop into DDB after a break
on the serial line.
What other way would be available to enter DDB? I don't know any - till
now.
>How-To-Repeat:
No explicit way known to trigger the problem. It happens time by time
...
I've classified this problem only as "serious", because I cannot
reproduce it on demand.
>Fix:
Accedently not known till now - I've failed to get a core dump this
time again ...
>Unformatted:
Home |
Main Index |
Thread Index |
Old Index