Re: python3.7 rebuild stuck in kernel in "entropy" during an "import" statement

[Chris Pinnock <chris_pinnock%mac.com@localhost>]

Hi Greg
It’s not immediately obvious, but I think you have to seed entropy if there isn’t “enough”.
It’s worth having a quick read of entropy(7) where there is a write-up. I had to seed /dev/urandom to unblock a similar build on a headless system (just the heads/tails output of a random script from another machine was enough).
Rgds
C

> On 30 Mar 2021, at 18:06, Greg A. Woods <woods%planix.ca@localhost> wrote:
> 
> So I've been running a pkg-rolling_replace and one of the packages being
> rebuilt is python3.7, and it has got stuck, apparently on an "entropy"
> wait in the kernel, and it's been in this state for over 24hrs as you
> can see.
> 
> The only things the process has open appear to be its stdio descriptors,
> two of which are are open on the log file I was directing all output to.
> 
> This is on a Xen domU of a machine running:
> 
> $ uname -a
> NetBSD xentastic 9.99.81 NetBSD 9.99.81 (XEN3_DOM0) #1: Tue Mar 23 14:39:55 PDT 2021  woods@xentastic:/build/woods/xentastic/current-amd64-amd64-obj/build/src/sys/arch/amd64/compile/XEN3_DOM0 amd64
> 
> 
> 09:51 [504] $ ps -lwwp 19875
> UID   PID  PPID CPU PRI NI   VSZ   RSS WCHAN   STAT TTY      TIME COMMAND
>  0 19875 11551   0  85  0 55412 11324 entropy I    pts/0 0:00.27 ./python -E -Wi /var/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/compileall.py -d /usr/pkg/lib/python3.7 -f -x bad_coding|badsyntax|site-packages|lib2to3/tests/data /var/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7
> 09:51 [505] $ ps -uwwp 19875
> USER   PID %CPU %MEM   VSZ   RSS TTY   STAT STARTED    TIME COMMAND
> root 19875  0.0  0.1 55412 11324 pts/0 I     9:09PM 0:00.27 ./python -E -Wi /var/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/compileall.py -d /usr/pkg/lib/python3.7 -f -x bad_coding|badsyntax|site-packages|lib2to3/tests/data /var/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7
> 09:51 [506] $ fstat -p 19875
> USER     CMD          PID   FD  MOUNT         INUM MODE         SZ|DV R/W
> root     python     19875   wd  /build    10645634 drwxr-xr-x    1024 r
> root     python     19875    0  /dev/pts         3 crw-------   pts/0 rw
> root     python     19875    1  /build     3721223 -rw-r--r--  28287492 w
> root     python     19875    2  /build     3721223 -rw-r--r--  28287492 w
> 09:51 [507] $ find /build -inum 3721223
> /build/packages/root/pkg_roll.out
> 09:51 [508] $
> 
> 
> It was killable -- I sent SIGINT from the tty and it died as expected.
> 
> 
> Running "make replace" gets it stuck in the same place again, an the
> SIGINT shows the following stack trace:
> 
> PYTHONPATH=/var/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7  LD_LIBRARY_PATH=/build/package-obj/root/lang/python37/work/Python-3.7.1  ./python -E -Wi /var/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/compileall.py  -d /usr/pkg/lib/python3.7 -f  -x 'bad_coding|badsyntax|site-packages|lib2to3/tests/data'  /var/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7
> ^T
> [ 563859.5589422] load: 0.39  cmd: make 15726 [wait] 0.23u 0.07s 0% 9184k
> make: Working in: /build/package-obj/root/lang/python37/work/Python-3.7.1
> make[1]: Working in: /work/woods/m-NetBSD-pkgsrc-current/lang/python37
> make: Working in: /work/woods/m-NetBSD-pkgsrc-current/lang/python37
> ^T
> [ 563866.4606073] load: 0.36  cmd: make 15726 [wait] 0.23u 0.07s 0% 9184k
> make: Working in: /work/woods/m-NetBSD-pkgsrc-current/lang/python37
> make: Working in: /build/package-obj/root/lang/python37/work/Python-3.7.1
> make[1]: Working in: /work/woods/m-NetBSD-pkgsrc-current/lang/python37
> ^?Traceback (most recent call last):
>  File "/var/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/compileall.py", line 20, in <module>
>    from concurrent.futures import ProcessPoolExecutor
>  File "<frozen importlib._bootstrap>", line 1032, in _handle_fromlist
>  File "/build/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/concurrent/futures/__init__.py", line 43, in __getattr__
>    from .process import ProcessPoolExecutor as pe
>  File "/build/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/concurrent/futures/process.py", line 53, in <module>
>    import multiprocessing as mp
>  File "/build/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/multiprocessing/__init__.py", line 16, in <module>
>    from . import context
>  File "/build/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/multiprocessing/context.py", line 5, in <module>
>    from . import process
>  File "/build/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/multiprocessing/process.py", line 363, in <module>
>    _current_process = _MainProcess()
>  File "/build/package-obj/root/lang/python37/work/.destdir/usr/pkg/lib/python3.7/multiprocessing/process.py", line 347, in __init__
>    self._config = {'authkey': AuthenticationString(os.urandom(32)),
> KeyboardInterrupt
> *** Error code 1 (ignored)
> *** Signal 2
> *** Signal 2
> 
> 
> 
> --
> 					Greg A. Woods <gwoods%acm.org@localhost>
> 
> Kelowna, BC     +1 250 762-7675           RoboHack <woods%robohack.ca@localhost>
> Planix, Inc. <woods%planix.com@localhost>     Avoncote Farms <woods%avoncote.ca@localhost>