Re: pkg/51657: Python (2.7): interpreter hangs on exit after a call to subproccess.Popen()

[Havard Eidnes <he%NetBSD.org@localhost>]

The following reply was made to PR pkg/51657; it has been noted by GNATS.

From: Havard Eidnes <he%NetBSD.org@localhost>
To: Oskar.Skog.Finland%gmail.com@localhost
Cc: gnats-bugs%NetBSD.org@localhost
Subject: Re: pkg/51657: Python (2.7): interpreter hangs on exit after a
 call to subproccess.Popen()
Date: Mon, 14 Aug 2017 14:40:58 +0200 (CEST)

 Hi,
 
 I'm wondering...  We're seeing something which looks a little
 similar with use of ansible on NetBSD/amd64 7.0_STABLE from Nov
 25 2016; its connection module also uses subproccess.Popen().
 
 What we're seeing is processes stuck in "DE" state, i.e. both
 exiting and in short-term IO-wait, partial "ps axlw" output:
 
 1071 22773     1     0   0  0       0       0 -       DE   pts/70-     =
 0:00.00 (python2.7)
 1071   267     1     0   0  0       0       0 -       DE   pts/71-     =
 0:00.00 (python2.7)
 1071  5273     1     0   0  0       0       0 -       DE   pts/71-     =
 0:00.00 (python2.7)
 
 These processes open pty's for doing IO, and we're also seeing
 output stuck on ptys, partial "pstat -t" output:
 
 pts/32   0  22 1024 1216 256     13 OC                    0     0 termi=
 os
 pts/33   0  22 1024 1216 256     14 OC                    0     0 termi=
 os
 pts/34   0  22 1024 1216 256      4 OC                    0     0 termi=
 os
 pts/35   0  22 1024 1216 256     14 OC                    0     0 termi=
 os
 pts/36   0  22 1024 1216 256      4 OC                    0     0 termi=
 os
 pts/37   0  22 1024 1216 256      4 OC                    0     0 termi=
 os
 pts/38   0  22 1024 1216 256      4 OC                    0     0 termi=
 os
 pts/39   0  22 1024 1216 256      4 OC                    0     0 termi=
 os
 pts/40   0  22 1024 1216 256      4 OC                    0     0 termi=
 os
 pts/41   0  22 1024 1216 256      4 OC                    0     0 termi=
 os
 pts/42   0  22 1024 1216 256      4 OC                    0     0 termi=
 os
 ...
 pts/74   3   0  81 1216 256       3 OC                    0     0 termi=
 os
 pts/75   0   0  95 1216 256       0 OC                    0     0 termi=
 os
 pts/76   0   0  95 1216 256       0 OC                    0     0 termi=
 os
 pts/77   0   0  95 1216 256       0 OC                    0     0 termi=
 os
 pts/78   0   0  95 1216 256       0 OC                    0     0 termi=
 os
 pts/79   0   0  95 1216 256       0 OC                    0     0 termi=
 os
 
 fstat for the three processes above show:
 
 : {11} fstat -p 22773
 USER     CMD          PID   FD MOUNT       INUM MODE         SZ|DV R/W
 nn  python2.7  22773   wd /home    4101726 drwxr-xr-x    1024 r =
 
 nn  python2.7  22773    1* pipe 0xfffffe8aee118968 -> 0x0 w
 nn  python2.7  22773    2* pipe 0xfffffe8efba98a58 -> 0x0 w
 nn  python2.7  22773    4 /dev/pts     152 crw-rw-rw-   ptc,74 rw
 nn  python2.7  22773    8* kqueue pending 0
 nn  python2.7  22773   10 /          62406 -rw-r--r--      63 r =
 
 nn  python2.7  22773   12* misc ops=3D0xffffffff80c3c820 0xfffffe8fec80=
 40f0
 : {12} fstat -p 267
 USER     CMD          PID   FD MOUNT       INUM MODE         SZ|DV R/W
 nn  python2.7    267   wd /home    4101726 drwxr-xr-x    1024 r =
 
 nn  python2.7    267    1* pipe 0xfffffe81011a3a00 -> 0x0 w
 nn  python2.7    267    2* pipe 0xfffffe8848716698 -> 0x0 w
 nn  python2.7    267    4 /dev/pts     154 crw-rw-rw-   ptc,75 rw
 nn  python2.7    267    8* kqueue pending 0
 nn  python2.7    267   10 /          62406 -rw-r--r--      63 r =
 
 nn  python2.7    267   12* misc ops=3D0xffffffff80c3c820 0xfffffe8fec80=
 4ec0
 : {13} fstat -p 5273
 USER     CMD          PID   FD MOUNT       INUM MODE         SZ|DV R/W
 nn  python2.7   5273   wd /home    4101726 drwxr-xr-x    1024 r =
 
 nn  python2.7   5273    1* pipe 0xfffffe84b1001808 -> 0x0 w
 nn  python2.7   5273    2* pipe 0xfffffe886827b198 -> 0x0 w
 nn  python2.7   5273    4 /dev/pts     158 crw-rw-rw-   ptc,77 rw
 nn  python2.7   5273    8* kqueue pending 0
 nn  python2.7   5273   10 /          62406 -rw-r--r--      63 r =
 
 nn  python2.7   5273   12* misc ops=3D0xffffffff80c3c820 0xfffffe8fec80=
 44d0
 : {14}
 
 Would you care to share your "bug" python script, so I can take a
 closer look?
 
 Best regards,
 
 - H=E5vard