Re: Re: bin/56728: iscsi redundancy doesn't work

[6bone%6bone.informatik.uni-leipzig.de@localhost]

On Sun, 27 Feb 2022, Michael van Elst wrote:

> Date: Sun, 27 Feb 2022 15:10:01 +0000 (UTC)
> From: Michael van Elst <mlelstv%serpens.de@localhost>
> Reply-To: gnats-bugs%netbsd.org@localhost
> To: gnats-admin%netbsd.org@localhost, netbsd-bugs%netbsd.org@localhost,
>     6bone%6bone.informatik.uni-leipzig.de@localhost
> Subject: [Extern] Re: bin/56728: iscsi redundancy doesn't work
>
> The following reply was made to PR bin/56728; it has been noted by GNATS.
>
> From: mlelstv%serpens.de@localhost (Michael van Elst)
> To: gnats-bugs%netbsd.org@localhost
> Cc:
> Subject: Re: bin/56728: iscsi redundancy doesn't work
> Date: Sun, 27 Feb 2022 15:09:02 -0000 (UTC)

iscsictl list_targets
     1: iqn.1992-08.com.netapp:naclaug
        2: 172.18.86.130:3260,1026
        3: 172.18.86.131:3260,1027

iscsictl list_sessions -c
Session 3: Target iqn.1992-08.com.netapp:naclaug
 Connection 1 Address 172.18.86.130:3260,1026

iscsictl add_connection -I 3 -P 3
iscsictl: add_connection: The login failed
-> crash

Here is some debug output. At time 881 'iscsictl login -P 2' was run. At 
1669 the iscsictl add_connection -I 3 -P 3. Nothing between.

[   863.216616] ISCSI Ioctl cmd = c0680002
[   863.216616] Create Connection for Session 1
[   863.216616] S1C1: get_socket: par_sock=8, fdesc=0xfffffe6856d01680
[   863.216616] ISCSI Ioctl cmd = c1000008
[   863.216616] ISCSI Ioctl cmd = c1000008
[   863.216616] ISCSI Ioctl cmd = c0080003
[   863.216616] ISCSI: kill_session 1, status 29, logout 0, recover 0
[   863.216616] S1C1: Kill_connection: terminating=0, status=29, logout=0, 
state=3
[   863.216616] S1C1: Kill_connection setting destroy flag
[   863.216616] S1C1: Received Logout PDU - CCB = 0xffffd600678fad00, 
otherconn=0, response=0
[   863.216616] S1C1: Closing Socket 0xfffffe6856d01680
[   863.216616] S1C1: TERMINATED
[   863.216616] S1C1: Waiting for conn_idle
[   863.216616] S1C1: Waited for conn_idle, destroy = 1
[   863.216616] ISCSI Ioctl cmd = c018000d
[   863.216616] S1C1: Send thread exits
[   863.216616] Cleanup: session 1
[   863.216616] Cleanup: Unmap session 1
[   863.216616] Cleanup: session ended 1
[   863.216616] ISCSI Ioctl cmd = c0680002
[   863.216616] Create Connection for Session 2
[   863.216616] S2C1: get_socket: par_sock=8, fdesc=0xfffffe68556c2b00
[   863.216616] ISCSI Ioctl cmd = c018000d
[   863.216616] ISCSI Ioctl cmd = c1000008
[   863.216616] ISCSI Ioctl cmd = c1000008
[   863.216616] ISCSI Ioctl cmd = c0080003
[   863.216616] ISCSI: kill_session 2, status 29, logout 0, recover 0
[   863.216616] S2C1: Kill_connection: terminating=0, status=29, logout=0, 
state=3
[   863.216616] S2C1: Kill_connection setting destroy flag
[   863.216616] S2C1: Received Logout PDU - CCB = 0xffffd600678fad00, 
otherconn=0, response=0
[   863.216616] S2C1: Closing Socket 0xfffffe68556c2b00
[   863.216616] S2C1: TERMINATED
[   863.216616] S2C1: ISCSI Ioctl cmd = c018000d
[   863.216616] Waiting for conn_idle
[   863.216616] S2C1: Waited for conn_idle, destroy = 1
[   863.216616] S2C1: Send thread exits
[   863.216616] Cleanup: session 2
[   863.216616] Cleanup: Unmap session 2
[   863.216616] Cleanup: session ended 2
[   863.216616] ISCSI Ioctl cmd = c018000d
[   881.873938] ISCSI Ioctl cmd = c0680002
[   881.873938] Create Connection for Session 3
[   881.873938] S3C1: get_socket: par_sock=8, fdesc=0xfffffe6856d01680
[   881.884021] Login: map session 3
[   881.884021] scsibus4 at iscsi0: 1 target, 16 luns per target
[   881.884021] sd3 at scsibus4 target 0 lun 11: <NETAPP, LUN C-Mode, 
9700> disk fixed
[   881.884021] sd3: 10240 GB, 65129 cyl, 16 head, 20607 sec, 512 
bytes/sect x 21474836480 sectors
[   881.884021] sd3: GPT GUID: d644c65b-110e-4dd0-9500-0cfc70900463
[   881.884021] dk0 at sd3: "NetApp01", 21474836413 blocks at 34, type: 
ffs
[   881.884021] sd3: async, 8-bit transfers, tagged queueing
[  1669.006479] ISCSI Ioctl cmd = c0680004
[  1669.006479] Create Connection for Session 3
[  1669.006479] S3C2: get_socket: par_sock=8, fdesc=0xfffffe68527dd7c0
[  1669.006479] S3C2: Login problem - Class = 2, Detail = a
[  1669.006479] S3C2: Login failed (rc 4)
[  1669.006479] S3C2: Kill_connection: terminating=0, status=4, logout=-1, 
state=0
[  1669.006479] S3C2: Kill_connection setting destroy flag
[  1669.006479] S3C2: Closing Socket 0xfffffe68527dd7c0
[  1669.006479] S3C2: S3C2: Read failed (ret: 0, req: 48, out: 48)
[  1669.006479] TERMINATED
[  1669.006479] S3C2: ISCSI Ioctl cmd = c018000d
[  1669.006479] S3C2: *** Connection Error, status=18, logout=2, state=6
[  1669.006479] Waiting for conn_idle
[  1669.006479] S3C2: Waited for conn_idle, destroy = 1
[  1669.006479] S3C2: Send thread exits
[  1669.006479] Cleanup: session 3
[  1669.006479] Cleanup: Unmap session 3
[  1669.006479] dk0 at sd3 (NetApp01) deleted
[  1669.006479] sd3: detached
[  1669.006479] scsibus4: detached
[  1669.006479] Cleanup: session ended 3
[  1669.006479] ISCSI Ioctl cmd = c018000d


> Trying to logout from that session fails somewhat. Access to the
> devices fails immediately with I/O error and after some timeout
> the session is dropped and the devices detach.
>
> Removing each connection individually with 'remove_connection' looks
> more sane. When last connection is removed, the session is dropped
> and the devices detach.
>
> Simply stopping the target would also cause infinite retries.
> You can trace all this by increasing hw.iscsi.debug with sysctl.


Thank you for your efforts

Regards
Uwe