Re: Network very very slow... was iSCSI and jumbo frames

[BERTRAND Joël <joel.bertrand%systella.fr@localhost>]

Michael van Elst a écrit :
> joel.bertrand%systella.fr@localhost (=?UTF-8?Q?BERTRAND_Jo=c3=abl?=) writes:
> 
>> 	But jumbo frames and Intel adapter don't increase NAS throughput :
>>              204Mb           407Mb           611Mb           814Mb
> 
> Where does this information come from?

	iftop.

> If you believe the network itself is the bottleneck, can you test
> just the network (e.g. with iperf3) ?

	I cannot test wm0 interface (I have to dismount iSCSI volume).
Nervertheless, I have tested another interface (agr0=wm3/vm4) :

-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.10.103, port 40986
[  5] local 192.168.10.128 port 5201 connected to 192.168.10.103 port 40988
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   110 MBytes   919 Mbits/sec
[  5]   1.00-2.00   sec   111 MBytes   932 Mbits/sec
[  5]   2.00-3.00   sec   110 MBytes   925 Mbits/sec
[  5]   3.00-4.00   sec   111 MBytes   934 Mbits/sec
[  5]   4.00-5.00   sec   112 MBytes   936 Mbits/sec
[  5]   5.00-6.00   sec   112 MBytes   936 Mbits/sec
[  5]   6.00-7.00   sec   111 MBytes   935 Mbits/sec
[  5]   7.00-8.00   sec   111 MBytes   935 Mbits/sec
[  5]   8.00-9.00   sec   111 MBytes   928 Mbits/sec
[  5]   9.00-10.00  sec   111 MBytes   934 Mbits/sec
[  5]  10.00-10.00  sec  33.9 KBytes   785 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  1.08 GBytes   931 Mbits/sec
receiver

hilbert:[~] > iperf3 -c 192.168.10.128
Connecting to host 192.168.10.128, port 5201
[  6] local 192.168.10.103 port 40988 connected to 192.168.10.128 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  6]   0.00-1.00   sec   110 MBytes   922 Mbits/sec    0   69.3 KBytes

[  6]   1.00-2.00   sec   111 MBytes   932 Mbits/sec    0   69.3 KBytes

[  6]   2.00-3.00   sec   110 MBytes   925 Mbits/sec    0   69.3 KBytes

[  6]   3.00-4.00   sec   111 MBytes   934 Mbits/sec    0   69.3 KBytes

[  6]   4.00-5.00   sec   112 MBytes   936 Mbits/sec    0   69.3 KBytes

[  6]   5.00-6.00   sec   112 MBytes   936 Mbits/sec    0   69.3 KBytes

[  6]   6.00-7.00   sec   111 MBytes   935 Mbits/sec    0   69.3 KBytes

[  6]   7.00-8.00   sec   111 MBytes   935 Mbits/sec    0   69.3 KBytes

[  6]   8.00-9.00   sec   111 MBytes   928 Mbits/sec    0   69.3 KBytes

[  6]   9.00-10.00  sec   111 MBytes   935 Mbits/sec    0   69.3 KBytes

- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  6]   0.00-10.00  sec  1.08 GBytes   932 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  1.08 GBytes   931 Mbits/sec
receiver

iperf Done.

	NAS exports a iSCSI device (Raid6, four disks). I have tested disk io's
also :

[~] # qcli_storage -T
fio test command for physical disk: /sbin/fio --filename=test_device
--direct=1 --rw=read --bs=1M --runtime=15 --name=test-read
--ioengine=libaio --iodepth=32 &>/tmp/qcli_storage.log
fio test command for RAID: /sbin/fio --filename=test_device --direct=0
--rw=read --bs=1M --runtime=15 --name=test-read --ioengine=libaio
--iodepth=32 &>/tmp/qcli_storage.log
Start testing!
Performance test is finished 100.000%...
Enclosure  Port  Sys_Name      Throughput    RAID        RAID_Type
RAID_Throughput   Pool
NAS_HOST   1     /dev/sda      210.50 MB/s   /dev/md1    RAID 6
310.78 MB/s       1
NAS_HOST   2     /dev/sdb      200.62 MB/s   /dev/md1    RAID 6
310.78 MB/s       1
NAS_HOST   3     /dev/sdc      207.33 MB/s   /dev/md1    RAID 6
310.78 MB/s       1
NAS_HOST   4     /dev/sdd      206.52 MB/s   /dev/md1    RAID 6
310.78 MB/s       1

	I think I will post on qNAP support as soon as possible.

	Best regards,

	JKB