NetBSD-Users archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: Help with low raid5 performance



On 12 November 2010 22:14, Peter Kerwien <peter%kerwien.homeip.net@localhost> 
wrote:
> Any comments on the following:
>
> Same disks, HW but different OS and filesystem: Linux Mint 10 (amd64)
> with mdadm created raid-5 and ext4. Chunk size = 32KB, block size = 4KB,
> stride size = 8 blocks = 32KB.
>
> # dd if=/mnt/vol1/pub/foo.mkv of=/dev/null bs=100M count=100
> 100+0 records in
> 100+0 records out
> 10485760000 bytes (10 GB) copied, 100.641 s, 104 MB/s
>
> # dd if=/dev/zero of=/mnt/vol1/pub/zero bs=100M count=100
> 100+0 records in
> 100+0 records out
> 10485760000 bytes (10 GB) copied, 102.646 s, 102 MB/s
>
> Note the *slightly* higher write speed. Comments?
>
I've noticed that with the same RAID configuration as yourself, I
started the wedge at 128 sectors, not 64 (ie a whole stripe of data
from the start), I remember having terrible performance until I got
this bit correct.

I have 3x2T HGST disks, set up like the following:-

(ian:~)$ sudo raidctl -G raid0
# raidctl config file for /dev/rraid0d

START array
# numRow numCol numSpare
1 3 0

START disks
/dev/wd4a
/dev/wd2a
/dev/wd3a

START layout
# sectPerSU SUsPerParityUnit SUsPerReconUnit RAID_level_5
64 1 1 5

START queue
fifo 100
(ian:~)$ sudo gpt show raid0
       start        size  index  contents
           0           1         PMBR
           1           1         Pri GPT header
           2          32         Pri GPT table
          34          94
         128  7814057951      1  GPT part - NetBSD UFS/UFS2
  7814058079          32         Sec GPT table
  7814058111           1         Sec GPT header
(ian:~)$ sudo dkctl raid0 listwedges
/dev/rraid0d: 1 wedge:
dk0: 16cdb564-4432-11df-8352-0050430072f6, 7814057951 blocks at 128, type: ffs
(ian:~)$

This gives the following performance:

(ian:~)$ cd /usr3/share/
(ian:/usr3/share)$ dd if=/dev/zero of=zero bs=100m count=1k
1024+0 records in
1024+0 records out
107374182400 bytes transferred in 626.305 secs (171440723 bytes/sec)
(ian:/usr3/share)$ dd if=zero of=/dev/null bs=100m count=1k
1024+0 records in
1024+0 records out
107374182400 bytes transferred in 458.915 secs (233974009 bytes/sec)
(ian:/usr3/share)$

(Quad core Phenom on a 780G motherboard.)

Cheers,

Ian


Home | Main Index | Thread Index | Old Index