Subject: Re: raid problems
To: Jukka Marin <jmarin@pyy.jmp.fi>
From: Greg Oster <oster@cs.usask.ca>
List: netbsd-users
Date: 09/22/2002 09:43:12
Jukka Marin writes:
> I'm trying to benchmark raidframe (level 1) with different options.
> 
> First: Where can I find a good document about raidframe?  man raidctl
> is good for raidctl, but it doesn't tell too much about raid tuning.

RAID tuning could be a whole other document :)

> For example, what is the maximum value of sectPerSU?  I have tried 64
> and 128 and 128 gave me better performance, so I wanted to try 256,
> but when I raidctl -C, raidctl -I, and raidctl -iv, I get
> 
> WARNING: raid0: total sector size in disklabel (16776704) != the size of
> raid (16776960)
> Initiating re-wrrite of parity
> aid0: IO Error.  Marking /dev/wd1f as failed.
> raid0: node (Rod) returned fail, rolling backward
> WAKEUP CALLED
> raid0: IO Error.  Marking /dev/wd0f as failed.
> raid0: node (Rod) returned fail, rolling backward
> Unable to verify raid1 parity: can't read stripe
> Could not verify parity
> raid0: Error re-writing parity!
> Parity Re-write status:

Hmmmmm... 
 
> After this, raidctl -u panics the system, I have to boot in single user
> mode etc.  Is 256 an illegal value for sectPerSU?  If so, why doesn't
> the manual say so?

It shouldn't be an illegal value, but it seems that values over 128 do cause 
problems in some cases... (perhaps related to MAXPHYS?)

> (What is a clean way of wiping away the old raid parameters, anyway?
> When I raidctl -C with new parameters, it still claims the raid disk is
> clean!)

I ususally just 'dd' a bunch of zeros to the beginning of the component.
Not recommended if you like the data on those components, but it does work
for nuking the component labels.
 
> My disks are reasonably fast (49 MB/s per disk when reading two disks
> simultaneously using dd), but raidframe is slower than with my previous
> machine that had slower disks (and the same motherboard).

Use a stripe width of 128.  RAIDframe will be a little slower on writes, and 
should be at least as fast on a single read.  If you do 2 simultaneous reads, 
you should see a nice speedup.  Also note that not all disks behave the same, 
even if they are newer... (We have some 73GB U160 disks at work that will 
write at ~40MB/sec to a filesystem on them, but will only get about 5MB/sec 
writes if RAIDframe is writing to them.  A newer firmware rev of the same
disk gets us writing at 35MB/sec (through a RAID 1) and we're much happier 
now. (machine, RAM, controller, kernel, etc. were all the same -- it was just 
the disks :( ))

Later...

Greg Oster