Subject: Raidframe performance and WD Raptors
To: None <>
From: David Brownlee <>
List: tech-perform
Date: 08/02/2005 14:52:13
  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.

Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed

 	Looking at putting together a new machine with a pair of
 	fast SATA disks (WD raptors), and wanted to get a rough
 	feel for the optimal filesystem blocksize, type, and
 	raidframe stripe size, plus what the speed increase would
 	be compared to an older IDE disk and another SATA disk.

 	So, one small perl script which calls newfs on a filesystem,
 	mounts, extracts Openoffice distfile, umounts, remounts
 	removes, and then umounts later...

 	Timings included for an older IDE disk (ST315320A), standard
 	SATA disk (ST3200822AS), the two fast raptors (WD740GD),
 	and of course two variations on raidframe RAID1 on top of
 	the two raptors.

 	In each case the filesystems were tested with 4k-64k
 	blocksizes, ffs 1 & 2 (O1 and O2), and softdep, no mount
 	flags, and async.

 	My conclusion on this was to go with 16 blocksizes, ffsv2
 	(more for the faster fsck), softdep, and raidframe with
 	128 stripe sizes.

 	The test system is the latest netbsd-2 on an Athlon64 4000+
 	in an Asus A8V-deluxe motherboard with 128M of RAM. On some
 	of the 64k async tests I was able to trigger a lockup.  I
 	need to look at that more.

 	In case anyone else finds this interesting. Do not place
 	any value on the fact seconds are displayed to one decimal

wd2 at atabus2 drive 0: <ST315320A>
wd2: drive supports 16-sector PIO transfers, LBA addressing
wd2: 14594 MB, 29651 cyl, 16 head, 63 sec, 512 bytes/sect x 29888820 sectors
wd2: 32-bit data port
wd2: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 4 (Ultra/66)
wd2(viaide1:0:0): using PIO mode 4, Ultra-DMA mode 4 (Ultra/66) (using DMA data transfers)

  4k-O2-softdep  newfs:4.8    tar:212.9  um:8.0    rm:182.1  um:0.1
  8k-O2-softdep  newfs:2.0    tar:192.4  um:9.1    rm:168.1  um:0.2
16k-O2-softdep  newfs:0.8    tar:153.9  um:4.5    rm:177.3  um:0.2
32k-O2-softdep  newfs:0.4    tar:153.5  um:2.3    rm:189.4  um:0.2
64k-O2-softdep  newfs:0.3    tar:592.0  um:2.1    rm:226.4  um:0.2
  4k-O1-softdep  newfs:28.5   tar:215.6  um:6.0    rm:167.5  um:0.1
  8k-O1-softdep  newfs:12.6   tar:173.6  um:4.5    rm:158.3  um:0.3
16k-O1-softdep  newfs:6.3    tar:146.8  um:5.6    rm:170.9  um:0.2
32k-O1-softdep  newfs:3.2    tar:148.3  um:3.9    rm:183.6  um:0.2
64k-O1-softdep  newfs:1.7    tar:199.2  um:1.7    rm:221.8  um:0.2
  4k-O2-         newfs:4.6    tar:291.0  um:4.7    rm:181.9  um:0.2
  8k-O2-         newfs:2.0    tar:257.1  um:3.5    rm:170.0  um:0.1
16k-O2-         newfs:0.8    tar:257.1  um:2.5    rm:178.6  um:0.1
32k-O2-         newfs:0.4    tar:291.0  um:2.1    rm:189.0  um:0.3
64k-O2-         newfs:0.3    tar:431.5  um:1.8    rm:227.7  um:0.2
  4k-O1-         newfs:28.5   tar:283.2  um:4.9    rm:167.9  um:0.3
  8k-O1-         newfs:12.7   tar:281.4  um:3.5    rm:159.9  um:0.1
16k-O1-         newfs:6.4    tar:274.1  um:2.5    rm:170.7  um:0.2
32k-O1-         newfs:3.2    tar:301.0  um:1.0    rm:184.7  um:0.2
64k-O1-         newfs:1.7    tar:431.1  um:1.4    rm:222.7  um:0.2
  4k-O2-async    newfs:4.6    tar:199.8  um:4.2    rm:182.4  um:0.3
  8k-O2-async    newfs:1.9    tar:162.4  um:3.4    rm:169.6  um:0.2
16k-O2-async    newfs:0.7    tar:132.0  um:2.3    rm:176.0  um:0.3
32k-O2-async    newfs:0.4    tar:116.3  um:2.3    rm:190.1  um:0.2
64k-O2-async    newfs:0.3    tar:221.7  um:2.0    rm:226.8  um:0.1
  4k-O1-async    newfs:28.4   tar:180.5  um:5.1    rm:165.6  um:0.2
  8k-O1-async    newfs:12.6   tar:151.8  um:3.8    rm:158.8  um:0.1
16k-O1-async    newfs:6.3    tar:136.6  um:2.5    rm:170.3  um:0.3
32k-O1-async    newfs:3.2    tar:123.2  um:2.1    rm:184.5  um:0.2
64k-O1-async    newfs:1.6    tar:265.3  um:2.4    rm:222.3  um:0.2
wd1 at atabus1 drive 0: <ST3200822AS>
wd1: drive supports 16-sector PIO transfers, LBA48 addressing
wd1: 186 GB, 387621 cyl, 16 head, 63 sec, 512 bytes/sect x 390721968 sectors
wd1: 32-bit data port
wd1: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd1(viaide0:1:0): using PIO mode 4, Ultra-DMA mode 6 (Ultra/133) (using DMA data transfers)

  4k-O2-softdep  newfs:3.6    tar:141.6  um:5.0    rm:101.9  um:0.3
  8k-O2-softdep  newfs:1.2    tar:132.8  um:2.6    rm:95.4   um:0.3
16k-O2-softdep  newfs:0.5    tar:122.3  um:1.9    rm:99.5   um:0.2
32k-O2-softdep  newfs:0.3    tar:118.1  um:1.3    rm:111.2  um:0.3
64k-O2-softdep  newfs:0.4    tar:2624   um:1.3    rm:133.8  um:0.2
  4k-O1-softdep  newfs:14.7   tar:131.4  um:4.0    rm:97.1   um:0.2
  8k-O1-softdep  newfs:5.5    tar:116.9  um:5.6    rm:95.7   um:0.3
16k-O1-softdep  newfs:2.7    tar:121.1  um:2.9    rm:97.9   um:0.3
32k-O1-softdep  newfs:1.5    tar:132.8  um:2.0    rm:113.6  um:0.4
64k-O1-softdep  newfs:0.8    tar:167.0  um:1.2    rm:132.5  um:0.2
  4k-O2-         newfs:3.6    tar:232.6  um:3.2    rm:101.3  um:0.5
  8k-O2-         newfs:1.5    tar:220.5  um:1.8    rm:96.5   um:0.3
16k-O2-         newfs:0.5    tar:210.8  um:0.9    rm:98.4   um:0.5
32k-O2-         newfs:0.4    tar:216.4  um:0.6    rm:111.2  um:0.4
64k-O2-         newfs:0.2    tar:302.2  um:0.4    rm:131.6  um:0.3
  4k-O1-         newfs:14.9   tar:221.7  um:3.1    rm:98.7   um:0.2
  8k-O1-         newfs:5.4    tar:210.5  um:1.7    rm:94.4   um:0.3
16k-O1-         newfs:2.9    tar:201.3  um:1.3    rm:92.8   um:0.3
32k-O1-         newfs:1.4    tar:210.6  um:1.1    rm:109.3  um:0.3
64k-O1-         newfs:0.8    tar:297.1  um:0.9    rm:135.0  um:0.3
  4k-O2-async    newfs:3.5    tar:121.2  um:4.1    rm:102.4  um:0.4
  8k-O2-async    newfs:1.2    tar:118.1  um:3.1    rm:97.6   um:0.1
16k-O2-async    newfs:0.5    tar:90.9   um:1.9    rm:96.4   um:0.3
32k-O2-async    newfs:0.2    tar:73.4   um:1.6    rm:109.4  um:0.4
64k-O2-async    newfs:0.1    tar:185.6  um:1.5    rm:131.9  um:0.3
  4k-O1-async    newfs:14.5   tar:118.4  um:3.8    rm:99.6   um:0.3
  8k-O1-async    newfs:5.5    tar:105.1  um:2.5    rm:90.6   um:0.2
16k-O1-async    newfs:2.7    tar:86.6   um:2.2    rm:95.8   um:0.3
32k-O1-async    newfs:1.5    tar:100.1  um:1.7    rm:106.1  um:0.3
64k-O1-async    newfs:0.8    tar:229.3  um:1.5    rm:127.3  um:0.3
wd0 at atabus0 drive 0: <WDC WD740GD-50FLC0>
wd0: drive supports 16-sector PIO transfers, LBA48 addressing
wd0: 70911 MB, 144073 cyl, 16 head, 63 sec, 512 bytes/sect x 145226112 sectors
wd0: 32-bit data port
wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd0(viaide0:0:0): using PIO mode 4, Ultra-DMA mode 6 (Ultra/133) (using DMA data transfers)

  4k-O2-softdep  newfs:2.6    tar:133.6  um:4.4    rm:75.7   um:0.8
  8k-O2-softdep  newfs:0.9    tar:75.6   um:3.7    rm:57.0   um:0.5
16k-O2-softdep  newfs:0.4    tar:81.4   um:2.9    rm:56.9   um:0.5
32k-O2-softdep  newfs:0.3    tar:59.1   um:2.6    rm:75.3   um:0.3
64k-O2-softdep  newfs:0.2    tar:190.4  um:1.3    rm:140.6  um:0.1
  4k-O1-softdep  newfs:10.4   tar:128.0  um:3.4    rm:66.1   um:0.8
  8k-O1-softdep  newfs:4.5    tar:71.6   um:2.6    rm:51.9   um:0.5
16k-O1-softdep  newfs:2.3    tar:57.9   um:2.3    rm:56.4   um:0.5
32k-O1-softdep  newfs:1.2    tar:58.4   um:2.2    rm:79.9   um:0.5
64k-O1-softdep  newfs:0.7    tar:82.8   um:5.3    rm:134.5  um:0.2
  4k-O2-         newfs:2.7    tar:146.2  um:0.6    rm:73.6   um:0.6
  8k-O2-         newfs:0.9    tar:88.7   um:1.4    rm:56.8   um:0.5
16k-O2-         newfs:0.4    tar:91.4   um:1.0    rm:53.9   um:0.6
32k-O2-         newfs:0.3    tar:146.3  um:0.6    rm:67.9   um:0.4
64k-O2-         newfs:0.2    tar:186.0  um:0.7    rm:146.4  um:0.2
  4k-O1-         newfs:10.3   tar:136.3  um:1.3    rm:66.3   um:0.7
  8k-O1-         newfs:4.5    tar:87.1   um:1.3    rm:53.0   um:0.5
16k-O1-         newfs:2.3    tar:98.5   um:0.9    rm:53.4   um:0.4
32k-O1-         newfs:1.2    tar:174.2  um:0.6    rm:75.2   um:0.2
64k-O1-         newfs:0.7    tar:188.8  um:0.6    rm:141.0  um:0.2
  4k-O2-async    newfs:2.7    tar:113.5  um:2.6    rm:74.7   um:0.6
  8k-O2-async    newfs:0.9    tar:62.0   um:1.4    rm:57.3   um:0.4
16k-O2-async    newfs:0.4    tar:45.9   um:1.0    rm:53.8   um:0.6
32k-O2-async    newfs:0.3    tar:36.7   um:0.9    rm:71.6   um:0.3
64k-O2-async    newfs:0.2    tar:92.4   um:0.7    rm:136.5  um:0.2
  4k-O1-async    newfs:10.3   tar:100.1  um:1.9    rm:66.4   um:0.6
  8k-O1-async    newfs:4.5    tar:67.3   um:1.5    rm:51.2   um:0.4
16k-O1-async    newfs:2.3    tar:47.1   um:0.9    rm:51.5   um:0.4
32k-O1-async    newfs:1.2    tar:33.8   um:1.0    rm:70.8   um:0.3
64k-O1-async    newfs:0.6    tar:119.9  um:1.0    rm:146.0  um:0.1
wd1 at atabus1 drive 0: <WDC WD740GD-00FLC0>
wd1: drive supports 16-sector PIO transfers, LBA48 addressing
wd1: 70911 MB, 144073 cyl, 16 head, 63 sec, 512 bytes/sect x 145226112 sectors
wd1: 32-bit data port
wd1: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd1(viaide0:1:0): using PIO mode 4, Ultra-DMA mode 6 (Ultra/133) (using DMA data transfers)

  4k-O2-softdep  newfs:2.3    tar:126.9  um:5.2    rm:71.3   um:0.6
  8k-O2-softdep  newfs:0.8    tar:69.5   um:4.5    rm:55.2   um:0.5
16k-O2-softdep  newfs:0.4    tar:59.1   um:2.0    rm:57.8   um:0.3
32k-O2-softdep  newfs:0.2    tar:66.2   um:0.6    rm:70.4   um:0.3
64k-O2-softdep  newfs:0.2    tar:659.2  um:0.9    rm:143.1  um:0.1
  4k-O1-softdep  newfs:10.2   tar:113.8  um:4.7    rm:64.3   um:0.5
  8k-O1-softdep  newfs:4.3    tar:69.5   um:4.8    rm:51.4   um:0.5
16k-O1-softdep  newfs:2.3    tar:55.9   um:2.8    rm:54.3   um:0.4
32k-O1-softdep  newfs:1.2    tar:59.4   um:2.6    rm:71.7   um:0.3
64k-O1-softdep  newfs:0.6    tar:86.8   um:1.1    rm:138.5  um:0.1
  4k-O2-         newfs:2.4    tar:140.3  um:1.8    rm:71.7   um:0.7
  8k-O2-         newfs:0.8    tar:85.3   um:1.3    rm:55.0   um:0.4
16k-O2-         newfs:0.4    tar:89.5   um:0.7    rm:51.7   um:0.3
32k-O2-         newfs:0.3    tar:136.9  um:0.7    rm:71.8   um:0.3
64k-O2-         newfs:0.2    tar:186.1  um:0.3    rm:143.2  um:0.2
  4k-O1-         newfs:10.2   tar:129.7  um:1.7    rm:64.4   um:0.7
  8k-O1-         newfs:4.4    tar:84.6   um:1.2    rm:50.3   um:0.4
16k-O1-         newfs:2.3    tar:94.3   um:0.8    rm:54.1   um:0.4
32k-O1-         newfs:1.2    tar:159.7  um:0.7    rm:73.3   um:0.2
64k-O1-         newfs:0.6    tar:181.3  um:0.6    rm:140.5  um:0.1
  4k-O2-async    newfs:2.5    tar:110.1  um:1.7    rm:71.6   um:0.6
  8k-O2-async    newfs:0.8    tar:59.4   um:1.0    rm:54.4   um:0.4
16k-O2-async    newfs:0.4    tar:45.9   um:0.7    rm:53.6   um:0.4
32k-O2-async    newfs:0.3    tar:36.3   um:0.9    rm:68.2   um:0.3
64k-O2-async    newfs:0.2    tar:62.6   um:0.7    rm:144.6  um:0.2
  4k-O1-async    newfs:10.2   tar:94.2   um:1.7    rm:64.9   um:0.6
  8k-O1-async    newfs:4.3    tar:77.1   um:1.5    rm:51.5   um:0.5
16k-O1-async    newfs:2.3    tar:42.7   um:0.8    rm:55.4   um:0.4
32k-O1-async    newfs:1.2    tar:41.6   um:0.8    rm:80.6   um:0.2
64k-O1-async    newfs:0.7    tar:142.7  um:0.9    rm:136.4  um:0.2
Using both disks from WD740GD-0 and WD740GD-1, raidframe RAID1,
128 sectors per stripe

  4k-O2-softdep  newfs:2.2    tar:198.9  um:9.5    rm:106.9  um:0.9
  8k-O2-softdep  newfs:0.6    tar:98.3   um:6.5    rm:67.6   um:0.5
16k-O2-softdep  newfs:0.3    tar:79.8   um:2.9    rm:67.8   um:0.3
32k-O2-softdep  newfs:0.2    tar:84.6   um:1.5    rm:119.8  um:0.0
64k-O2-softdep  newfs:0.1    tar:964.7  um:2.2    rm:190.3  um:0.1
  4k-O1-softdep  newfs:10.3   tar:168.0  um:7.9    rm:123.0  um:0.0
  8k-O1-softdep  newfs:4.3    tar:89.2   um:7.0    rm:61.9   um:0.0
16k-O1-softdep  newfs:2.2    tar:77.5   um:6.2    rm:114.2  um:0.0
32k-O1-softdep  newfs:1.2    tar:70.3   um:5.5    rm:148.4  um:0.0
64k-O1-softdep  newfs:0.6    tar:108.1  um:3.7    rm:155.0  um:0.0
  4k-O2-         newfs:2.2    tar:280.1  um:3.5    rm:129.5  um:0.3
  8k-O2-         newfs:0.7    tar:138.3  um:1.8    rm:68.0   um:0.1
16k-O2-         newfs:0.2    tar:115.7  um:1.9    rm:66.6   um:0.2
32k-O2-         newfs:0.1    tar:164.0  um:0.6    rm:98.6   um:0.1
64k-O2-         newfs:0.1    tar:233.8  um:0.9    rm:172.1  um:0.0
  4k-O1-         newfs:10.2   tar:302.7  um:4.6    rm:122.8  um:0.6
  8k-O1-         newfs:4.5    tar:137.8  um:2.5    rm:61.0   um:0.0
16k-O1-         newfs:2.5    tar:133.2  um:1.9    rm:109.9  um:0.0
32k-O1-         newfs:1.2    tar:211.5  um:1.5    rm:177.5  um:0.0
64k-O1-         newfs:0.6    tar:240.1  um:1.2    rm:159.6  um:0.0
  4k-O2-async    newfs:2.2    tar:144.2  um:4.8    rm:129.7  um:0.1
  8k-O2-async    newfs:0.7    tar:74.7   um:3.0    rm:67.7   um:0.2
16k-O2-async    newfs:0.3    tar:57.7   um:1.4    rm:65.4   um:0.2
32k-O2-async    newfs:0.1    tar:45.2   um:1.2    rm:111.6  um:0.0
64k-O2-async    newfs:0.1    tar:72.4   um:0.6    rm:171.9  um:0.0
  4k-O1-async    newfs:10.2   tar:122.3  um:7.3    rm:120.3  um:0.1
  8k-O1-async    newfs:4.6    tar:68.4   um:3.8    rm:59.3   um:0.0
16k-O1-async    newfs:2.5    tar:53.8   um:2.7    rm:69.1   um:0.0
32k-O1-async    newfs:1.2    tar:42.8   um:2.4    rm:131.8  um:0.0
64k-O1-async    newfs:0.6    tar:71.8   um:1.7    rm:158.1  um:0.0
Using both disks from WD740GD-0 and WD740GD-1, raidframe RAID1,
64 sectors per stripe

  4k-O2-softdep  newfs:2.2    tar:189.8  um:6.9    rm:107.9  um:0.3
  8k-O2-softdep  newfs:0.6    tar:99.8   um:3.8    rm:69.3   um:0.4
16k-O2-softdep  newfs:0.2    tar:82.8   um:1.5    rm:66.3   um:0.0
32k-O2-softdep  newfs:0.1    tar:89.4   um:1.0    rm:104.7  um:0.1
64k-O2-softdep  newfs:0.1    tar:104.8  um:1.4    rm:258.7  um:0.1
  4k-O1-softdep  newfs:10.5   tar:168.0  um:8.0    rm:129.8  um:0.1
  8k-O1-softdep  newfs:4.5    tar:95.5   um:3.6    rm:63.8   um:0.2
16k-O1-softdep  newfs:2.4    tar:73.8   um:4.6    rm:102.4  um:0.1
32k-O1-softdep  newfs:1.2    tar:71.8   um:5.0    rm:144.7  um:0.0
64k-O1-softdep  newfs:0.5    tar:103.9  um:4.2    rm:265.9  um:0.0
  4k-O2-         newfs:2.3    tar:269.2  um:3.3    rm:108.6  um:0.1
  8k-O2-         newfs:0.6    tar:122.7  um:2.0    rm:70.0   um:0.1
16k-O2-         newfs:0.3    tar:120.5  um:2.1    rm:62.9   um:0.1
32k-O2-         newfs:0.1    tar:160.6  um:1.8    rm:122.9  um:0.1
64k-O2-         newfs:0.1    tar:236.1  um:1.2    rm:253.1  um:0.0
  4k-O1-         newfs:10.8   tar:305.8  um:4.9    rm:138.4  um:0.0
  8k-O1-         newfs:4.4    tar:153.6  um:2.4    rm:64.6   um:0.1
16k-O1-         newfs:2.4    tar:121.9  um:1.5    rm:71.5   um:0.1
32k-O1-         newfs:1.1    tar:229.7  um:1.6    rm:123.6  um:0.0
64k-O1-         newfs:0.6    tar:250.7  um:0.4    rm:264.0  um:0.0
  4k-O2-async    newfs:2.3    tar:142.7  um:5.7    rm:116.3  um:0.1
  8k-O2-async    newfs:0.7    tar:75.2   um:3.2    rm:69.5   um:0.4
16k-O2-async    newfs:0.3    tar:56.7   um:2.3    rm:61.8   um:0.3
32k-O2-async    newfs:0.1    tar:45.6   um:2.0    rm:123.7  um:0.1
64k-O2-async    newfs:0.1    tar:86.1   um:1.4    rm:257.5  um:0.1
  4k-O1-async    newfs:10.9   tar:125.2  um:8.5    rm:130.6  um:0.1
  8k-O1-async    newfs:4.6    tar:69.0   um:3.9    rm:64.6   um:0.0
16k-O1-async    newfs:2.4    tar:53.6   um:3.0    rm:112.8  um:0.0
32k-O1-async    newfs:1.2    tar:43.5   um:2.5    rm:126.6  um:0.0
64k-O1-async    newfs:0.6    tar:56.7   um:1.9    rm:264.6  um:0.0

 			   David Brownlee --
Content-Type: TEXT/PLAIN; charset=US-ASCII; name=disktest
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.NEB.4.62.0508021452130.402@localhost.>
Content-Disposition: attachment; filename=disktest