Subject: Re: nfs sync, slow
To: Andrew Gillham <gillham@vaultron.com>
From: Tracy J. Di Marco White <gendalia@iastate.edu>
List: current-users
Date: 12/06/2000 00:51:05
}Tracy J. Di Marco White writes:
}>
}> NetBSD and Linux are the NFS clients. Linux is slower, I believe they've
}> only gotten v2 to work. I've gotten the NetBSD boxes to be slightly faster,
}> I've changed -r & -w to 16K. I'm not sure if that's led to improvement
}> on the Linux boxes, I'll be checking benchmarks on them later today.
}
}Here are some numbers from bonnie on my machine. The NFS server is a
}1.5_ALPHA2 system with a PII-400, 128MB, an epic ethernet (100FD), and
}a 20GB UDMA/33 drive. The client is a Duron 950, 256MB, fxp (100FD), and
}it is running 1.5L with UBC.
}The input numbers are not accurate due to having 256MB and UBC. I will test
}some more with larger files.
}Anyway, I tested 64k/32k/16k/8k udp v3 mounts, a 16k udp v2, and a "default"
}tcp mount. (a "default" v2 mount performed similar to the 16k v2 mount)
}The difference between a v2 mount and a tcp mount was astonishing. I did
}not expect to see a 5x difference!
}
} -------Sequential Output-------- ---Sequential Input-- --Random--
} -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
}Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
}65k 100 5580 12.9 5784 7.2 5138 11.7 47708 102.7 230898 101.4 800.6 19.1
}32k 100 6192 14.3 6268 7.7 5307 12.6 47860 102.1 230648 100.9 2088.3 39.0
}16k 100 6392 15.0 6381 7.5 5315 10.4 47880 101.3 231486 100.8 2111.3 48.4
}8k 100 3187 9.2 3188 4.4 3194 5.1 47842 112.8 234803 106.5 2614.4 47.8
}16kv2 100 1793 4.7 1789 2.4 1938 5.2 8111 22.0 234653 99.2 1752.2 37.9
}tcpmnt 100 8772 23.9 9463 11.6 5969 11.6 47381 98.2 223368 98.6 1816.6 39.3
}
}What benchmarks are you using, and what numbers are you getting?
bonnie, and the 1.5.1_ALPHA machines have nfs patches fvdl sent me.
NFS server 1.5_ALPHA2
===============================
Local:
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
lyra 100 5090 49.1 4923 16.8 3136 14.9 8042 76.4 9596 23.6 125.2 7.3
NFS:
solstice (NetBSD 1.5.1_ALPHA with fvdl nfs patches):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
solstice 100 2786 16.5 3079 4.1 2089 6.2 6549 62.8 8033 8.1 100.8 5.2
16K solstice (NetBSD 1.5_BETA2):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
solstice 100 2309 16.2 1980 4.2 1673 7.1 5566 54.0 7273 8.8 89.5 5.5
8K solstice (NetBSD 1.5_BETA2):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
solstice 100 871 7.0 1282 2.8 1489 7.4 4669 48.2 6350 9.0 115.6 5.5
16K equinox (Linux kernel 2.2.17):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
equinox 100 312 2.4 304 0.9 499 3.2 8204 59.5 7637 18.2 66.4 1.9
8K equinox (Linux kernel 2.2.17):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
equinox 100 307 2.3 312 1.0 474 2.8 7610 55.1 7660 17.1 65.8 2.1
8K eclipse (Linux kernel 2.2.13):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
eclipse 100 258 2.9 139 0.7 308 3.0 3803 45.7 4849 31.5 64.8 5.4
NFS server at NetBSD 1.5.1_ALPHA
===============================
Local:
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
lyra 100 5088 50.4 4941 17.1 3183 14.2 8088 79.7 9588 23.6 125.8 7.3
NFS:
solstice (NetBSD 1.5.1_ALPHA with fvdl nfs patches):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
solstice 100 3710 23.0 3626 4.1 2057 6.6 7268 68.7 6791 6.0 52.1 3.9
32K equinox (Linux kernel 2.2.17):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
equinox 100 328 2.5 328 1.0 466 2.8 7458 55.3 7442 18.1 66.3 2.0
16K equinox (Linux kernel 2.2.17):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
equinox 100 324 2.5 314 1.0 477 3.1 7513 56.1 7253 15.5 65.4 2.1
8K equinox (Linux kernel 2.2.17):
-------Sequential Output-------- ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
equinox 100 330 2.6 328 1.0 482 3.1 6034 51.7 5908 14.9 65.8 2.2
lyra:
cpu0: AMD K6 (586-class)
total memory = 65152 KB
avail memory = 58084 KB
using 840 buffers containing 3360 KB of memory
solstice:
cpu0: Intel Pentium II (Klamath) (686-class)
total memory = 255 MB
avail memory = 234 MB
266MHz
equinox:
vendor_id : AuthenticAMD
cpu family : 5
model : 7
model name : AMD-K6tm w/ multimedia extensions
stepping : 0
cpu MHz : 300.692
128MB RAM
eclipse:
vendor_id : AuthenticAMD
cpu family : 5
model : 3
model name : AMD-K5(tm) Processor
stepping : 4
cpu MHz : 132.875145
48MB RAM
Tracy J. Di Marco White
Project Vincent Systems Manager
gendalia@iastate.edu