Subject: 1.4.3 versus 1.5 (lmbench results on i386)
To: None <current-users@netbsd.org>
From: Andrew Gillham <gillhaa@ghost.whirlpool.com>
List: current-users
Date: 12/05/2000 20:10:16
Hello,
Here are my results from benchmarking 1.4.3 against 1.5 on the same
machine.
I installed 1.4.3 clean first, configured the network, installed perl
and lmbench, then rebooted (multiuser) and ran lmbench. After testing
1.4.3, I did the same thing for 1.5. Both were installed from CDs
made today from binaries downloaded today from ftp.netbsd.org. The
packages were installed via ftp.netbsd.org also.
The tests were:
NetBSD 1.4.3 with /usr mounted async
NetBSD 1.4.3 normal
NetBSD 1.5 normal
NetBSD 1.5 with /usr mounted async
NetBSD 1.5 with softdep on / and /usr
NetBSD 1.5L UBC with softdep on / and /usr
I only ran the benchmarks once each for lack of time.
-Andrew
L M B E N C H 1 . 9 S U M M A R Y
------------------------------------
(Alpha software, do not distribute)
Processor, Processes - times in microseconds - smaller is better
----------------------------------------------------------------
Host OS Mhz null null open selct sig sig fork exec sh
call I/O stat clos inst hndl proc proc proc
--------- ------------- ---- ---- ---- ---- ---- ----- ---- ---- ---- ---- ----
i386-netb NetBSD 1.4.3 266 1.4 4.9 23 32 0.05K 3.1 5 1.0K 5K 8K
i386-netb NetBSD 1.4.3 266 1.4 4.9 23 31 0.05K 3.1 5 1.0K 5K 8K
i386-netb NetBSD 1.5 266 1.4 5.1 26 36 0.05K 3.1 5 1.1K 4K 7K
i386-netb NetBSD 1.5 266 1.4 5.1 26 36 0.05K 3.1 5 1.1K 4K 7K
i386-netb NetBSD 1.5 266 1.4 5.1 26 36 0.05K 3.1 5 1.1K 4K 7K
i386-netb NetBSD 1.5L 266 1.4 5.3 24 33 0.05K 3.1 5 1.3K 5K 8K
Context switching - times in microseconds - smaller is better
-------------------------------------------------------------
Host OS 2p/0K 2p/16K 2p/64K 8p/16K 8p/64K 16p/16K 16p/64K
ctxsw ctxsw ctxsw ctxsw ctxsw ctxsw ctxsw
--------- ------------- ----- ------ ------ ------ ------ ------- -------
i386-netb NetBSD 1.4.3 11 39 90 48 208 51 291
i386-netb NetBSD 1.4.3 11 40 91 38 203 42 279
i386-netb NetBSD 1.5 13 46 99 53 235 55 302
i386-netb NetBSD 1.5 14 46 99 48 211 55 290
i386-netb NetBSD 1.5 14 47 99 53 209 57 291
i386-netb NetBSD 1.5L 13 43 95 43 219 56 285
*Local* Communication latencies in microseconds - smaller is better
-------------------------------------------------------------------
Host OS 2p/0K Pipe AF UDP RPC/ TCP RPC/ TCP
ctxsw UNIX UDP TCP conn
--------- ------------- ----- ----- ---- ----- ----- ----- ----- ----
i386-netb NetBSD 1.4.3 11 41 41 93 117 587
i386-netb NetBSD 1.4.3 11 40 41 93 117 592
i386-netb NetBSD 1.5 13 48 50 134 151 704
i386-netb NetBSD 1.5 14 48 49 135 147 695
i386-netb NetBSD 1.5 14 49 49 137 168 695
i386-netb NetBSD 1.5L 13 42 42 132 168 707
File & VM system latencies in microseconds - smaller is better
--------------------------------------------------------------
Host OS 0K File 10K File Mmap Prot Page
Create Delete Create Delete Latency Fault Fault
--------- ------------- ------ ------ ------ ------ ------- ----- -----
i386-netb NetBSD 1.4.3 39 6 253 11 14757 9.8K
i386-netb NetBSD 1.4.3 416 127 602 355 14759 10.1K
i386-netb NetBSD 1.5 359 127 595 335 17800 6.6K
i386-netb NetBSD 1.5 38 5 251 11 17665 6.6K
i386-netb NetBSD 1.5 40 8 286 8 17654 7.0K
i386-netb NetBSD 1.5L 42 10 83 31 842 8.5K
*Local* Communication bandwidths in MB/s - bigger is better
-----------------------------------------------------------
Host OS Pipe AF TCP File Mmap Bcopy Bcopy Mem Mem
UNIX reread reread (libc) (hand) read write
--------- ------------- ---- ---- ---- ------ ------ ------ ------ ---- -----
i386-netb NetBSD 1.4.3 72 71 34 35 211 94 76 211 112
i386-netb NetBSD 1.4.3 71 70 36 34 211 94 76 211 112
i386-netb NetBSD 1.5 61 63 31 35 211 96 77 211 112
i386-netb NetBSD 1.5 62 64 34 35 211 96 77 211 112
i386-netb NetBSD 1.5 63 62 33 35 211 96 77 211 112
i386-netb NetBSD 1.5L 64 64 35 76 211 93 76 211 111
Memory latencies in nanoseconds - smaller is better
(WARNING - may not be correct, check graphs)
---------------------------------------------------
Host OS Mhz L1 $ L2 $ Main mem Guesses
--------- ------------- --- ---- ---- -------- -------
i386-netb NetBSD 1.4.3 266 11 90 235
i386-netb NetBSD 1.4.3 266 11 90 235
i386-netb NetBSD 1.5 266 11 90 235
i386-netb NetBSD 1.5 266 11 90 235
i386-netb NetBSD 1.5 266 11 90 235
i386-netb NetBSD 1.5L 266 11 90 236