Subject: Re: Benchmarking of different NetBSD versions
To: Martin J. Laubach <mjl@NetBSD.org>
From: Manuel Bouyer <bouyer@antioche.eu.org>
List: tech-perform
Date: 12/17/2005 16:55:37
On Sat, Dec 17, 2005 at 02:34:53PM +0000, Martin J. Laubach wrote:
>   I'd like to redo fefe's benchmarks, so that we have a stable
> baseline from which we can re-run the benchmarks after major
> changes have gone in.
> 
>   My question is, is it worthwhile to do that under Qemu, or
> will I just be measuring emulator overhead and the real results
> will be lost in the noise?

I don't think it'll be really good, because the time to execute an
instruction may vary depending on the load of the system hosting
qemu.

A Xen guest may be a better choise, because in this case the
user and system time should be accurate (the time won't be incremented
when the CPU is scheduled for another domain or for the hypervisor).
Of course the elapsed time won't be accurate either.

the NetBSD CVS has support for Xen2 only for 3.0 and current,
but there are patches for NetBSD-2.0 in the Xen svn repository (and source
tarballs).

-- 
Manuel Bouyer <bouyer@antioche.eu.org>
     NetBSD: 26 ans d'experience feront toujours la difference
--