Current-Users archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Raw data from automated tests available by rsync



Hello -current users,

A couple of developers have expressed interest in getting access
to the raw data from the automated build and test runs on
babylon5.netbsd.org, for research or to generate new reports 
and visualizations.

The data are now available by anonymous rsync, not only to developers
but also to the general public.  They have in fact been available for
some months now, but I didn't get around to announcing it until now.

There are historical data from builds and tests of the i386 and sparc
ports going back to May 2011, and for amd64 going back to August 2011.
New data are added in real time as each build or test run finishes.

The following shell command will mirror the full data set to a local
directory:

   for arch in i386 amd64 sparc
   do
       rsync -v -a rsync://babylon5.netbsd.org/bracket-${arch}-results ${arch}
   done

This currently takes 7.3 GB of disk space.

The data for each port are organized into one directory per CVS source
date tested, and include

 - The last 1000 lines of the build log from each build, including
   the output of a "time" command indicating the total user, system,
   and CPU time consumed (build.log.tail.gz)

 - Full console output from the sysinst installation and the ATF
   test run (isntall.log.gz and test.log.gz, respectively)

 - The raw ATF output and the corresponding XML from each test run
   (test.tps.gz and test.xml.gz, respectively)

 - A text file of key-value pairs containing summary information
   such as the exit status of the build and install (bracket.db).

The console logs in particular are easy to query using zgrep.
For example, if you are curious about when the "min" test case of
the usr.bin/config/t_config test started failing on amd64, you
could simply run

  zgrep 'min: ' amd64/2015*/test.log.gz

Thanks to spz@ for setting up the rsync service.

Yours,
-- 
Andreas Gustafsson, gson%NetBSD.org@localhost


Home | Main Index | Thread Index | Old Index