Current-Users archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: prerequisites for our atf suite

On Thu, 10 Nov 2011, Greg Troxel wrote:

summary: I'm unclear on what state a machine should be in prior to
running ATF.

I have a -current tree with a not-yet-committed change, and I'd like to
run the test suite.  So I built a full release to ISO, and in virtualbox
used that iso to do an installation.

I booted single user, remounted / rw, and did, more or less

cd /usr/tests
atf-run . | atf-report

and found that lots of tests are failing (with signal 6).

I saw that recently on amd64 - it "went away" on its own.

I then let the system come up multiuser, but with wm0 not configured
(just lo0), and tried again.  There are still problems.

What I don't understand is:

 in order to run the full test suite, in what state should the system
 be?  Is it supposed to work in any or all of the following:

   single user, ro fs (enough mounted to have base system present)

   single user, rw fs

   multiuser, no Ethernets configured

   multiuser, an Ethernet configured

   multiuser, an Ethernet configured, various daemons running, e.g. a
   system that's being used

 Here, work means "test results match the results shown on the
 autobuild/tests page".   So I would expect 2 failed tests, or
 sometimes 1.

I think it needs to be in multi user, but does not require any network interfaces (except maybe lo0). You will need comp, base, etc, text, and test sets for most things. One or two tests actually depend on the games set!

| Paul Goyette     | PGP Key fingerprint:     | E-mail addresses:       |
| Customer Service | FA29 0E3B 35AF E8AE 6651 | paul at    |
| Network Engineer | 0786 F758 55DE 53BA 7731 | pgoyette at |
| Kernel Developer |                          | pgoyette at  |

Home | Main Index | Thread Index | Old Index