Re: Build failure tooling improvements

[David Holland <dholland-pkgtech%netbsd.org@localhost>]

On Sun, Mar 23, 2025 at 10:20:14PM +0100, Roland Illig wrote:
 > >  >   - it will be testing the binaries in the build tree, using the
 > >  >     package's mechanisms to find the built (and not installed shlibs)
 > >
 > > Providing glue to run it in a VM would fix the last two problems.
 > >
 > > (In order to have it be not super expensive, you'd want it to start
 > > from a preexisting VM image, install just the package and the deps and
 > > the test script, and run it...)
 > 
 > This could be solved in the same way as with ATF, in that the tests get
 > installed along the package, so they can be run at any time.

Yeah, that is probably the simplest way to do it. (Let's just not do
it _with_ ATF as that's anything but simple...)

 > If there were a standard location for the entry point of the test files,
 > such as ${PREFIX}/tests/${PKGBASE}/smoketest, this sounds as if it could
 > be automated nicely.

Yeah, that's one half of building out the glue; the other half is the
stuff for having the base VM image and doing the VM runs.

-- 
David A. Holland
dholland%netbsd.org@localhost