Re: Packages using more than their assigned MAKE_JOBS

[Jonathan Perkin <jperkin%pkgsrc.org@localhost>]

* On 2026-10-16 at 10:53 BST, Thomas Klausner wrote:

> On Fri, Oct 16, 2026 at 10:19:13AM +0100, Jonathan Perkin wrote:
> > I don't have much time at the moment to dig into these, but my trunk builder
> > is getting overloaded again, and I just happened to notice at least these
> > two packages spawning more processes than their MAKE_JOBS allocates:
> >
> >  shells/fish:
> >     606373 /opt/local/bin/bmake -j 3 all
> >       606477 bash
> >         606519 /opt/local/bin/bmake -s -f CMakeFiles/Makefile2 all
> >           774000 bash
> >             774036 /opt/local/bin/bmake -s -f CMakeFiles/sphinx-docs.dir/build.make CMakeFiles/sph
> >               774040 bash
> >                 774074 cmake-pkgsrc-build/cargo/debug/xtask html-docs --fish-indent=/tmp/work/shells/f
> >                   774359 /opt/local/bin/python3.13 /opt/local/bin/sphinx-build-3.13 -j auto -q -b html -
> >                     791682 /opt/local/bin/python3.13 /opt/local/bin/sphinx-build-3.13 -j auto -q -b html -
> >                     791913 /opt/local/bin/python3.13 /opt/local/bin/sphinx-build-3.13 -j auto -q -b html -
> >                     791949 /opt/local/bin/python3.13 /opt/local/bin/sphinx-build-3.13 -j auto -q -b html -
> >                     791987 /opt/local/bin/python3.13 /opt/local/bin/sphinx-build-3.13 -j auto -q -b html -
> >                     792024 /opt/local/bin/python3.13 /opt/local/bin/sphinx-build-3.13 -j auto -q -b html -
>
> I think I've fixed this.
>
> IIUC this was only for generating man pages, so was this really a load problem?

On its own probably not, but I think that these can add up quickly if 
you happen to encounter a number of them all at once, especially if you 
are running a high number of concurrent package builds like I do 
(currently 32 on this particular host).

This can probably happen more than expected too, given a lot of these 
jobs abusers seem to be python related, and multiple py-* builds are 
often scheduled at the same time for each PYTHON_VERSIONS_ACCEPTED.

--
Jonathan Perkin                    pkgsrc.smartos.org
Open Source Complete Cloud   www.tritondatacenter.com