pkgsrc-Users archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: Conceptual talk about distributed pbulk on exotic port

* On 2018-07-08 at 09:42 BST, Joerg Sonnenberger wrote:

> On Sun, Jul 08, 2018 at 08:57:01AM +0100, Jonathan Perkin wrote:
> > You will always get better throughput with multiple build processes
> > running single threaded than a single build process with a high
> > MAKE_JOBS, assuming you're building more than a couple of packages.
> I don't completely agree with this, it is misguiding. It is desirable to
> have a medium high MAKE_JOBS, since that will benefit some of the very
> heavy packages like webkit. Rule of thumb is number of instances *
> MAKE_JOBS should be no higher than RAM in GB * 2 or so.

We simply keep a list of packages for where MAKE_JOBS > 1 is highly
beneficial, and just increase those based on PKGPATH:

Those values aren't exactly what we use ourselves, we keep a log of
how long each package took and adjust as necessary.

But other than that small list of packages, everything else uses

Jonathan Perkin  -  Joyent, Inc.  -

Home | Main Index | Thread Index | Old Index