pkgsrc-Users archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: CentOS binary packages, etc.



On 08/30/16 03:21, Jonathan Perkin wrote:
* On 2016-08-29 at 15:12 BST, Jason Bacon wrote:

I found the following page, which appears to contain a rather Old package
set from 2014:

     https://pkgsrc.joyent.com/install-on-linux/

1)    Is anyone out there is presently working on bulk builds for EL?  If
so, I would love to coordinate with you so we don't waste our time on
duplicated effort.
Yes, I've continued these builds for trunk - I just haven't gotten
around to updating the above page and announcing them.  You can see
the results of these daily bulk builds on the pkgsrc-bulk@ list, e.g.:

   http://mail-index.netbsd.org/pkgsrc-bulk/2016/08/30/msg013085.html
   http://mail-index.netbsd.org/pkgsrc-bulk/2016/08/28/msg013079.html

32-bit and 64-bit take it in turns each day, just in case a build
takes >24 hours.  The packages are synced to:

   https://pkgsrc.joyent.com/packages/Linux/trunk/

2)    Roughly how long does it take to do a bulk build of the entire tree on
a single high-end server?  I was thinking of doing builds on one of our
production clusters, but I'm leaning against it due to some issues with
leakage of Yum packages into certain builds.  I think it would be safer to
do the builds on a dedicated server with a minimal CentOS installation.
The above builds are performed on 7-core 7GB KVM instances in the
Joyent cloud, using 7 concurrent chroots, and are generally done in
less than 12 hours.  I think a full from-scratch build takes around 24
to 30 hours.

Our KVM implementation definitely isn't optimal, so you will probably
see faster builds than this on native hardware, as well as being able
to bump up the concurrency.


Fantastic, thanks!

So I poked around your site a bit and found bootstrap-trunk-x86_64.tar.gz. I then attempted to substitute it into the instructions at

    https://pkgsrc.joyent.com/install-on-linux/

The installation breaks itself the first time I run pkgin upgrade, full-upgrade, or install. I attached the script that produced the output below as well as pkg_install-err.log.

Thanks,

    Jason

[root@centosdev bacon]# ./centos-pkgin
+ PATH=/usr/pkg/sbin:/usr/pkg/bin:/bin:/usr/bin:/sbin:/usr/sbin
+ export PATH
+ rm -rf /usr/pkg /var/db/pkgin
+ site=https://pkgsrc.joyent.com/packages/Linux/bootstrap
+ archive=bootstrap-trunk-x86_64.tar.gz
+ curl -Oks https://pkgsrc.joyent.com/packages/Linux/bootstrap/bootstrap-trunk-x86_64.tar.gz
+ sha1sum bootstrap-trunk-x86_64.tar.gz
b389cc7edcb7d045eda2d9644f331e4757a3bc9f bootstrap-trunk-x86_64.tar.gz
+ cat
b389cc7edcb7d045eda2d9644f331e4757a3bc9f bootstrap-trunk-x86_64.tar.gz
+ printf '\nDo the checksums match? y/[n] '

Do the checksums match? y/[n] + read match
y
+ '[' 0y = 0y ']'
+ tar -zxpf bootstrap-trunk-x86_64.tar.gz -C /
+ pkgin update -y
reading local summary...
processing local summary...
processing remote summary (http://pkgsrc.joyent.com/packages/Linux/trunk/x86_64/All)...
pkg_summary.xz                      100% 1901KB 316.8KB/s 301.0KB/s   00:06
+ pkgin full-upgrade -y
calculating dependencies... done.

12 packages to be upgraded:

pkgsrc-gnupg-keys-20150416 pkgin-0.9.3nb1 mozilla-rootcerts-1.0.20150804 sqlite3-3.9.2 pkg_install-20150901 openssl-1.0.2d libarchive-3.1.2nb1 bootstrap-mk-files-20150908 ncurses-6.0nb1

13 packages to be installed (34M to download, 45M to install):

pkg_install-20160410nb1 ncurses-6.0nb2 perl-5.24.0 sqlite3-3.14.1 openssl-1.0.2hnb2 libarchive-3.2.1nb2 bootstrap-mk-files-20160411 pkgsrc-gnupg-keys-20160519 pkgin-0.9.4nb3 mozilla-rootcerts-1.0.20160610

downloading packages...
pkg_install-20160410nb1.tgz         100% 1446KB   1.4MB/s 1.4MB/s   00:01
ncurses-6.0nb2.tgz                  100% 1533KB   1.5MB/s 1.5MB/s   00:00
perl-5.24.0.tgz                     100%   17MB  17.4MB/s 3.9MB/s   00:01
sqlite3-3.14.1.tgz                  100% 1027KB   1.0MB/s 1.0MB/s   00:01
openssl-1.0.2hnb2.tgz               100% 4635KB   4.5MB/s 4.5MB/s   00:00
libarchive-3.2.1nb2.tgz             100%  832KB 831.6KB/s 831.6KB/s   00:01
bootstrap-mk-files-20160411.tgz     100%   26KB  26.4KB/s 26.4KB/s   00:00
pkgsrc-gnupg-keys-20160519.tgz      100%   20KB  20.3KB/s 20.3KB/s   00:00
pkgin-0.9.4nb3.tgz                  100%   72KB  72.4KB/s 72.4KB/s   00:00
mozilla-rootcerts-1.0.20160610.tgz  100%  711KB 711.1KB/s 711.1KB/s   00:01
removing packages to be upgraded...
removing pkgsrc-gnupg-keys-20150416...
removing pkgin-0.9.3nb1...
===========================================================================
The following files are no longer being used by pkgin-0.9.3nb1,
and they can be removed if no other packages are using them:

        /usr/pkg/etc/pkgin/repositories.conf

===========================================================================
===========================================================================
The following directories are no longer being used by pkgin-0.9.3nb1,
and they can be removed if no other packages are using them:

        /var/db/pkgin
        /usr/pkg/etc/pkgin

===========================================================================
removing mozilla-rootcerts-1.0.20150804...
removing sqlite3-3.9.2...
removing pkg_install-20150901...
removing openssl-1.0.2d...
removing libarchive-3.1.2nb1...
removing bootstrap-mk-files-20150908...
removing ncurses-6.0nb1...
pkg_install warnings: 0, errors: 2
pkg_install error log can be found in /var/db/pkgin/pkg_install-err.log
installing packages...
installing pkg_install-20160410nb1...
about to upgrade pkg_install, installing ncurses-6.0nb2...
installing perl-5.24.0...
installing sqlite3-3.14.1...
installing openssl-1.0.2hnb2...
installing libarchive-3.2.1nb2...
installing bootstrap-mk-files-20160411...
installing pkgsrc-gnupg-keys-20160519...
installing pkgin-0.9.4nb3...
installing mozilla-rootcerts-1.0.20160610...
pkg_install warnings: 0, errors: 12
pkg_install error log can be found in /var/db/pkgin/pkg_install-err.log
reading local summary...
processing local summary...
no such installed package mozilla-rootcerts-1.0.20160610
no such installed package pkg_install-20160410nb1
no such installed package pkgin-0.9.4nb3
no such installed package pkgsrc-gnupg-keys-20160519
no such installed package bootstrap-mk-files-20160411
[root@centosdev bacon]# pkgin
bash: /usr/pkg/bin/pkgin: No such file or directory

--

Those who spend their lives in the shallows see their whole world in turmoil
every time the wind blows.

Those who explore the depths see only ripples at the surface of an otherwise
serene world.

#!/bin/sh -ex

# Add paths
PATH=/usr/pkg/sbin:/usr/pkg/bin:/bin:/usr/bin:/sbin:/usr/sbin
export PATH

rm -rf /usr/pkg /var/db/pkgin
site=https://pkgsrc.joyent.com/packages/Linux/bootstrap
archive=bootstrap-trunk-x86_64.tar.gz
#curl -Ok https://pkgsrc.joyent.com/packages/Linux/bootstrap/bootstrap-2014Q2-el6-x86_64.tar.gz
curl -Oks $site/$archive

sha1sum $archive

cat << EOM
b389cc7edcb7d045eda2d9644f331e4757a3bc9f  bootstrap-trunk-x86_64.tar.gz
EOM

printf "\nDo the checksums match? y/[n] "
read match
if [ 0$match = 0y ]; then
    tar -zxpf $archive -C /
fi

pkgin update -y
pkgin full-upgrade -y
#pkgin install ffmpeg2

---Aug 30 09:41:29: removing pkgsrc-gnupg-keys-20150416...
---Aug 30 09:41:29: removing pkgin-0.9.3nb1...
---Aug 30 09:41:29: removing mozilla-rootcerts-1.0.20150804...
---Aug 30 09:41:29: removing sqlite3-3.9.2...
---Aug 30 09:41:29: removing pkg_install-20150901...
pkg_delete: The following packages are marked as not for deletion:
	pkg_install-20150901
---Aug 30 09:41:29: removing openssl-1.0.2d...
Package `openssl-1.0.2d' is still required by other packages:
	libarchive-3.1.2nb1
---Aug 30 09:41:30: removing libarchive-3.1.2nb1...
---Aug 30 09:41:30: removing bootstrap-mk-files-20150908...
Package `bootstrap-mk-files-20150908' is still required by other packages:
	bmake-20150505
pkg_delete: The following packages are marked as not for deletion:
	bootstrap-mk-files-20150908
---Aug 30 09:41:30: removing ncurses-6.0nb1...
Package `ncurses-6.0nb1' is still required by other packages:
	readline-6.3nb3
---Aug 30 09:41:30: installing pkg_install-20160410nb1...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing ncurses-6.0nb2...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing perl-5.24.0...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing sqlite3-3.14.1...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing openssl-1.0.2hnb2...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing libarchive-3.2.1nb2...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing bootstrap-mk-files-20160411...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing pkgsrc-gnupg-keys-20160519...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing pkgin-0.9.4nb3...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 
---Aug 30 09:41:30: installing mozilla-rootcerts-1.0.20160610...
pkg_add: unable to verify signature: Signature key id 42393ba93f9aabc7 not found 


Home | Main Index | Thread Index | Old Index