misc/58098: build.sh release fails due to missing METALOG entries

To: misc-bug-people%netbsd.org@localhost,gnats-admin%netbsd.org@localhost,netbsd-bugs%netbsd.org@localhost
Subject: misc/58098: build.sh release fails due to missing METALOG entries
From: rwhitlock22%gmail.com@localhost
Date: Tue, 2 Apr 2024 02:40:01 +0000 (UTC)
>Number:         58098
>Category:       misc
>Synopsis:       build.sh release fails due to missing METALOG entries
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    misc-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Tue Apr 02 02:40:01 +0000 2024
>Originator:     Robert Whitlock
>Release:        netbsd-10 cvs branch
>Organization:
>Environment:
NetBSD thinkpad 10.0 NetBSD 10.0 (THINKPAD_BUILDSH) #0: Mon Apr  1 00:52:54 EDT 2024  rob@thinkpad:/usr/src_netbsd-10_buildsh/build1-amd64-thinkpad/sys/arch/amd64/compile/THINKPAD_BUILDSH amd64
(THINKPAD_BUILDSH is just GENERIC at the moment)
>Description:
Running build.sh release as an unprivileged user fails with

obj ===> distrib/amd64/installimage-bios
--- obj-cdroms ---
--- obj ---
#    objdir  /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad/distrib/amd64/cdroms/installcd
--- obj-installimage-bios ---
--- obj ---
#    objdir  /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad/distrib/amd64/installimage-bios
clean_METALOG ===> .
--- clean_METALOG ---
clean_METALOG ===> distrib/sets
--- /usr/src_netbsd-10_buildsh/destdir/METALOG.sanitised ---
</usr/src_netbsd-10_buildsh/destdir/METALOG   /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad/tooldir.NetBSD-10.0-amd64/bin/nbawk '{ a[$1] = $0; } END { for (f in a) print a[f]; }' |   sort | /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad/tooldir.NetBSD-10.0-amd64/bin/nbmtree -CSM -k all -R time -N /usr/src_netbsd-10_buildsh/src/etc  >/usr/src_netbsd-10_buildsh/destdir/METALOG.new
nbmtree: .: missing directory in specification
nbmtree: failed at line 1 of the specification
*** Failed target: /usr/src_netbsd-10_buildsh/destdir/METALOG.sanitised
*** Failed commands:
        <${METALOG}  ${${MKUPDATE} != "no" :? ${METALOG_REMOVE_DUPLICATES} | :}  sort | ${TOOL_MTREE} -CSM -k all -R time -N ${NETBSDSRCDIR}/etc  >${METALOG}.new
        => </usr/src_netbsd-10_buildsh/destdir/METALOG   /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad/tooldir.NetBSD-10.0-amd64/bin/nbawk '{ a[$1] = $0; } END { for (f in a) print a[f]; }' |   sort | /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad/tooldir.NetBSD-10.0-amd64/bin/nbmtree -CSM -k all -R time -N /usr/src_netbsd-10_buildsh/src/etc  >/usr/src_netbsd-10_buildsh/destdir/METALOG.new
        mv ${METALOG}.new ${METALOG}.sanitised
        => mv /usr/src_netbsd-10_buildsh/destdir/METALOG.new /usr/src_netbsd-10_buildsh/destdir/METALOG.sanitised
*** [/usr/src_netbsd-10_buildsh/destdir/METALOG.sanitised] Error code 1
nbmake[4]: stopped in /usr/src_netbsd-10_buildsh/src/distrib/sets
1 error
nbmake[4]: stopped in /usr/src_netbsd-10_buildsh/src/distrib/sets
nbmake[3]: stopped in /usr/src_netbsd-10_buildsh/src
nbmake[2]: stopped in /usr/src_netbsd-10_buildsh/src
nbmake[1]: stopped in /usr/src_netbsd-10_buildsh/src

nbmake: stopped in /usr/src_netbsd-10_buildsh/src

ERROR: Failed to make release

*** BUILD ABORTED ***
1 thinkpad$ 

METALOG was missing an entry for . (the destdir) and when a line for . and ./stand makes the error go away and the build completes. The lines I manually added were:

. type=dir uname=root gname=wheel mode=0755
./stand type=dir uname=root gname=wheel mode=0755

At the time that the build quit due to the error, the METALOG also had many duplicate entries. I'm not sure whether this was expected due to the METALOG being from the middle of a build or not. It was also not sorted, but I don't know whether this is unexpected either, for the same reason. Here is a sample from the beginning of the METALOG file:

./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0/modules/compat_util type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules/compat_util/compat_util.kmod type=file uname=root gname=wheel mode=0444 size=19680 time=1711948068.0 sha256=097cb48b50163164ef96c770d58cb4e8fa5aa6294a53d2d01fd221e2bd0699c9
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules/compat_43 type=dir mode=0755
./stand/amd64/10.0/modules/compat_43/compat_43.kmod type=file uname=root gname=wheel mode=0444 size=68168 time=1711948075.0 sha256=6a383c46c203820b4860efb7d44fa281fb8c913bd8750d503efc2a457d518141
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules/compat_sysctl_09_43 type=dir mode=0755
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules/compat_sysctl_09_43/compat_sysctl_09_43.kmod type=file uname=root gname=wheel mode=0444 size=15872 time=1711948069.0 sha256=c80551743ca3aa5e93369655b6aa78c825bc4af3f31b303b5ffea2b0294b7b66
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules/compat_09 type=dir mode=0755
./stand/amd64/10.0/modules/compat_09/compat_09.kmod type=file uname=root gname=wheel mode=0444 size=15408 time=1711948071.0 sha256=e76d87437f529fb5da9bb85f58676e7e44614947ef2bc893d13c078fd313128b
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0/modules/compat_10 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules/compat_10/compat_10.kmod type=file uname=root gname=wheel mode=0444 size=3880 time=1711948073.0 sha256=afd9eda822c0f7d2ffb65bedeb82dc8694b6ff01ab59edd020a107bfa5c7729c
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules/compat_12 type=dir mode=0755
./stand/amd64/10.0/modules/compat_12/compat_12.kmod type=file uname=root gname=wheel mode=0444 size=27776 time=1711948076.0 sha256=26d0a6ef82c765fdcaebcac60bc956b4b1b113d275a161d3e3730c69c0db6e2a
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules/compat_14 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules/compat_13 type=dir mode=0755
./stand/amd64/10.0/modules/compat_14/compat_14.kmod type=file uname=root gname=wheel mode=0444 size=9048 time=1711948077.0 sha256=10692724621f25d4c95d87f89581d0952cca5c36d0223129429985eaf7a9199d
./stand/amd64/10.0/modules/compat_13/compat_13.kmod type=file uname=root gname=wheel mode=0444 size=16816 time=1711948077.0 sha256=2d2cc9b2d19fa7133414ef7b4fb87dc6edfacbb67de44e0a349082242d747612
./stand/amd64 type=dir mode=0755
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules/compat_20 type=dir mode=0755
./stand/amd64/10.0/modules/compat_16 type=dir mode=0755
./stand/amd64/10.0/modules/compat_20/compat_20.kmod type=file uname=root gname=wheel mode=0444 size=31608 time=1711948080.0 sha256=d6ef34f07730739fbae07fb0661f30586e59551c89241c373f2dd67520fb12aa
./stand/amd64/10.0/modules/compat_16/compat_16.kmod type=file uname=root gname=wheel mode=0444 size=14688 time=1711948079.0 sha256=436e2ca84622d519b1d1ecbf2cf6dde886b6cf4578fe5ad5cdb15465b5f6124d
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0/modules/compat_40 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules/compat_40/compat_40.kmod type=file uname=root gname=wheel mode=0444 size=20816 time=1711948082.0 sha256=456a53d1bad074fe5e0bf9af8a32c940d228262d11307d43b23116e197b47ee6
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules/compat_30 type=dir mode=0755
./stand/amd64/10.0/modules/compat_30/compat_30.kmod type=file uname=root gname=wheel mode=0444 size=38584 time=1711948083.0 sha256=7c4749cd87e7696982125236bbce4802f5c891710e99b92cf51d672909f50bd7
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0 type=dir mode=0755
./stand/amd64/10.0/modules/compat_60 type=dir mode=0755
./stand/amd64/10.0/modules type=dir mode=0755
./stand/amd64/10.0/modules/compat_50 type=dir mode=0755
./stand/amd64/10.0/modules/compat_60/compat_60.kmod type=file uname=root gname=wheel mode=0444 size=22560 time=1711948087.0 sha256=589a8fd546e9b51c521a1349ef9aafb27379fe701bc6fea96b4e344a902ebab2
./stand/amd64/10.0/modules/compat_50/compat_50.kmod type=file uname=root gname=wheel mode=0444 size=99320 time=1711948094.0 sha256=88a0d0c8fc419690fc244886320b49fb7f41587c6e80769c74966106433a643a
>How-To-Repeat:
cd /usr/src_netbsd-10_buildsh
rm -rf *
cvs checkout -r netbsd-10 -P src # with CVSROOT and CVS_RSH set appropriately
cvs checkout -r netbsd-10 -P xsrc
cd src

then copy the following files to /usr/src_netbsd-10_buildsh/src:

0 thinkpad$ cat mybuildtools.sh
#!/bin/sh

./build.sh -U -u -O /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad -j2 -D /usr/src_netbsd-10_buildsh/destdir tools
0 thinkpad$ cat mybuildkernel.sh
#!/bin/sh

./build.sh -U -u -O /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad -j2 -D /usr/src_netbsd-10_buildsh/destdir kernel=THINKPAD_BUILDSH
0 thinkpad$ cat mybuildmodules.sh
#!/bin/sh

./build.sh -U -u -O /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad -j2 -D /usr/src_netbsd-10_buildsh/destdir modules
0 thinkpad$ cat myinstallmodules.sh
#!/bin/sh

./build.sh -U -u -O /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad -j2 -D /usr/src_netbsd-10_buildsh/destdir installmodules=/
0 thinkpad$ cat mybuildrelease.sh
#!/bin/sh

./build.sh -U -u -O /usr/src_netbsd-10_buildsh/build1-amd64-thinkpad -j2 -D /usr/src_netbsd-10_buildsh/destdir -x -X /usr/src_netbsd-10_buildsh/xsrc release

0 thinkpad$ 

then run:

./mybuildtools.sh
./mybuildkernel.sh

copy the "netbsd" kernel file to /netbsd
run:

./mybuildmodules.sh
./myinstallmodules.sh

reboot, then run

./mybuildrelease.sh
>Fix:
Fix METALOG generation/handling somehow.
Prev by Date: port-amd64/58096: booting with x86 multiboot doesn't pass ctf data
Next by Date: kern/58099: wpa_supplicant logs spurious ENOTTY errors
Previous by Thread: port-amd64/58096: booting with x86 multiboot doesn't pass ctf data
Next by Thread: Re: misc/58098: build.sh release fails due to missing METALOG entries
Indexes:
Home | Main Index | Thread Index | Old Index