NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
Re: misc/54856: makefs/walk.c assertion building images
The following reply was made to PR misc/54856; it has been noted by GNATS.
From: Christos Zoulas <christos%zoulas.com@localhost>
To: bch <brad.harder%gmail.com@localhost>
Cc: gnats-bugs%netbsd.org@localhost,
gnats-admin%netbsd.org@localhost,
misc-bug-people%netbsd.org@localhost,
netbsd-bugs%netbsd.org@localhost
Subject: Re: misc/54856: makefs/walk.c assertion building images
Date: Mon, 20 Jan 2020 19:19:59 -0500
--Apple-Mail=_6AC504FA-53C9-4AF3-B259-FC8310601949
Content-Type: multipart/alternative;
boundary="Apple-Mail=_4F25A8BA-129E-42DB-A209-8E87ED994EA4"
--Apple-Mail=_4F25A8BA-129E-42DB-A209-8E87ED994EA4
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
Since you have a core file, can you go in gdb and print a stack trace?
christos
> On Jan 20, 2020, at 7:16 PM, bch <brad.harder%gmail.com@localhost> wrote:
>=20
>=20
>=20
>=20
>=20
> On Sat, Jan 18, 2020 at 11:45 Martin Husemann <martin%duskware.de@localhost =
<mailto:martin%duskware.de@localhost>> wrote:
>=20
> The following reply was made to PR misc/54856; it has been noted by =
GNATS.
>=20
> From: Martin Husemann <martin%duskware.de@localhost <mailto:martin%duskware.de@localhost>>
> To: gnats-bugs%NetBSD.org@localhost
> Cc:
> Subject: Re: misc/54856: makefs/walk.c assertion building images
> Date: Sat, 18 Jan 2020 20:42:17 +0100
>=20
> I can not reproduce it:
>=20
>=20
>=20
>=20
> Hrm - I can still successfully reproduce the error. I=E2=80=99ve done =
a clean (no =E2=80=9C-u=E2=80=9D) (re)build of kernel, modules and tools =
in case some flaw was =E2=80=9Cleaking=E2=80=9D into the build env. The =
tail of my latest effort has some (undocumented) makefs debugging turned =
on, though it=E2=80=99s not immediately illuminating to me:
>=20
>=20
>=20
> # env CDMAKEFSEXTRAOPTS=3D"-d 536870911" nice ./build.sh -j1 -u -U -x =
-V CDMAKEFSEXTRAOPTS=3D"-d 536870911" -N2 release
>=20
>=20
>=20
> [...]
>=20
>=20
>=20
> apply_specdir: spec ethers
>=20
> apply_specdir: spec exports
>=20
> apply_specdir: spec fstab
>=20
> apply_specdir: adding fstab
>=20
> apply_specentry: cdrom/etc/fstab
>=20
> changing gid from 0 to 0
>=20
> changing mode from 0 to 0644
>=20
> changing uid from 0 to 0
>=20
> apply_specdir: spec ftpd.conf
>=20
> apply_specdir: spec ftpwelcome
>=20
> apply_specdir: spec gateways
>=20
> apply_specdir: spec hesiod.conf
>=20
> apply_specdir: spec hosts.allow
>=20
> apply_specdir: spec hosts.deny
>=20
> apply_specdir: spec ifaliases
>=20
> apply_specdir: spec ipf.conf
>=20
> apply_specdir: spec ipf6.conf
>=20
> apply_specdir: spec ipnat.conf
>=20
> apply_specdir: spec ipsec.conf
>=20
> apply_specdir: spec ld.so.conf
>=20
> apply_specdir: spec localtime
>=20
> apply_specdir: adding localtime
>=20
> [1] Abort trap (core dumped) =
/usr/src/obj/tooldir.NetBSD-9.99.39-amd64/bin/...
>=20
> *** [image] Error code 134
>=20
> nbmake[5]: stopped in /usr/src/distrib/amd64/cdroms/bootcd
>=20
> 1 error
>=20
> nbmake[5]: stopped in /usr/src/distrib/amd64/cdroms/bootcd
>=20
> *** [release-bootcd] Error code 2
>=20
>=20
>=20
> nbmake[4]: stopped in /usr/src/distrib/amd64/cdroms
>=20
> 1 error
>=20
>=20
>=20
> nbmake[4]: stopped in /usr/src/distrib/amd64/cdroms
>=20
> *** [release-cdroms] Error code 2
>=20
>=20
>=20
> nbmake[3]: stopped in /usr/src/distrib/amd64
>=20
> 1 error
>=20
>=20
>=20
> nbmake[3]: stopped in /usr/src/distrib/amd64
>=20
> *** [release-amd64] Error code 2
>=20
>=20
>=20
> nbmake[2]: stopped in /usr/src/distrib
>=20
> 1 error
>=20
>=20
>=20
> nbmake[2]: stopped in /usr/src/distrib
>=20
> *** [snap_post] Error code 2
>=20
>=20
>=20
> nbmake[1]: stopped in /usr/src/etc
>=20
> 1 error
>=20
>=20
>=20
> nbmake[1]: stopped in /usr/src/etc
>=20
> *** [release] Error code 2
>=20
>=20
>=20
> nbmake: stopped in /usr/src
>=20
> 1 error
>=20
>=20
>=20
> nbmake: stopped in /usr/src
>=20
>=20
>=20
> ERROR: Failed to make release
>=20
> *** BUILD ABORTED ***
>=20
>=20
>=20
>=20
>=20
>=20
>=20
>=20
>=20
>=20
> =3D=3D=3D> Successful make install-image
> =3D=3D=3D> build.sh ended: Sat Jan 18 20:39:08 CET 2020
> =3D=3D=3D> Summary of results:
> build.sh command: /usr/src/build.sh -O /tmp/obj -D =
/tmp/dest -T /tmp/tools -j24 -u -U -x release install-image
> build.sh started: Sat Jan 18 19:58:34 CET 2020
> NetBSD version: 9.99.39
> MACHINE: amd64
> MACHINE_ARCH: x86_64
> Build platform: NetBSD 9.99.38 amd64
> HOST_SH: /bin/sh
> No $TOOLDIR/bin/nbmake, needs building.
> Bootstrapping nbmake
> MAKECONF file: /etc/mk.conf
> TOOLDIR path: /tmp/tools
> DESTDIR path: /tmp/dest
> RELEASEDIR path: /tmp/obj/releasedir
> Created /tmp/tools/bin/nbmake
> Updated makewrapper: /tmp/tools/bin/nbmake-amd64
> Successful make release
> Successful make install-image
> build.sh ended: Sat Jan 18 20:39:08 CET 2020
> =3D=3D=3D> .
>=20
>=20
> Martin
>=20
>=20
>=20
> <sanitizer.log>
--Apple-Mail=_4F25A8BA-129E-42DB-A209-8E87ED994EA4
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">Since=
you have a core file, can you go in gdb and print a stack trace?<div =
class=3D""><br class=3D""></div><div class=3D"">christos<br =
class=3D""><div><br class=3D""><blockquote type=3D"cite" class=3D""><div =
class=3D"">On Jan 20, 2020, at 7:16 PM, bch <<a =
href=3D"mailto:brad.harder%gmail.com@localhost"; =
class=3D"">brad.harder%gmail.com@localhost</a>> wrote:</div><br =
class=3D"Apple-interchange-newline"><div class=3D""><p =
class=3D""><defanged_div class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div class=3D""><br class=3D""></defanged_div></p><p =
class=3D""><defanged_div class=3D"gmail_quote"></defanged_div></p><p =
class=3D""><defanged_div dir=3D"ltr" class=3D"gmail_attr">On Sat, Jan =
18, 2020 at 11:45 Martin Husemann <<a =
href=3D"mailto:martin%duskware.de@localhost"; class=3D"">martin%duskware.de@localhost</a>> =
wrote:<br class=3D""></defanged_div></p><defanged_div =
class=3D""><blockquote class=3D"gmail_quote" defanged_style=3D"margin:0 =
0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">The following =
reply was made to PR misc/54856; it has been noted by GNATS.<br =
class=3D"">
<br class=3D"">
From: Martin Husemann <<a href=3D"mailto:martin%duskware.de@localhost"; =
target=3D"_blank" class=3D"">martin%duskware.de@localhost</a>><br class=3D"">
To: <a href=3D"mailto:gnats-bugs%NetBSD.org@localhost"; =
class=3D"">gnats-bugs%NetBSD.org@localhost</a><br class=3D"">
Cc: <br class=3D"">
Subject: Re: misc/54856: makefs/walk.c assertion building =
images<br class=3D"">
Date: Sat, 18 Jan 2020 20:42:17 +0100<br class=3D"">
<br class=3D"">
I can not reproduce it:</blockquote><p class=3D""><defanged_div =
dir=3D"auto" class=3D""><br class=3D""></defanged_div></p><defanged_div =
class=3D""><p class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">Hrm - I can still =
successfully reproduce the error. I=E2=80=99ve done a clean (no =
=E2=80=9C-u=E2=80=9D) (re)build of kernel, modules and tools in case =
some flaw was =E2=80=9Cleaking=E2=80=9D into the build env. The tail of =
my latest effort has some (undocumented) makefs debugging turned on, =
though it=E2=80=99s not immediately illuminating to =
me:</defanged_div></p><defanged_div class=3D""><p class=3D""><defanged_div=
dir=3D"auto" class=3D""><br class=3D""></defanged_div></p><defanged_div =
class=3D""><p class=3D""><defanged_div dir=3D"auto" =
class=3D""></defanged_div></p><p class=3D""><defanged_div dir=3D"auto" =
class=3D""># env CDMAKEFSEXTRAOPTS=3D"-d 536870911" nice ./build.sh -j1 =
-u -U -x -V CDMAKEFSEXTRAOPTS=3D"-d 536870911" -N2 =
release</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" =
class=3D"">[...]</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ethers</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec exports</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec fstab</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: adding =
fstab</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specentry: =
cdrom/etc/fstab</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""> =
changing =
gid from 0 to 0</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""> =
changing =
mode from 0 to 0644</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""> =
changing =
uid from 0 to 0</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ftpd.conf</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ftpwelcome</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec gateways</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec hesiod.conf</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec hosts.allow</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec hosts.deny</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ifaliases</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ipf.conf</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ipf6.conf</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ipnat.conf</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ipsec.conf</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec ld.so.conf</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: =
spec localtime</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">apply_specdir: adding =
localtime</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">[1] Abort trap =
(core dumped) =
/usr/src/obj/tooldir.NetBSD-9.99.39-amd64/bin/...</defanged_div></p><defan=
ged_div class=3D""><p class=3D""><defanged_div dir=3D"auto" class=3D"">***=
[image] Error code 134</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[5]: stopped in =
/usr/src/distrib/amd64/cdroms/bootcd</defanged_div></p><defanged_div =
class=3D""><p class=3D""><defanged_div dir=3D"auto" class=3D"">1 =
error</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[5]: stopped in =
/usr/src/distrib/amd64/cdroms/bootcd</defanged_div></p><defanged_div =
class=3D""><p class=3D""><defanged_div dir=3D"auto" class=3D"">*** =
[release-bootcd] Error code 2</defanged_div></p><defanged_div =
class=3D""><p class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[4]: stopped in =
/usr/src/distrib/amd64/cdroms</defanged_div></p><defanged_div =
class=3D""><p class=3D""><defanged_div dir=3D"auto" class=3D"">1 =
error</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[4]: stopped in =
/usr/src/distrib/amd64/cdroms</defanged_div></p><defanged_div =
class=3D""><p class=3D""><defanged_div dir=3D"auto" class=3D"">*** =
[release-cdroms] Error code 2</defanged_div></p><defanged_div =
class=3D""><p class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[3]: stopped in =
/usr/src/distrib/amd64</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">1 =
error</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[3]: stopped in =
/usr/src/distrib/amd64</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">*** [release-amd64] =
Error code 2</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[2]: stopped in =
/usr/src/distrib</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">1 =
error</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[2]: stopped in =
/usr/src/distrib</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">*** [snap_post] Error =
code 2</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[1]: stopped in =
/usr/src/etc</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">1 =
error</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake[1]: stopped in =
/usr/src/etc</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">*** [release] Error =
code 2</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake: stopped in =
/usr/src</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">1 =
error</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">nbmake: stopped in =
/usr/src</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">ERROR: Failed to make =
release</defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D"">*** BUILD ABORTED =
***</defanged_div></p><defanged_div class=3D""><p class=3D""><defanged_div=
dir=3D"auto" class=3D""><br class=3D""></defanged_div></p><defanged_div =
class=3D""><div class=3D""><br =
class=3D"webkit-block-placeholder"></div><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><p =
class=3D""><defanged_div dir=3D"auto" class=3D""><br =
class=3D""></defanged_div></p><defanged_div class=3D""><blockquote =
class=3D"gmail_quote" defanged_style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><br class=3D"">
<br class=3D"">
=3D=3D=3D> Successful make install-image<br class=3D"">
=3D=3D=3D> build.sh ended: Sat Jan 18 =
20:39:08 CET 2020<br class=3D"">
=3D=3D=3D> Summary of results:<br class=3D"">
build.sh command: =
/usr/src/build.sh -O /tmp/obj -D /tmp/dest -T /tmp/tools -j24 -u -U -x =
release install-image<br class=3D"">
build.sh started: Sat =
Jan 18 19:58:34 CET 2020<br class=3D"">
NetBSD version: =
9.99.39<br class=3D"">
MACHINE: =
amd64<br class=3D"">
MACHINE_ARCH: =
x86_64<br class=3D"">
Build platform: =
NetBSD 9.99.38 amd64<br class=3D"">
HOST_SH: =
/bin/sh<br class=3D"">
No $TOOLDIR/bin/nbmake, needs =
building.<br class=3D"">
Bootstrapping nbmake<br class=3D"">
MAKECONF file: =
/etc/mk.conf<br class=3D"">
TOOLDIR path: =
/tmp/tools<br class=3D"">
DESTDIR path: =
/tmp/dest<br class=3D"">
RELEASEDIR path: =
/tmp/obj/releasedir<br class=3D"">
Created /tmp/tools/bin/nbmake<br =
class=3D"">
Updated makewrapper: =
/tmp/tools/bin/nbmake-amd64<br class=3D"">
Successful make release<br class=3D"">
Successful make install-image<br =
class=3D"">
build.sh ended: =
Sat Jan 18 20:39:08 CET 2020<br class=3D"">
=3D=3D=3D> .<br class=3D"">
<br class=3D"">
<br class=3D"">
Martin<br class=3D"">
<br class=3D"">
</blockquote><div class=3D""><br =
class=3D"webkit-block-placeholder"></div><defanged_div class=3D""><div =
class=3D""><br class=3D"webkit-block-placeholder"></div><defanged_div =
class=3D"">
<span =
id=3D"cid:107F6563-AE54-49A1-8C98-40C9BD96EF6B@astron.com"><sanitizer.l=
og></span></defanged_div></defanged_div></defanged_div></defanged_div><=
/defanged_div></defanged_div></defanged_div></defanged_div></defanged_div>=
</defanged_div></defanged_div></defanged_div></defanged_div></defanged_div=
></defanged_div></defanged_div></defanged_div></defanged_div></defanged_di=
v></defanged_div></defanged_div></defanged_div></defanged_div></defanged_d=
iv></defanged_div></defanged_div></defanged_div></defanged_div></defanged_=
div></defanged_div></defanged_div></defanged_div></defanged_div></defanged=
_div></defanged_div></defanged_div></defanged_div></defanged_div></defange=
d_div></defanged_div></defanged_div></defanged_div></defanged_div></defang=
ed_div></defanged_div></defanged_div></defanged_div></defanged_div></defan=
ged_div></defanged_div></defanged_div></defanged_div></defanged_div></defa=
nged_div></defanged_div></defanged_div></defanged_div></defanged_div></def=
anged_div></defanged_div></defanged_div></defanged_div></defanged_div></de=
fanged_div></defanged_div></defanged_div></defanged_div></defanged_div></d=
efanged_div></defanged_div></defanged_div></defanged_div></defanged_div></=
defanged_div></defanged_div></defanged_div></div></blockquote></div><br =
class=3D""></div></body></html>=
--Apple-Mail=_4F25A8BA-129E-42DB-A209-8E87ED994EA4--
--Apple-Mail=_6AC504FA-53C9-4AF3-B259-FC8310601949
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
filename=signature.asc
Content-Type: application/pgp-signature;
name=signature.asc
Content-Description: Message signed with OpenPGP
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - http://gpgtools.org
iF0EARECAB0WIQS+BJlbqPkO0MDBdsRxESqxbLM7OgUCXiZDrwAKCRBxESqxbLM7
OtI4AJ914sOMGyNI4xXhC/iC/hkzm8IXhgCdE3uULuW8KpOcd4eAjRAc9wbHbmQ=
=2TYJ
-----END PGP SIGNATURE-----
--Apple-Mail=_6AC504FA-53C9-4AF3-B259-FC8310601949--
Home |
Main Index |
Thread Index |
Old Index