Re: weird error updating from https://github.com/NetBSD/pkgsrc.git

[Andrew Cagney <andrew.cagney%gmail.com@localhost>]

I suspect the corrupt binary spewed crud that included the invalid
utf-8 sequence u'\udc8c' on stdout/stderr.  The Python script, which
assumed the world only speaks valid utf-8, hoovered the raw output
into a String and then tried to print it as utf-8.

If you replace the binary with something that spews the above, what happens?

(Yes, it is technically possible to fix this - Python does has
distinct utf-8 and binary types.  However, with everything looking
like a witch^D^D^Dduck tracking this down and fixing it is a pain not
worth enduring).

On Sun, 21 Mar 2021 at 20:26, Greg A. Woods <woods%planix.ca@localhost> wrote:
>
> At Sat, 20 Mar 2021 21:56:12 -0700, "Greg A. Woods" <woods%planix.ca@localhost> wrote:
> Subject: weird error updating from https://github.com/NetBSD/pkgsrc.git
> >
> > I haven't updated my local git clone of pkgsrc in a while, but I tried
> > just now and got this:
> >
> >
> > $ cd g-NetBSD-pkgsrc
> > /work/woods/g-NetBSD-pkgsrc
> > $ git up
> > Fetching origin
> > OLDtrunk  rebasing
> > Failed to rebase origin/trunk onto OLDtrunk
> >
> > Here's what git said:
> >
> > Traceback (most recent call last):
> >   File "/usr/pkg/bin/git-up", line 11, in <module>
> >     sys.exit(run())
> >   File "/usr/pkg/lib/python2.7/site-packages/click/core.py", line 829, in __call__
> >     return self.main(*args, **kwargs)
> >   File "/usr/pkg/lib/python2.7/site-packages/click/core.py", line 782, in main
> >     rv = self.invoke(ctx)
> >   File "/usr/pkg/lib/python2.7/site-packages/click/core.py", line 1066, in invoke
> >     return ctx.invoke(self.callback, **ctx.params)
> >   File "/usr/pkg/lib/python2.7/site-packages/click/core.py", line 610, in invoke
> >     return callback(*args, **kwargs)
> >   File "/usr/pkg/lib/python2.7/site-packages/PyGitUp/gitup.py", line 656, in run
> >     gitup.run()
> >   File "/usr/pkg/lib/python2.7/site-packages/PyGitUp/gitup.py", line 208, in run
> >     self.print_error(error)
> >   File "/usr/pkg/lib/python2.7/site-packages/PyGitUp/gitup.py", line 594, in print_error
> >     print(error.stderr, file=self.stderr)
> >   File "/usr/pkg/lib/python2.7/site-packages/colorama/ansitowin32.py", line 41, in write
> >     self.__convertor.write(text)
> >   File "/usr/pkg/lib/python2.7/site-packages/colorama/ansitowin32.py", line 164, in write
> >     self.wrapped.write(text)
> > UnicodeEncodeError: 'ascii' codec can't encode character u'\udc8c' in position 55: ordinal not in range(128)
>
> N.B.:  I haven't seen this error again since finding and fixing a
> corrupted program file (part of git-base -- I just re-installed the
> binary package).
>
> (The system in question, a Xen domU, suffered a major crash some days
> ago (due to its dom0 panicing) and while everything seemed to have
> survived, there was this one corrupt file, so far, with no obvious
> cause.  One other NetBSD domU on the same hardware survived without any
> apparent problems, at least none discovered so far.  On the other hand a
> FreeBSD domU encountered major problems with the new Xen and did not
> survive.)
>
> --
>                                         Greg A. Woods <gwoods%acm.org@localhost>
>
> Kelowna, BC     +1 250 762-7675           RoboHack <woods%robohack.ca@localhost>
> Planix, Inc. <woods%planix.com@localhost>     Avoncote Farms <woods%avoncote.ca@localhost>