Subject: /usr/bin/tar cannot extract UTF-8 filenames on Darwin (was Re: pkgsrc Darwin 8.3.0/powerpc bulk build results 2005-12-14)
To: None <tech-pkg@NetBSD.org>
From: Klaus Heinz <k.heinz.dez.fuenf@onlinehome.de>
List: tech-pkg
Date: 12/20/2005 23:57:52
Hi,

it looks like the test suite of package converters/convmv cannot be
extracted in the "post-extract" target on Darwin:

  [ bulk build results at ftp://ftp.NetBSD.org/pub/pkgsrc/misc/kristerw/pkgstat/Darwin/20051214.0427/converters/convmv/.broken.html ]
  ...
  ===> Required installed package coreutils-[0-9]*: coreutils-5.2.1nb1 found
  tar: Cannot create suite/test-iso8859-15/2/süb (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/2/süb/güte.zo9Ba3 (No such file or directory)
  tar: Cannot create suite/test-iso8859-15/2/Äpfel.TnC2no (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/3/Äpfel (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/füße.yrkDx4 (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/Äpfel (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/euro¤.hWIBrU (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/a directory/link-nach-außerhalb2 (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/a directory/link-nach-außerhalb (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/a directory/linkzufüßen (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/a directory/subdir/björn.js3YbM (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/a directory/link-zu den füßen (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/.hidden Straße.qQk2A2 (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/schön und gut (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/schön und gut/birnen.ldbtXw (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/schön und gut/subdir (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/schön und gut/subdir/schön.HVBWCM (Invalid argument)
  tar: Cannot create suite/test-iso8859-15/schön und gut/äpfel.AlPm7H (Invalid argument)
  *** Error code 1

  Stop.

If I remember correctly pkgsrc only supports UFS on Darwin and I am
surprised that tar (to be precise: ${TAR}, ie /usr/bin/tar according to
tools.Darwin.mk) cannot extract an archive containing UTF-8 file names
on such a partition.

To my knowledge, convmv is supposed to work on Darwin. It even has special
options to deal with Darwin's use of UTF-8 in the file system
("normalization form D for UTF-8").

Can anyone please try to execute the "post-extract" target with a
different program like pax (from bootstrap) or gtar on Darwin?

ciao
     Klaus