Re: Speed up unbundling of hg bundles

[Matthias Petermann <mp%petermann-it.de@localhost>]

Hello Martin,

On 12.12.20 13:35, Martin Husemann wrote:
> It sounds more like you are hitting a python (or NetBSD library) bug here
> (unless your machine has too little RAM and is quite slow).

that seems to be the right conclusion. One thing in advance: the problem 
is now solved.

For documentation purposes: what were the circumstances?

I am using NetBSD 9.1 on amd64. Both CPU and RAM are sufficient 
(i5-3320M, 16 GB). I was running Mercurial in the Python 2.7 variant 
from pkgsrc-2020Q3. The reason for Python 2.7 was that I wanted to use 
TortoiseHg, which requires Python 2.7. TortoiseHg didn't work (that's 
another topic) but I continued to use Mercurial with Python 2.7 as a result.

The unbundle always stopped at this point:

# hg unbundle ../77d2a2ece3a06d837da45acd0fda80086ab4113c.zstd.hg
adding changesets
adding manifests 

adding file changes

I have now removed the Python 2.7 variant along with TortoiseHg, and 
installed the Python 3 variant instead. With this, it works in a 
perfectly acceptable time (something around 1 h I believe):

# hg unbundle ../77d2a2ece3a06d837da45acd0fda80086ab4113c.zstd.hg
adding changesets
adding manifests 

adding file changes 

added 931876 changesets with 2425841 changes to 439702 files (+417 
heads)
new changesets 8cec458d70ff:77d2a2ece3a0 (931876 drafts)
(run 'hg heads' to see heads)

So it does seem to be a bug. Since Python 2.7 has had its day anyway, I 
wouldn't pursue it any further for the time being. After this bumpy 
start, I am now happy to use Mercurial and am glad that my first 
suspicion (ZFS) did not prove to be true.

Thanks again for all the suggestions on this topic, and have a nice 
Saturday.

Matthias