Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

[Andreas Kusalananda Kähäri <andreas.kahari%abc.se@localhost>]

On Fri, Jun 12, 2020 at 12:26:26AM -0700, Greg A. Woods wrote:
> OK, so the initial "hg clone" equivalent took almost exactly 3 hrs.
> 
> 17:46 [663] $ ftp https://cdn.NetBSD.org/_bundles/src/77d2a2ece3a06d837da45acd>
> Requesting https://cdn.NetBSD.org/_bundles/src/77d2a2ece3a06d837da45acd0fda80086ab4113c.zstd.hg
> 100% |***********************************|  1285 MiB    6.86 MiB/s    00:00 ETA
> 1347521045 bytes retrieved in 03:07 (6.84 MiB/s)
> 17:49 [664] $
> 
> 17:55 [669] $ hg init h-NetBSD-src
> 17:55 [668] $ cd h-NetBSD-src
> 17:55 [669] $ hg unbundle /build/work-tmp/77d2a2ece3a06d837da45acd0fda80086ab4>
> adding changesets
> adding manifests
> adding file changes
> added 931876 changesets with 2425841 changes to 439702 files (+417 heads)
> new changesets 8cec458d70ff:77d2a2ece3a0
> (run 'hg heads' to see heads)
> 20:48 [670] $
> 
> 
> The final "hg checkout trunk" took almost exactly 2 hrs:
> 
> 20:48 [671] $ time hg checkout trunk
> 171685 files updated, 0 files merged, 0 files removed, 0 files unresolved
>  7204.00s real   501.37s user  1645.00s system
> 22:48 [672] $
> 
> 
> So, that's 5hrs total to do an "hg clone".
> 
> Wow.


Well, you're asking to fetch all the history for all the sources to an
actively developed operating system project running since at least 1993
(27 years).

With git, you can use --depth=1 when cloning to create a shallow clone.
This would limit the amount of data fetched.  I imagine Mercurial has
some similar option (but I don't really know).


Regards,


> Now this was to an NFS-hosted filesystem, and there was another "rsync
> && cvs update" running during some of that time on the NFS server, but
> still....  (the rsync and other cvs activity normally only occupies
> about 1/2 or less of the file server's capacity according to sysstat).
> 
> 
> I'll now fire up a new "git clone" next for a more up-to-date
> comparison.  There will be another rsync && cvs start during this, just
> to be fair.  :-)
> 
> --
> 					Greg A. Woods <gwoods%acm.org@localhost>
> 
> Kelowna, BC     +1 250 762-7675           RoboHack <woods%robohack.ca@localhost>
> Planix, Inc. <woods%planix.com@localhost>     Avoncote Farms <woods%avoncote.ca@localhost>
> 



-- 
Andreas (Kusalananda) Kähäri
SciLifeLab, NBIS, ICM
Uppsala University, Sweden

.