CVS commit: pkgsrc/sysutils/py-fsspec

["Adam Ciarcinski" <adam%netbsd.org@localhost>]

Module Name:    pkgsrc
Committed By:   adam
Date:           Wed Oct 28 08:57:52 UTC 2026

Modified Files:
        pkgsrc/sysutils/py-fsspec: Makefile PLIST distinfo

Log Message:
py-fsspec: updated to 2026.9.0

2026.9.0

Enhancements

ia:// filesystem for files in Internet Archive items: an HTTPFileSystem reading from archive.org/download with credentials from ia configure's ia.ini
Allow instance-local memory stores with global_store=False while preserving normal instance caching and the default shared store
Add an adaptive readahead cache
Implement created and modified for SFTPFileSystem
Allow filesystem implementations to assign protocol per instance
Delegate sizes and cat_ranges from DirFileSystem to the wrapped filesystem
Delegate invalidate_cache, ukey and checksum from DirFileSystem to the wrapped filesystem
Support negative offsets in TarFileSystem.cat_file
Mirror readinto from the PyArrow stream onto ArrowFile
Allow simplecache files to be removed by age using their modification times
HTTP: retry transient failures (408/425/429/5xx, dropped connections, timeouts, truncated range bodies, a 416 inside the file) of cat_file, HTTPFile block reads and the size lookup behind open, 
controlled by the new retries, retry_wait, retry_statuses and retry_exceptions options

Fixes

Compute HadoopFileSystem.fsid from its configured host and port instead of accessing attributes no longer exposed by PyArrow
Normalize dot path components in TarFileSystem listings and lookups, while preserving original archive names for reading
Make merge_offset_ranges O(n log n) and keep merged blocks within max_block, replacing the quadratic nested-range filter added
Fix transactions with compressed files
Make MemoryFileSystem.rm raise FileNotFoundError for a path that does not exist, as rm_file and the other filesystems do, so deleting a missing key from a memory-backed mapper raises KeyError
Create missing ZIP archives in append mode without truncating existing archives
Close cached readers when exiting an open_files context
Avoid mutating live BlockCache and BackgroundBlockCache instances when pickling
End the transaction even when a commit or discard raises, so the filesystem is not left in transaction mode and deferred temporary files are cleaned up
Honor a caller-owned output file in get_file
Preserve existing files when checking FSMap write access
Normalize ZIP paths in pipe_file and find
Reject get destinations that resolve above the target
Pass maxdepth through in AsyncFileSystem._rm
Do not let isfile swallow BaseException
Keep reference filesystem get destinations inside the target
Return relative names from DirFileSystem.glob and find
Raise FileNotFoundError for missing ZIP and TAR members
Stop collapsing three-character drive-relative paths to the drive root
Use / as the only glob separator on every platform
Distinguish omitted and None defaults in FSMap.pop
Forward an Arrow file's flush and closed state to its stream
Keep reference filesystem cat_file offsets inside the referenced part
Raise FileNotFoundError from archive ls for a missing path
Download uncached files in simplecache.cat_ranges
Fix tail on simplecache and filecache
Get whole-file reference sizes asynchronously in ReferenceFileSystem._info
Report the target size for links in TarFileSystem
Keep the async generator returned by AsyncFileSystemWrapper._walk
Join the default output filename with / in _expand_paths
Make names relative in DirFileSystem.walk(detail=True)
Ignore a leading slash in TarFileSystem paths
Fix cat_ranges on whole-file caches
Normalize paths in AsyncFileSystemWrapper like the wrapped filesystem
The SFTP host key policy is configurable with the new host_key_policy argument of SFTPFileSystem, which accepts "auto_add" (default, unchanged behaviour), "warning" or "reject", or any 
paramiko.MissingHostKeyPolicy


To generate a diff of this commit:
cvs rdiff -u -r1.30 -r1.31 pkgsrc/sysutils/py-fsspec/Makefile
cvs rdiff -u -r1.11 -r1.12 pkgsrc/sysutils/py-fsspec/PLIST
cvs rdiff -u -r1.29 -r1.30 pkgsrc/sysutils/py-fsspec/distinfo

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: pkgsrc/sysutils/py-fsspec/Makefile
diff -u pkgsrc/sysutils/py-fsspec/Makefile:1.30 pkgsrc/sysutils/py-fsspec/Makefile:1.31
--- pkgsrc/sysutils/py-fsspec/Makefile:1.30     Tue Aug 11 06:22:53 2026
+++ pkgsrc/sysutils/py-fsspec/Makefile  Wed Oct 28 08:57:52 2026
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.30 2026/08/11 06:22:53 adam Exp $
+# $NetBSD: Makefile,v 1.31 2026/10/28 08:57:52 adam Exp $
 
-DISTNAME=      fsspec-2026.7.0
+DISTNAME=      fsspec-2026.9.0
 PKGNAME=       ${PYPKGPREFIX}-${DISTNAME}
 CATEGORIES=    sysutils python
 MASTER_SITES=  ${MASTER_SITE_PYPI:=f/fsspec/}
@@ -10,7 +10,7 @@ HOMEPAGE=     https://github.com/fsspec/file
 COMMENT=       File-system specification
 LICENSE=       modified-bsd
 
-TOOL_DEPENDS+= ${PYPKGPREFIX}-hatch-vcs-[0-9]*:../../devel/py-hatch-vcs
+TOOL_DEPENDS+= ${PYPKGPREFIX}-hatch-vcs>=0:../../devel/py-hatch-vcs
 TOOL_DEPENDS+= ${PYPKGPREFIX}-hatchling>=1.27.0:../../devel/py-hatchling
 
 USE_LANGUAGES= # none

Index: pkgsrc/sysutils/py-fsspec/PLIST
diff -u pkgsrc/sysutils/py-fsspec/PLIST:1.11 pkgsrc/sysutils/py-fsspec/PLIST:1.12
--- pkgsrc/sysutils/py-fsspec/PLIST:1.11        Tue Nov 11 10:22:05 2025
+++ pkgsrc/sysutils/py-fsspec/PLIST     Wed Oct 28 08:57:52 2026
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.11 2025/11/11 10:22:05 adam Exp $
+@comment $NetBSD: PLIST,v 1.12 2026/10/28 08:57:52 adam Exp $
 ${PYSITELIB}/${WHEEL_INFODIR}/METADATA
 ${PYSITELIB}/${WHEEL_INFODIR}/RECORD
 ${PYSITELIB}/${WHEEL_INFODIR}/WHEEL
@@ -138,6 +138,9 @@ ${PYSITELIB}/fsspec/mapping.pyo
 ${PYSITELIB}/fsspec/parquet.py
 ${PYSITELIB}/fsspec/parquet.pyc
 ${PYSITELIB}/fsspec/parquet.pyo
+${PYSITELIB}/fsspec/prefetcher.py
+${PYSITELIB}/fsspec/prefetcher.pyc
+${PYSITELIB}/fsspec/prefetcher.pyo
 ${PYSITELIB}/fsspec/registry.py
 ${PYSITELIB}/fsspec/registry.pyc
 ${PYSITELIB}/fsspec/registry.pyo

Index: pkgsrc/sysutils/py-fsspec/distinfo
diff -u pkgsrc/sysutils/py-fsspec/distinfo:1.29 pkgsrc/sysutils/py-fsspec/distinfo:1.30
--- pkgsrc/sysutils/py-fsspec/distinfo:1.29     Tue Aug 11 06:22:53 2026
+++ pkgsrc/sysutils/py-fsspec/distinfo  Wed Oct 28 08:57:52 2026
@@ -1,5 +1,5 @@
-$NetBSD: distinfo,v 1.29 2026/08/11 06:22:53 adam Exp $
+$NetBSD: distinfo,v 1.30 2026/10/28 08:57:52 adam Exp $
 
-BLAKE2s (fsspec-2026.7.0.tar.gz) = ca079ef14a248582686723b2235536e8b83b45f718e6b159102a0fc91f42bb15
-SHA512 (fsspec-2026.7.0.tar.gz) = a523eec4bfc35f63aa11c5446ae9f32461ff45d76c579bba44929b4b9381ed82f574af9b5df5e4325311a3e391a8c02f5e45a0dac5cc3bbd424363d0bc61f47c
-Size (fsspec-2026.7.0.tar.gz) = 317040 bytes
+BLAKE2s (fsspec-2026.9.0.tar.gz) = 031a398494f2229d501d63d8b1bb32f694c800b644b2bef9a15012b2f6a81b83
+SHA512 (fsspec-2026.9.0.tar.gz) = 8dd597360f671e4f73f74ddf1ba0a8b9e639c7206db3b38a20110fd0cb577c3cda0820a2b32725815beeb64a33d9b3b9b6868f410ce2e6794213dee72251b8c4
+Size (fsspec-2026.9.0.tar.gz) = 333545 bytes