CVS commit: pkgsrc/textproc/py-nltk

To: pkgsrc-changes%NetBSD.org@localhost
Subject: CVS commit: pkgsrc/textproc/py-nltk
From: "Adam Ciarcinski" <adam%netbsd.org@localhost>
Date: Wed, 27 May 2026 08:35:28 +0000

Module Name:    pkgsrc
Committed By:   adam
Date:           Wed May 27 08:35:28 UTC 2026

Modified Files:
        pkgsrc/textproc/py-nltk: Makefile PLIST distinfo

Log Message:
py-nltk: updated to 3.9.4

Version 3.9.4 2026-03-24

* Support Python 3.14
* Fix bug in Levenshtein distance when substitution_cost > 2
* Fix bug in Treebank detokeniser re quote ordering
* Fix bug in Jaro similarity for empty strings
* Several security enhancements
* Fix GHSA-rf74-v2fm-23pw: unbounded recursion in JSONTaggedDecoder
* Implement TextTiling vocabulary introduction method (Hearst 1997)
* Fix ALINE feature matrix errors and add comprehensive tests
* Support multiple VerbNet versions, fix longid/shortid regex for VerbNet ids
* Let downloader fallback to md5 when sha256 is unavailable
* Several other minor bugfixes and code cleanups

Version 3.9.3 2026-02-21

* Fix CVE-2025-14009: secure ZIP extraction in nltk.downloader
* Block path traversal/arbitrary reads in nltk.data for protocol-less refs
* Block path traversal/abs paths in corpus readers and FS pointers
* Validate external StanfordSegmenter JARs using SHA256
* Add optional sandbox enforcement for filestring()
* Maintenance: downloader/zipped models, CI/tooling updates


To generate a diff of this commit:
cvs rdiff -u -r1.20 -r1.21 pkgsrc/textproc/py-nltk/Makefile
cvs rdiff -u -r1.8 -r1.9 pkgsrc/textproc/py-nltk/PLIST
cvs rdiff -u -r1.10 -r1.11 pkgsrc/textproc/py-nltk/distinfo

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: pkgsrc/textproc/py-nltk/Makefile
diff -u pkgsrc/textproc/py-nltk/Makefile:1.20 pkgsrc/textproc/py-nltk/Makefile:1.21
--- pkgsrc/textproc/py-nltk/Makefile:1.20       Fri Dec 12 10:35:30 2025
+++ pkgsrc/textproc/py-nltk/Makefile    Wed May 27 08:35:28 2026
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.20 2025/12/12 10:35:30 adam Exp $
+# $NetBSD: Makefile,v 1.21 2026/05/27 08:35:28 adam Exp $
 
-DISTNAME=      nltk-3.9.2
+DISTNAME=      nltk-3.9.4
 PKGNAME=       ${PYPKGPREFIX}-${DISTNAME}
 CATEGORIES=    textproc python
 MASTER_SITES=  ${MASTER_SITE_PYPI:=n/nltk/}
@@ -50,15 +50,13 @@ TEST_DEPENDS+=      nltk_data-words-[0-9]*:..
 
 REPLACE_PYTHON=                nltk/corpus/reader/knbc.py
 
+PY_RENAME_BINARIES=    nltk
+
 PYTHON_VERSIONS_INCOMPATIBLE=  310
 
 post-extract:
        ${FIND} ${WRKSRC} -type f -exec ${CHMOD} g-w,o-w {} +
 
-post-install:
-       cd ${DESTDIR}${PREFIX}/bin && \
-       ${MV} nltk nltk-${PYVERSSUFFIX} || ${TRUE}
-
 .include "../../lang/python/batteries-included.mk"
 .include "../../lang/python/application.mk"
 .include "../../lang/python/wheel.mk"

Index: pkgsrc/textproc/py-nltk/PLIST
diff -u pkgsrc/textproc/py-nltk/PLIST:1.8 pkgsrc/textproc/py-nltk/PLIST:1.9
--- pkgsrc/textproc/py-nltk/PLIST:1.8   Fri Dec 12 10:35:30 2025
+++ pkgsrc/textproc/py-nltk/PLIST       Wed May 27 08:35:28 2026
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.8 2025/12/12 10:35:30 adam Exp $
+@comment $NetBSD: PLIST,v 1.9 2026/05/27 08:35:28 adam Exp $
 bin/nltk-${PYVERSSUFFIX}
 ${PYSITELIB}/${WHEEL_INFODIR}/METADATA
 ${PYSITELIB}/${WHEEL_INFODIR}/RECORD
@@ -546,6 +546,12 @@ ${PYSITELIB}/nltk/parse/util.pyo
 ${PYSITELIB}/nltk/parse/viterbi.py
 ${PYSITELIB}/nltk/parse/viterbi.pyc
 ${PYSITELIB}/nltk/parse/viterbi.pyo
+${PYSITELIB}/nltk/pathsec.py
+${PYSITELIB}/nltk/pathsec.pyc
+${PYSITELIB}/nltk/pathsec.pyo
+${PYSITELIB}/nltk/picklesec.py
+${PYSITELIB}/nltk/picklesec.pyc
+${PYSITELIB}/nltk/picklesec.pyo
 ${PYSITELIB}/nltk/probability.py
 ${PYSITELIB}/nltk/probability.pyc
 ${PYSITELIB}/nltk/probability.pyo
@@ -790,6 +796,9 @@ ${PYSITELIB}/nltk/test/setup_fixt.pyo
 ${PYSITELIB}/nltk/test/simple.doctest
 ${PYSITELIB}/nltk/test/stem.doctest
 ${PYSITELIB}/nltk/test/tag.doctest
+${PYSITELIB}/nltk/test/test_filestring_sandbox.py
+${PYSITELIB}/nltk/test/test_filestring_sandbox.pyc
+${PYSITELIB}/nltk/test/test_filestring_sandbox.pyo
 ${PYSITELIB}/nltk/test/tokenize.doctest
 ${PYSITELIB}/nltk/test/toolbox.doctest
 ${PYSITELIB}/nltk/test/translate.doctest
@@ -847,12 +856,21 @@ ${PYSITELIB}/nltk/test/unit/test_corenlp
 ${PYSITELIB}/nltk/test/unit/test_corpora.py
 ${PYSITELIB}/nltk/test/unit/test_corpora.pyc
 ${PYSITELIB}/nltk/test/unit/test_corpora.pyo
+${PYSITELIB}/nltk/test/unit/test_corpus_reader.py
+${PYSITELIB}/nltk/test/unit/test_corpus_reader.pyc
+${PYSITELIB}/nltk/test/unit/test_corpus_reader.pyo
+${PYSITELIB}/nltk/test/unit/test_corpus_util.py
+${PYSITELIB}/nltk/test/unit/test_corpus_util.pyc
+${PYSITELIB}/nltk/test/unit/test_corpus_util.pyo
 ${PYSITELIB}/nltk/test/unit/test_corpus_views.py
 ${PYSITELIB}/nltk/test/unit/test_corpus_views.pyc
 ${PYSITELIB}/nltk/test/unit/test_corpus_views.pyo
 ${PYSITELIB}/nltk/test/unit/test_data.py
 ${PYSITELIB}/nltk/test/unit/test_data.pyc
 ${PYSITELIB}/nltk/test/unit/test_data.pyo
+${PYSITELIB}/nltk/test/unit/test_data_security.py
+${PYSITELIB}/nltk/test/unit/test_data_security.pyc
+${PYSITELIB}/nltk/test/unit/test_data_security.pyo
 ${PYSITELIB}/nltk/test/unit/test_disagreement.py
 ${PYSITELIB}/nltk/test/unit/test_disagreement.pyc
 ${PYSITELIB}/nltk/test/unit/test_disagreement.pyo
@@ -862,6 +880,9 @@ ${PYSITELIB}/nltk/test/unit/test_distanc
 ${PYSITELIB}/nltk/test/unit/test_downloader.py
 ${PYSITELIB}/nltk/test/unit/test_downloader.pyc
 ${PYSITELIB}/nltk/test/unit/test_downloader.pyo
+${PYSITELIB}/nltk/test/unit/test_downloader_unzip.py
+${PYSITELIB}/nltk/test/unit/test_downloader_unzip.pyc
+${PYSITELIB}/nltk/test/unit/test_downloader_unzip.pyo
 ${PYSITELIB}/nltk/test/unit/test_freqdist.py
 ${PYSITELIB}/nltk/test/unit/test_freqdist.pyc
 ${PYSITELIB}/nltk/test/unit/test_freqdist.pyo
@@ -883,6 +904,15 @@ ${PYSITELIB}/nltk/test/unit/test_naiveba
 ${PYSITELIB}/nltk/test/unit/test_nombank.py
 ${PYSITELIB}/nltk/test/unit/test_nombank.pyc
 ${PYSITELIB}/nltk/test/unit/test_nombank.pyo
+${PYSITELIB}/nltk/test/unit/test_open_datafile.py
+${PYSITELIB}/nltk/test/unit/test_open_datafile.pyc
+${PYSITELIB}/nltk/test/unit/test_open_datafile.pyo
+${PYSITELIB}/nltk/test/unit/test_pathsec.py
+${PYSITELIB}/nltk/test/unit/test_pathsec.pyc
+${PYSITELIB}/nltk/test/unit/test_pathsec.pyo
+${PYSITELIB}/nltk/test/unit/test_pickle_load_warnings.py
+${PYSITELIB}/nltk/test/unit/test_pickle_load_warnings.pyc
+${PYSITELIB}/nltk/test/unit/test_pickle_load_warnings.pyo
 ${PYSITELIB}/nltk/test/unit/test_pl196x.py
 ${PYSITELIB}/nltk/test/unit/test_pl196x.pyc
 ${PYSITELIB}/nltk/test/unit/test_pl196x.pyo
@@ -898,6 +928,9 @@ ${PYSITELIB}/nltk/test/unit/test_rte_cla
 ${PYSITELIB}/nltk/test/unit/test_seekable_unicode_stream_reader.py
 ${PYSITELIB}/nltk/test/unit/test_seekable_unicode_stream_reader.pyc
 ${PYSITELIB}/nltk/test/unit/test_seekable_unicode_stream_reader.pyo
+${PYSITELIB}/nltk/test/unit/test_segmentation.py
+${PYSITELIB}/nltk/test/unit/test_segmentation.pyc
+${PYSITELIB}/nltk/test/unit/test_segmentation.pyo
 ${PYSITELIB}/nltk/test/unit/test_senna.py
 ${PYSITELIB}/nltk/test/unit/test_senna.pyc
 ${PYSITELIB}/nltk/test/unit/test_senna.pyo
@@ -907,6 +940,9 @@ ${PYSITELIB}/nltk/test/unit/test_stem.py
 ${PYSITELIB}/nltk/test/unit/test_tag.py
 ${PYSITELIB}/nltk/test/unit/test_tag.pyc
 ${PYSITELIB}/nltk/test/unit/test_tag.pyo
+${PYSITELIB}/nltk/test/unit/test_texttiling.py
+${PYSITELIB}/nltk/test/unit/test_texttiling.pyc
+${PYSITELIB}/nltk/test/unit/test_texttiling.pyo
 ${PYSITELIB}/nltk/test/unit/test_tgrep.py
 ${PYSITELIB}/nltk/test/unit/test_tgrep.pyc
 ${PYSITELIB}/nltk/test/unit/test_tgrep.pyo
@@ -919,6 +955,9 @@ ${PYSITELIB}/nltk/test/unit/test_twitter
 ${PYSITELIB}/nltk/test/unit/test_util.py
 ${PYSITELIB}/nltk/test/unit/test_util.pyc
 ${PYSITELIB}/nltk/test/unit/test_util.pyo
+${PYSITELIB}/nltk/test/unit/test_verbnet.py
+${PYSITELIB}/nltk/test/unit/test_verbnet.pyc
+${PYSITELIB}/nltk/test/unit/test_verbnet.pyo
 ${PYSITELIB}/nltk/test/unit/test_wordnet.py
 ${PYSITELIB}/nltk/test/unit/test_wordnet.pyc
 ${PYSITELIB}/nltk/test/unit/test_wordnet.pyo

Index: pkgsrc/textproc/py-nltk/distinfo
diff -u pkgsrc/textproc/py-nltk/distinfo:1.10 pkgsrc/textproc/py-nltk/distinfo:1.11
--- pkgsrc/textproc/py-nltk/distinfo:1.10       Fri Dec 12 10:35:30 2025
+++ pkgsrc/textproc/py-nltk/distinfo    Wed May 27 08:35:28 2026
@@ -1,5 +1,5 @@
-$NetBSD: distinfo,v 1.10 2025/12/12 10:35:30 adam Exp $
+$NetBSD: distinfo,v 1.11 2026/05/27 08:35:28 adam Exp $
 
-BLAKE2s (nltk-3.9.2.tar.gz) = 8bd3d8fcad25ec4b7f48a93d3b162ba52279402a619d09adc26b0a19c3a17914
-SHA512 (nltk-3.9.2.tar.gz) = 2dd339b8f820722914c0b8d77e8457a19e5d2287fbb1713158dc69e29f1078429d55cdb532efbff497b4f3747497e55ff7e1cd0e8974a62ab6b2f1461a5b7240
-Size (nltk-3.9.2.tar.gz) = 2887629 bytes
+BLAKE2s (nltk-3.9.4.tar.gz) = 533ed8a5c2a67cdc3090a00e5e75b2a68494bc0b1c260625c3086cd610e49516
+SHA512 (nltk-3.9.4.tar.gz) = 5fad33b5b6a79cce7c7d649441473f5435a11159cf5eb9eb7336b92292b6ddcd23a58a434d39d944e4b9fb5b6d2af23156850c9bf2956b1fa39ffeaf1cbcf242
+Size (nltk-3.9.4.tar.gz) = 2946864 bytes

Prev by Date: CVS commit: pkgsrc/doc
Next by Date: CVS commit: pkgsrc/www/py-django-tasks
Previous by Thread: CVS commit: pkgsrc/doc
Next by Thread: CVS commit: pkgsrc/www/py-django-tasks
Indexes:

Home | Main Index | Thread Index | Old Index