pkgsrc-Changes-HG archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

[pkgsrc/trunk]: pkgsrc/converters/py-charset-normalizer py-charset-normalizer...



details:   https://anonhg.NetBSD.org/pkgsrc/rev/3f3fe095cc3d
branches:  trunk
changeset: 388398:3f3fe095cc3d
user:      adam <adam%pkgsrc.org@localhost>
date:      Fri Nov 18 18:50:29 2022 +0000

description:
py-charset-normalizer: updated to 3.0.1

3.0.1 (2022-11-18)

Fixed

Multi-bytes cutter/chunk generator did not always cut correctly

Changed

Speedup provided by mypy/c 0.990 on Python >= 3.7


3.0.0 (2022-10-20)

Added

Extend the capability of explain=True when cp_isolation contains at most two entries (min one), will log in details of the Mess-detector results
Support for alternative language frequency set in charset_normalizer.assets.FREQUENCIES
Add parameter language_threshold in from_bytes, from_path and from_fp to adjust the minimum expected coherence ratio
normalizer --version now specify if current version provide extra speedup (meaning mypyc compilation whl)

Changed

Build with static metadata using 'build' frontend
Make the language detection stricter
Optional: Module md.py can be compiled using Mypyc to provide an extra speedup up to 4x faster than v2.1

Fixed

CLI with opt --normalize fail when using full path for files
TooManyAccentuatedPlugin induce false positive on the mess detection when too few alpha character have been fed to it
Sphinx warnings when generating the documentation

Removed

Coherence detector no longer return 'Simple English' instead return 'English'
Coherence detector no longer return 'Classical Chinese' instead return 'Chinese'
Breaking: Method first() and best() from CharsetMatch
UTF-7 will no longer appear as "detected" without a recognized SIG/mark (is unreliable/conflict with ASCII)
Breaking: Class aliases CharsetDetector, CharsetDoctor, CharsetNormalizerMatch and CharsetNormalizerMatches
Breaking: Top-level function normalize
Breaking: Properties chaos_secondary_pass, coherence_non_latin and w_counter from CharsetMatch
Support for the backport unicodedata2

diffstat:

 converters/py-charset-normalizer/Makefile |  4 ++--
 converters/py-charset-normalizer/distinfo |  8 ++++----
 2 files changed, 6 insertions(+), 6 deletions(-)

diffs (25 lines):

diff -r 90a89cc8b03a -r 3f3fe095cc3d converters/py-charset-normalizer/Makefile
--- a/converters/py-charset-normalizer/Makefile Fri Nov 18 18:43:42 2022 +0000
+++ b/converters/py-charset-normalizer/Makefile Fri Nov 18 18:50:29 2022 +0000
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.12 2022/09/14 11:10:00 adam Exp $
+# $NetBSD: Makefile,v 1.13 2022/11/18 18:50:29 adam Exp $
 
-DISTNAME=      charset-normalizer-2.1.1
+DISTNAME=      charset-normalizer-3.0.1
 PKGNAME=       ${PYPKGPREFIX}-${DISTNAME}
 CATEGORIES=    converters python
 MASTER_SITES=  ${MASTER_SITE_PYPI:=c/charset-normalizer/}
diff -r 90a89cc8b03a -r 3f3fe095cc3d converters/py-charset-normalizer/distinfo
--- a/converters/py-charset-normalizer/distinfo Fri Nov 18 18:43:42 2022 +0000
+++ b/converters/py-charset-normalizer/distinfo Fri Nov 18 18:50:29 2022 +0000
@@ -1,5 +1,5 @@
-$NetBSD: distinfo,v 1.12 2022/09/14 11:10:00 adam Exp $
+$NetBSD: distinfo,v 1.13 2022/11/18 18:50:29 adam Exp $
 
-BLAKE2s (charset-normalizer-2.1.1.tar.gz) = bd1f7d198d6717323c1f4e9e497e6e970ee751c4fdabf2165452bbe4b442e277
-SHA512 (charset-normalizer-2.1.1.tar.gz) = f52abab683ebda4100d67ec6ee0349713baee453a742d60a1356f405c5ce2c3b4d850b0891527f08f92fa1217d59c46d6b181dc4ff1b962ce60d9c5ef8c913d1
-Size (charset-normalizer-2.1.1.tar.gz) = 82360 bytes
+BLAKE2s (charset-normalizer-3.0.1.tar.gz) = 385192a53e6991a0b0cf6a76223ef657c146941bfb9ec7ada48e55aeb4f6347f
+SHA512 (charset-normalizer-3.0.1.tar.gz) = 25bfb8d708f2c1827d4f074f1b3c4f9932f7a00b833423f9edd6d5a942af39eeb703dea7471bdf2764094e8d01af7d98017c030f7b7a2a1a24e65c1161aef52f
+Size (charset-normalizer-3.0.1.tar.gz) = 92842 bytes



Home | Main Index | Thread Index | Old Index