CVS commit: pkgsrc/www/py-protego

["Adam Ciarcinski" <adam%netbsd.org@localhost>]

Module Name:    pkgsrc
Committed By:   adam
Date:           Tue Oct 20 04:53:42 UTC 2026

Modified Files:
        pkgsrc/www/py-protego: Makefile distinfo

Log Message:
py-protego: updated to 0.7.0

0.7.0 (2026-09-21)

-   **Backward-incompatible:** ``Protego.parse()`` now raises a more suitable
    ``TypeError`` instead of a ``ValueError`` when ``content`` is not a string.

-   Added official support for Python 3.15.

-   ``can_fetch()`` now allows ``/robots.txt`` whatever the rules say, as
    required by RFC 9309.

-   A group now applies to a user agent only if its product token appears in
    that user agent at a token boundary, so that ``User-agent: bot`` no longer
    applies to ``mybot``. A product token within a whole ``User-Agent`` header
    value, e.g. ``Mozilla/5.0 (compatible; mybot/1.0)``, still matches.

-   Percent-encoding is now normalized in the query string and the parameters
    of a URL, and not only in its path, so that a rule matches whichever
    spelling either of them uses, e.g. ``Disallow: /a?b=ツ`` now matches
    ``/a?b=%E3%83%84``. The fragment is now left out of matching altogether.

-   ``Visit-time`` now also accepts a hyphen between the two times, e.g.
    ``0400-0845``, and times with a single-digit hour, e.g. ``400``.

-   Malformed ``Crawl-delay`` values, such as a negative or infinite number,
    and ``Request-rate`` values with zero requests or zero seconds, are now
    ignored, as other malformed values already were.

-   Improved the handling of invalid and misspelled lines.

    ``Sitemap`` and ``Host`` lines are now read anywhere in the file,
    including before any ``User-agent`` line, and no longer merge the groups
    they sit between. A ``User-agent`` line without a value still ends the
    preceding group. Lines written without a colon are now salvaged for every
    directive, ``Visit-time`` included, and with any whitespace as the
    separator. A line whose field is not a known directive is no longer read
    as one.

-   Fixed matching of URLs whose path contains ``=``, which no rule could
    match because it was percent-encoded in the URL but not in the rule.

-   Fixed matching of URLs whose path starts with ``//``, which got extra
    slashes before being matched.

-   Fixed ``Allow: …/index.html``, which, besides allowing the parent
    directory as intended, also allowed URLs with a ``$`` right after that
    directory.

-   Improved matching and parsing performance.

-   Documentation improvements, including a rewritten parser comparison table
    generated from benchmarks.


To generate a diff of this commit:
cvs rdiff -u -r1.13 -r1.14 pkgsrc/www/py-protego/Makefile
cvs rdiff -u -r1.10 -r1.11 pkgsrc/www/py-protego/distinfo

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: pkgsrc/www/py-protego/Makefile
diff -u pkgsrc/www/py-protego/Makefile:1.13 pkgsrc/www/py-protego/Makefile:1.14
--- pkgsrc/www/py-protego/Makefile:1.13 Mon Jun 29 13:32:47 2026
+++ pkgsrc/www/py-protego/Makefile      Tue Oct 20 04:53:42 2026
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.13 2026/06/29 13:32:47 adam Exp $
+# $NetBSD: Makefile,v 1.14 2026/10/20 04:53:42 adam Exp $
 
-DISTNAME=      protego-0.6.2
+DISTNAME=      protego-0.7.0
 PKGNAME=       ${PYPKGPREFIX}-${DISTNAME}
 CATEGORIES=    www python
 MASTER_SITES=  ${MASTER_SITE_PYPI:=P/Protego/}

Index: pkgsrc/www/py-protego/distinfo
diff -u pkgsrc/www/py-protego/distinfo:1.10 pkgsrc/www/py-protego/distinfo:1.11
--- pkgsrc/www/py-protego/distinfo:1.10 Mon Jun 29 13:32:47 2026
+++ pkgsrc/www/py-protego/distinfo      Tue Oct 20 04:53:42 2026
@@ -1,5 +1,5 @@
-$NetBSD: distinfo,v 1.10 2026/06/29 13:32:47 adam Exp $
+$NetBSD: distinfo,v 1.11 2026/10/20 04:53:42 adam Exp $
 
-BLAKE2s (protego-0.6.2.tar.gz) = e1acca582d3cc25394801ee61a9f6797a5fa9a6894617809ed84f4b4d2d14475
-SHA512 (protego-0.6.2.tar.gz) = 5441764c0b95b9607fbd0277c1044c20f459670d27671bd2f579b7975bedaf51789dacf58c07c5179834dbfeee3c7885a49b01666e3c3b7d2ec936c24229c85f
-Size (protego-0.6.2.tar.gz) = 3137854 bytes
+BLAKE2s (protego-0.7.0.tar.gz) = 010f23d598bf6ee05cd030a6be4582d34d3f210e2a349951c8cfb10d62f0314c
+SHA512 (protego-0.7.0.tar.gz) = fbf107662867adde1f0fd5858558ca2dedbfa8ec13f3ad4155bd9978ed6f41aaf149c91218006f9d05e137994cb42cebc9c86ed3da910107800c5ae0ee5ba6a1
+Size (protego-0.7.0.tar.gz) = 3144321 bytes