py-distributed: update to 2022.12.1

To: pkgsrc-wip-changes%NetBSD.org@localhost
Subject: py-distributed: update to 2022.12.1
From: Matthew Danielson <matthewd%fastmail.us@localhost>
Date: Sun, 18 Dec 2022 04:34:28 +0000
Module Name:	pkgsrc-wip
Committed By:	Matthew Danielson <matthewd%fastmail.us@localhost>
Pushed By:	matthewd
Date:		Sat Dec 17 20:34:28 2022 -0800
Changeset:	edacc2ea11ec229880b202485478b2196287d422

Modified Files:
	py-distributed/Makefile
	py-distributed/PLIST
	py-distributed/distinfo

Log Message:
py-distributed: update to 2022.12.1

2022.12.1
Released on December 16, 2022
Enhancements
    SpillBuffer metrics (GH#7368) crusaderky
    Prometheus: measure how much spilling blocks the event loop (GH#7370) crusaderky
    Add transfer_outgoing_bytes_total metric (GH#7388) Gabe Joseph
    Fail P2PShuffle gracefully upon worker failure (GH#7326) Hendrik Makait
Bug Fixes
    Select queued tasks in stimuli, not transitions (GH#7402) Gabe Joseph
    Check ContextVar in default_client (GH#7369) Matthew Rocklin
    Fix sending event messages to non-subscribers (GH#7014) Laurence Watts
    Set sizing mode on Tabs to avoid layout collapse (GH#7365) Mateusz Paprocki
Maintenance
    Restructure P2PShuffle extensions (GH#7390) Hendrik Makait
    Add Python 3.11 classifier (GH#7408) James Bourbeau
    Add support for Python 3.11 (GH#7249) Thomas Grainger
    Add test for using annotations with client.submit and client.map (GH#7399) James Bourbeau
    Bump actions/checkout from 3.1.0 to 3.2.0 (GH#7393)
    Remove superfluous ShuffleSchedulerExtension.barriers (GH#7389) Hendrik Makait
    Remove ignore annotation-unchecked (GH#7379) crusaderky
    Remove tornado max version from nightly recipe (GH#7376) Charles Blackmon-Luca
    Remove the experimental feature warning for Semaphore (GH#7373) Florian Jetter
2022.12.0
Released on December 2, 2022
Enhancements
    Expose event loop health metrics in Prometheus (GH#7360) Hendrik Makait
    Allow log propagation by default (GH#5669) Florian Jetter
    Clean up of unpack_remotedata() (GH#7322) Mads R. B. Kristensen
    Upgrade to tornado 6.2 (GH#7286) Thomas Grainger
    Introduce Server level comm counters (GH#7332) Florian Jetter
    Prometheus debug log (GH#7302) Florian Jetter
Bug Fixes
    Catch BaseException s from user tasks (GH#5997) Gabe Joseph
    Impossible use case of erred deps in transition to waiting (GH#7354) crusaderky
    Fix a deadlock when queued tasks are resubmitted quickly in succession (GH#7348) Florian Jetter
Documentation
    Editorial changes to Prometheus documentation (GH#7350) Hendrik Makait
Maintenance
    Fetch all artifacts (GH#7355) Enrico Minack
    Delay fsspec and urllib3 import time (GH#6659) Florian Jetter
    Bump mypy (GH#7349) crusaderky
    Bump mypy and remove win specific run (GH#7344) Florian Jetter
    Finish overhaul of SchedulerState annotations (GH#7333) crusaderky
    Fix flaky test_pause_while_spilling (GH#7334) Gabe Joseph
    Update gpuCI RAPIDS_VER to 23.02 (GH#7337)
2022.11.1
Released on November 18, 2022
Enhancements
    Restrict bokeh=3 support (GH#7329) Gabe Joseph
    Respect death timeout when waiting for scheduler file (GH#7296) Florian Jetter
    Always raise exception if P2PShuffle s send fails (GH#7317) Hendrik Makait
Documentation
    Fix typo in client.run() docstring (GH#7315) Richard Pelgrim
    Note queuing default change in changelog (GH#7314) Gabe Joseph
Maintenance
    Update ga-yaml-parser step in gpuCI updating workflow (GH#7335) Charles Blackmon-Luca
    Remove exception handling from transitions (GH#7316) crusaderky
    Turn private functions into private SchedulerState methods (GH#7260) Hendrik Makait
    Bump toolz minimum version to 0.10.0 (GH#7309) Sam Grayson
2022.11.0
Released on November 15, 2022
Note
This release changes the default scheduling mode to use queuing. This will significantly reduce cluster memory use in most cases, and generally improve stability and performance. Learn more here and please provide any feedback on this discussion.
In rare cases, this could make some workloads slower. See the documentation for more information, and how to switch back to the old mode.
New Features
    Add ForwardOutput worker plugin to forward stdout and stderr to client. (GH#7297) Hendrik Makait
    Duration counters on prefix level (GH#7288) Florian Jetter
    Include button for launching JupyterLab layout in repr (GH#7218) Ian Rose
Enhancements
    Support MIG parsing during CUDA context creation in UCX initialization (GH#6720) Peter Andreas Entschev
    Handle /metrics endpoint without prometheus-client installed (GH#7234) Hendrik Makait
    Add support for unpacking namedtuples in remote data (GH#7282) Andrew
    Enable queuing by default (GH#7279) Florian Jetter
    Fix exists->``exist`` typo in scheduler error messages (GH#7281) Matthew Plough
    If there’s an exception in the Client async context manager body then close fast (GH#6920) Thomas Grainger
Documentation
    Copyediting typos + codespell pre-commit hook for docs (GH#7294) Matthew Plough
    Queuing docs (GH#7203) Gabe Joseph
Bug Fixes
    Ensure category is optional when logging "warn" events (GH#7169) James Bourbeau
    Edge and impossible transitions to memory (GH#7205) crusaderky
Maintenance
    Use conda-incubator/setup-miniconda@v2.2.0 (GH#7310) jakirkham
    Allow bokeh=3 (GH#5648) James Bourbeau
    Fix typos in P2P shuffle code (GH#7304) Hendrik Makait
    Reenable test_bad_disk (GH#7300) Florian Jetter
    Reduce max-runs in test reports (GH#7299) Florian Jetter
    Revert idle classification when worker-saturation is set (GH#7278) Florian Jetter
    Fix flaky deadline_expiration (GH#7287) Florian Jetter
    Rewrite of P2P control flow (GH#7268) Florian Jetter
    Add codecov token (GH#7277) Florian Jetter
    Bump minimum bokeh version to 2.4.2 (GH#7271) James Bourbeau
    Remove deprecated code calls to IOLoop.make_current() (GH#7240) Thomas Grainger
    Improved test for balancing expensive tasks (GH#7272) Hendrik Makait
    Refactor semaphore._Watch into general-purpose Deadline utility (GH#7238) Hendrik Makait
    Coverage report fixing (GH#7270) Tom Hu
    Require Click 7.0+ (GH#7226) jakirkham
    Drop tests (GH#7269) Hendrik Makait
    Replace test_(do_not_)steal_communication_heavy_tasks tests with more robust versions (GH#7243) Hendrik Makait
    xfail test_bad_disk (GH#7265) crusaderky
    Move transition_log from Scheduler to SchedulerState (GH#7254) crusaderky
    Remove Scheduler.log (GH#7258) crusaderky
    Use latest pickle (GH#5826) jakirkham
    Polish parsing of worker-saturation from config (GH#7255) crusaderky
    Avoid expensive occupancy calculation when unused (GH#7257) Gabe Joseph
    Un-skip test_nested_compute (GH#7247) Gabe Joseph
    Review test_do_not_steal_communication_heavy_tasks (GH#7250) crusaderky
    Fix test_stress_creation_and_deletion (GH#7215) crusaderky
    Raise exceptions in Server.handle_stream instead of swallowing/logging (GH#7162) Hendrik Makait
    Upgrade to mypy v0.982 (GH#7241) Thomas Grainger
    Fix _update_scheduler_info hanging failed tests (GH#7225) Gabe Joseph
    Bump xarray-contrib/ci-trigger from 1.1 to 1.2 (GH#7232)
2022.10.2
Released on October 31, 2022
    Reverted a bug where Bokeh was accidentally made non-optional (GH#7230) Oliver Holworthy
    Schedule a queued task when a task secedes (GH#7224) Gabe Joseph
This was a hotfix release
2022.10.1
Released on October 28, 2022
New Features
    Add Client.restart_workers method (GH#7154) James Bourbeau
    Implement PackageInstall plugin for pip and conda (GH#7126) Hendrik Makait
Enhancements
    Add prometheus collector for work-stealing (GH#7206) Hendrik Makait
    Track reason of workers closing and restarting (GH#7166) Hendrik Makait
    Show no-worker on task progress bar (GH#7171) Florian Jetter
    Set OPENBLAS_NUM_THREADS by default (GH#7177) James Bourbeau
    Optionally provide local directory to data constructor (GH#7153) Lawrence Mitchell
    Introduce distributed.comm.ucx.environment config slot (GH#7164) Lawrence Mitchell
    Log information about memory limit (GH#7160) Florian Jetter
    Improve log messages on scheduler for restart (GH#7150) Florian Jetter
    More comprehensive WorkerState task counters (GH#7167) crusaderky
Documentation
    Add note to changelog about new CLI (GH#7178) James Bourbeau
    Update AMM docs (GH#7158) Benjamin Zaitlen
    Add CondaInstall to plugins doc (GH#7149) James Bourbeau
Bug Fixes
    Update minimum bokeh version message (GH#7172) James Bourbeau
    Revamped implementations of remote print() and warn(), fixing #7095 (GH#7129) Max Bane
Maintenance
    Temporarily restrict bokeh<3 (GH#7219) James Bourbeau
    Make Scheduler.reschedule private (GH#7216) crusaderky
    Fix decide_worker_rootish_queuing_disabled assert (GH#7065) Gabe Joseph
    Fix flaky test_include_communication_in_occupancy (GH#7212) Gabe Joseph
    Do not raise on leaked websockets (GH#7199) Florian Jetter
    Update nightly recipes with CLI tests, dependency changes (GH#7201) Charles Blackmon-Luca
    Make p2p shuffle submodules private (GH#7186) Florian Jetter
    Backport tornado PeriodicCallback (GH#7165) Florian Jetter
    Fix mypy failure on CI (GH#7198) Florian Jetter
    User a layer for p2p shuffle (GH#7180) Florian Jetter
    Type annotations for shuffle (GH#7185) Florian Jetter
    Do not close worker on comm error in heartbeat (GH#7163) Hendrik Makait
    Errors when setting TCP timeouts log as error (GH#7161) Florian Jetter
    Remove incorrect advice from pre-commit config (GH#7159) crusaderky
    Bump the-coding-turtle/ga-yaml-parser from 0.1.1 to 0.1.2 (GH#7146)
    Bump JamesIves/github-pages-deploy-action from 4.1.7 to 4.4.1 (GH#7145)
    Use functionalities network for codecov uploader (GH#7148) Florian Jetter
    Use counter metric type where appropriate, incoming_count was reporting bytes (GH#7125) Nat Tabris

To see a diff of this commit:
https://wip.pkgsrc.org/cgi-bin/gitweb.cgi?p=pkgsrc-wip.git;a=commitdiff;h=edacc2ea11ec229880b202485478b2196287d422

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

diffstat:
 py-distributed/Makefile | 19 +++++++++++--------
 py-distributed/PLIST    | 34 +++++++++++++++++++++-------------
 py-distributed/distinfo |  6 +++---
 3 files changed, 35 insertions(+), 24 deletions(-)

diffs:
diff --git a/py-distributed/Makefile b/py-distributed/Makefile
index ae531d3abe..825b18a88c 100644
--- a/py-distributed/Makefile
+++ b/py-distributed/Makefile
@@ -1,6 +1,6 @@
 # $NetBSD$
 
-DISTNAME=	distributed-2022.10.0
+DISTNAME=	distributed-2022.12.1
 PKGNAME=	${PYPKGPREFIX}-${DISTNAME}
 CATEGORIES=	devel net
 GITHUB_PROJECT=	distributed
@@ -12,13 +12,8 @@ HOMEPAGE=	https://github.com/dask/distributed/
 COMMENT=	Distributed is the parallel scheduler for dask
 LICENSE=	modified-bsd
 
-TEST_DEPENDS+=	${PYPKGPREFIX}-lz4>=3.1.10:../../archivers/py-lz4
-TEST_DEPENDS+=	${PYPKGPREFIX}-zstandard>=0.18.0:../../archivers/py-zstandard
-TEST_DEPENDS+=	${PYPKGPREFIX}-requests>=2.28.1:../../devel/py-requests
-TEST_DEPENDS+=	${PYPKGPREFIX}-test-[0-9]*:../../devel/py-test
-TEST_DEPENDS+=	${PYPKGPREFIX}-test-timeout-[0-9]*:../../devel/py-test-timeout
-TEST_DEPENDS+=	${PYPKGPREFIX}-dask-2022.9.1{,nb*}:../../wip/py-dask
-TEST_DEPENDS+=	${PYPKGPREFIX}-ipywidgets>=7.7.0:../../www/py-ipywidgets
+BUILD_DEPENDS+=       ${PYPKGPREFIX}-wheel>=0:../../devel/py-wheel
+
 DEPENDS+=	${PYPKGPREFIX}-click>=8.1.3:../../devel/py-click
 DEPENDS+=	${PYPKGPREFIX}-sortedcontainers>=2.0.1:../../devel/py-sortedcontainers
 DEPENDS+=	${PYPKGPREFIX}-cloudpickle>=2.2.0:../../wip/py-cloudpickle
@@ -29,6 +24,14 @@ DEPENDS+=	${PYPKGPREFIX}-toolz>=0.8.2:../../devel/py-toolz
 DEPENDS+=	${PYPKGPREFIX}-tornado>=6.0.3:../../www/py-tornado
 DEPENDS+=	${PYPKGPREFIX}-tblib>=1.7.0:../../wip/py-tblib
 
+TEST_DEPENDS+=	${PYPKGPREFIX}-lz4>=3.1.10:../../archivers/py-lz4
+TEST_DEPENDS+=	${PYPKGPREFIX}-zstandard>=0.18.0:../../archivers/py-zstandard
+TEST_DEPENDS+=	${PYPKGPREFIX}-requests>=2.28.1:../../devel/py-requests
+TEST_DEPENDS+=	${PYPKGPREFIX}-test-[0-9]*:../../devel/py-test
+TEST_DEPENDS+=	${PYPKGPREFIX}-test-timeout-[0-9]*:../../devel/py-test-timeout
+TEST_DEPENDS+=	${PYPKGPREFIX}-dask-2022.9.1{,nb*}:../../wip/py-dask
+TEST_DEPENDS+=	${PYPKGPREFIX}-ipywidgets>=7.7.0:../../www/py-ipywidgets
+
 USE_LANGUAGES=	# none
 post-install:
 	cd ${DESTDIR}${PREFIX} && \
diff --git a/py-distributed/PLIST b/py-distributed/PLIST
index 92622ce9a8..128bf1f611 100644
--- a/py-distributed/PLIST
+++ b/py-distributed/PLIST
@@ -1,7 +1,7 @@
 @comment $NetBSD$
-bin/dask-scheduler-${PYVERSSUFFIX}
-bin/dask-ssh-${PYVERSSUFFIX}
-bin/dask-worker-${PYVERSSUFFIX}
+bin/dask-scheduler-3.10
+bin/dask-ssh-3.10
+bin/dask-worker-3.10
 ${PYSITELIB}/${WHEEL_INFODIR}/AUTHORS.md
 ${PYSITELIB}/${WHEEL_INFODIR}/INSTALLER
 ${PYSITELIB}/${WHEEL_INFODIR}/LICENSE.txt
@@ -179,6 +179,8 @@ ${PYSITELIB}/distributed/http/scheduler/prometheus/core.py
 ${PYSITELIB}/distributed/http/scheduler/prometheus/core.pyc
 ${PYSITELIB}/distributed/http/scheduler/prometheus/semaphore.py
 ${PYSITELIB}/distributed/http/scheduler/prometheus/semaphore.pyc
+${PYSITELIB}/distributed/http/scheduler/prometheus/stealing.py
+${PYSITELIB}/distributed/http/scheduler/prometheus/stealing.pyc
 ${PYSITELIB}/distributed/http/static/css/base.css
 ${PYSITELIB}/distributed/http/static/css/gpu.css
 ${PYSITELIB}/distributed/http/static/css/individual-cluster-map.css
@@ -291,16 +293,22 @@ ${PYSITELIB}/distributed/semaphore.py
 ${PYSITELIB}/distributed/semaphore.pyc
 ${PYSITELIB}/distributed/shuffle/__init__.py
 ${PYSITELIB}/distributed/shuffle/__init__.pyc
-${PYSITELIB}/distributed/shuffle/arrow.py
-${PYSITELIB}/distributed/shuffle/arrow.pyc
-${PYSITELIB}/distributed/shuffle/multi_comm.py
-${PYSITELIB}/distributed/shuffle/multi_comm.pyc
-${PYSITELIB}/distributed/shuffle/multi_file.py
-${PYSITELIB}/distributed/shuffle/multi_file.pyc
-${PYSITELIB}/distributed/shuffle/shuffle.py
-${PYSITELIB}/distributed/shuffle/shuffle.pyc
-${PYSITELIB}/distributed/shuffle/shuffle_extension.py
-${PYSITELIB}/distributed/shuffle/shuffle_extension.pyc
+${PYSITELIB}/distributed/shuffle/_arrow.py
+${PYSITELIB}/distributed/shuffle/_arrow.pyc
+${PYSITELIB}/distributed/shuffle/_buffer.py
+${PYSITELIB}/distributed/shuffle/_buffer.pyc
+${PYSITELIB}/distributed/shuffle/_comms.py
+${PYSITELIB}/distributed/shuffle/_comms.pyc
+${PYSITELIB}/distributed/shuffle/_disk.py
+${PYSITELIB}/distributed/shuffle/_disk.pyc
+${PYSITELIB}/distributed/shuffle/_limiter.py
+${PYSITELIB}/distributed/shuffle/_limiter.pyc
+${PYSITELIB}/distributed/shuffle/_scheduler_extension.py
+${PYSITELIB}/distributed/shuffle/_scheduler_extension.pyc
+${PYSITELIB}/distributed/shuffle/_shuffle.py
+${PYSITELIB}/distributed/shuffle/_shuffle.pyc
+${PYSITELIB}/distributed/shuffle/_worker_extension.py
+${PYSITELIB}/distributed/shuffle/_worker_extension.pyc
 ${PYSITELIB}/distributed/sizeof.py
 ${PYSITELIB}/distributed/sizeof.pyc
 ${PYSITELIB}/distributed/spill.py
diff --git a/py-distributed/distinfo b/py-distributed/distinfo
index 1c5f30fa65..deef05acf0 100644
--- a/py-distributed/distinfo
+++ b/py-distributed/distinfo
@@ -1,5 +1,5 @@
 $NetBSD$
 
-BLAKE2s (distributed-2022.10.0.tar.gz) = 86d26035992a69cc23a022d1a23035135e44b2cc061983fff41f7158ea7ddf9c
-SHA512 (distributed-2022.10.0.tar.gz) = 500c4ab0d4a6550b7dcf00a0f787771690a9ba58cab5da040fed4a2be392f55ffebd4d74d6c8946977d72b051bf1f582d30f7066a95e718e8ff140f68263b3df
-Size (distributed-2022.10.0.tar.gz) = 1754746 bytes
+BLAKE2s (distributed-2022.12.1.tar.gz) = a7ac26cf2aea8cd1ee2c89f4cc5cf164263a499a0bf76ee6839931d3cc403da9
+SHA512 (distributed-2022.12.1.tar.gz) = 72c687b0640bbfb414f0148cce75b5e4da2742b53bf583b49439d2175f09090aee6b7fac43ea63cd122a61f3fcd2bd7e75cacb79bff28dcbd185de3b1af67666
+Size (distributed-2022.12.1.tar.gz) = 1796755 bytes
Prev by Date: py-dask: Update to 2022.12.1
Next by Date: py-cityhash: Update to 0.4.3
Previous by Thread: py-dask: Update to 2022.12.1
Next by Thread: py-cityhash: Update to 0.4.3
Indexes:
Home | Main Index | Thread Index | Old Index