pkgsrc-WIP-changes archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

py-distributed: Update to 3.5.1

Module Name:	pkgsrc-wip
Committed By:	Matthew Danielson <>
Pushed By:	matthewd
Date:		Thu Jun 1 15:00:14 2023 -0700
Changeset:	6feef77cc30e50c7e2a78755ed41186016298f75

Modified Files:

Log Message:
py-distributed: Update to 3.5.1


Released on May 26, 2023
Note This release drops support for Python 3.8. As of this release Dask supports Python 3.9, 3.10, and 3.11. See this community issue for more details.
    Exclude IPython code from computations (GH#7788) Miles
    Drop Python 3.8 support (GH#7840) Thomas Grainger
    Add storage_options to performance_report (GH#7636) ypogorelova
    Don’t warn about mismatched msgpack (GH#7839) Irina Truong
    Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
    Dashboard: Fine Performance Metrics (GH#7725) Miles
Bug Fixes
    Properly handle unknown chunk sizes in P2P rechunking (GH#7856) Hendrik Makait
    Minimal change to work around (GH#7726) / support for UCX (GH#7851) Benjamin Zaitlen
    Don’t end computations until cluster is truly idle (GH#7790) crusaderky
    Explicitly install anaconda-client from conda-forge when uploading conda nightlies (GH#7861) Charles Blackmon-Luca
    Fix is_idle docs build (GH#7854) James Bourbeau
    Add tests for P2P barrier fusion (GH#7845) Hendrik Makait
    Avoid DeprecationWarning in cupy dispatch registration (GH#7836) Lawrence Mitchell

Released on May 12, 2023
    Client.upload_file send to both Workers and Scheduler and rename scratch directory (GH#7802) Miles
    Allow dashboard to be used with bokeh prereleases (GH#7814) James Bourbeau
Bug Fixes
    Ensure log_event of non-msgpack serializable object do not kill servers (GH#7472) Florian Jetter
    Fix duplicated pytestmark definitions (GH#7819) Thomas Grainger
    Fix flaky (GH#7817) Thomas Grainger
    Annotation-less P2P shuffling (GH#7801) Hendrik Makait
    Fix docstring for batch_size in (GH#7833) David Chudzicki
    Refactor (GH#7829) crusaderky
    Lint #6496 (GH#7828) crusaderky
    Remove hardcoded 60s timeout (GH#6496) Florian Jetter
    Add files to template and static directories (GH#7809) Thomas Grainger
    Disable compression for fast comms (GH#7768) crusaderky
    Avoid deprecated pd.api.types.is_sparse (GH#7813) James Bourbeau
    Bump gpuCI PYTHON_VER from 3.8 to 3.9 (GH#7812) Charles Blackmon-Luca

Released on April 28, 2023
    Enable GIL monitoring when gilknocker installed (GH#7730) Miles
    By default only set logging handler if no other handler has been set to avoid double logging (GH#7750) Thomas Grainger
    Cluster wait (GH#6700) Iain Dorrington
    Add Prometheus counter for SystemMonitor.last_time (GH#7785) Miles
Bug Fixes
    Partial revert defaultclient config setting (GH#7803) Florian Jetter
    Delay awaiting async SchedulerPlugin.{add|remove}_worker hooks in order to immediately execute all sync ones (GH#7799) Hendrik Makait
    Fix check_idle not returning the correct value if no change to idleness (GH#7781) Jacob Tomlinson
    Avoid warning when gilknocker not installed (GH#7808) James Bourbeau
    Only set worker/nanny to Status.running if it is in Status.init (GH#7773) Thomas Grainger
    Add --cov-config=pyproject.toml so config is always correctly loaded by pytest-cov (GH#7793) Thomas Grainger
    gilknocker from conda-forge (GH#7791) James Bourbeau
    Minor zict cleanup (GH#7783) crusaderky
    Bump actions/checkout from 3.5.0 to 3.5.2 (GH#7784)
    Fix typing now that code is tuple of frame(s) (GH#7778) Nat Tabris

Released on April 14, 2023
Note With this release we are making a change which will require the Dask scheduler to have consistent software and hardware capabilities as the client and workers.
It’s always been recommended that your client and workers have a consistent software and hardware environment so that data structures and dependencies can be pickled and passed between them. However recent changes to the Dask scheduler mean that we now also require your scheduler to have the same consistent environment as everything else.
    Meter queue time to the offload executor (GH#7758) crusaderky
    Add GIL contention metric to Prometheus (GH#7651) Miles
    Add methods Client.forward_logging() and Client.unforward_logging(). (GH#7276) Max Bane
    Optionally capture more frames in computations (GH#7656) Gabe Joseph
    Consider Jupyter activity in idle timeout (GH#7687) Gabe Joseph
    Add a dashboard component that displays RMM memory (GH#7718) Peter Andreas Entschev
    Improve error message if shuffle/rechunk lost annotations (GH#7707) Hendrik Makait
    Exception chaining in P2P shuffling (GH#7706) Hendrik Makait
    Use pickle for graph submissions from client to scheduler (GH#7564) Florian Jetter
Bug Fixes
    Fix crash on missing env var in dashboard link formatting (GH#7729) Miles
    Fix randbytes() on Python 3.8 (GH#7771) crusaderky
    Run scheduler of SubprocessCluster in subprocess (GH#7727) Hendrik Makait
    Drop id from RMM dashboard component (GH#7739) James Bourbeau
    Bump peter-evans/create-pull-request from 4 to 5 (GH#7766)
    Fix flaky test_malloc_trim_threshold in CI (GH#7764) crusaderky
    Minor polish in spill and worker_memory_manager (GH#7752) crusaderky
    Merge identical tool.mypy.overrides sections (GH#7749) Thomas Grainger
    Add changelog section for 2023.3.2.1 (GH#7755) Charles Blackmon-Luca
    Specify ts resolution explicitly in test_processing_chain (GH#7744) Patrick Hoefler
    Unignore Sphinx ref.python (GH#7713) Thomas Grainger
    Temporary fix for test_merge_by_multiple_columns with pandas 2.0 (GH#7747) James Bourbeau
    Remove dask/gpu from gpuCI update reviewers (GH#7741) Charles Blackmon-Luca
    Update gpuCI RAPIDS_VER to 23.06 (GH#7728)
    Remove test for DataFrame.to_hdf (GH#7735) Hendrik Makait
    Test P2P shuffling with DataFrame.to_hdf (GH#7720) Hendrik Makait typing - remove allow_incomplete_defs (GH#7721) Florian Jetter
    Remove bokeh upper bound (GH#7413) James Bourbeau
    Use declarative setuptools (GH#7629) Thomas Grainger
    Store performance metrics on scheduler (GH#7701) Miles
    Upgrade readthedocs config to ubuntu 22.04 and Python 3.11 (GH#7722) Thomas Grainger
    Clean up legacy cruft from worker reconnection (GH#7712) crusaderky
    Bump actions/checkout from 3.4.0 to 3.5.0 (GH#7711)
    Drop support for zict 2.1.0 (GH#7709) crusaderky
    Fix mypy warning in (GH#7710) crusaderky
    Test P2P shuffling with DataFrame.categorize (GH#7708) Hendrik Makait

Released on April 5, 2023
Bug Fixes
    Register atexit handler before Distributed handlers to unblock hanging UCX clusters Lawrence Mitchell Ben Zaitlen

Released on March 24, 2023
    Enhanced thread-safety in zict.File (GH#7691) crusaderky
    Future deserialization without available client (GH#7580) Florian Jetter
    Support adjusting GIL monitoring interval (GH#7650) Miles
    Gracefully stop GIL monitoring if running (GH#7652) Miles
    Fine performance metrics for execute, gather_dep, etc. (GH#7586) crusaderky
    Add GIL metric to dashboard (GH#7646) Miles
    Expose scheduler idle via RPC and HTTP API (GH#7642) Jacob Tomlinson
    Add full dashboard link in scheduler logs (GH#7631) Miles
Bug Fixes
    Tell workers when their peers have left (so they don’t hang fetching data from them) (GH#7574) Thomas Grainger
    Fix regression in dashboard after (GH#7586) (GH#7683) crusaderky
    Fix OverflowError in Cluster._sync_cluster_info() (GH#7648) Hendrik Makait
    Ensure that serialized data is measured correctly (GH#7593) Florian Jetter
    Fix unexpected indentation in Client.cancel docstring (GH#7694) Thomas Grainger
    Improve plugin API documentation (GH#7653) Florian Jetter
    Configure sphinx warnings as errors (GH#7697) Thomas Grainger
    Fix naming comparison in test-report workflow script (GH#7695) Miles
    Temporarily restrict ipywidgets<8.0.5 (GH#7693) crusaderky
    Bump actions/checkout from 3.3.0 to 3.4.0 (GH#7685)
    Temporarily restrict ipykernel<6.22.0 (GH#7689) James Bourbeau
    Fix typo in CODEOWNERS (GH#7670) Hendrik Makait
    Avoid bool object has no attribute close in @gen_cluster (GH#7657) Thomas Grainger
    Fix failing test_server_close_stops_gil_monitoring (GH#7659) James Bourbeau
    Add CODEOWNERS file (GH#7645) Jacob Tomlinson
    Remove weakref finalizer for Offload Executor (GH#7644) Florian Jetter

To see a diff of this commit:;a=commitdiff;h=6feef77cc30e50c7e2a78755ed41186016298f75

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

 py-distributed/Makefile |  5 ++++-
 py-distributed/PLIST    | 20 ++++++++++++++++++++
 py-distributed/distinfo |  6 +++---
 3 files changed, 27 insertions(+), 4 deletions(-)

diff --git a/py-distributed/Makefile b/py-distributed/Makefile
index 7a19b83d97..8970fa991a 100644
--- a/py-distributed/Makefile
+++ b/py-distributed/Makefile
@@ -1,6 +1,6 @@
 # $NetBSD$
-DISTNAME=	distributed-2023.3.1
+DISTNAME=	distributed-2023.5.1
 CATEGORIES=	devel net
 GITHUB_PROJECT=	distributed
@@ -12,7 +12,10 @@ HOMEPAGE=
 COMMENT=	Distributed is the parallel scheduler for dask
 LICENSE=	modified-bsd
 BUILD_DEPENDS+=       ${PYPKGPREFIX}-wheel>=0:../../devel/py-wheel
+BUILD_DEPENDS+=       ${PYPKGPREFIX}-versioneer>=0.28:../../devel/py-versioneer
 DEPENDS+=	${PYPKGPREFIX}-click>=8.1.3:../../devel/py-click
 DEPENDS+=	${PYPKGPREFIX}-sortedcontainers>=2.0.1:../../devel/py-sortedcontainers
diff --git a/py-distributed/PLIST b/py-distributed/PLIST
index bd0a254eca..5bb3f93958 100644
--- a/py-distributed/PLIST
+++ b/py-distributed/PLIST
@@ -86,6 +86,8 @@ ${PYSITELIB}/distributed/dashboard/components/
@@ -99,6 +101,8 @@ ${PYSITELIB}/distributed/dashboard/
@@ -145,6 +149,8 @@ ${PYSITELIB}/distributed/diagnostics/
@@ -155,6 +161,8 @@ ${PYSITELIB}/distributed/distributed-schema.yaml
@@ -183,10 +191,16 @@ ${PYSITELIB}/distributed/http/scheduler/prometheus/
@@ -195,11 +209,15 @@ ${PYSITELIB}/distributed/http/static/images/numpy.png
@@ -342,6 +360,8 @@ ${PYSITELIB}/distributed/
diff --git a/py-distributed/distinfo b/py-distributed/distinfo
index 5d657fcd08..06af01b189 100644
--- a/py-distributed/distinfo
+++ b/py-distributed/distinfo
@@ -1,5 +1,5 @@
-BLAKE2s (distributed-2023.3.1.tar.gz) = b220172c890ad1f62ccad98ecdbdd61e59534086d3875ca91797f4ffd51a98a2
-SHA512 (distributed-2023.3.1.tar.gz) = 822acfce6150bfcb467b3e844592b1924a1bd94ba1fefee57436f386b64a4246fffc5fdad48e19bbc887a943a3f812c3bc324acdb94a16c1bace59793270b251
-Size (distributed-2023.3.1.tar.gz) = 1838628 bytes
+BLAKE2s (distributed-2023.5.1.tar.gz) = 8a4bf5cff18102c84d5de6788657062af91a32272845c4e7cf05cb777d386a72
+SHA512 (distributed-2023.5.1.tar.gz) = b5b5cd61e90db2eff88df9268082f5a75c36bf911e63e41aec18f72276b9dc2764ff107e4122a1dead59602c43261af3e7664bbf893488780b9fc56e97210440
+Size (distributed-2023.5.1.tar.gz) = 1860331 bytes

Home | Main Index | Thread Index | Old Index