pkgsrc-Changes-HG archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
[pkgsrc/trunk]: pkgsrc/net/py-gsutil Update py-gsutil to 4.31.
details: https://anonhg.NetBSD.org/pkgsrc/rev/81331f4987f8
branches: trunk
changeset: 381762:81331f4987f8
user: bsiegert <bsiegert%pkgsrc.org@localhost>
date: Sat Jun 16 14:50:25 2018 +0000
description:
Update py-gsutil to 4.31.
Fix all dependencies. This time, there is an actual working gsutil binary.
Thus, fix PR pkg/52941.
Release 4.31 (release date: 2018-04-26)
=======================================
New features
------------------
- Added support for reauthentication within gsutil. Note that this only affects
authentication when "gs_oauth2_refresh_token" is configured under the
"Credentials" section of the boto config file and that token corresponds to a
user account enrolled in 2-step verification.
Bug Fixes
------------------
- When creating a signed URL via the "signurl" command, gsutil now verifies that
the specified expiration isn't longer than 7 days (the maximum allowed by the
service).
- To support rewriting objects to be encrypted using a bucket's default KMS key,
the "rewrite" command now rewrites all specified objects if no value is
specified for "encryption_key" under the "GSUtil" section in the boto config
file.
Other Changes
------------------
- Several documentation updates and clarifications.
Release 4.30 (release date: 2018-03-28)
=======================================
New features
------------------
- Added Cloud KMS support for Google Cloud Storage resources, allowing the use
of customer-managed encryption keys (CMEKs). Bucket-related functionality
includes the new "kms" command, which can be used to get or set a bucket's
default KMS key. Concerning objects, users may now specify the CMEK to be used
for encryption via their boto config file, in the "encryption_key" attribute.
In this way, users may specify either a CSEK or a CMEK to encrypt new objects,
but not both. For more information, see "gsutil help encryption".
Other Changes
------------------
- Several documentation updates and clarifications.
Release 4.29 (release date: 2018-03-14)
=======================================
New features
------------------
- Added transport compression support, available through the "-j" and "-J"
options for the "cp", "mv", and "rsync" commands. This is useful when
uploading files with highly-compressible content. When specificed, files being
uploaded are compressed on-the-fly in memory, sent to GCS, and uncompressed by
GCS before they are stored. See "gsutil help cp" for additional information.
- When "use_magicfile=True" is set in the boto config file, gsutil will now
append the detected charset, if present, to the object's Content-Type metadata
field. For example, a Content-Type might be populated with
"text/html; charset=us-ascii" rather than simply "text/html".
Bug Fixes
------------------
- Improved error handling and logging for upload resumption.
- After encountering a PreconditionException, the "acl ch" command will now
re-fetch the object generation before retrying.
- Fixed issue with parsing lifecycle conditions when using the XML API.
Conditions whose values could be evaluated by Python as "falsy" (e.g. setting
an "age" condition to the number 0 or "isLive" to false) would be omitted from
the lifecycle configuration when "prefer_api=xml" was set in the boto config
file. Note that the JSON API is preferred by default, so most users were
unlikely to encounter this issue.
- For commands that fetch bucket ACLs or default ACLs, when the user does not
have storage.buckets.getIamPolicy on the GCS bucket, using the XML API will
now behave consistently with the JSON API and display ACL/default ACL fields
as empty, rather than throwing a CommandException.
Other Changes
------------------
- Several documentation updates and clarifications.
- The "signurl" command now uses signature V4 signing format to generate URLs.
diffstat:
net/py-gsutil/Makefile | 29 +++++++--
net/py-gsutil/PLIST | 140 +++++++++++++++++++++++++++++++++++--------------
net/py-gsutil/distinfo | 10 +-
3 files changed, 127 insertions(+), 52 deletions(-)
diffs (truncated from 313 to 300 lines):
diff -r 464321d95695 -r 81331f4987f8 net/py-gsutil/Makefile
--- a/net/py-gsutil/Makefile Sat Jun 16 14:45:32 2018 +0000
+++ b/net/py-gsutil/Makefile Sat Jun 16 14:50:25 2018 +0000
@@ -1,7 +1,6 @@
-# $NetBSD: Makefile,v 1.2 2018/03/04 12:11:21 bsiegert Exp $
+# $NetBSD: Makefile,v 1.3 2018/06/16 14:50:25 bsiegert Exp $
-DISTNAME= gsutil-4.28
-PKGREVISION= 1
+DISTNAME= gsutil-4.31
PKGNAME= ${PYPKGPREFIX}-${DISTNAME}
CATEGORIES= net
MASTER_SITES= ${MASTER_SITE_PYPI:=g/gsutil/}
@@ -14,12 +13,28 @@
PYTHON_VERSIONS_ACCEPTED= 27
REPLACE_PYTHON= test/gsutil_measure_imports
-DEPENDS+= ${PYPKGPREFIX}-argcomplete>=1.8:../../devel/py-argcomplete
+#SUBST_CLASSES+= requires
+#SUBST_STAGE.requires= pre-configure
+#SUBST_FILES.requires= setup.py gsutil.egg-info/requires.txt
+#SUBST_SED.requires= -e 's/oauth2client==/oauth2client>=/g'
+#SUBST_SED.requires+= -e 's/google-apitools==/google-apitools>=/'
+
+DEPENDS+= ${PYPKGPREFIX}-argcomplete>=1.9.4:../../devel/py-argcomplete
DEPENDS+= ${PYPKGPREFIX}-boto-2.48.0*:../../net/py-boto
+DEPENDS+= ${PYPKGPREFIX}-crcmod-[0-9]*:../../security/py-crcmod
+DEPENDS+= ${PYPKGPREFIX}-fasteners-[0-9]*:../../devel/py-fasteners
+DEPENDS+= ${PYPKGPREFIX}-gcs-oauth2-boto-plugin>=2.1:../../net/py-gcs-oauth2-boto-plugin
+DEPENDS+= ${PYPKGPREFIX}-gflags>=3.1.2nb1:../../devel/py-gflags
+DEPENDS+= ${PYPKGPREFIX}-google-apitools>=0.5.22:../../www/py-google-apitools
+DEPENDS+= ${PYPKGPREFIX}-google-reauth-[0-9]*:../../security/py-google-reauth
+DEPENDS+= ${PYPKGPREFIX}-httplib2>=0.11.3:../../www/py-httplib2
+DEPENDS+= ${PYPKGPREFIX}-mock-[0-9]*:../../devel/py-mock
+DEPENDS+= ${PYPKGPREFIX}-monotonic-[0-9]*:../../time/py-monotonic
+DEPENDS+= ${PYPKGPREFIX}-oauth2client-[0-9]*:../../security/py-oauth2client
+DEPENDS+= ${PYPKGPREFIX}-OpenSSL-[0-9]*:../../security/py-OpenSSL
+DEPENDS+= ${PYPKGPREFIX}-retry_decorator>=1.1.0:../../devel/py-retry_decorator
+DEPENDS+= ${PYPKGPREFIX}-six>=1.9.0:../../lang/py-six
DEPENDS+= ${PYPKGPREFIX}-SocksiPy-branch-1.01*:../../net/py-socksipy-branch
-DEPENDS+= ${PYPKGPREFIX}-six>=1.9.0:../../lang/py-six
-DEPENDS+= ${PYPKGPREFIX}-retry_decorator>=1.1.0:../../devel/py-retry_decorator
-DEPENDS+= ${PYPKGPREFIX}-gflags>=2:../../devel/py-gflags
.include "../../lang/python/application.mk"
.include "../../lang/python/egg.mk"
diff -r 464321d95695 -r 81331f4987f8 net/py-gsutil/PLIST
--- a/net/py-gsutil/PLIST Sat Jun 16 14:45:32 2018 +0000
+++ b/net/py-gsutil/PLIST Sat Jun 16 14:50:25 2018 +0000
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.1 2018/01/08 19:01:20 bsiegert Exp $
+@comment $NetBSD: PLIST,v 1.2 2018/06/16 14:50:25 bsiegert Exp $
bin/gsutil
${PYSITELIB}/gslib/CHECKSUM
${PYSITELIB}/gslib/README
@@ -9,9 +9,6 @@
${PYSITELIB}/gslib/__main__.py
${PYSITELIB}/gslib/__main__.pyc
${PYSITELIB}/gslib/__main__.pyo
-${PYSITELIB}/gslib/aclhelpers.py
-${PYSITELIB}/gslib/aclhelpers.pyc
-${PYSITELIB}/gslib/aclhelpers.pyo
${PYSITELIB}/gslib/addlhelp/__init__.py
${PYSITELIB}/gslib/addlhelp/__init__.pyc
${PYSITELIB}/gslib/addlhelp/__init__.pyo
@@ -33,15 +30,15 @@
${PYSITELIB}/gslib/addlhelp/creds.py
${PYSITELIB}/gslib/addlhelp/creds.pyc
${PYSITELIB}/gslib/addlhelp/creds.pyo
-${PYSITELIB}/gslib/addlhelp/csek.py
-${PYSITELIB}/gslib/addlhelp/csek.pyc
-${PYSITELIB}/gslib/addlhelp/csek.pyo
${PYSITELIB}/gslib/addlhelp/dev.py
${PYSITELIB}/gslib/addlhelp/dev.pyc
${PYSITELIB}/gslib/addlhelp/dev.pyo
${PYSITELIB}/gslib/addlhelp/encoding.py
${PYSITELIB}/gslib/addlhelp/encoding.pyc
${PYSITELIB}/gslib/addlhelp/encoding.pyo
+${PYSITELIB}/gslib/addlhelp/encryption.py
+${PYSITELIB}/gslib/addlhelp/encryption.pyc
+${PYSITELIB}/gslib/addlhelp/encryption.pyo
${PYSITELIB}/gslib/addlhelp/metadata.py
${PYSITELIB}/gslib/addlhelp/metadata.pyc
${PYSITELIB}/gslib/addlhelp/metadata.pyo
@@ -84,18 +81,12 @@
${PYSITELIB}/gslib/bucket_listing_ref.py
${PYSITELIB}/gslib/bucket_listing_ref.pyc
${PYSITELIB}/gslib/bucket_listing_ref.pyo
-${PYSITELIB}/gslib/cat_helper.py
-${PYSITELIB}/gslib/cat_helper.pyc
-${PYSITELIB}/gslib/cat_helper.pyo
${PYSITELIB}/gslib/cloud_api.py
${PYSITELIB}/gslib/cloud_api.pyc
${PYSITELIB}/gslib/cloud_api.pyo
${PYSITELIB}/gslib/cloud_api_delegator.py
${PYSITELIB}/gslib/cloud_api_delegator.pyc
${PYSITELIB}/gslib/cloud_api_delegator.pyo
-${PYSITELIB}/gslib/cloud_api_helper.py
-${PYSITELIB}/gslib/cloud_api_helper.pyc
-${PYSITELIB}/gslib/cloud_api_helper.pyo
${PYSITELIB}/gslib/command.py
${PYSITELIB}/gslib/command.pyc
${PYSITELIB}/gslib/command.pyo
@@ -144,6 +135,9 @@
${PYSITELIB}/gslib/commands/iam.py
${PYSITELIB}/gslib/commands/iam.pyc
${PYSITELIB}/gslib/commands/iam.pyo
+${PYSITELIB}/gslib/commands/kms.py
+${PYSITELIB}/gslib/commands/kms.pyc
+${PYSITELIB}/gslib/commands/kms.pyo
${PYSITELIB}/gslib/commands/label.py
${PYSITELIB}/gslib/commands/label.pyc
${PYSITELIB}/gslib/commands/label.pyo
@@ -204,9 +198,6 @@
${PYSITELIB}/gslib/commands/web.py
${PYSITELIB}/gslib/commands/web.pyc
${PYSITELIB}/gslib/commands/web.pyo
-${PYSITELIB}/gslib/copy_helper.py
-${PYSITELIB}/gslib/copy_helper.pyc
-${PYSITELIB}/gslib/copy_helper.pyo
${PYSITELIB}/gslib/cred_types.py
${PYSITELIB}/gslib/cred_types.pyc
${PYSITELIB}/gslib/cred_types.pyo
@@ -220,9 +211,9 @@
${PYSITELIB}/gslib/devshell_auth_plugin.py
${PYSITELIB}/gslib/devshell_auth_plugin.pyc
${PYSITELIB}/gslib/devshell_auth_plugin.pyo
-${PYSITELIB}/gslib/encryption_helper.py
-${PYSITELIB}/gslib/encryption_helper.pyc
-${PYSITELIB}/gslib/encryption_helper.pyo
+${PYSITELIB}/gslib/discard_messages_queue.py
+${PYSITELIB}/gslib/discard_messages_queue.pyc
+${PYSITELIB}/gslib/discard_messages_queue.pyo
${PYSITELIB}/gslib/exception.py
${PYSITELIB}/gslib/exception.pyc
${PYSITELIB}/gslib/exception.pyo
@@ -238,18 +229,15 @@
${PYSITELIB}/gslib/gcs_json_media.py
${PYSITELIB}/gslib/gcs_json_media.pyc
${PYSITELIB}/gslib/gcs_json_media.pyo
-${PYSITELIB}/gslib/hashing_helper.py
-${PYSITELIB}/gslib/hashing_helper.pyc
-${PYSITELIB}/gslib/hashing_helper.pyo
${PYSITELIB}/gslib/help_provider.py
${PYSITELIB}/gslib/help_provider.pyc
${PYSITELIB}/gslib/help_provider.pyo
-${PYSITELIB}/gslib/iamhelpers.py
-${PYSITELIB}/gslib/iamhelpers.pyc
-${PYSITELIB}/gslib/iamhelpers.pyo
-${PYSITELIB}/gslib/ls_helper.py
-${PYSITELIB}/gslib/ls_helper.pyc
-${PYSITELIB}/gslib/ls_helper.pyo
+${PYSITELIB}/gslib/kms_api.py
+${PYSITELIB}/gslib/kms_api.pyc
+${PYSITELIB}/gslib/kms_api.pyo
+${PYSITELIB}/gslib/lazy_wrapper.py
+${PYSITELIB}/gslib/lazy_wrapper.pyc
+${PYSITELIB}/gslib/lazy_wrapper.pyo
${PYSITELIB}/gslib/metrics.py
${PYSITELIB}/gslib/metrics.pyc
${PYSITELIB}/gslib/metrics.pyo
@@ -271,15 +259,9 @@
${PYSITELIB}/gslib/parallel_tracker_file.py
${PYSITELIB}/gslib/parallel_tracker_file.pyc
${PYSITELIB}/gslib/parallel_tracker_file.pyo
-${PYSITELIB}/gslib/parallelism_framework_util.py
-${PYSITELIB}/gslib/parallelism_framework_util.pyc
-${PYSITELIB}/gslib/parallelism_framework_util.pyo
${PYSITELIB}/gslib/plurality_checkable_iterator.py
${PYSITELIB}/gslib/plurality_checkable_iterator.pyc
${PYSITELIB}/gslib/plurality_checkable_iterator.pyo
-${PYSITELIB}/gslib/posix_util.py
-${PYSITELIB}/gslib/posix_util.pyc
-${PYSITELIB}/gslib/posix_util.pyo
${PYSITELIB}/gslib/progress_callback.py
${PYSITELIB}/gslib/progress_callback.pyc
${PYSITELIB}/gslib/progress_callback.pyo
@@ -378,6 +360,9 @@
${PYSITELIB}/gslib/tests/test_file_part.py
${PYSITELIB}/gslib/tests/test_file_part.pyc
${PYSITELIB}/gslib/tests/test_file_part.pyo
+${PYSITELIB}/gslib/tests/test_gcs_json_media.py
+${PYSITELIB}/gslib/tests/test_gcs_json_media.pyc
+${PYSITELIB}/gslib/tests/test_gcs_json_media.pyo
${PYSITELIB}/gslib/tests/test_gsutil.py
${PYSITELIB}/gslib/tests/test_gsutil.pyc
${PYSITELIB}/gslib/tests/test_gsutil.pyo
@@ -393,6 +378,9 @@
${PYSITELIB}/gslib/tests/test_iam.py
${PYSITELIB}/gslib/tests/test_iam.pyc
${PYSITELIB}/gslib/tests/test_iam.pyo
+${PYSITELIB}/gslib/tests/test_kms.py
+${PYSITELIB}/gslib/tests/test_kms.pyc
+${PYSITELIB}/gslib/tests/test_kms.pyo
${PYSITELIB}/gslib/tests/test_label.py
${PYSITELIB}/gslib/tests/test_label.pyc
${PYSITELIB}/gslib/tests/test_label.pyo
@@ -516,6 +504,18 @@
${PYSITELIB}/gslib/third_party/__init__.py
${PYSITELIB}/gslib/third_party/__init__.pyc
${PYSITELIB}/gslib/third_party/__init__.pyo
+${PYSITELIB}/gslib/third_party/kms_apitools/__init__.py
+${PYSITELIB}/gslib/third_party/kms_apitools/__init__.pyc
+${PYSITELIB}/gslib/third_party/kms_apitools/__init__.pyo
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_client.py
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_client.pyc
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_client.pyo
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_messages.py
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_messages.pyc
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_messages.pyo
+${PYSITELIB}/gslib/third_party/kms_apitools/resources.py
+${PYSITELIB}/gslib/third_party/kms_apitools/resources.pyc
+${PYSITELIB}/gslib/third_party/kms_apitools/resources.pyo
${PYSITELIB}/gslib/third_party/pubsub_apitools/__init__.py
${PYSITELIB}/gslib/third_party/pubsub_apitools/__init__.pyc
${PYSITELIB}/gslib/third_party/pubsub_apitools/__init__.pyo
@@ -543,15 +543,75 @@
${PYSITELIB}/gslib/tracker_file.py
${PYSITELIB}/gslib/tracker_file.pyc
${PYSITELIB}/gslib/tracker_file.pyo
-${PYSITELIB}/gslib/translation_helper.py
-${PYSITELIB}/gslib/translation_helper.pyc
-${PYSITELIB}/gslib/translation_helper.pyo
+${PYSITELIB}/gslib/tz_utc.py
+${PYSITELIB}/gslib/tz_utc.pyc
+${PYSITELIB}/gslib/tz_utc.pyo
${PYSITELIB}/gslib/ui_controller.py
${PYSITELIB}/gslib/ui_controller.pyc
${PYSITELIB}/gslib/ui_controller.pyo
-${PYSITELIB}/gslib/util.py
-${PYSITELIB}/gslib/util.pyc
-${PYSITELIB}/gslib/util.pyo
+${PYSITELIB}/gslib/utils/__init__.py
+${PYSITELIB}/gslib/utils/__init__.pyc
+${PYSITELIB}/gslib/utils/__init__.pyo
+${PYSITELIB}/gslib/utils/acl_helper.py
+${PYSITELIB}/gslib/utils/acl_helper.pyc
+${PYSITELIB}/gslib/utils/acl_helper.pyo
+${PYSITELIB}/gslib/utils/boto_util.py
+${PYSITELIB}/gslib/utils/boto_util.pyc
+${PYSITELIB}/gslib/utils/boto_util.pyo
+${PYSITELIB}/gslib/utils/cat_helper.py
+${PYSITELIB}/gslib/utils/cat_helper.pyc
+${PYSITELIB}/gslib/utils/cat_helper.pyo
+${PYSITELIB}/gslib/utils/cloud_api_helper.py
+${PYSITELIB}/gslib/utils/cloud_api_helper.pyc
+${PYSITELIB}/gslib/utils/cloud_api_helper.pyo
+${PYSITELIB}/gslib/utils/constants.py
+${PYSITELIB}/gslib/utils/constants.pyc
+${PYSITELIB}/gslib/utils/constants.pyo
+${PYSITELIB}/gslib/utils/copy_helper.py
+${PYSITELIB}/gslib/utils/copy_helper.pyc
+${PYSITELIB}/gslib/utils/copy_helper.pyo
+${PYSITELIB}/gslib/utils/encryption_helper.py
+${PYSITELIB}/gslib/utils/encryption_helper.pyc
+${PYSITELIB}/gslib/utils/encryption_helper.pyo
+${PYSITELIB}/gslib/utils/hashing_helper.py
+${PYSITELIB}/gslib/utils/hashing_helper.pyc
+${PYSITELIB}/gslib/utils/hashing_helper.pyo
+${PYSITELIB}/gslib/utils/iam_helper.py
+${PYSITELIB}/gslib/utils/iam_helper.pyc
+${PYSITELIB}/gslib/utils/iam_helper.pyo
+${PYSITELIB}/gslib/utils/ls_helper.py
+${PYSITELIB}/gslib/utils/ls_helper.pyc
+${PYSITELIB}/gslib/utils/ls_helper.pyo
+${PYSITELIB}/gslib/utils/metadata_util.py
+${PYSITELIB}/gslib/utils/metadata_util.pyc
+${PYSITELIB}/gslib/utils/metadata_util.pyo
+${PYSITELIB}/gslib/utils/parallelism_framework_util.py
+${PYSITELIB}/gslib/utils/parallelism_framework_util.pyc
+${PYSITELIB}/gslib/utils/parallelism_framework_util.pyo
+${PYSITELIB}/gslib/utils/posix_util.py
+${PYSITELIB}/gslib/utils/posix_util.pyc
+${PYSITELIB}/gslib/utils/posix_util.pyo
+${PYSITELIB}/gslib/utils/retry_util.py
+${PYSITELIB}/gslib/utils/retry_util.pyc
+${PYSITELIB}/gslib/utils/retry_util.pyo
+${PYSITELIB}/gslib/utils/rsync_util.py
+${PYSITELIB}/gslib/utils/rsync_util.pyc
+${PYSITELIB}/gslib/utils/rsync_util.pyo
+${PYSITELIB}/gslib/utils/system_util.py
+${PYSITELIB}/gslib/utils/system_util.pyc
+${PYSITELIB}/gslib/utils/system_util.pyo
+${PYSITELIB}/gslib/utils/text_util.py
+${PYSITELIB}/gslib/utils/text_util.pyc
+${PYSITELIB}/gslib/utils/text_util.pyo
+${PYSITELIB}/gslib/utils/translation_helper.py
+${PYSITELIB}/gslib/utils/translation_helper.pyc
+${PYSITELIB}/gslib/utils/translation_helper.pyo
+${PYSITELIB}/gslib/utils/unit_util.py
+${PYSITELIB}/gslib/utils/unit_util.pyc
+${PYSITELIB}/gslib/utils/unit_util.pyo
+${PYSITELIB}/gslib/utils/update_util.py
+${PYSITELIB}/gslib/utils/update_util.pyc
+${PYSITELIB}/gslib/utils/update_util.pyo
${PYSITELIB}/gslib/wildcard_iterator.py
${PYSITELIB}/gslib/wildcard_iterator.pyc
${PYSITELIB}/gslib/wildcard_iterator.pyo
diff -r 464321d95695 -r 81331f4987f8 net/py-gsutil/distinfo
--- a/net/py-gsutil/distinfo Sat Jun 16 14:45:32 2018 +0000
Home |
Main Index |
Thread Index |
Old Index