pkgsrc-Changes-HG archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

[pkgsrc/trunk]: pkgsrc/net/py-gsutil Update py-gsutil to 4.31.



details:   https://anonhg.NetBSD.org/pkgsrc/rev/81331f4987f8
branches:  trunk
changeset: 381762:81331f4987f8
user:      bsiegert <bsiegert%pkgsrc.org@localhost>
date:      Sat Jun 16 14:50:25 2018 +0000

description:
Update py-gsutil to 4.31.

Fix all dependencies. This time, there is an actual working gsutil binary.
Thus, fix PR pkg/52941.

Release 4.31 (release date: 2018-04-26)
=======================================
New features
------------------
- Added support for reauthentication within gsutil. Note that this only affects
  authentication when "gs_oauth2_refresh_token" is configured under the
  "Credentials" section of the boto config file and that token corresponds to a
  user account enrolled in 2-step verification.

Bug Fixes
------------------
- When creating a signed URL via the "signurl" command, gsutil now verifies that
  the specified expiration isn't longer than 7 days (the maximum allowed by the
  service).
- To support rewriting objects to be encrypted using a bucket's default KMS key,
  the "rewrite" command now rewrites all specified objects if no value is
  specified for "encryption_key" under the "GSUtil" section in the boto config
  file.

Other Changes
------------------
- Several documentation updates and clarifications.


Release 4.30 (release date: 2018-03-28)
=======================================
New features
------------------
- Added Cloud KMS support for Google Cloud Storage resources, allowing the use
  of customer-managed encryption keys (CMEKs). Bucket-related functionality
  includes the new "kms" command, which can be used to get or set a bucket's
  default KMS key. Concerning objects, users may now specify the CMEK to be used
  for encryption via their boto config file, in the "encryption_key" attribute.
  In this way, users may specify either a CSEK or a CMEK to encrypt new objects,
  but not both. For more information, see "gsutil help encryption".

Other Changes
------------------
- Several documentation updates and clarifications.


Release 4.29 (release date: 2018-03-14)
=======================================
New features
------------------
- Added transport compression support, available through the "-j" and "-J"
  options for the "cp", "mv", and "rsync" commands. This is useful when
  uploading files with highly-compressible content. When specificed, files being
  uploaded are compressed on-the-fly in memory, sent to GCS, and uncompressed by
  GCS before they are stored. See "gsutil help cp" for additional information.
- When "use_magicfile=True" is set in the boto config file, gsutil will now
  append the detected charset, if present, to the object's Content-Type metadata
  field. For example, a Content-Type might be populated with
  "text/html; charset=us-ascii" rather than simply "text/html".

Bug Fixes
------------------
- Improved error handling and logging for upload resumption.
- After encountering a PreconditionException, the "acl ch" command will now
  re-fetch the object generation before retrying.
- Fixed issue with parsing lifecycle conditions when using the XML API.
  Conditions whose values could be evaluated by Python as "falsy" (e.g. setting
  an "age" condition to the number 0 or "isLive" to false) would be omitted from
  the lifecycle configuration when "prefer_api=xml" was set in the boto config
  file. Note that the JSON API is preferred by default, so most users were
  unlikely to encounter this issue.
- For commands that fetch bucket ACLs or default ACLs, when the user does not
  have storage.buckets.getIamPolicy on the GCS bucket, using the XML API will
  now behave consistently with the JSON API and display ACL/default ACL fields
  as empty, rather than throwing a CommandException.

Other Changes
------------------
- Several documentation updates and clarifications.
- The "signurl" command now uses signature V4 signing format to generate URLs.

diffstat:

 net/py-gsutil/Makefile |   29 +++++++--
 net/py-gsutil/PLIST    |  140 +++++++++++++++++++++++++++++++++++--------------
 net/py-gsutil/distinfo |   10 +-
 3 files changed, 127 insertions(+), 52 deletions(-)

diffs (truncated from 313 to 300 lines):

diff -r 464321d95695 -r 81331f4987f8 net/py-gsutil/Makefile
--- a/net/py-gsutil/Makefile    Sat Jun 16 14:45:32 2018 +0000
+++ b/net/py-gsutil/Makefile    Sat Jun 16 14:50:25 2018 +0000
@@ -1,7 +1,6 @@
-# $NetBSD: Makefile,v 1.2 2018/03/04 12:11:21 bsiegert Exp $
+# $NetBSD: Makefile,v 1.3 2018/06/16 14:50:25 bsiegert Exp $
 
-DISTNAME=      gsutil-4.28
-PKGREVISION=   1
+DISTNAME=      gsutil-4.31
 PKGNAME=       ${PYPKGPREFIX}-${DISTNAME}
 CATEGORIES=    net
 MASTER_SITES=  ${MASTER_SITE_PYPI:=g/gsutil/}
@@ -14,12 +13,28 @@
 PYTHON_VERSIONS_ACCEPTED=      27
 REPLACE_PYTHON=                        test/gsutil_measure_imports
 
-DEPENDS+=      ${PYPKGPREFIX}-argcomplete>=1.8:../../devel/py-argcomplete
+#SUBST_CLASSES+=               requires
+#SUBST_STAGE.requires= pre-configure
+#SUBST_FILES.requires= setup.py gsutil.egg-info/requires.txt
+#SUBST_SED.requires=   -e 's/oauth2client==/oauth2client>=/g'
+#SUBST_SED.requires+=  -e 's/google-apitools==/google-apitools>=/'
+
+DEPENDS+=      ${PYPKGPREFIX}-argcomplete>=1.9.4:../../devel/py-argcomplete
 DEPENDS+=      ${PYPKGPREFIX}-boto-2.48.0*:../../net/py-boto
+DEPENDS+=      ${PYPKGPREFIX}-crcmod-[0-9]*:../../security/py-crcmod
+DEPENDS+=      ${PYPKGPREFIX}-fasteners-[0-9]*:../../devel/py-fasteners
+DEPENDS+=      ${PYPKGPREFIX}-gcs-oauth2-boto-plugin>=2.1:../../net/py-gcs-oauth2-boto-plugin
+DEPENDS+=      ${PYPKGPREFIX}-gflags>=3.1.2nb1:../../devel/py-gflags
+DEPENDS+=      ${PYPKGPREFIX}-google-apitools>=0.5.22:../../www/py-google-apitools
+DEPENDS+=      ${PYPKGPREFIX}-google-reauth-[0-9]*:../../security/py-google-reauth
+DEPENDS+=      ${PYPKGPREFIX}-httplib2>=0.11.3:../../www/py-httplib2
+DEPENDS+=      ${PYPKGPREFIX}-mock-[0-9]*:../../devel/py-mock
+DEPENDS+=      ${PYPKGPREFIX}-monotonic-[0-9]*:../../time/py-monotonic
+DEPENDS+=      ${PYPKGPREFIX}-oauth2client-[0-9]*:../../security/py-oauth2client
+DEPENDS+=      ${PYPKGPREFIX}-OpenSSL-[0-9]*:../../security/py-OpenSSL
+DEPENDS+=      ${PYPKGPREFIX}-retry_decorator>=1.1.0:../../devel/py-retry_decorator
+DEPENDS+=      ${PYPKGPREFIX}-six>=1.9.0:../../lang/py-six
 DEPENDS+=      ${PYPKGPREFIX}-SocksiPy-branch-1.01*:../../net/py-socksipy-branch
-DEPENDS+=      ${PYPKGPREFIX}-six>=1.9.0:../../lang/py-six
-DEPENDS+=      ${PYPKGPREFIX}-retry_decorator>=1.1.0:../../devel/py-retry_decorator
-DEPENDS+=      ${PYPKGPREFIX}-gflags>=2:../../devel/py-gflags
 
 .include "../../lang/python/application.mk"
 .include "../../lang/python/egg.mk"
diff -r 464321d95695 -r 81331f4987f8 net/py-gsutil/PLIST
--- a/net/py-gsutil/PLIST       Sat Jun 16 14:45:32 2018 +0000
+++ b/net/py-gsutil/PLIST       Sat Jun 16 14:50:25 2018 +0000
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.1 2018/01/08 19:01:20 bsiegert Exp $
+@comment $NetBSD: PLIST,v 1.2 2018/06/16 14:50:25 bsiegert Exp $
 bin/gsutil
 ${PYSITELIB}/gslib/CHECKSUM
 ${PYSITELIB}/gslib/README
@@ -9,9 +9,6 @@
 ${PYSITELIB}/gslib/__main__.py
 ${PYSITELIB}/gslib/__main__.pyc
 ${PYSITELIB}/gslib/__main__.pyo
-${PYSITELIB}/gslib/aclhelpers.py
-${PYSITELIB}/gslib/aclhelpers.pyc
-${PYSITELIB}/gslib/aclhelpers.pyo
 ${PYSITELIB}/gslib/addlhelp/__init__.py
 ${PYSITELIB}/gslib/addlhelp/__init__.pyc
 ${PYSITELIB}/gslib/addlhelp/__init__.pyo
@@ -33,15 +30,15 @@
 ${PYSITELIB}/gslib/addlhelp/creds.py
 ${PYSITELIB}/gslib/addlhelp/creds.pyc
 ${PYSITELIB}/gslib/addlhelp/creds.pyo
-${PYSITELIB}/gslib/addlhelp/csek.py
-${PYSITELIB}/gslib/addlhelp/csek.pyc
-${PYSITELIB}/gslib/addlhelp/csek.pyo
 ${PYSITELIB}/gslib/addlhelp/dev.py
 ${PYSITELIB}/gslib/addlhelp/dev.pyc
 ${PYSITELIB}/gslib/addlhelp/dev.pyo
 ${PYSITELIB}/gslib/addlhelp/encoding.py
 ${PYSITELIB}/gslib/addlhelp/encoding.pyc
 ${PYSITELIB}/gslib/addlhelp/encoding.pyo
+${PYSITELIB}/gslib/addlhelp/encryption.py
+${PYSITELIB}/gslib/addlhelp/encryption.pyc
+${PYSITELIB}/gslib/addlhelp/encryption.pyo
 ${PYSITELIB}/gslib/addlhelp/metadata.py
 ${PYSITELIB}/gslib/addlhelp/metadata.pyc
 ${PYSITELIB}/gslib/addlhelp/metadata.pyo
@@ -84,18 +81,12 @@
 ${PYSITELIB}/gslib/bucket_listing_ref.py
 ${PYSITELIB}/gslib/bucket_listing_ref.pyc
 ${PYSITELIB}/gslib/bucket_listing_ref.pyo
-${PYSITELIB}/gslib/cat_helper.py
-${PYSITELIB}/gslib/cat_helper.pyc
-${PYSITELIB}/gslib/cat_helper.pyo
 ${PYSITELIB}/gslib/cloud_api.py
 ${PYSITELIB}/gslib/cloud_api.pyc
 ${PYSITELIB}/gslib/cloud_api.pyo
 ${PYSITELIB}/gslib/cloud_api_delegator.py
 ${PYSITELIB}/gslib/cloud_api_delegator.pyc
 ${PYSITELIB}/gslib/cloud_api_delegator.pyo
-${PYSITELIB}/gslib/cloud_api_helper.py
-${PYSITELIB}/gslib/cloud_api_helper.pyc
-${PYSITELIB}/gslib/cloud_api_helper.pyo
 ${PYSITELIB}/gslib/command.py
 ${PYSITELIB}/gslib/command.pyc
 ${PYSITELIB}/gslib/command.pyo
@@ -144,6 +135,9 @@
 ${PYSITELIB}/gslib/commands/iam.py
 ${PYSITELIB}/gslib/commands/iam.pyc
 ${PYSITELIB}/gslib/commands/iam.pyo
+${PYSITELIB}/gslib/commands/kms.py
+${PYSITELIB}/gslib/commands/kms.pyc
+${PYSITELIB}/gslib/commands/kms.pyo
 ${PYSITELIB}/gslib/commands/label.py
 ${PYSITELIB}/gslib/commands/label.pyc
 ${PYSITELIB}/gslib/commands/label.pyo
@@ -204,9 +198,6 @@
 ${PYSITELIB}/gslib/commands/web.py
 ${PYSITELIB}/gslib/commands/web.pyc
 ${PYSITELIB}/gslib/commands/web.pyo
-${PYSITELIB}/gslib/copy_helper.py
-${PYSITELIB}/gslib/copy_helper.pyc
-${PYSITELIB}/gslib/copy_helper.pyo
 ${PYSITELIB}/gslib/cred_types.py
 ${PYSITELIB}/gslib/cred_types.pyc
 ${PYSITELIB}/gslib/cred_types.pyo
@@ -220,9 +211,9 @@
 ${PYSITELIB}/gslib/devshell_auth_plugin.py
 ${PYSITELIB}/gslib/devshell_auth_plugin.pyc
 ${PYSITELIB}/gslib/devshell_auth_plugin.pyo
-${PYSITELIB}/gslib/encryption_helper.py
-${PYSITELIB}/gslib/encryption_helper.pyc
-${PYSITELIB}/gslib/encryption_helper.pyo
+${PYSITELIB}/gslib/discard_messages_queue.py
+${PYSITELIB}/gslib/discard_messages_queue.pyc
+${PYSITELIB}/gslib/discard_messages_queue.pyo
 ${PYSITELIB}/gslib/exception.py
 ${PYSITELIB}/gslib/exception.pyc
 ${PYSITELIB}/gslib/exception.pyo
@@ -238,18 +229,15 @@
 ${PYSITELIB}/gslib/gcs_json_media.py
 ${PYSITELIB}/gslib/gcs_json_media.pyc
 ${PYSITELIB}/gslib/gcs_json_media.pyo
-${PYSITELIB}/gslib/hashing_helper.py
-${PYSITELIB}/gslib/hashing_helper.pyc
-${PYSITELIB}/gslib/hashing_helper.pyo
 ${PYSITELIB}/gslib/help_provider.py
 ${PYSITELIB}/gslib/help_provider.pyc
 ${PYSITELIB}/gslib/help_provider.pyo
-${PYSITELIB}/gslib/iamhelpers.py
-${PYSITELIB}/gslib/iamhelpers.pyc
-${PYSITELIB}/gslib/iamhelpers.pyo
-${PYSITELIB}/gslib/ls_helper.py
-${PYSITELIB}/gslib/ls_helper.pyc
-${PYSITELIB}/gslib/ls_helper.pyo
+${PYSITELIB}/gslib/kms_api.py
+${PYSITELIB}/gslib/kms_api.pyc
+${PYSITELIB}/gslib/kms_api.pyo
+${PYSITELIB}/gslib/lazy_wrapper.py
+${PYSITELIB}/gslib/lazy_wrapper.pyc
+${PYSITELIB}/gslib/lazy_wrapper.pyo
 ${PYSITELIB}/gslib/metrics.py
 ${PYSITELIB}/gslib/metrics.pyc
 ${PYSITELIB}/gslib/metrics.pyo
@@ -271,15 +259,9 @@
 ${PYSITELIB}/gslib/parallel_tracker_file.py
 ${PYSITELIB}/gslib/parallel_tracker_file.pyc
 ${PYSITELIB}/gslib/parallel_tracker_file.pyo
-${PYSITELIB}/gslib/parallelism_framework_util.py
-${PYSITELIB}/gslib/parallelism_framework_util.pyc
-${PYSITELIB}/gslib/parallelism_framework_util.pyo
 ${PYSITELIB}/gslib/plurality_checkable_iterator.py
 ${PYSITELIB}/gslib/plurality_checkable_iterator.pyc
 ${PYSITELIB}/gslib/plurality_checkable_iterator.pyo
-${PYSITELIB}/gslib/posix_util.py
-${PYSITELIB}/gslib/posix_util.pyc
-${PYSITELIB}/gslib/posix_util.pyo
 ${PYSITELIB}/gslib/progress_callback.py
 ${PYSITELIB}/gslib/progress_callback.pyc
 ${PYSITELIB}/gslib/progress_callback.pyo
@@ -378,6 +360,9 @@
 ${PYSITELIB}/gslib/tests/test_file_part.py
 ${PYSITELIB}/gslib/tests/test_file_part.pyc
 ${PYSITELIB}/gslib/tests/test_file_part.pyo
+${PYSITELIB}/gslib/tests/test_gcs_json_media.py
+${PYSITELIB}/gslib/tests/test_gcs_json_media.pyc
+${PYSITELIB}/gslib/tests/test_gcs_json_media.pyo
 ${PYSITELIB}/gslib/tests/test_gsutil.py
 ${PYSITELIB}/gslib/tests/test_gsutil.pyc
 ${PYSITELIB}/gslib/tests/test_gsutil.pyo
@@ -393,6 +378,9 @@
 ${PYSITELIB}/gslib/tests/test_iam.py
 ${PYSITELIB}/gslib/tests/test_iam.pyc
 ${PYSITELIB}/gslib/tests/test_iam.pyo
+${PYSITELIB}/gslib/tests/test_kms.py
+${PYSITELIB}/gslib/tests/test_kms.pyc
+${PYSITELIB}/gslib/tests/test_kms.pyo
 ${PYSITELIB}/gslib/tests/test_label.py
 ${PYSITELIB}/gslib/tests/test_label.pyc
 ${PYSITELIB}/gslib/tests/test_label.pyo
@@ -516,6 +504,18 @@
 ${PYSITELIB}/gslib/third_party/__init__.py
 ${PYSITELIB}/gslib/third_party/__init__.pyc
 ${PYSITELIB}/gslib/third_party/__init__.pyo
+${PYSITELIB}/gslib/third_party/kms_apitools/__init__.py
+${PYSITELIB}/gslib/third_party/kms_apitools/__init__.pyc
+${PYSITELIB}/gslib/third_party/kms_apitools/__init__.pyo
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_client.py
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_client.pyc
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_client.pyo
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_messages.py
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_messages.pyc
+${PYSITELIB}/gslib/third_party/kms_apitools/cloudkms_v1_messages.pyo
+${PYSITELIB}/gslib/third_party/kms_apitools/resources.py
+${PYSITELIB}/gslib/third_party/kms_apitools/resources.pyc
+${PYSITELIB}/gslib/third_party/kms_apitools/resources.pyo
 ${PYSITELIB}/gslib/third_party/pubsub_apitools/__init__.py
 ${PYSITELIB}/gslib/third_party/pubsub_apitools/__init__.pyc
 ${PYSITELIB}/gslib/third_party/pubsub_apitools/__init__.pyo
@@ -543,15 +543,75 @@
 ${PYSITELIB}/gslib/tracker_file.py
 ${PYSITELIB}/gslib/tracker_file.pyc
 ${PYSITELIB}/gslib/tracker_file.pyo
-${PYSITELIB}/gslib/translation_helper.py
-${PYSITELIB}/gslib/translation_helper.pyc
-${PYSITELIB}/gslib/translation_helper.pyo
+${PYSITELIB}/gslib/tz_utc.py
+${PYSITELIB}/gslib/tz_utc.pyc
+${PYSITELIB}/gslib/tz_utc.pyo
 ${PYSITELIB}/gslib/ui_controller.py
 ${PYSITELIB}/gslib/ui_controller.pyc
 ${PYSITELIB}/gslib/ui_controller.pyo
-${PYSITELIB}/gslib/util.py
-${PYSITELIB}/gslib/util.pyc
-${PYSITELIB}/gslib/util.pyo
+${PYSITELIB}/gslib/utils/__init__.py
+${PYSITELIB}/gslib/utils/__init__.pyc
+${PYSITELIB}/gslib/utils/__init__.pyo
+${PYSITELIB}/gslib/utils/acl_helper.py
+${PYSITELIB}/gslib/utils/acl_helper.pyc
+${PYSITELIB}/gslib/utils/acl_helper.pyo
+${PYSITELIB}/gslib/utils/boto_util.py
+${PYSITELIB}/gslib/utils/boto_util.pyc
+${PYSITELIB}/gslib/utils/boto_util.pyo
+${PYSITELIB}/gslib/utils/cat_helper.py
+${PYSITELIB}/gslib/utils/cat_helper.pyc
+${PYSITELIB}/gslib/utils/cat_helper.pyo
+${PYSITELIB}/gslib/utils/cloud_api_helper.py
+${PYSITELIB}/gslib/utils/cloud_api_helper.pyc
+${PYSITELIB}/gslib/utils/cloud_api_helper.pyo
+${PYSITELIB}/gslib/utils/constants.py
+${PYSITELIB}/gslib/utils/constants.pyc
+${PYSITELIB}/gslib/utils/constants.pyo
+${PYSITELIB}/gslib/utils/copy_helper.py
+${PYSITELIB}/gslib/utils/copy_helper.pyc
+${PYSITELIB}/gslib/utils/copy_helper.pyo
+${PYSITELIB}/gslib/utils/encryption_helper.py
+${PYSITELIB}/gslib/utils/encryption_helper.pyc
+${PYSITELIB}/gslib/utils/encryption_helper.pyo
+${PYSITELIB}/gslib/utils/hashing_helper.py
+${PYSITELIB}/gslib/utils/hashing_helper.pyc
+${PYSITELIB}/gslib/utils/hashing_helper.pyo
+${PYSITELIB}/gslib/utils/iam_helper.py
+${PYSITELIB}/gslib/utils/iam_helper.pyc
+${PYSITELIB}/gslib/utils/iam_helper.pyo
+${PYSITELIB}/gslib/utils/ls_helper.py
+${PYSITELIB}/gslib/utils/ls_helper.pyc
+${PYSITELIB}/gslib/utils/ls_helper.pyo
+${PYSITELIB}/gslib/utils/metadata_util.py
+${PYSITELIB}/gslib/utils/metadata_util.pyc
+${PYSITELIB}/gslib/utils/metadata_util.pyo
+${PYSITELIB}/gslib/utils/parallelism_framework_util.py
+${PYSITELIB}/gslib/utils/parallelism_framework_util.pyc
+${PYSITELIB}/gslib/utils/parallelism_framework_util.pyo
+${PYSITELIB}/gslib/utils/posix_util.py
+${PYSITELIB}/gslib/utils/posix_util.pyc
+${PYSITELIB}/gslib/utils/posix_util.pyo
+${PYSITELIB}/gslib/utils/retry_util.py
+${PYSITELIB}/gslib/utils/retry_util.pyc
+${PYSITELIB}/gslib/utils/retry_util.pyo
+${PYSITELIB}/gslib/utils/rsync_util.py
+${PYSITELIB}/gslib/utils/rsync_util.pyc
+${PYSITELIB}/gslib/utils/rsync_util.pyo
+${PYSITELIB}/gslib/utils/system_util.py
+${PYSITELIB}/gslib/utils/system_util.pyc
+${PYSITELIB}/gslib/utils/system_util.pyo
+${PYSITELIB}/gslib/utils/text_util.py
+${PYSITELIB}/gslib/utils/text_util.pyc
+${PYSITELIB}/gslib/utils/text_util.pyo
+${PYSITELIB}/gslib/utils/translation_helper.py
+${PYSITELIB}/gslib/utils/translation_helper.pyc
+${PYSITELIB}/gslib/utils/translation_helper.pyo
+${PYSITELIB}/gslib/utils/unit_util.py
+${PYSITELIB}/gslib/utils/unit_util.pyc
+${PYSITELIB}/gslib/utils/unit_util.pyo
+${PYSITELIB}/gslib/utils/update_util.py
+${PYSITELIB}/gslib/utils/update_util.pyc
+${PYSITELIB}/gslib/utils/update_util.pyo
 ${PYSITELIB}/gslib/wildcard_iterator.py
 ${PYSITELIB}/gslib/wildcard_iterator.pyc
 ${PYSITELIB}/gslib/wildcard_iterator.pyo
diff -r 464321d95695 -r 81331f4987f8 net/py-gsutil/distinfo
--- a/net/py-gsutil/distinfo    Sat Jun 16 14:45:32 2018 +0000



Home | Main Index | Thread Index | Old Index