pkgsrc-Changes archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

CVS commit: pkgsrc/www/py-scrapy



Module Name:    pkgsrc
Committed By:   adam
Date:           Sat May 20 06:25:36 UTC 2017

Modified Files:
        pkgsrc/www/py-scrapy: Makefile PLIST distinfo
Added Files:
        pkgsrc/www/py-scrapy: ALTERNATIVES

Log Message:
Scrapy 1.4 does not bring that many breathtaking new features
but quite a few handy improvements nonetheless.

Scrapy now supports anonymous FTP sessions with customizable user and
password via the new :setting:`FTP_USER` and :setting:`FTP_PASSWORD` settings.
And if you're using Twisted version 17.1.0 or above, FTP is now available
with Python 3.

There's a new :meth:`response.follow <scrapy.http.TextResponse.follow>` method
for creating requests; **it is now a recommended way to create Requests
in Scrapy spiders**. This method makes it easier to write correct
spiders; ``response.follow`` has several advantages over creating
``scrapy.Request`` objects directly:

* it handles relative URLs;
* it works properly with non-ascii URLs on non-UTF8 pages;
* in addition to absolute and relative URLs it supports Selectors;
  for ``<a>`` elements it can also extract their href values.


To generate a diff of this commit:
cvs rdiff -u -r0 -r1.1 pkgsrc/www/py-scrapy/ALTERNATIVES
cvs rdiff -u -r1.2 -r1.3 pkgsrc/www/py-scrapy/Makefile \
    pkgsrc/www/py-scrapy/distinfo
cvs rdiff -u -r1.1 -r1.2 pkgsrc/www/py-scrapy/PLIST

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: pkgsrc/www/py-scrapy/Makefile
diff -u pkgsrc/www/py-scrapy/Makefile:1.2 pkgsrc/www/py-scrapy/Makefile:1.3
--- pkgsrc/www/py-scrapy/Makefile:1.2   Sun Mar 19 22:59:10 2017
+++ pkgsrc/www/py-scrapy/Makefile       Sat May 20 06:25:36 2017
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.2 2017/03/19 22:59:10 adam Exp $
+# $NetBSD: Makefile,v 1.3 2017/05/20 06:25:36 adam Exp $
 
-DISTNAME=      Scrapy-1.3.3
+DISTNAME=      Scrapy-1.4.0
 PKGNAME=       ${PYPKGPREFIX}-${DISTNAME:tl}
 CATEGORIES=    www python
 MASTER_SITES=  ${MASTER_SITE_PYPI:=S/Scrapy/}
@@ -15,5 +15,9 @@ DEPENDS+=     ${PYPKGPREFIX}-parsel>=1.1.0:.
 DEPENDS+=      ${PYPKGPREFIX}-pydispatcher>=2.0.5:../../devel/py-pydispatcher
 DEPENDS+=      ${PYPKGPREFIX}-twisted>=13.1.0:../../net/py-twisted
 
+post-install:
+       ${MV} ${DESTDIR}${PREFIX}/bin/scrapy \
+               ${DESTDIR}${PREFIX}/bin/scrapy${PYVERSSUFFIX} || ${TRUE}
+
 .include "../../lang/python/egg.mk"
 .include "../../mk/bsd.pkg.mk"
Index: pkgsrc/www/py-scrapy/distinfo
diff -u pkgsrc/www/py-scrapy/distinfo:1.2 pkgsrc/www/py-scrapy/distinfo:1.3
--- pkgsrc/www/py-scrapy/distinfo:1.2   Sun Mar 19 22:59:11 2017
+++ pkgsrc/www/py-scrapy/distinfo       Sat May 20 06:25:36 2017
@@ -1,6 +1,6 @@
-$NetBSD: distinfo,v 1.2 2017/03/19 22:59:11 adam Exp $
+$NetBSD: distinfo,v 1.3 2017/05/20 06:25:36 adam Exp $
 
-SHA1 (Scrapy-1.3.3.tar.gz) = 603b258932b868ad6315e374b7b3de8c45564264
-RMD160 (Scrapy-1.3.3.tar.gz) = a23e026285640af4cf1ec29590040a67ef57326d
-SHA512 (Scrapy-1.3.3.tar.gz) = 795ac4a421be6e903e14cb9d9b242f4e6a130e3f51d43bf2a0904de0e4cadb4f54837badb63a65331ab67c4f8d6111f6fc85e6cb79acca5544db128b55ba3867
-Size (Scrapy-1.3.3.tar.gz) = 848990 bytes
+SHA1 (Scrapy-1.4.0.tar.gz) = 24222debf2e6b9220a91a56c476c208ac5ecb8e5
+RMD160 (Scrapy-1.4.0.tar.gz) = ef20b9288851962fb552c1045e297c8917a74d17
+SHA512 (Scrapy-1.4.0.tar.gz) = eedcd7003c51f45a580f160b4e5f428c01713e4ecb5b64e35570bc750fc03bef7cc991e318ef4ff9c96e12a2d21cc32d0f07ce278486ea2e65f08e53c3e4a8f1
+Size (Scrapy-1.4.0.tar.gz) = 898159 bytes

Index: pkgsrc/www/py-scrapy/PLIST
diff -u pkgsrc/www/py-scrapy/PLIST:1.1 pkgsrc/www/py-scrapy/PLIST:1.2
--- pkgsrc/www/py-scrapy/PLIST:1.1      Mon Feb 13 21:25:33 2017
+++ pkgsrc/www/py-scrapy/PLIST  Sat May 20 06:25:36 2017
@@ -1,5 +1,5 @@
-@comment $NetBSD: PLIST,v 1.1 2017/02/13 21:25:33 adam Exp $
-bin/scrapy
+@comment $NetBSD: PLIST,v 1.2 2017/05/20 06:25:36 adam Exp $
+bin/scrapy${PYVERSSUFFIX}
 ${PYSITELIB}/${EGG_INFODIR}/PKG-INFO
 ${PYSITELIB}/${EGG_INFODIR}/SOURCES.txt
 ${PYSITELIB}/${EGG_INFODIR}/dependency_links.txt
@@ -11,6 +11,9 @@ ${PYSITELIB}/scrapy/VERSION
 ${PYSITELIB}/scrapy/__init__.py
 ${PYSITELIB}/scrapy/__init__.pyc
 ${PYSITELIB}/scrapy/__init__.pyo
+${PYSITELIB}/scrapy/__main__.py
+${PYSITELIB}/scrapy/__main__.pyc
+${PYSITELIB}/scrapy/__main__.pyo
 ${PYSITELIB}/scrapy/_monkeypatches.py
 ${PYSITELIB}/scrapy/_monkeypatches.pyc
 ${PYSITELIB}/scrapy/_monkeypatches.pyo
@@ -254,6 +257,9 @@ ${PYSITELIB}/scrapy/core/downloader/cont
 ${PYSITELIB}/scrapy/core/downloader/handlers/__init__.py
 ${PYSITELIB}/scrapy/core/downloader/handlers/__init__.pyc
 ${PYSITELIB}/scrapy/core/downloader/handlers/__init__.pyo
+${PYSITELIB}/scrapy/core/downloader/handlers/datauri.py
+${PYSITELIB}/scrapy/core/downloader/handlers/datauri.pyc
+${PYSITELIB}/scrapy/core/downloader/handlers/datauri.pyo
 ${PYSITELIB}/scrapy/core/downloader/handlers/file.py
 ${PYSITELIB}/scrapy/core/downloader/handlers/file.pyc
 ${PYSITELIB}/scrapy/core/downloader/handlers/file.pyo

Added files:

Index: pkgsrc/www/py-scrapy/ALTERNATIVES
diff -u /dev/null pkgsrc/www/py-scrapy/ALTERNATIVES:1.1
--- /dev/null   Sat May 20 06:25:36 2017
+++ pkgsrc/www/py-scrapy/ALTERNATIVES   Sat May 20 06:25:36 2017
@@ -0,0 +1 @@
+bin/scrapy @PREFIX@/bin/scrapy@PYVERSSUFFIX@



Home | Main Index | Thread Index | Old Index