pkgsrc-Changes-HG archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

[pkgsrc/trunk]: pkgsrc/textproc/py-Unidecode Initial import of py-Unidecode-0...



details:   https://anonhg.NetBSD.org/pkgsrc/rev/9ac9b5b06f9b
branches:  trunk
changeset: 604409:9ac9b5b06f9b
user:      wiz <wiz%pkgsrc.org@localhost>
date:      Wed May 30 11:03:50 2012 +0000

description:
Initial import of py-Unidecode-0.04.9:

It often happens that you have text data in Unicode, but you need
to represent it in ASCII. For example when integrating with legacy
code that doesn't support Unicode, or for ease of entry of non-Roman
names on a US keyboard, or when constructing ASCII machine identifiers
from human-readable Unicode strings that should still be somewhat
intelligeble (a popular example of this is when making an URL slug
from an article title).

Note that this module generally produces better results than simply
stripping accents from characters (which can be done in Python with
built-in functions). It is based on hand-tuned character mappings
that for example also contain ASCII approximations for symbols and
non-Latin alphabets.

This is a Python port of Text::Unidecode Perl module by Sean M.
Burke.

diffstat:

 textproc/py-Unidecode/DESCR    |   16 +
 textproc/py-Unidecode/Makefile |   19 +
 textproc/py-Unidecode/PLIST    |  563 +++++++++++++++++++++++++++++++++++++++++
 textproc/py-Unidecode/distinfo |    5 +
 4 files changed, 603 insertions(+), 0 deletions(-)

diffs (truncated from 619 to 300 lines):

diff -r d01125e9fc8f -r 9ac9b5b06f9b textproc/py-Unidecode/DESCR
--- /dev/null   Thu Jan 01 00:00:00 1970 +0000
+++ b/textproc/py-Unidecode/DESCR       Wed May 30 11:03:50 2012 +0000
@@ -0,0 +1,16 @@
+It often happens that you have text data in Unicode, but you need
+to represent it in ASCII. For example when integrating with legacy
+code that doesn't support Unicode, or for ease of entry of non-Roman
+names on a US keyboard, or when constructing ASCII machine identifiers
+from human-readable Unicode strings that should still be somewhat
+intelligeble (a popular example of this is when making an URL slug
+from an article title).
+
+Note that this module generally produces better results than simply
+stripping accents from characters (which can be done in Python with
+built-in functions). It is based on hand-tuned character mappings
+that for example also contain ASCII approximations for symbols and
+non-Latin alphabets.
+
+This is a Python port of Text::Unidecode Perl module by Sean M.
+Burke.
diff -r d01125e9fc8f -r 9ac9b5b06f9b textproc/py-Unidecode/Makefile
--- /dev/null   Thu Jan 01 00:00:00 1970 +0000
+++ b/textproc/py-Unidecode/Makefile    Wed May 30 11:03:50 2012 +0000
@@ -0,0 +1,19 @@
+# $NetBSD: Makefile,v 1.1.1.1 2012/05/30 11:03:50 wiz Exp $
+#
+
+DISTNAME=      Unidecode-0.04.9
+PKGNAME=       ${PYPKGPREFIX}-${DISTNAME}
+CATEGORIES=    textproc
+MASTER_SITES=  http://pypi.python.org/packages/source/U/Unidecode/
+
+MAINTAINER=    pkgsrc-users%NetBSD.org@localhost
+HOMEPAGE=      http://pypi.python.org/pypi/Unidecode/
+COMMENT=       ASCII transliterations of Unicode text
+LICENSE=       gnu-gpl-v2 # or newer
+
+PKG_DESTDIR_SUPPORT=   user-destdir
+
+USE_LANGUAGES= # none
+
+.include "../../lang/python/distutils.mk"
+.include "../../mk/bsd.pkg.mk"
diff -r d01125e9fc8f -r 9ac9b5b06f9b textproc/py-Unidecode/PLIST
--- /dev/null   Thu Jan 01 00:00:00 1970 +0000
+++ b/textproc/py-Unidecode/PLIST       Wed May 30 11:03:50 2012 +0000
@@ -0,0 +1,563 @@
+@comment $NetBSD: PLIST,v 1.1.1.1 2012/05/30 11:03:50 wiz Exp $
+${PYSITELIB}/${EGG_FILE}
+${PYSITELIB}/unidecode/__init__.py
+${PYSITELIB}/unidecode/__init__.pyc
+${PYSITELIB}/unidecode/__init__.pyo
+${PYSITELIB}/unidecode/x000.py
+${PYSITELIB}/unidecode/x000.pyc
+${PYSITELIB}/unidecode/x000.pyo
+${PYSITELIB}/unidecode/x001.py
+${PYSITELIB}/unidecode/x001.pyc
+${PYSITELIB}/unidecode/x001.pyo
+${PYSITELIB}/unidecode/x002.py
+${PYSITELIB}/unidecode/x002.pyc
+${PYSITELIB}/unidecode/x002.pyo
+${PYSITELIB}/unidecode/x003.py
+${PYSITELIB}/unidecode/x003.pyc
+${PYSITELIB}/unidecode/x003.pyo
+${PYSITELIB}/unidecode/x004.py
+${PYSITELIB}/unidecode/x004.pyc
+${PYSITELIB}/unidecode/x004.pyo
+${PYSITELIB}/unidecode/x005.py
+${PYSITELIB}/unidecode/x005.pyc
+${PYSITELIB}/unidecode/x005.pyo
+${PYSITELIB}/unidecode/x006.py
+${PYSITELIB}/unidecode/x006.pyc
+${PYSITELIB}/unidecode/x006.pyo
+${PYSITELIB}/unidecode/x007.py
+${PYSITELIB}/unidecode/x007.pyc
+${PYSITELIB}/unidecode/x007.pyo
+${PYSITELIB}/unidecode/x009.py
+${PYSITELIB}/unidecode/x009.pyc
+${PYSITELIB}/unidecode/x009.pyo
+${PYSITELIB}/unidecode/x00a.py
+${PYSITELIB}/unidecode/x00a.pyc
+${PYSITELIB}/unidecode/x00a.pyo
+${PYSITELIB}/unidecode/x00b.py
+${PYSITELIB}/unidecode/x00b.pyc
+${PYSITELIB}/unidecode/x00b.pyo
+${PYSITELIB}/unidecode/x00c.py
+${PYSITELIB}/unidecode/x00c.pyc
+${PYSITELIB}/unidecode/x00c.pyo
+${PYSITELIB}/unidecode/x00d.py
+${PYSITELIB}/unidecode/x00d.pyc
+${PYSITELIB}/unidecode/x00d.pyo
+${PYSITELIB}/unidecode/x00e.py
+${PYSITELIB}/unidecode/x00e.pyc
+${PYSITELIB}/unidecode/x00e.pyo
+${PYSITELIB}/unidecode/x00f.py
+${PYSITELIB}/unidecode/x00f.pyc
+${PYSITELIB}/unidecode/x00f.pyo
+${PYSITELIB}/unidecode/x010.py
+${PYSITELIB}/unidecode/x010.pyc
+${PYSITELIB}/unidecode/x010.pyo
+${PYSITELIB}/unidecode/x011.py
+${PYSITELIB}/unidecode/x011.pyc
+${PYSITELIB}/unidecode/x011.pyo
+${PYSITELIB}/unidecode/x012.py
+${PYSITELIB}/unidecode/x012.pyc
+${PYSITELIB}/unidecode/x012.pyo
+${PYSITELIB}/unidecode/x013.py
+${PYSITELIB}/unidecode/x013.pyc
+${PYSITELIB}/unidecode/x013.pyo
+${PYSITELIB}/unidecode/x014.py
+${PYSITELIB}/unidecode/x014.pyc
+${PYSITELIB}/unidecode/x014.pyo
+${PYSITELIB}/unidecode/x015.py
+${PYSITELIB}/unidecode/x015.pyc
+${PYSITELIB}/unidecode/x015.pyo
+${PYSITELIB}/unidecode/x016.py
+${PYSITELIB}/unidecode/x016.pyc
+${PYSITELIB}/unidecode/x016.pyo
+${PYSITELIB}/unidecode/x017.py
+${PYSITELIB}/unidecode/x017.pyc
+${PYSITELIB}/unidecode/x017.pyo
+${PYSITELIB}/unidecode/x018.py
+${PYSITELIB}/unidecode/x018.pyc
+${PYSITELIB}/unidecode/x018.pyo
+${PYSITELIB}/unidecode/x01d.py
+${PYSITELIB}/unidecode/x01d.pyc
+${PYSITELIB}/unidecode/x01d.pyo
+${PYSITELIB}/unidecode/x01e.py
+${PYSITELIB}/unidecode/x01e.pyc
+${PYSITELIB}/unidecode/x01e.pyo
+${PYSITELIB}/unidecode/x01f.py
+${PYSITELIB}/unidecode/x01f.pyc
+${PYSITELIB}/unidecode/x01f.pyo
+${PYSITELIB}/unidecode/x020.py
+${PYSITELIB}/unidecode/x020.pyc
+${PYSITELIB}/unidecode/x020.pyo
+${PYSITELIB}/unidecode/x021.py
+${PYSITELIB}/unidecode/x021.pyc
+${PYSITELIB}/unidecode/x021.pyo
+${PYSITELIB}/unidecode/x022.py
+${PYSITELIB}/unidecode/x022.pyc
+${PYSITELIB}/unidecode/x022.pyo
+${PYSITELIB}/unidecode/x023.py
+${PYSITELIB}/unidecode/x023.pyc
+${PYSITELIB}/unidecode/x023.pyo
+${PYSITELIB}/unidecode/x024.py
+${PYSITELIB}/unidecode/x024.pyc
+${PYSITELIB}/unidecode/x024.pyo
+${PYSITELIB}/unidecode/x025.py
+${PYSITELIB}/unidecode/x025.pyc
+${PYSITELIB}/unidecode/x025.pyo
+${PYSITELIB}/unidecode/x026.py
+${PYSITELIB}/unidecode/x026.pyc
+${PYSITELIB}/unidecode/x026.pyo
+${PYSITELIB}/unidecode/x027.py
+${PYSITELIB}/unidecode/x027.pyc
+${PYSITELIB}/unidecode/x027.pyo
+${PYSITELIB}/unidecode/x028.py
+${PYSITELIB}/unidecode/x028.pyc
+${PYSITELIB}/unidecode/x028.pyo
+${PYSITELIB}/unidecode/x02c.py
+${PYSITELIB}/unidecode/x02c.pyc
+${PYSITELIB}/unidecode/x02c.pyo
+${PYSITELIB}/unidecode/x02e.py
+${PYSITELIB}/unidecode/x02e.pyc
+${PYSITELIB}/unidecode/x02e.pyo
+${PYSITELIB}/unidecode/x02f.py
+${PYSITELIB}/unidecode/x02f.pyc
+${PYSITELIB}/unidecode/x02f.pyo
+${PYSITELIB}/unidecode/x030.py
+${PYSITELIB}/unidecode/x030.pyc
+${PYSITELIB}/unidecode/x030.pyo
+${PYSITELIB}/unidecode/x031.py
+${PYSITELIB}/unidecode/x031.pyc
+${PYSITELIB}/unidecode/x031.pyo
+${PYSITELIB}/unidecode/x032.py
+${PYSITELIB}/unidecode/x032.pyc
+${PYSITELIB}/unidecode/x032.pyo
+${PYSITELIB}/unidecode/x033.py
+${PYSITELIB}/unidecode/x033.pyc
+${PYSITELIB}/unidecode/x033.pyo
+${PYSITELIB}/unidecode/x04d.py
+${PYSITELIB}/unidecode/x04d.pyc
+${PYSITELIB}/unidecode/x04d.pyo
+${PYSITELIB}/unidecode/x04e.py
+${PYSITELIB}/unidecode/x04e.pyc
+${PYSITELIB}/unidecode/x04e.pyo
+${PYSITELIB}/unidecode/x04f.py
+${PYSITELIB}/unidecode/x04f.pyc
+${PYSITELIB}/unidecode/x04f.pyo
+${PYSITELIB}/unidecode/x050.py
+${PYSITELIB}/unidecode/x050.pyc
+${PYSITELIB}/unidecode/x050.pyo
+${PYSITELIB}/unidecode/x051.py
+${PYSITELIB}/unidecode/x051.pyc
+${PYSITELIB}/unidecode/x051.pyo
+${PYSITELIB}/unidecode/x052.py
+${PYSITELIB}/unidecode/x052.pyc
+${PYSITELIB}/unidecode/x052.pyo
+${PYSITELIB}/unidecode/x053.py
+${PYSITELIB}/unidecode/x053.pyc
+${PYSITELIB}/unidecode/x053.pyo
+${PYSITELIB}/unidecode/x054.py
+${PYSITELIB}/unidecode/x054.pyc
+${PYSITELIB}/unidecode/x054.pyo
+${PYSITELIB}/unidecode/x055.py
+${PYSITELIB}/unidecode/x055.pyc
+${PYSITELIB}/unidecode/x055.pyo
+${PYSITELIB}/unidecode/x056.py
+${PYSITELIB}/unidecode/x056.pyc
+${PYSITELIB}/unidecode/x056.pyo
+${PYSITELIB}/unidecode/x057.py
+${PYSITELIB}/unidecode/x057.pyc
+${PYSITELIB}/unidecode/x057.pyo
+${PYSITELIB}/unidecode/x058.py
+${PYSITELIB}/unidecode/x058.pyc
+${PYSITELIB}/unidecode/x058.pyo
+${PYSITELIB}/unidecode/x059.py
+${PYSITELIB}/unidecode/x059.pyc
+${PYSITELIB}/unidecode/x059.pyo
+${PYSITELIB}/unidecode/x05a.py
+${PYSITELIB}/unidecode/x05a.pyc
+${PYSITELIB}/unidecode/x05a.pyo
+${PYSITELIB}/unidecode/x05b.py
+${PYSITELIB}/unidecode/x05b.pyc
+${PYSITELIB}/unidecode/x05b.pyo
+${PYSITELIB}/unidecode/x05c.py
+${PYSITELIB}/unidecode/x05c.pyc
+${PYSITELIB}/unidecode/x05c.pyo
+${PYSITELIB}/unidecode/x05d.py
+${PYSITELIB}/unidecode/x05d.pyc
+${PYSITELIB}/unidecode/x05d.pyo
+${PYSITELIB}/unidecode/x05e.py
+${PYSITELIB}/unidecode/x05e.pyc
+${PYSITELIB}/unidecode/x05e.pyo
+${PYSITELIB}/unidecode/x05f.py
+${PYSITELIB}/unidecode/x05f.pyc
+${PYSITELIB}/unidecode/x05f.pyo
+${PYSITELIB}/unidecode/x060.py
+${PYSITELIB}/unidecode/x060.pyc
+${PYSITELIB}/unidecode/x060.pyo
+${PYSITELIB}/unidecode/x061.py
+${PYSITELIB}/unidecode/x061.pyc
+${PYSITELIB}/unidecode/x061.pyo
+${PYSITELIB}/unidecode/x062.py
+${PYSITELIB}/unidecode/x062.pyc
+${PYSITELIB}/unidecode/x062.pyo
+${PYSITELIB}/unidecode/x063.py
+${PYSITELIB}/unidecode/x063.pyc
+${PYSITELIB}/unidecode/x063.pyo
+${PYSITELIB}/unidecode/x064.py
+${PYSITELIB}/unidecode/x064.pyc
+${PYSITELIB}/unidecode/x064.pyo
+${PYSITELIB}/unidecode/x065.py
+${PYSITELIB}/unidecode/x065.pyc
+${PYSITELIB}/unidecode/x065.pyo
+${PYSITELIB}/unidecode/x066.py
+${PYSITELIB}/unidecode/x066.pyc
+${PYSITELIB}/unidecode/x066.pyo
+${PYSITELIB}/unidecode/x067.py
+${PYSITELIB}/unidecode/x067.pyc
+${PYSITELIB}/unidecode/x067.pyo
+${PYSITELIB}/unidecode/x068.py
+${PYSITELIB}/unidecode/x068.pyc
+${PYSITELIB}/unidecode/x068.pyo
+${PYSITELIB}/unidecode/x069.py
+${PYSITELIB}/unidecode/x069.pyc
+${PYSITELIB}/unidecode/x069.pyo
+${PYSITELIB}/unidecode/x06a.py
+${PYSITELIB}/unidecode/x06a.pyc
+${PYSITELIB}/unidecode/x06a.pyo
+${PYSITELIB}/unidecode/x06b.py
+${PYSITELIB}/unidecode/x06b.pyc
+${PYSITELIB}/unidecode/x06b.pyo
+${PYSITELIB}/unidecode/x06c.py
+${PYSITELIB}/unidecode/x06c.pyc
+${PYSITELIB}/unidecode/x06c.pyo
+${PYSITELIB}/unidecode/x06d.py
+${PYSITELIB}/unidecode/x06d.pyc
+${PYSITELIB}/unidecode/x06d.pyo
+${PYSITELIB}/unidecode/x06e.py
+${PYSITELIB}/unidecode/x06e.pyc
+${PYSITELIB}/unidecode/x06e.pyo
+${PYSITELIB}/unidecode/x06f.py
+${PYSITELIB}/unidecode/x06f.pyc
+${PYSITELIB}/unidecode/x06f.pyo
+${PYSITELIB}/unidecode/x070.py
+${PYSITELIB}/unidecode/x070.pyc
+${PYSITELIB}/unidecode/x070.pyo
+${PYSITELIB}/unidecode/x071.py
+${PYSITELIB}/unidecode/x071.pyc
+${PYSITELIB}/unidecode/x071.pyo
+${PYSITELIB}/unidecode/x072.py
+${PYSITELIB}/unidecode/x072.pyc
+${PYSITELIB}/unidecode/x072.pyo
+${PYSITELIB}/unidecode/x073.py
+${PYSITELIB}/unidecode/x073.pyc
+${PYSITELIB}/unidecode/x073.pyo
+${PYSITELIB}/unidecode/x074.py
+${PYSITELIB}/unidecode/x074.pyc



Home | Main Index | Thread Index | Old Index