Update to 0.4.20:

Version 0.4.20                                       [2008-07-29]
=================================================================
focus: minor improvements

* Fixed some typos in the manual page

* Upgraded license to GPLv3

* --version: prints now build date and cleaned up the print out

* src/clive/util.py: added

* update config.{guess,sub} (sr #2064):

    * Upgraded autoconf: 2.61 -> 2.62 (automake: 1.10.1)

    * config.guess: replaced version 2003-07-02 with 2008-03-12

    * config.sub: replaced version 2003-07-04 with 2008-03-26

    * depcomp: replaced version 2005-07-09.11 with 2007-03-29.01

    * install-sh: replaced version 2005-05-14.22 with 2006-12-25.00

    * missing: replaced version 2005-06-08.21 with 2006-05-10.23

    * ltmain.sh: replaced version 1.5.24 with 1.5.26

* Added more comments and cleaned up the code here and there


Version 0.4.19                                       [2008-07-22]
=================================================================
+new !fix ~change -remove | focus: minor improvements, bugfixes

+ tests/scan.lst
    Related to the "--scan: multiple url disarray" issue described
    further below.

! "OperationalError: Could not decode to UTF-8 column 'cache_title'"
    Endless string of encoding issues. An attempt was made to improve
    the overall unicode/string handling throughout the program.

    Ditched HTMLParser in favor for a custom SGMLParser.

    Related to this: UnicodeDecodeError should no longer cause
    instability as much anymore. Added safeguards (ignore 'n forget)
    for these errors.

! --scan: Multiple URL disarray
    The list was filled incorrectly if multiple scan URLs were supplied,
    e.g.: % clive -S < tests/scan.lst

~ Improved: Youtube: HQ video not available (error: no-content) [bug #12000]
    clive would previously exit with "no-content" error if the automatic
    quality switching failed for still unknown reason.

    This was originally fixed in the last release but that created a new
    bug which caused clive to crash with the "CliveNoMediaError" exception.

    Because this crash is very difficult to reproduce, the original code
    was slightly modified so that clive should now report it as a "host
    returned zero file length (timeout?)" error instead of crashing.

    Should this error occur, re-extraction usually sorts it out.

~ Video filenames: "/" are no longer permitted in filenames
    These characters are now converted by the program to "_". This
    caused crashing for obvious reasons. Using the --filter option
    does not have any effect on this.

~ Updated: README, INSTALL files
    Description was changed, removed obsolete text. Added a note
    about using --with-installed-PACKAGE.

~ Updated: Manual page (clive.1)
    Complete overhaul.

~ --version:
    OS release and locale encoding are now printed.

~ $HOME/.clive/config: renamed "youtube_id" to "youtube_user"
~ $HOME/.clive/config: renamed "dmotion_id" to "dmotion_user"

~ Modified: "warn: ... (same length) exists already"
    Added "skipped:" to the message.

- Arcane filename limitation
    Filename length is no more limited to 64 characters.


Version 0.4.18                                       [2008-07-15]
=================================================================
+new !fix ~change -remove | focus: major bugfixes

! Metacafe:  Extraction fails ("HTTP/404 error")
    Due to changes made to the website.

! Youtube: HQ video not available (error: no-content) [bug #12000]
    Automatic quality detection would fail with some videos. clive
    now switches to low quality if the host returns zero length
    for a video file.

! --rss: Do not display empty feeds
    Show no more feeds without items.

~ Updated: INSTALL and README files
    INSTALL was rewritten, README was cleaned up.

~ NEWS: Utilized
    All user-visible changes are now described in the NEWS file.

~ configure: --with-PACKAGE renamed (downstream maintainers take a note)
    Renamed the --with-PACKAGE options to --with-installed-PACKAGE.
    See the NEWS and the INSTALL files for more details.

~ Cleaned up: Version and options display at start
    Less is more. Use --version for more detailed information, e.g. modules.

~ Cleaned up: removed unnecessary module import calls
    Should speed up program start.

~ --rss, --cache, --scan: Utilize terminal size better
~ --scan, --cache, --rss: "OK - Extract" -> "Extract"
~ --scan, --cache, --rss: "Refresh" -> "Resize"

~ Removed remaining "notice:" messages
    These messages were either renamed or removed.


Version 0.4.17                                       [2008-06-29]
=================================================================
+new !fix ~change -remove | focus: minor bugfixes, improvements

NOTE: Feature freeze (0.5.0).Shifting the effort towards fixing any
remaining bugs and improving the usability.

+ Locale settings
    All printed (stdout, stderr, newt) strings are now encoded.
    clive depends on the locale settings for this. If the setting
    is not found, clive defaults the encoding to "iso-8859-1".
    This change is related to the bug #11848.

+ --cache, --rss, --cache: Refresh function
    Added a new button. Refresh can be used to resize the widgets
    if the terminal size was changed.

+ --clear-cache,-d
    Clears all cache data from ~/.clive/cache.

+ --clear-last,-D
    Clears last batch data from ~/.clive/recall.

! --scan, --rss, --cache: Hitting F12 would result in "TypeError" crash
    Hitting F12 is now the same as hitting "OK".

! Typo: src/clive/login.py.in (ln:99)
    The exception instance was referred incorrectly.

! --scan: "UnicodeDecodeError: 'unicodeescape'" (bug #11848)
    Should no longer occur. All printed (stdout, stderr, newt) strings are
    now encoded to the locale encoding.

~ Print out: Tweaked
    Making better use of available line space.

~ Startup: Options display
    Replaced "exist" with "locale".

~ --cache: Changed data layout
    Changed from the old layout (VideoTitle) to (VideoTitle / VideoURL).

~ --scan: Changed data layout (sr #2032)
    Scrapped the old layout (ScanURL / VideoTitle) in favor for (VideoTitle /
    VideoURL). The CheckboxTree widget has its limitations.

~ --recall: Changed no data error message
    Exits now with "error: no recall data".

~ --cache: Check for existing data
    clive now checks if cache data is available before displaying it.

~ Run and terminate options can be chained
    Chaining the "run and terminate" options, such as --write-conf and
    --clear-cache, is now possible. For example:
        % clive -udDw

~ --scan: Improved duplicate URL checking (sr #2032)
    For example:

    * http://video.google.com/videoplay?docid=-1943351180544198777
    * http://video.google.com/googleplayer.swf?docid=-1943351180544198777

    Are considered to be the same.

~ --scan, --rss, --cache: Improved title clipping (sr #2032)
    Titles are no longer clipped unnecessarily if there's enough
    space left. clive will now also attempt to maximize the use
    of the terminal area instead of using hardcoded dimensions.

3 files changed, 16 insertions, 10 deletions

diff --git a/net/clive/Makefile b/net/clive/Makefile
index 1d046d77c92..ca1260f19da 100644
--- a/net/clive/Makefile
+++ b/net/clive/Makefile
@@ -1,7 +1,7 @@
-# $NetBSD: Makefile,v 1.10 2008/06/21 15:53:55 wiz Exp $
+# $NetBSD: Makefile,v 1.11 2008/07/29 21:30:10 wiz Exp $
 #
 
-DISTNAME=	clive-0.4.16
+DISTNAME=	clive-0.4.20
 CATEGORIES=	net multimedia www
 MASTER_SITES=	http://dl.gna.org/clive/0.4/src/ \
 		${MASTER_SITE_SOURCEFORGE:=clive/}
@@ -18,9 +18,9 @@ DEPENDS+=	${PYPKGPREFIX}-feedparser>=4.1:../../textproc/py-feedparser
 DEPENDS+=	urlgrabber>=3.1.0:../../www/urlgrabber
 
 GNU_CONFIGURE=	yes
-CONFIGURE_ARGS+=	--without-urlgrabber
-CONFIGURE_ARGS+=	--without-feedparser
-CONFIGURE_ARGS+=	--without-newt
+CONFIGURE_ARGS+=	--with-installed-urlgrabber
+CONFIGURE_ARGS+=	--with-installed-feedparser
+CONFIGURE_ARGS+=	--with-installed-newt
 USE_LANGUAGES=	c # configure script
 PY_PATCHPLIST=			yes
 
diff --git a/net/clive/PLIST b/net/clive/PLIST
index f69a6e14d50..194e5f6c205 100644
--- a/net/clive/PLIST
+++ b/net/clive/PLIST
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.5 2008/05/21 13:50:30 wiz Exp $
+@comment $NetBSD: PLIST,v 1.6 2008/07/29 21:30:10 wiz Exp $
 bin/clive
 ${PYSITELIB}/clive/__init__.py
 ${PYSITELIB}/clive/__init__.pyc
@@ -45,8 +45,14 @@ ${PYSITELIB}/clive/rss.pyo
 ${PYSITELIB}/clive/scan.py
 ${PYSITELIB}/clive/scan.pyc
 ${PYSITELIB}/clive/scan.pyo
+${PYSITELIB}/clive/unicode.py
+${PYSITELIB}/clive/unicode.pyc
+${PYSITELIB}/clive/unicode.pyo
 ${PYSITELIB}/clive/update.py
 ${PYSITELIB}/clive/update.pyc
 ${PYSITELIB}/clive/update.pyo
+${PYSITELIB}/clive/util.py
+${PYSITELIB}/clive/util.pyc
+${PYSITELIB}/clive/util.pyo
 man/man1/clive.1
 @dirrm ${PYSITELIB}/clive
diff --git a/net/clive/distinfo b/net/clive/distinfo
index 2a2ad919584..2613d63fbd1 100644
--- a/net/clive/distinfo
+++ b/net/clive/distinfo
@@ -1,5 +1,5 @@
-$NetBSD: distinfo,v 1.7 2008/06/21 15:53:55 wiz Exp $
+$NetBSD: distinfo,v 1.8 2008/07/29 21:30:10 wiz Exp $
 
-SHA1 (clive-0.4.16.tar.bz2) = ab33aef9afd403736bac9fb7b4d4fce026919483
-RMD160 (clive-0.4.16.tar.bz2) = a072cd1a041f77e196f4e09b5a0da67040183e00
-Size (clive-0.4.16.tar.bz2) = 415364 bytes
+SHA1 (clive-0.4.20.tar.bz2) = 668fd72d455a324736edcfe83ab17feb4df01100
+RMD160 (clive-0.4.20.tar.bz2) = d5ffb28ff012db42cfcbe9358cc2286434660282
+Size (clive-0.4.20.tar.bz2) = 429981 bytes