summaryrefslogtreecommitdiff
path: root/net/clive
AgeCommit message (Collapse)AuthorFilesLines
2008-05-27Update to 0.4.14:wiz2-7/+7
Version 0.4.14 [2008-05-26] ================================================================= +new !fix ~change -remove | focus: minor bugfixes, improvements + Support: sevenload.com (sr #2015) Contributor: Kai Wasserbach http://bugs.debian.org/482289 Minor modifications were made to the contributed patch to maintain backward compatibility with Python 2.4. + Scan: GoogleVideo support --scan now looks for embedded google videos. + Scripts: run.py, build.py These used to be available in the svn repository only. build.py: * builds and installs clive to top_srcdir/dist subdir * wraps "configure" and "make install" * wraps CFLAGS and LDFLAGS for building newt (bundled) * takes any of the configure parameters run.py: runs clive from the top_srcdir/dist subdir * Wraps PYTHONPATH * takes any of the clive parameters Example: % ./build.py --without-newt % ./run.py --no-cache URL ! GoogleVideo: "error: extraction url not found" [blocker] Affected versions: clive 0.4.12, 0.4.13 Low quality video extraction would fail due to page HTML changes. ! File extension Affected versions: clive < 0.4.14 mp4 file extension was used incorrectly for Metacafe and Guba videos. ! manual page Typos. ~ code cleanup Replaced "if .. .find(..) !=/== -1" with "if .. in .."
2008-05-21Update to 0.4.13:wiz3-8/+10
Version 0.4.13 [2008-05-20] ================================================================= +new !fix ~change -remove | focus: minor feature enhancements + --scan, -S Causes clive to scan the fed URLs for identifiable video links. The found links are then checked and displayed to the user for selection. Example: % clive -S "http://fakesteve.blogspot.com/" This feature currently scans for Youtube video links only. Googlevideo support will follow. ! manual page Cleaned up and fixed some typos. ~ config: url_feed -> feed_url Renamed config file command "url_feed" to "feed_url". Version 0.4.12 [2008-05-12] ================================================================= +new !fix ~change -remove | focus: Minor bugfixes ! VGoogle: OSError: [Errno 2] No such file or directory (bug #11668) Affected versions: clive 0.4.10, 0.4.11 Extraction would fail for google videos that did not have mp4 link available. See also: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=480444 ! cache: "OperationalError: no such column: cache_lowq" [blocker] Affected versions: clive 0.4.10, 0.4.11 Cache upgrade would fail on some configurations for still unknown reasons. clive will attempt to recreate the cache if the above error occurs. Any existing cache data will be lost. See also: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=479315 ~ configure.ac: module checks configure no longer checks for modules (urlgrabber, feedparser) when --without-PACKAGE or --with-PACKAGE=no are being used. ~ Warnings: tweaked Some warnings have been tweaked.
2008-04-26Update to 1.4.11:wiz4-56/+16
pkgsrc change: use python dependencies from pkgsrc instead of the ones delivered with clive. Version 0.4.11 [2008-04-24] ================================================================= +new !fix ~change -remove | focus: Major bugfixes + --with-PACKAGE[=yes|no] (sr #1986) See the INSTALL file for more details. ~ Prerequisite: newt (snack) module The module is now expected to be found. ! Youtube: "video removed" (bug #11564) [blocker] Affected versions: clive < 0.4.11 ! Unportable test(1) construct (bug #11552) [0.4.10] configure used previously the unportable bash "==" comparison operator for test(1) which is not supported by most other shells.
2008-04-25Update PYTHON_VERSIONS_COMPATIBLEjoerg1-2/+1
- assume that Python 2.4 and 2.5 are compatible and allow checking for fallout. - remove PYTHON_VERSIONS_COMPATIBLE that are obsoleted by the 2.3+ default. Modify the others to deal with the removals.
2008-04-22Update to 0.4.10:wiz4-10/+33
Version 0.4.10 [2008-04-21] ================================================================= +new !fix ~change -remove | focus: Major bugfixes + newt library The library, which is written in C and depends on the libslang, is now part of the clive distribution. For more details, see the README file. + configure: --with-newt[=yes/no] (default:yes) If disabled: - python newt module will not be built - The --rss feature will be disabled + Prerequisite: libslang >= 2.0 The newt library depends on this library. + Google Video: mp4 support clive will now attempt to download mp4 format from the host by default. --low-quality option can be used to override this. Falls back to flv if the mp4 link is not found. Example: mp4: Video: h264, yuv420p, 320x240, 29.97 fps(r) mp4: Audio: mpeg4aac, 48000 Hz, stereo flv: Video: flv, yuv420p, 320x240, 29.75 fps(r) flv: Audio: mp3, 22050 Hz, mono, 64 kb/s + Google Video: Partial support for continuing transfers Continuing partially downloaded files is now possible for the mp4 transfers introduced in this release. As with Youtube/FLV, continuing GoogleVideo/FLV files still fails. ~ Program start options stdout clive now prints out the bundled newt version (if any). ! Cache: --low-quality Caching should now work properly with the --low-quality option. If the cache entry was previously recorded using different video quality, the video page is re-visited and the cache is updated. A new column 'cache_lowq' was added to the 'cache' sqlite table. Should the upgrade from a previous version fail, remove the existing ~/.clive/cache file. ! Bug #11523: Google video extraction fails Affected versions: clive < 0.4.10 ! Various typos Mostly in the manual page. - Prerequisite: python-newt module The module is now part of the distribution.
2008-04-13Update to 0.4.9:wiz3-16/+57
Version 0.4.9 [2008-04-09] ================================================================= +new !fix ~change -remove | focus: major feature improvements + RSS/Atom parser (req. python newt module >= 0.51) Designed to be used with video host feeds. Parses and displays found videos available for extraction. If the required newt module is not found, the feature is disabled. Note that the python feedparser module is now part of the clive distribution, for more details, see the README file. Option: --rss (config: url_feed) When the --rss option is used, the URLs are treated as RSS/Atom feed URLs, for example: % clive --rss http://youtube.com/rss/global/recently_featured.rss Downstreamers: Python newt module is a new prerequisite. Note that the program still runs without it, only the --rss feature is disabled. FreeBSD: the newt library needs to be built with WITH_PYTHON, for example: % cd /usr/ports/devel/newt % make WITH_PYTHON=yes install clean Ubuntu: https://bugs.launchpad.net/ubuntu/+source/newt/+bug/110880 + Dailymotion: Log-in support (sr #1834) Options: --dmotion-user=USERNAME (config: dmotion_id) --dmotion-pass=PASSWORD (config: dmotion_password) + Metacafe: Family filter off (sr #1956) The family filter is disabled for all extractions. + Youtube: Log-in support (sr #1953) Resurrected the log-in support that was previously available in 0.2.x but removed in 0.3.0 due to the complete program overhaul. Options: --youtube-user=USERNAME (config: youtube_id) --youtube-pass=PASSWORD (config: youtube_password) ! ~/.clive/config; improved parsing The parser is now more resistant to invalid values. clive will now also exit if an error occurs while parsing. ! ~/.clive/config; output_if_file_exists Accepts "RENAME" as it should have. ! Console; q_r_paste command Crash at: "UnboundLocalError: local variable 'cmd' referenced before assignment" ~ --write-conf; increased verbosity clive is now more verbose about found 3rd party programs. ~ --write-conf; sort commands The written commands are now sorted alphabetically. Version 0.4.8 [2008-03-31] ================================================================= +new !fix ~change -remove | focus: minor bugfixes + Youtube: HTTP/415 No media fallback Extract low quality (flv) video if better quality (mp4) is not available. ! Youtube: Partial support for continuing transfers It is now be possible to continue partial downloads as long as they are high-quality (mp4) videos. Note that this fails utterly for the flv videos. It appears urlgrabber appends a complete file at the end of the existing file when the host refuses to continue transfer. Instead of bloating the code with the conditions, continuing the youtube flv file transfers remains disabled. ! Dailymotion: improved media support clive no more assumes 512x384 is the highest available quality. The video page is now parsed for best available quality which clive extracts unless the --low-quality option is being used. It should be noted that most videos appear to have only the low-quality (flv) video available. No media warning will be displayed if high quality video is not found and the low quality video is extracted instead. ! Transfer rate calculations File length offset is now used properly with files that are being overwritten. This fixes the only-progress-percentage odditity is being displayed. ! Youtube: New error messages "error: country restriction/censorship" "error: private video" ! --check-update,-u Crash at: "TypeError: __init__() takes exactly 2 arguments (1 given)" ~ Reduce progress stdout flickering (sr #1944) Progress is now rendered in one second intervals. clive will now also display average transfer rate and total time elapsed when the transfer completes. ~ Clean up clive(1), INSTALL etc. Version 0.4.7 [2008-03-17] ================================================================= +new !fix ~change -remove | focus: major feature enhancements + GNU Autotools support See the INSTALL file for the updated installation details. + urlgrabber integration The urlgrabber module is now part of the source code distribution. For more info, please read the README file. Downstream maintainers: urlgrabber module is no longer a prerequisite + Cache If caching is enabled, clive will collect data about visited URLs to a sqlite3 database file (~/.clive/cache). Note that cache is only available for Python >= 2.5. Also, depending on the system, the sqlite3 may not be installed with Python by default, e.g. on FreeBSD you need to install it separately (databases/py-sqlite3). Added also --no-cache and enable_cache. Caching is enabled by default. + Youtube: new default format clive now defaults to extract the better quality (mp4) videos from Youtube. The default behaviour can be overridden with the --low-quality option. + "Paste" option displayed at program start The state for "paste from xclip" is now displayed when the program starts. ! Same output filename in URL batch clive did not previously check the URLs in current batch for same output filename. For example: http://video.google.com/videoplay?docid=-4505462782975458603 http://video.google.ca/videoplay?docid=-4505462782975458603 Both URLs point to the same video, note the different TLD. If they were fed to clive in same URL batch the program accepted them without any scrutiny. This resulted clive to waste bandwidth downloading the same file twice and overwriting the previously extracted video file. clive now generates (--exist=rename) a new output filename for the last URL. ! Dailymotion support clive will now attempt to extract the higher resolution vide (mp4) _only_ if it is available. This was causing HTTP/404 errors for some dmotion URLs with the previous release. The new option --low-quality overrides this default behaviour. ! Status/progress stdout line breaking on some system configurations This was caused by improper use of '\b' which would cause the lines to break on some terminal emulation settings. ! Calculations for resumed transfers (patch #990) The transfer rate calculations should no longer go berzerk for resumed transfers. "The problem is that when urlgrabber calls update(), the 'read' parameter is the current size of the file. When you resume, you need to discard the offset from the previous download or else the calculations will be off." -- zythmer ~ clive(1) The manual page was rewritten. ~ Accept-encoding is now always set to gzip Removed the rather useless --no-gzip option from wasting space. Note that compression is only used if the host supports it. ~ Configuration file format The configuration file format has undergone several iterations of changes over the last 12 months and this release introduces yet another format. Wait for it. This one's final. For a comparison: Then: {.., 'verbose':1, ..} Now: enable_verbose="YES" To get started, you can generate a "template" configuration file with: % clive --write-conf The created file contains comments and all supported commands. clive will also attempt to autodetect the 3rd party programs such as ffmpeg and set the paths to these programs with recommended options. ~ File name changes in ~/.clive config.py -> config last.log -> recall userdef.py -> custom.py Note that since history is no longer used, the ~/.clive/history.log is now obsolete and can be removed if it's still around. ~ Option --write-conf Previously known as --conf-write. Writes the config file with default program values. clive will now attempt to autodetect vlc, ffmpeg and xclip. ~ Option --emit Renamed to "--emit-csv". Standard output format was also changed. From: video: "extraction-url" "filename" "length"\n To: OK: "url","extraction-url","filename","length"\n FAILED: "url","error-message"\n Should be now more parsing-friendly. ~ Options changed Much of the options were either renamed, merged, removed or otherwise modified. Some new short options were added also. ~ Renamed --simulate Renamed --simulate,-s to --no-extract,-n. ~ Tweaked warnings Some of the warnings were rewritten. ~ Stdout overhaul Much of the stdout messages were changed, e.g. "status:" and similar were replaced with lines that make better use of the line space. ~ Options displayed at program start Renamed "throttle" to "rate". Renamed "exists" to "exist". ~ sys.platform instead of platform.uname Platform string is now constructed using the platform module. - Logging features More or less replaced by the new "cache" and "recall" features. See also "File name changes" above. - GUI features: --configure, --history Rather than transforming clive into a CLI-GUI hybrid, I've decided to remove the GUI elements. The code to these short-lived features could still be reused for a GUI-only clive configruation tool later if there's any demand for it. Downstream maintainers: Tkinter is no longer used by clive. - Mswindows support Anyone familiar with the woe32 specific non-standard approach to everything can probably relate to this, and even if python hides much of the mswindows nonsense, I've decided not to bother myself with it anymore. So instead of bloating the code base with a set of conditions and exceptions for woe32, I've, hereby, removed all of the ms-platform specific nonsense from the project. Come to the unix side. - distutils support (setup.py) Starting from this release, clive uses GNU Autotools. - stage6 support Shut down service effective February 28, 2008 (http://www.stage6.com/blog/107/).
2008-03-14Pick up maintainership.wiz1-2/+2
2008-03-14Import clive-0.4.6 as net/clive.wiz4-0/+68
clive is a cross-platform command line video extraction tool for user-uploaded video hosts such as Youtube, Google Video, Dailymotion, Guba, and Metacafe. It can be chained with 3rd party tools for subsequent video re-encoding and playing.