summaryrefslogtreecommitdiff
path: root/textproc/py-feedparser
AgeCommit message (Collapse)AuthorFilesLines
2004-07-22add python as categoryrecht1-2/+2
ok'd a while back at pkgsrcCon by agc and wiz
2004-07-17Update to 3.3.schmonz2-5/+5
Changes in 3.2: * use cjkcodecs and iconv_codec if available * always convert feed to UTF-8 before passing to XML parser * completely revamped logic for determining character encoding and attempting XML parsing (much faster) * increased default timeout to 20 seconds * test for presence of Location header on redirects * added tests for many alternate character encodings * support various EBCDIC encodings * support UTF-16BE and UTF16-LE with or without a BOM * support UTF-8 with a BOM * support UTF-32BE and UTF-32LE with or without a BOM * fixed crashing bug if no XML parsers are available * added support for "Content-encoding: deflate" * send blank "Accept-encoding: " header if neither gzip nor zlib modules are available Changes in 3.3: * optimize EBCDIC to ASCII conversion * fix obscure problem tracking xml:base and xml:lang if element declares it, child doesn't, first grandchild redeclares it, and second grandchild doesn't * refactored date parsing * defined public registerDateHandler so callers can add support for additional date formats at runtime * added support for OnBlog, Nate, MSSQL, Greek, and Hungarian dates (ytrewq1) * added zopeCompatibilityHack() which turns FeedParserDict into a regular dictionary, required for Zope compatibility, and also makes command-line debugging easier because pprint module formats real dictionaries better than dictionary-like objects * added NonXMLContentType exception, which is stored in bozo_exception when a feed is served with a non-XML media type such as "text/plain" * respect Content-Language as default language if not xml:lang is present * cloud dict is now FeedParserDict * generator dict is now FeedParserDict * better tracking of xml:lang, including support for xml:lang="" to unset the current language * recognize RSS 1.0 feeds even when RSS 1.0 namespace is not the default namespace * don't overwrite final status on redirects (scenarios: redirecting to a URL that returns 304, redirecting to a URL that redirects to another URL with a different type of redirect) * add support for HTTP 303 redirects
2004-06-30Update to 3.1. From the changelog:schmonz2-5/+5
* added and passed tests for converting HTML entities to Unicode equivalents in illformed feeds (aaronsw) * added and passed tests for converting character entities to Unicode equivalents in illformed feeds (aaronsw) * test for valid parsers when setting XML_AVAILABLE * make version and encoding available when server returns a 304 * add handlers parameter to pass arbitrary urllib2 handlers (like digest auth or proxy support) * add code to parse username/password out of url and send as basic authentication * expose downloading-related exceptions in bozo_exception (aaronsw) * added __contains__ method to FeedParserDict (aaronsw) * added publisher_detail (aaronsw)
2004-06-27Import Universal Feed Parser 3.0.1.schmonz4-0/+42
Universal Feed Parser is a Python module for downloading and parsing syndicated feeds. It can handle RSS 0.90, Netscape RSS 0.91, Userland RSS 0.91, RSS 0.92, RSS 0.93, RSS 0.94, RSS 1.0, RSS 2.0, Atom, and CDF feeds. To use Universal Feed Parser, you will need Python 2.1 or later. Universal Feed Parser is not meant to run standalone; it is a module for you to use as part of a larger Python program. Universal Feed Parser is easy to use; the module is self-contained in a single file, feedparser.py, and it has only one public function, parse. parse takes a number of arguments, but only one is required, and it can be a URL, a local filename, or a raw string containing feed data in any format.