From 4eab98f14f91491555cdc9035787e3581a528ad7 Mon Sep 17 00:00:00 2001 From: wen Date: Thu, 15 Aug 2013 08:02:23 +0000 Subject: Update to 1.35 Upstream changes: 1.35 Tue Aug 13 19:50:55 PDT 2013 - improve conversion of certain composed characters to MARC8 Some characters should not be fully decomposed before converting them to MARC8. This patch adds a table of such characters, based on Annex A of http://www.loc.gov/marc/marbi/2006/2006-04.html and on some sample records provided by Jason Stephenson of MVLC. - recognize G0 and G1 characters properly When converting from MARC8 to UTF8, MARC::Charset now properly recognizes if a (single-byte) MARC8 character falls in G0 or G1. This is part of the fix for RT#63271 (converting characters in the Extended Cyrillic character set), but should also fix similar issues with converting characters in the extended Arabic set. This commit also means that all MARC8 character sets that support both G0 and G1 wll be properly converted, regardless of whether they're currently set as the G0 or G1 character set. For example, it is now possible to convert Extended Latin as G0 or Basic Latin as G1. This fixes RT#63271 - have MARC::Charset::Code->marc_value() handle G0/G1 conversion Since there's at present no need to do things like have ANSEL be the G0 character set when converting from UTF8 to MARC8, this commit centralizes the logic for deciding whether to return the G0 or G1 MARC8 representation of a character. Also add MARC::Charset::Code->g0_marc_value(), which returns the G0 representation of the character for use by the character DB. - New test cases for converting Vietnamese and Extended Cyrillic text. 1.34 Mon Feb 11 09:10:35 PST 2013 - RT#83257: use AnyDBM_File rather than hardcode GDBM_File To improve portability, use AnyDBM_File to select a DBM rather than rely on GDBM_File. GDBM_File apparently used to be a core module, but not all distributions included it, particularly OS X. In any event, GDBM_File is no longer core. This patch also includes a tweak to allow MARC::Charset to work with NDBM_File and ODBM_File, neither of which support 'exists'. I've tested MARC::Charset successfully on the following DBMs: - GDBM_File - DB_File - NDBM_File - ODBM_File - SDBM_File This is also my preferred order; SDBM_File is selected last because it produces the biggest data file on disk. - RT#38912: fix mapping of double diacritics (ligature and double tilde). Thanks to Thomas P. Ventimiglia for the bug report and test case. --- converters/p5-MARC-Charset/Makefile | 5 ++--- converters/p5-MARC-Charset/distinfo | 8 ++++---- 2 files changed, 6 insertions(+), 7 deletions(-) (limited to 'converters') diff --git a/converters/p5-MARC-Charset/Makefile b/converters/p5-MARC-Charset/Makefile index bee55d2187d..30d63de29f8 100644 --- a/converters/p5-MARC-Charset/Makefile +++ b/converters/p5-MARC-Charset/Makefile @@ -1,8 +1,7 @@ -# $NetBSD: Makefile,v 1.8 2013/05/31 12:39:45 wiz Exp $ +# $NetBSD: Makefile,v 1.9 2013/08/15 08:02:23 wen Exp $ -DISTNAME= MARC-Charset-1.33 +DISTNAME= MARC-Charset-1.35 PKGNAME= p5-${DISTNAME} -PKGREVISION= 2 CATEGORIES= converters perl5 MASTER_SITES= ${MASTER_SITE_PERL_CPAN:=MARC/} diff --git a/converters/p5-MARC-Charset/distinfo b/converters/p5-MARC-Charset/distinfo index bedcb9a2230..eabc5e2fe67 100644 --- a/converters/p5-MARC-Charset/distinfo +++ b/converters/p5-MARC-Charset/distinfo @@ -1,5 +1,5 @@ -$NetBSD: distinfo,v 1.2 2011/10/06 15:06:07 hiramatsu Exp $ +$NetBSD: distinfo,v 1.3 2013/08/15 08:02:23 wen Exp $ -SHA1 (MARC-Charset-1.33.tar.gz) = 047cc5b59420c7e30fba2dcf92890bfccb83792e -RMD160 (MARC-Charset-1.33.tar.gz) = cbb7e6f5ce07eaff20f76cfad5f34fdeb67d907c -Size (MARC-Charset-1.33.tar.gz) = 190024 bytes +SHA1 (MARC-Charset-1.35.tar.gz) = 0db7c2294cb636abf79e3c69404d81ab0411fd86 +RMD160 (MARC-Charset-1.35.tar.gz) = 3fc740ead065e809f35d22ece970f31f198a88b7 +Size (MARC-Charset-1.35.tar.gz) = 194082 bytes -- cgit v1.2.3