summaryrefslogtreecommitdiff
path: root/archivers/zstd
AgeCommit message (Collapse)AuthorFilesLines
2020-03-12zstd: CHECK_PORTABILITY_SKIP in test suitetnn1-1/+3
2020-01-18all: migrate several HOMEPAGEs to httpsrillig1-2/+2
pkglint --only "https instead of http" -r -F With manual adjustments afterwards since pkglint 19.4.4 fixed a few indentations in unrelated lines. This mainly affects projects hosted at SourceForce, as well as freedesktop.org, CTAN and GNU.
2019-11-06zstd: updated to 1.4.4adam2-7/+7
Zstandard v1.4.4 This release includes some major performance improvements and new CLI features, which make it a recommended upgrade. perf: Improved decompression speed, by > 10% perf: Better compression speed when re-using a context perf: Fix compression ratio when compressing large files with small dictionary perf: zstd reference encoder can generate RLE blocks perf: minor generic speed optimization api: new ability to extract sequences from the parser for analysis api: fixed decoding of magic-less frames api: fixed ZSTD_initCStream_advanced() performance with fast modes, reported by @QrczakMK cli: Named pipes support cli: short tar's extension support cli: command --output-dir-flat=DIE , generates target files into requested directory cli: commands --stream-size=# and --size-hint=# cli: command --exclude-compressed cli: faster -t test mode cli: improved some error messages cli: fix rare deadlock condition within dictionary builder build: single-file decoder with emscripten compilation script build: fixed zlibWrapper compilation on Visual Studio, reported by @bluenlive build: fixed deprecation warning for certain gcc version, reported by @jasonma163 build: fix compilation on old gcc versions build: improved installation directories for cmake script, by Dmitri Shubin pack: modified pkgconfig, for better integration into openwrt, requested by @neheb misc: Improved documentation : ZSTD_CLEVEL, DYNAMIC_BMI2, ZSTD_CDict, function deprecation, zstd format misc: fixed educational decoder : accept larger literals section, and removed UNALIGNED() macro
2019-08-20zstd: updated to 1.4.3adam2-7/+7
Zstandard v1.4.3 Dictionary Compression Regression We discovered an issue in the v1.4.2 release, which can degrade the effectiveness of dictionary compression. This release fixes that issue. Detailed Changes * bug: Fix Dictionary Compression Ratio Regression * bug: Fix Buffer Overflow in v0.3 Decompression * build: Add support for IAR C/C++ Compiler for Arm * misc: Add NULL pointer check in util.c by
2019-08-02zstd: updated to 1.4.2adam2-7/+7
Zstandard v1.4.2 Legacy Decompression Fix This release is a small one, that corrects an issue discovered in the previous release. Zstandard v1.4.1 included a bug in decompressing v0.5 legacy frames, which is fixed in v1.4.2. Detailed Changes bug: Fix bug in zstd-0.5 decoder bug: Fix seekable decompression in-memory API bug: Close minor memory leak in CLI misc: Validate blocks are smaller than size limit misc: Restructure source files
2019-07-21zstd: update to 1.4.1.wiz2-7/+7
v1.4.1 bug: Fix data corruption in niche use cases by @terrelln (#1659) bug: Fuzz legacy modes, fix uncovered bugs by @terrelln (#1593, #1594, #1595) bug: Fix out of bounds read by @terrelln (#1590) perf: Improve decode speed by ~7% @mgrice (#1668) perf: Slightly improved compression ratio of level 3 and 4 (ZSTD_dfast) by @cyan4973 (#1681) perf: Slightly faster compression speed when re-using a context by @cyan4973 (#1658) perf: Improve compression ratio for small windowLog by @cyan4973 (#1624) perf: Faster compression speed in high compression mode for repetitive data by @terrelln (#1635) api: Add parameter to generate smaller dictionaries by @tyler-tran (#1656) cli: Recognize symlinks when built in C99 mode by @felixhandte (#1640) cli: Expose cpu load indicator for each file on -vv mode by @ephiepark (#1631) cli: Restrict read permissions on destination files by @chungy (#1644) cli: zstdgrep: handle -f flag by @felixhandte (#1618) cli: zstdcat: follow symlinks by @vejnar (#1604) doc: Remove extra size limit on compressed blocks by @felixhandte (#1689) doc: Fix typo by @yk-tanigawa (#1633) doc: Improve documentation on streaming buffer sizes by @cyan4973 (#1629) build: CMake: support building with LZ4 @leeyoung624 (#1626) build: CMake: install zstdless and zstdgrep by @leeyoung624 (#1647) build: CMake: respect existing uninstall target by @j301scott (#1619) build: Make: skip multithread tests when built without support by @michaelforney (#1620) build: Make: Fix examples/ test target by @sjnam (#1603) build: Meson: rename options out of deprecated namespace by @lzutao (#1665) build: Meson: fix build by @lzutao (#1602) build: Visual Studio: don't export symbols in static lib by @scharan (#1650) build: Visual Studio: fix linking by @absotively (#1639) build: Fix MinGW-W64 build by @myzhang1029 (#1600) misc: Expand decodecorpus coverage by @ephiepark (#1664)
2019-05-01zstd: update to 1.4.0.wiz3-12/+12
v1.4.0 perf: Improve level 1 compression speed in most scenarios by 6% by @gbtucker and @terrelln api: Move the advanced API, including all functions in the staging section, to the stable section api: Make ZSTD_e_flush and ZSTD_e_end block for maximum forward progress api: Rename ZSTD_CCtxParam_getParameter to ZSTD_CCtxParams_getParameter api: Rename ZSTD_CCtxParam_setParameter to ZSTD_CCtxParams_setParameter api: Don't export ZSTDMT functions from the shared library by default api: Require ZSTD_MULTITHREAD to be defined to use ZSTDMT api: Add ZSTD_decompressBound() to provide an upper bound on decompressed size by @shakeelrao api: Fix ZSTD_decompressDCtx() corner cases with a dictionary api: Move ZSTD_getDictID_*() functions to the stable section api: Add ZSTD_c_literalCompressionMode flag to enable or disable literal compression by @terrelln api: Allow compression parameters to be set when a dictionary is used api: Allow setting parameters before or after ZSTD_CCtx_loadDictionary() is called api: Fix ZSTD_estimateCStreamSize_usingCCtxParams() api: Setting ZSTD_d_maxWindowLog to 0 means use the default cli: Ensure that a dictionary is not used to compress itself by @shakeelrao cli: Add --[no-]compress-literals flag to enable or disable literal compression doc: Update the examples to use the advanced API doc: Explain how to transition from old streaming functions to the advanced API in the header build: Improve the Windows release packages build: Improve CMake build by @hjmjohnson build: Build fixes for FreeBSD by @lwhsu build: Remove redundant warnings by @thatsafunnyname build: Fix tests on OpenBSD by @bket build: Extend fuzzer build system to work with the new clang engine build: CMake now creates the libzstd.so.1 symlink build: Improve Menson build by @lzutao misc: Fix symbolic link detection on FreeBSD misc: Use physical core count for -T0 on FreeBSD by @cemeyer misc: Fix zstd --list on truncated files by @kostmo misc: Improve logging in debug mode by @felixhandte misc: Add CirrusCI tests by @lwhsu misc: Optimize dictionary memory usage in corner cases misc: Improve the dictionary builder on small or homogeneous data misc: Fix spelling across the repo by @jsoref
2019-01-02zstd: updated to 1.3.8adam3-14/+14
Zstandard v1.3.8 perf: better decompression speed on large files (+7%) and cold dictionaries (+15%) perf: slightly better compression ratio at high compression modes api : finalized advanced API, last stage before "stable" status api : new --rsyncable mode api : support decompression of empty frames into NULL (used to be an error) build: new set of build macros to generate a minimal size decoder build: fix compilation on MIPS32 build: fix compilation with multiple -arch flags build: highly upgraded meson build build: improved buck support build: fix cmake script : can create debug build build: Makefile : grep works on both colored consoles and systems without color support build: fixed zstd-pgo target cli : support ZSTD_CLEVEL environment variable cli : --no-progress flag, preserving final summary cli : ensure destination file is not source file cli : clearer error messages, notably when input file not present doc : clarified zstd_compression_format.md misc: fixed zstdgrep, returns 1 on failure misc: NEWS renamed as CHANGELOG, in accordance with fb.oss policy
2018-10-22zstd: updated to 1.3.7adam6-17/+98
Zstandard v1.3.7 perf: slightly better decompression speed on clang (depending on hardware target) fix: ratio for dictionary compression at levels 9 and 10, reported by @indygreg build: no longer build backtrace by default in release mode; restrict further automatic mode build: control backtrace support through build macro BACKTRACE misc: added man pages for zstdless and zstdgrep, by @samrussell
2018-10-17zstd: Fix build on SunOS. Requires GNU grep.jperkin3-3/+16
2018-10-07zstd: updated to 1.3.6adam4-21/+21
Zstandard v1.3.6 release is focused on intensive dictionary compression for database scenarios. This is a new environment we are experimenting. The success of dictionary compression on small data, of which databases tend to store plentiful, led to increased adoption, and we now see scenarios where literally thousands of dictionaries are being used simultaneously, with permanent generation or update of new dictionaries.
2018-07-03zstd: updated to 1.3.5adam4-19/+33
Zstandard v1.3.5 is a maintenance release focused on dictionary compression performance.
2018-04-02zstd: updated to 1.3.4adam2-9/+8
The v1.3.4 release of Zstandard is focused on performance, and offers nice speed boost in most scenarios.
2017-12-21zstd: updated to 1.3.3adam2-9/+11
1.3.3: perf: improved zstd_opt strategy (levels 16-19) fix : bug 944 : multithreading with shared ditionary and large data cli : fix : content size written in header by default cli : fix : improved LZ4 format support cli : new : hidden command -b -S, to benchmark multiple files and generate one result per file api : change : when setting pledgedSrcSize, use ZSTD_CONTENTSIZE_UNKNOWN macro value to mean "unknown" api : fix : support large skippable frames api : fix : re-using context could result in suboptimal block size in some corner case scenarios api : fix : streaming interface was adding a useless 3-bytes null block to small frames build: fix : compilation under rhel6 and centos6 build: added check target build: improved meson support
2017-10-20archivers/zstd: non-redistributable distfile has been fixed.joerg1-5/+1
2017-10-20zstd: update to 1.3.2adam4-22/+22
v1.3.2 new : long range mode, using --long command new : ability to generate and decode magicless frames changed : maximum nb of threads reduced to 200, to avoid address space exhaustion in 32-bits mode fix : multi-threading compression works with custom allocators fix : ZSTD_sizeof_CStream() was over-evaluating memory usage fix : a rare compression bug when compression generates very large distances and bunch of other conditions (only possible at --ultra -22) fix : 32-bits build can now decode large offsets (levels 21+) cli : added LZ4 frame support by default cli : improved --list output cli : new : can split input file for dictionary training, using command -B# cli : new : clean operation artefact on Ctrl-C interruption cli : fix : do not change /dev/null permissions when using command -t with root access cli : fix : write file size in header in multiple-files mode api : added macro ZSTD_COMPRESSBOUND() for static allocation api : experimental : new advanced decompression API api : fix : sizeof_CCtx() used to over-estimate build: fix : no-multithread variant compiles without pool.c dependency build: better compatibility with reproducible builds example : added streaming_memory_usage license : changed /examples license to BSD + GPLv2 license : fix a few header files to reflect new license
2017-08-24Added gnu-gpl-v2 to LICENSEadam1-2/+2
2017-08-21Zstandard v1.3.1adam2-8/+8
New license : BSD + GPLv2 perf: substantially decreased memory usage in Multi-threading mode perf: Multi-threading supports up to 256 threads. Cap at 256 when more are requested cli : improved and fixed --list command cli : command -vV lists supported formats build : fixed binary variants build : fix Visual compilation for non x86/x64 targets API exp : breaking change : ZSTD_getframeHeader() provides more information API exp : breaking change : pinned down values of error codes doc : fixed huffman example new : contrib/adaptive-compression, I/O driven compression strength new : contrib/long_distance_matching updated : contrib/linux-kernel
2017-07-23fix pkglint warning about RESTRICTEDnros1-2/+2
2017-07-23Set zstd to RESTRICTED since its examples are not redistributablenros1-1/+5
2017-07-22v1.3.0adam4-22/+25
cli : new : `--list` command, by Paul Cruz cli : changed : xz/lzma support enabled by default cli : changed : `-t *` continue processing list after a decompression error API : added : ZSTD_versionString() API : promoted to stable status : ZSTD_getFrameContentSize(), by Sean Purcell API exp : new advanced API : ZSTD_compress_generic(), ZSTD_CCtx_setParameter() API exp : new : API for static or external allocation : ZSTD_initStatic?Ctx() API exp : added : ZSTD_decompressBegin_usingDDict(), requested by Guy Riddle API exp : clarified memory estimation / measurement functions. API exp : changed : strongest strategy renamed ZSTD_btultra, fastest strategy ZSTD_fast set to 1 tools : decodecorpus can generate random dictionary-compressed samples, by Paul Cruz new : contrib/seekable_format, demo and API, by Sean Purcell changed : contrib/linux-kernel, updated version and license, by Nick Terrell
2017-04-20Needs zlib. Use ${INSTALL}. Fix "install" target. Now works on SunOS.jperkin3-2/+27
2017-04-11Update archivers/zstd to 1.1.4mef2-7/+9
------------------------------- v1.1.4 cli : new : can compress in *.gz format, using --format=gzip command, by Przemyslaw Skibinski cli : new : advanced benchmark command --priority=rt cli : fix : write on sparse-enabled file systems in 32-bits mode, by @ds77 cli : fix : --rm remains silent when input is stdin cli : experimental : xzstd, with support for xz/lzma decoding, by Przemyslaw Skibinski speed : improved decompression speed in streaming mode for single shot scenarios (+5%) memory : DDict (decompression dictionary) memory usage down from 150 KB to 20 KB arch : 32-bits variant able to generate and decode very long matches (>32 MB), by Sean Purcell API : new : ZSTD_findFrameCompressedSize(), ZSTD_getFrameContentSize(), ZSTD_findDecompressedSize() API : changed : dropped support of legacy versions <= v0.3 (can be changed by modifying ZSTD_LEGACY_SUPPORT value) build: new: meson build system in contrib/meson, by Dima Krasner build: improved cmake script, by @Majlen build: added -Wformat-security flag, as recommended by Padraig Brady doc : new : educational decoder, by Sean Purcell (pkgsrc changes) + MAKE_JOBS_SAFE= no
2017-03-08Add bl3.mk file.wiz1-0/+12
2017-02-22Updated zstd to 1.1.3.wiz3-7/+26
v1.1.3 cli : zstd can decompress .gz files (can be disabled with `make zstd-nogz` or `make HAVE_ZLIB=0`) cli : new : experimental target `make zstdmt`, with multi-threading support cli : new : improved dictionary builder "cover" (experimental), by Nick Terrell cli : new : advanced commands for detailed parameters, by Przemyslaw Skibinski cli : fix zstdless on Mac OS-X, by Andrew Janke cli : fix #232 "compress non-files" dictBuilder : improved dictionary generation quality, thanks to Nick Terrell API : new : lib/compress/ZSTDMT_compress.h multithreading API (experimental) API : new : ZSTD_create?Dict_byReference(), requested by Bartosz Taudul API : new : ZDICT_finalizeDictionary() API : fix : ZSTD_initCStream_usingCDict() properly writes dictID into frame header, by Gregory Szorc (#511) API : fix : all symbols properly exposed in libzstd, by Nick Terrell build : support for Solaris target, by Przemyslaw Skibinski doc : clarified specification, by Andrew Purcell
2016-12-16Updated archivers/zstd to 1.1.2mef3-8/+10
------------------------------- v1.1.2 API : streaming : decompression : changed : automatic implicit reset when chain-decoding new frames without init API : experimental : added : dictID retrieval functions, and ZSTD_initCStream_srcSize() API : zbuff : changed : prototypes now generate deprecation warnings lib : improved : faster decompression speed at ultra compression settings and 32-bits mode lib : changed : only public ZSTD_ symbols are now exposed lib : changed : reduced usage of stack memory lib : fixed : several corner case bugs, by Nick Terrell cli : new : gzstd, experimental version able to decode .gz files, by Przemyslaw Skibinski cli : new : preserve file attributes cli : new : added zstdless and zstdgrep tools cli : fixed : status displays total amount decoded, even for file consisting of multiple frames (like pzstd) cli : fixed : zstdcat zlib_wrapper : added support for gz* functions, by Przemyslaw Skibinski install : better compatibility with FreeBSD, by Dimitry Andric source tree : changed : zbuff source files moved to lib/deprecated
2016-12-04Updated zstd to 1.1.1.wiz3-8/+9
v1.1.1 New : command -M#, --memory=, --memlimit=, --memlimit-decompress= to limit allowed memory consumption New : doc/zstd_manual.html, by Przemyslaw Skibinski Improved : slightly better compression ratio at --ultra levels (>= 20) Improved : better memory usage when using streaming compression API, thanks to @Rogier-5 report Added : API : ZSTD_initCStream_usingCDict(), ZSTD_initDStream_usingDDict() (experimental section) Added : example/multiple_streaming_compression.c Changed : zstd_errors.h is now installed within /include (and replaces errors_public.h) Updated man page Fixed : zstd-small, zstd-compress and zstd-decompress compilation targets
2016-10-04Updated zstd to 1.1.0.wiz7-310/+7
v1.1.0 New : contrib/pzstd, parallel version of zstd, by Nick Terrell added : NetBSD install target (#338) Improved : speed for batches of small files Improved : speed of zlib wrapper, by Przemyslaw Skibinski Changed : libzstd on Windows supports legacy formats, by Christophe Chevalier Fixed : CLI -d output to stdout by default when input is stdin (#322) Fixed : CLI correctly detects console on Mac OS-X Fixed : CLI supports recursive mode `-r` on Mac OS-X Fixed : Legacy decoders use unified error codes, reported by benrg (#341), fixed by Przemyslaw Skibinski Fixed : compatibility with OpenBSD, reported by Juan Francisco Cantero Hurtado (#319) Fixed : compatibility with Hurd, by Przemyslaw Skibinski (#365) Fixed : zstd-pgo, reported by octoploid (#329)
2016-09-04Add upstream pull request.wiz4-7/+10
2016-09-04Import zstd-1.0.0 as archivers/zstd.wiz9-0/+342
Zstd, short for Zstandard, is a fast lossless compression algorithm, targeting real-time compression scenarios at zlib-level and better compression ratios.