summaryrefslogtreecommitdiff
path: root/databases
AgeCommit message (Collapse)AuthorFilesLines
2017-05-31LDAP EXOP patch fixmanu1-1/+2
A code repetition caused add and modify operations to be done twice.
2017-05-29Pullup ticket #5434 - requested by sevanbsiegert23-48/+76
databases/postgresql92: security fix databases/postgresql93: security fix databases/postgresql94: security fix databases/postgresql95: security fix databases/postgresql96: security fix Revisions pulled up: - databases/postgresql92-docs/PLIST 1.21 - databases/postgresql92-server/PLIST 1.13 - databases/postgresql92/Makefile.common 1.28 - databases/postgresql92/distinfo 1.23 - databases/postgresql93-docs/PLIST 1.18 - databases/postgresql93-server/PLIST 1.11 - databases/postgresql93/Makefile.common 1.24 - databases/postgresql93/distinfo 1.23 - databases/postgresql94-client/PLIST 1.3 - databases/postgresql94-docs/PLIST 1.13 - databases/postgresql94-server/PLIST 1.8 - databases/postgresql94/Makefile.common 1.16 - databases/postgresql94/distinfo 1.15 - databases/postgresql95-client/PLIST 1.4 - databases/postgresql95-docs/PLIST 1.7 - databases/postgresql95-server/PLIST 1.6 - databases/postgresql95/Makefile.common 1.9 - databases/postgresql95/distinfo 1.8 - databases/postgresql96-client/PLIST 1.2 - databases/postgresql96-docs/PLIST 1.3 - databases/postgresql96-server/PLIST 1.3 - databases/postgresql96/Makefile.common 1.3 - databases/postgresql96/distinfo 1.4 --- Module Name: pkgsrc Committed By: adam Date: Fri May 12 19:37:55 UTC 2017 Modified Files: pkgsrc/databases/postgresql92: Makefile.common distinfo pkgsrc/databases/postgresql92-docs: PLIST pkgsrc/databases/postgresql92-server: PLIST pkgsrc/databases/postgresql93: Makefile.common distinfo pkgsrc/databases/postgresql93-docs: PLIST pkgsrc/databases/postgresql93-server: PLIST pkgsrc/databases/postgresql94: Makefile.common distinfo pkgsrc/databases/postgresql94-client: PLIST pkgsrc/databases/postgresql94-docs: PLIST pkgsrc/databases/postgresql94-server: PLIST pkgsrc/databases/postgresql95: Makefile.common distinfo pkgsrc/databases/postgresql95-client: PLIST pkgsrc/databases/postgresql95-docs: PLIST pkgsrc/databases/postgresql95-server: PLIST pkgsrc/databases/postgresql96: Makefile.common distinfo pkgsrc/databases/postgresql96-client: PLIST pkgsrc/databases/postgresql96-docs: PLIST pkgsrc/databases/postgresql96-server: PLIST Log Message: The PostgreSQL Global Development Group has released an update to all supported versions of our database system, including 9.6.3, 9.5.7, 9.4.12, 9.3.17, and 9.2.21. This release fixes three security issues. It also patches a number of other bugs reported over the last three months. Users who use the PGREQUIRESSL environment variable to control connections, and users who rely on security isolation between database users when using foreign servers, should update as soon as possible. Other users should plan to update at the next convenient downtime.
2017-05-01Pullup ticket #5383 - requested by sevanbsiegert2-1/+15
databases/leveldb: build fix for NetBSD Revisions pulled up: - databases/leveldb/distinfo 1.2 - databases/leveldb/patches/patch-build__detect__platform 1.1 --- Module Name: pkgsrc Committed By: joerg Date: Thu Apr 27 17:04:56 UTC 2017 Modified Files: pkgsrc/databases/leveldb: distinfo Added Files: pkgsrc/databases/leveldb/patches: patch-build__detect__platform Log Message: Don't hard-code -lgcc_s on NetBSD.
2017-04-17Pullup ticket #5301 - requested by sevanbsiegert2-4/+15
databases/sqlite: build fix Revisions pulled up: - databases/sqlite/distinfo 1.25 - databases/sqlite/patches/patch-Makefile.in 1.2 --- Module Name: pkgsrc Committed By: khorben Date: Sun Apr 16 20:27:09 UTC 2017 Modified Files: pkgsrc/databases/sqlite: distinfo pkgsrc/databases/sqlite/patches: patch-Makefile.in Log Message: Avoid a warning while generating config.h No functional change intended.
2017-04-04Pullup ticket #5236 - requested by sevanbsiegert1-2/+2
databases/cdb: remove restriction Revisions pulled up: - databases/cdb/Makefile 1.24 --- Module Name: pkgsrc Committed By: schmonz Date: Tue Apr 4 07:29:40 UTC 2017 Modified Files: pkgsrc/databases/cdb: Makefile Log Message: DJB_RESTRICTED=NO. From https://cr.yp.to/distributors.html: 2009.07.21: I hereby place the cdb package (in particular, cdb- 0.75.tar.gz, with MD5 checksum 81fed54d0bde51b147dd6c20cdb92d51) into the public domain. The package is no longer copyrighted.
2017-03-23Extend SHA512 checksums to various files I have on my local distfilejoerg3-3/+8
mirror.
2017-03-21Amend comment to patch.maya2-4/+4
explain it's for a netbsd-specific error.
2017-03-20Updated py-psycopg2 to 2.7.1.wiz2-7/+7
What's new in psycopg 2.7.1 ^^^^^^^^^^^^^^^^^^^^^^^^^^^ - Ignore `!None` arguments passed to `~psycopg2.connect()` and `~psycopg2.extensions.make_dsn()` (:ticket:`#517`). - OpenSSL upgraded from major version 0.9.8 to 1.0.2 in the Linux wheel packages (:ticket:`#518`). - Fixed build with libpq versions < 9.3 (:ticket:`#520`).
2017-03-20Version 1.13 - 2017-03-11adam9-19/+38
* gdbm_fetch, gdbm_firstkey, and gdbm_nextkey behavior If the requested key was not found, these functions return datum with dptr pointing to NULL and set gdbm_errno to GDBM_ITEM_NOT_FOUND (in prior releases, gdbm_errno was set to GDBM_NO_ERROR), If an error occurred, dptr is set to NULL, and gdbm_errno to the error code. In any case gdbm_errno is guaranteed to have meaningful value upon return. * Error handling In previous versions of GDBM, fatal errors (such as write error while storing the key/data pair or bucket) caused immediate termination of the program via call to exit(3). This is no longer the case. Starting from this version, if a fatal error occurrs while modifying the database file, that database is marked as needing recovery and gdbm_errno is set to GDBM_NEED_RECOVERY. Calls to any GDBM functions, except gdbm_recover, will then return immediately with the same error code. The function gdbm_recover examines the database file and fixes eventual inconsistencies. Upon successful return it clears the error state and makes the database operational again. For backward compatibility, the fatal_func argument to gdbm_open is retained and its functionality is not changed. If it is not NULL, the new error handling procedures are disabled, the function it points to will be called upon fatal errors. When it returns, exit(1) will be called. * Per-database error codes In addition to gdbm_error global variable, the most recent error state is saved in the GDBM_FILE structure. This facilitates error handling when operating multiple GDBM databases simultaneously.
2017-03-16mysql57-server: fix compilation on NetBSD. fix -fpermissive error.maya4-1/+70
netbsd xdrproc_t takes 2 arguments, most others are variadic, os x is 3. ifdef __NetBSD__ to match the signature. PR pkg/52062
2017-03-14+ leveldb.wiz1-1/+2
2017-03-14Import leveldb-1.20 as databases/leveldb.wiz7-0/+134
Packaged for wip by Mike M. Volokhov and myself. LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
2017-03-12Update php-redis3 to 3.1.1.taca2-10/+8
phpredis 3.1.1 * Additional test updates for 32 bit systems (@remicollet) * ARM rounding issue in tests (@remicollet) * Use new zend_list_close instead of zend_list_delete when reconnecting. * Refactoring of redis_boolean_response_impl and redis_sock_write (@yatsukhnenko) phpredis 3.1.1 This release contains mostly fixes for issues introduced when merging the php 5 and 7 codebase into a single branch. * Fixed a segfault in igbinary serialization (@yatsukhnenko) * Restore 2.2.8/3.0.0 functionality to distinguish between an error and simply empty session data. (@remicollet) * Fix double to string conversion function (@yatsukhnenko) * Use PHP_FE_END definition when available (@remicollet) * Fixed various 'static function declared but not used' warnings * Fixes to various calls which were typecasting pointers to the wrong size. (@remicollet) * Added php session unit test (@yatsukhnenko) * Added explicit module dependancy for igbinary (@remicollet) * Added phpinfo serialization information (@remicollet) phpredis 3.1.1RC2 * Additional test updates for 32 bit systems (@remicollet) * ARM rounding issue in tests (@remicollet) * Use new zend_list_close instead of zend_list_delete when reconnecting. * Refactoring of redis_boolean_response_impl and redis_sock_write (@yatsukhnenko) phpredis 3.1.1.RC1 This release contains mostly fixes for issues introduced when merging the php 5 and 7 codebase into a single branch. * Fixed a segfault in igbinary serialization (@yatsukhnenko) * Restore 2.2.8/3.0.0 functionality to distinguish between an error and simply empty session data. (@remicollet) * Fix double to string conversion function (@yatsukhnenko) * Use PHP_FE_END definition when available (@remicollet) * Fixed various 'static function declared but not used' warnings * Fixes to various calls which were typecasting pointers to the wrong size. (@remicollet) * Added php session unit test (@yatsukhnenko) * Added explicit module dependancy for igbinary (@remicollet) * Added phpinfo serialization information (@remicollet) phpredis 3.1.0 In this version of phpredis codebase was unified to work with all versions of php \o/ Also many bug fixes and some improvements has been made. --- Improvements --- * Support the client to Redis Cluster just having one master (andyli) [892e5646] * Allow both long and strings that are longs for zrangebyscore offset/limit (Michael Grunder) [bdcdd2aa] * Process NX|XX, CH and INCR options in zAdd command (Pavlo Yatsukhnenko) [71c9f7c8] --- Fixes --- * Fix incrby/decrby for large integers (Michael Grunder) [3a12758a] * Use static declarations for spl_ce_RuntimeException decl (Jeremy Mikola) [a9857d69] * Fixed method call problem causes session handler to display two times (ZiHang Gao) [24f86c49] * psetex method returns '+OK' on success, not true (sitri@ndxbn) [afcd8445] * Fix integer overflow for long (>32bit) increments in hIncrBy (iyesin) [58e1d799] * Move zend_object handler to the end (Michael Grunder) [34107966] * Using setOption on redis array causes immediate connection (Pavlo Yatsukhnenko) [f1a85b38]
2017-03-12Update php-redis to 2.2.8.taca2-7/+7
phpredis 2.2.8 The main improvement in this version of phpredis is support for Redis Cluster. This version of phpredis is intended for versions of php older than 7. In addition there have been many bug fixes and improvements to non cluster related commands, which are listed below. I've attempted to include everyone who contribued to the project in each fix description and have included names or github user ids. Thanks to everyone for submitting bug reports and pull requests. A special thanks to Remi Collet for helping with any and all packaging related issues \o/ --- Improvements --- * Added randomization to our seed nodes to balance which instance is used to map the keyspace (Vitaliy Stepanyuk) [32eb1c5f] * Added support for IPv6 addresses --- Fixes --- * PHP liveness checking workaround (Shafreeck Sea) [c18d58b9] * Various documentation and code formatting and style fixes (ares333, sanpili, Bryan Nelson, linfangrong, Romero Malaquias, Viktor Sz?pe) * Fix scan reply processing to use long instead of int to avoid overflow (mixiaojiong). * Fix potential segfault in Redis Cluster session storage (Sergei Lomakov) [cc15aae] * Fixed memory leak in discard function [17b1f427] * Sanity check for igbinary unserialization (Maurus Cuelenaere) [3266b222, 5528297a] * Fix segfault occuring from unclosed socket connection for Redis Cluster (CatKang) [04196aee] * Case insensitive zRangeByScore options * Fixed dreaded size_t vs long long compiler warning
2017-03-12Release 1.1.6 continues to provide bug fixes and some new features within ↵adam2-7/+7
the 1.1 series. As we begin to lead into the development phase for 1.2 and solidify the 1.1 series as "done", additional behavioral improvements will more likely to be targeted at 1.2 rather than 1.1. Nevertheless, 1.1.6 includes a few fairly major behavioral improvements in the area of performance; some significant performance issues within the "joined eager loading" functionality were identified and repaired, which should cut the Python-level latency for such a query roughly in half, as well as an unnecessary SELECT which could emit when using the "eager defaults" feature was repaired.
2017-03-11Update ruby-sqlite3 to 1.3.13.taca2-9/+8
* Fix flags declaration in case of no OPEN_V2. And other fixes for Windows.
2017-03-11Update ruby-sequel to 4.44.0.taca3-8/+15
=== 4.44.0 (2017-03-01) * Add where_all, where_each, where_single_value model dataset methods, optimized for frozen datasets (jeremyevans) * Add eager method to dataset_module (jeremyevans) * Add implicit_subquery extension, for implicitly using a subquery for datasets using raw SQL when calling dataset methods that modify SQL (jeremyevans) * Make Dataset#from_self keep the columns from the current dataset if present (jeremyevans) * Add implicit_subquery extension, implicitly using subqueries for dataset methods if the current dataset uses raw SQL (jeremyevans) * Make SQL::ValueList#inspect show that it is a value list (jeremyevans) * Make LiteralString#inspect show that it is a literal string (jeremyevans) * Make Model::Associations::AssociationReflection#inspect show reflection class and guess at association definition line (jeremyevans) * Make SQLTime#inspect show it is an SQLTime instance, and only the time component (jeremyevans) * Make SQL::Blob#inspect show that it is a blob, the number of bytes, and some or all of the content (jeremyevans) * Make plugins not modify the constant namespace for the model class that uses them (jeremyevans) * Do not modify encoding of SQL::Blob instances in force_encoding plugin (jeremyevans) * Add Model.freeze_descendents to subclasses plugin, for easier finalizing associations/freezing of descendent classes (jeremyevans) * Add Model.finalize_associations method for finalizing associations, speeding up some association reflections methods almost 10x (jeremyevans) * Implement Model.freeze such that it can be used in production (jeremyevans) * Recognize another disconnect error in the jdbc/as400 adapter (perlun) (#1300) * Correctly handle conversion of false values when typecasting PostgreSQL arrays (mistoo) (#1299) * Raise error if the postgres adapter attempts to load an incompatible version of sequel_pg (mahlonsmith) (#1298) * Fix jdbc adapter so basic_type_convertor_map is not shared between instances, work with Database#freeze (jeremyevans) === 4.43.0 (2017-02-01) * Make jdbc/postgresql adapter work if pg_hstore extension is loaded first (jeremyevans) (#1296) * Make prepared_statements_associations plugin work correctly on some instance specific associations (jeremyevans) * Make prepared_statements plugin not use prepared statements in cases where it is probably slower (jeremyevans) * Optimize Model#refresh similar to Model.with_pk (jeremyevans) * Make Database#extension not attempt to load the same extension more than once (jeremyevans) * Implement Database#freeze such that it can be used in production (jeremyevans) * Freeze enum_labels in the pg_enum extension (jeremyevans) * Handle Database#type_supported? thread-safely on PostgreSQL (jeremyevans) * Handle primary_key_sequences thread-safely on Oracle (jeremyevans) * Handle sharding better when using mysql2 native prepared statements (jeremyevans) * Use thread-safe incrementor for mock adapter autoid handling (jeremyevans) * Make Model#freeze not freeze associations hash until after validating the model instance (jeremyevans) * Make prepared_statements_associations plugin work correctly when model object explicitly specifies server to use when also using sharding plugin (jeremyevans) * Make prepared_statements_with_pk plugin work correctly when dataset explicitly specifies server to use (jeremyevans) * Make prepared_statements plugin work correctly when model object explicitly specifies server to use (jeremyevans) * Make dataset_module inherited to subclasses when using the single_table_inheritance plugin (jeremyevans) (#1284) * Support use of SQLite result codes in the jdbc-sqlite adapter, if the jdbc sqlite driver supports them (flash-gordon, jeremyevans) (#1283) * Make timestamp migrator handle key length limitations when using MySQL with InnoDB engine and utf8mb4 charset default (jeremyevans) (#1282)
2017-03-11Update ruby-pg to 0.20.0taca2-8/+7
== v0.20.0 [2017-03-10] Michael Granger <ged@FaerieMUD.org> Enhancements: - Update error codes to PostgreSQL-9.6 - Update Windows binary gems to Ruby-2.4, PostgreSQL 9.6.1 and OpenSSL 1.0.2j. - Add support for RubyInstaller2 to Windows binary gems. Bugfixes: - Use secure JSON methods for JSON (de)serialisation. #248 - Fix Result#inspect on a cleared result. - Fix test case that failed on Ruby-2.4. #255 Documentation fixes: - Talk about Integer instead of Fixnum. - Fix method signature of Coder#encode.
2017-03-05Updated py-sqlparse to 0.2.3.wiz2-7/+7
Release 0.2.3 (Mar 02, 2017) ---------------------------- Enhancements * New command line option "--encoding" (by twang2218, pr317). * Support CONCURRENTLY keyword (issue322, by rowanseymour). Bug Fixes * Fix some edge-cases when parsing invalid SQL statements. * Fix indentation of LIMIT (by romainr, issue320). * Fix parsing of INTO keyword (issue324). Internal Changes * Several improvements regarding encodings.
2017-03-05Updated py-psycopg2 to 2.7.wiz3-10/+30
What's new in psycopg 2.7 ------------------------- New features: - Added `~psycopg2.sql` module to generate SQL dynamically (:ticket:`#308`). - Added :ref:`replication-support` (:ticket:`#322`). Main authors are Oleksandr Shulgin and Craig Ringer, who deserve a huge thank you. - Added `~psycopg2.extensions.parse_dsn()` and `~psycopg2.extensions.make_dsn()` functions (:tickets:`#321, #363`). `~psycopg2.connect()` now can take both *dsn* and keyword arguments, merging them together. - Added `~psycopg2.__libpq_version__` and `~psycopg2.extensions.libpq_version()` to inspect the version of the ``libpq`` library the module was compiled/loaded with (:tickets:`#35, #323`). - The attributes `~connection.notices` and `~connection.notifies` can be customized replacing them with any object exposing an `!append()` method (:ticket:`#326`). - Adapt network types to `ipaddress` objects when available. When not enabled, convert arrays of network types to lists by default. The old `!Inet` adapter is deprecated (:tickets:`#317, #343, #387`). - Added `~psycopg2.extensions.quote_ident()` function (:ticket:`#359`). - Added `~connection.get_dsn_parameters()` connection method (:ticket:`#364`). - `~cursor.callproc()` now accepts a dictionary of parameters (:ticket:`#381`). - Give precedence to `!__conform__()` over superclasses to choose an object adapter (:ticket:`#456`). - Using Python C API decoding functions and codecs caching for faster unicode encoding/decoding (:ticket:`#473`). - `~cursor.executemany()` slowness addressed by `~psycopg2.extras.execute_batch()` and `~psycopg2.extras.execute_values()` (:ticket:`#491`). - Added ``async_`` as an alias for ``async`` to support Python 3.7 where ``async`` will become a keyword (:ticket:`#495`). - Unless in autocommit, do not use :sql:`default_transaction_*` settings to control the session characteristics as it may create problems with external connection pools such as pgbouncer; use :sql:`BEGIN` options instead (:ticket:`#503`). - `~connection.isolation_level` is now writable and entirely separated from `~connection.autocommit`; added `~connection.readonly`, `~connection.deferrable` writable attributes. Bug fixes: - Fixed error caused by missing decoding `~psycopg2.extras.LoggingConnection` (:ticket:`#483`). - Fixed integer overflow in :sql:`interval` seconds (:ticket:`#512`). Other changes: - Dropped support for Python 2.5 and 3.1. - Dropped support for client library older than PostgreSQL 9.1 (but older server versions are still supported). - `~connection.isolation_level` doesn't read from the database but will return `~psycopg2.extensions.ISOLATION_LEVEL_DEFAULT` if no value was set on the connection. - Empty arrays no more converted into lists if they don't have a type attached (:ticket:`#506`)
2017-03-01Update databases/elasticsearch to 5.2.2.fhajny3-24/+24
5.2.2 - The request circuit breaker, which track the size of in-flight requests, was not decrementing its counter when the connection was closed by the client before the response could be returned. This could result in no further requests being accepted until the node has been restarted. All users should upgrade to take advantage of this bug fix. - The cgroup functionality (for reading OS stats for containers) had a bug in the regex for parsing /proc/self/cgroup which prevented nodes with multiple hierarchies from starting up. - Requests which have been delayed by a shard lock might be executed later on a different thread which lacks the request context, resulting in the requests being incorrectly rejected as unauthorised. - Removal of an undocumented syntax for include/exclude parameters in the terms aggregation broke certain aggregations in Kibana. 5.2.1 - When stored fields are configured with best_compression, we rely on JVM garbage collection to reclaim Deflater/Inflater instances. However these classes use little JVM memory but may use significant native memory, so if may happen that the OS runs out of native memory before the JVM collects these unreachable Deflater/Inflater instances. - Certain queries can hold a reference to the IndexReader that was used to build them. When these queries are cached, this reference causes Lucene to hold onto segments long after they should have been deleted.
2017-02-28Recursive revbump from graphics/libwebpryoon2-4/+4
2017-02-27Update databases/py-cassandra-driver to 3.8.0.fhajny4-28/+11
Features - Quote index names in metadata CQL generation (PYTHON-616) - On column deserialization failure, keep error message consistent between python and cython (PYTHON-631) - TokenAwarePolicy always sends requests to the same replica for a given key (PYTHON-643) - Added cql types to result set (PYTHON-648) - Add __len__ to BatchStatement (PYTHON-650) - Duration Type for Cassandra (PYTHON-655) - Send flags with PREPARE message in v5 (PYTHON-684) Bug Fixes - Potential Timing issue if application exits prior to session pool initialization (PYTHON-636) - "Host X.X.X.X has been marked down" without any exceptions (PYTHON-640) - NoHostAvailable or OperationTimedOut when using execute_concurrent with a generator that inserts into more than one table (PYTHON-642) - ResponseFuture creates Timers and don't cancel them even when result is received which leads to memory leaks (PYTHON-644) - Driver cannot connect to Cassandra version > 3 (PYTHON-646) - Unable to import model using UserType without setuping connection since 3.7 (PYTHON-649) - Don't prepare queries on ignored hosts on_up (PYTHON-669) - Sockets associated with sessions not getting cleaned up on session.shutdown() (PYTHON-673) - Make client timestamps strictly monotonic (PYTHON-676) - cassandra.cqlengine.connection.register_connection broken when hosts=None (PYTHON-692) Other - Create a cqlengine doc section explaining None semantics (PYTHON-623) - Resolve warnings in documentation generation (PYTHON-645) - Cython dependency (PYTHON-686) - Drop Support for Python 2.6 (PYTHON-690)
2017-02-26Update to 1.08wen2-7/+7
Upstream changes: 1.08 Fri Jan 13 21:20:15 CET 2017 Add support for dBASE IV memo type B.
2017-02-24Fix building on systems where alloca.h does not exists, like NetBSD.adam6-16/+69
2017-02-23Add workaround for build issue on Darwin, to be removed in the next update.jperkin1-1/+5
2017-02-23Recursive bump for libzip shlib major bump.wiz1-2/+2
2017-02-20Switch py-dateutils to plain DEPENDS.wiz2-9/+5
It supports both python 2 and 3 nowadays.
2017-02-18Released 2.4.32:adam2-7/+7
Running tests made easier: - python setup.py test - added tox.ini
2017-02-16Add support for Cython>0.24 using an override mechanism in trunk.fhajny3-2/+25
2017-02-14Update databases/py-elasticsearch to 5.2.0.fhajny2-7/+7
5.2.0 (2017-02-12) - The client now automatically sends Content-Type http header set to application/json. If you are explicitly passing in other encoding than json you need to set the header manually. 5.1.0 (2017-01-11) - Fixed sniffing
2017-02-14Update databases/elasticsearch to 5.2.0.fhajny3-35/+35
=== Breaking changes Core:: - Add system call filter bootstrap check === Breaking Java changes Allocation:: - Cluster Explain API uses the allocation process to explain shard allocation decisions Cluster:: - Remove PROTO-based custom cluster state components Ingest:: - Change type of ingest doc meta-data field 'TIMESTAMP' to `Date` Internal:: - Consolidate the last easy parser construction - Introduce XContentParser#namedObject Plugins:: - Plugins: Replace Rest filters with RestHandler wrapper Query DSL:: - Resolve index names in indices_boost Search:: - Cluster search shards improvements: expose ShardId, adjust visibility of some members === Deprecations Java API:: - Deprecate and remove "minimumNumberShouldMatch" in BoolQueryBuilder Shadow Replicas:: - Add a deprecation notice to shadow replicas === New features Analysis:: - Synonym Graph Support (LUCENE-6664) Ingest:: - introduce KV Processor in Ingest Node Mapping:: - Add the ability to set a normalizer on keyword fields. - Add RangeFieldMapper for numeric and date range types === Enhancements Aggregations:: - `value_type` is useful regardless of scripting. - Support for partitioning set of terms Allocation:: - Adds setting level to allocation decider explanations - Improves allocation decider decision explanation messages - Prepares allocator decision objects for use with the allocation explain API Analysis:: - Expose FlattenGraphTokenFilter CRUD:: - Use correct block levels for TRA subclasses Cluster:: - Keep NodeConnectionsService in sync with current nodes in the cluster state - Add a generic way of checking version before serializing custom cluster object - Add validation for supported index version on node join, restore, upgrade & open index - Let ClusterStateObserver only hold onto state that's needed for change detection - Remove mutable status field from cluster state Core:: - Rename bootstrap.seccomp to bootstrap.system_call_filter - Cleanup random stats serialization code - Avoid corruption when deserializing booleans - Reduce memory pressure when sending large terms queries. Discovery:: - Simplify Unicast Zen Ping - Prefer joining node with conflicting transport address when becoming master Ingest:: - add `ignore_missing` flag to ingest plugins - Added ability to remove pipelines via wildcards (#22149) - Enables the ability to inject serialized json fields into root of document - compile ScriptProcessor inline scripts when creating ingest pipelines Internal:: - Remove some more usages of ParseFieldMatcher - Remove some more usages of ParseFieldMatcher - Remove some ParseFieldMatcher usages - Add infrastructure to manage network connections outside of Transport/TransportService - Replace strict parsing mode with response headers assertions - Start using `ObjectParser` for aggs. - Don't output null source node in RecoveryFailedException - ClusterService should expose "applied" cluster states (i.e., remove ClusterStateStatus) Java High Level REST Client:: - Add fromxcontent methods to index response - Add fromXContent() methods for ReplicationResponse - Add parsing method for ElasticsearchException - Add fromXContent method to GetResponse Java REST Client:: - Warn log deprecation warnings received from server Logging:: - Log deleting indices at info level - Log failure to connect to node at info instead of debug Mapping:: - Atomic mapping updates across types - Only update DocumentMapper if field type changes - Better error message when `_parent` isn't an object Network:: - Disable the Netty recycler - Tell Netty not to be unsafe in transport client - Introduce a low level protocol handshake - Detach handshake from connect to node - Reduce number of connections per node depending on the nodes role - Add a connect timeout to the ConnectionProfile to allow per node connect timeouts - Grant Netty permission to read system somaxconn - Remove connectToNodeLight and replace it with a connection profile Packaging:: - Improve the out-of-the-box experience Plugin Discovery EC2:: - Add support for ca-central-1 region to EC2 and S3 plugins - Support for eu-west-2 (London) cloud-aws plugin - Add us-east-2 AWS region - Add setting to set read timeout for EC2 discovery and S3 repository plugins Plugin Ingest GeoIp:: - Cache results of geoip lookups Plugin Lang Painless:: - Improve painless's ScriptException generation Plugins:: - Pass ThreadContext to transport interceptors to allow header modification - Provide helpful error message if a plugin exists - Add shutdown hook for closing CLI commands - Allow plugins to install bootstrap checks Query DSL:: - Un-deprecate fuzzy query - support numeric bounds with decimal parts for long/integer/short/byte datatypes Reindex API:: - Reindex: Better error message for pipeline in wrong place - Timeout improvements for rest client and reindex Scripting:: - Wrap VerifyError in ScriptException - Log ScriptException's xcontent if file script compilation fails Search:: - Move SearchTransportService and SearchPhaseController creation outside of TransportSearchAction constructor - Don't carry ShardRouting around when not needed in AbstractSearchAsyncAction - ShardSearchRequest to take ShardId constructor argument rather than the whole ShardRouting - Use index uuid as key in the alias filter map rather than the index name Settings:: - Speed up filter and prefix settings operations Snapshot/Restore:: - Fixes retrieval of the latest snapshot index blob - Synchronize snapshot deletions on the cluster state Stats:: - Include unindexed field in FieldStats response Task Manager:: - Improve the error message if task and node isn't found - Add descriptions to create snapshot and restore snapshot tasks. - Add proper descriptions to reindex, update-by-query and delete-by-query tasks. === Bug fixes Aggregations:: - Fix scaled_float numeric type in aggregations - Allow terms aggregations on pure boolean scripts. - Fix numeric terms aggregations with includes/excludes and minDocCount=0 - Fix `missing` on aggs on `boolean` fields. - IP range masks exclude the maximum address of the range. - Fix `other_bucket` on the `filters` agg to be enabled if a key is set. Allocation:: - Cannot force allocate primary to a node where the shard already exists - Promote shadow replica to primary when initializing primary fails - Trim in-sync allocations set only when it grows Analysis:: - AsciiFoldingFilter's multi-term component should never preserve the original token. - Pre-built analysis factories do not implement MultiTermAware correctly. CRUD:: - Reject external versioning and explicit version numbers on create Cluster:: - IndicesService handles all exceptions during index deletion Core:: - Streamline foreign stored context restore and allow to perserve response headers - Support negative numbers in readVLong Discovery:: - Close InputStream when receiving cluster state in PublishClusterStateAction - Do not reply to pings from another cluster Engine:: - Close and flush refresh listeners on shard close Exceptions:: - Fixing shard recovery error message to report the number of docs correctly for each node Highlighting:: - Fix FiltersFunctionScoreQuery highlighting Index APIs:: - Ensure shrunk indices carry over version information from its source Ingest:: - fix index out of bounds error in KV Processor - Fixes GrokProcessor's ignorance of named-captures with same name. Inner Hits:: - Inner hits and ignore unmapped Internal:: - Index creation and setting update may not return deprecation logging Java API:: - Don't output empty ext object in SearchSourceBuilder#toXContent Java REST Client:: - Don't use null charset in RequestLogger Mapping:: - The `_all` default mapper is not completely configured. - Fix MapperService.allEnabled(). - Dynamic `date` fields should use the `format` that was used to detect it is a date. - Sub-fields should not accept `include_in_all` parameter - Mappings: Fix get mapping when no indexes exist to not fail in response generation Nested Docs:: - Fix bug in query builder rewrite that ignores the ignore_unmapped option Network:: - Pass `forceExecution` flag to transport interceptor - Ensure new connections won't be opened if transport is closed or closing - Prevent open channel leaks if handshake times out or is interrupted - Execute low level handshake in #openConnection - Properly configure Netty 3 ClientBootstrap when using custom connection profile - Handle connection close / reset events gracefully during handshake - Do not lose host information when pinging - DiscoveryNode and TransportAddress should preserve host information Packaging:: - Another fix for handling of paths on Windows - Fix handling of spaces in Windows paths - Add option to skip kernel parameters on install Percolator:: - Fix NPE in percolator's 'now' range check for percolator queries with range queries Plugin Analysis Stempel:: - Fix thread safety of Stempel's token filter factory Plugin Lang Painless:: - Whitelist some ScriptDocValues in painless - Update Painless Loop Counter to be Higher - Fix some issues with painless's strings - Test fix for def equals in Painless - Fix a VerifyError bug in Painless Plugin Mapper Attachment:: - NPE is raised when defining a non existing type within attachments type Plugin Repository Azure:: - Fixes default chunk size for Azure repositories - readonly on azure repository must be taken into account Query DSL:: - Fix script score function that combines `_score` and weight REST:: - Adds percent-encoding for Location headers Recovery:: - Fix primary relocation for shadow replicas - Don't close store under CancellableThreads - Use a fresh recovery id when retrying recoveries - Allow flush/force_merge/upgrade on shard marked as relocated Reindex API:: - Fix reindex from remote clearing scroll - Fix source filtering in reindex-from-remote - Remove content type detection from reindex-from-remote - Don't close rest client from its callback - Keep context during reindex's retries Scripting:: - Expose `ip` fields as strings in scripts. Search:: - Improve concurrency of ShardCoreKeyMap. - Make `-0` compare less than `+0` consistently. - Fix boost_mode propagation when the function score query builder is rewritten - FiltersAggregationBuilder: rewriting filter queries, the same way as in FilterAggregationBuilder - Fix cross_fields type on multi_match query with synonyms Search Templates:: - SearchTemplateRequest to implement CompositeIndicesRequest Settings:: - Handle spaces in `action.auto_create_index` gracefully - Fix settings diff generation for affix and group settings Snapshot/Restore:: - Gracefully handles pre 2.x compressed snapshots - URLRepository should throw NoSuchFileException to correctly adhere to readBlob contract - Fixes shard level snapshot metadata loading when index-N file is missing Stats:: - Implement stats for geo_point and geo_shape field - Use reader for doc stats - Avoid NPE in NodeService#stats if HTTP is disabled - Add support for "include_segment_file_sizes" in indices stats REST handler Term Vectors:: - Fix `_termvectors` with preference to not hit NPE - Return correct term statistics when a field is not found in a shard === Regressions Core:: - Source filtering: only accept array items if the previous include pattern matches Logging:: - Restores the original default format of search slow log Search:: - Handle specialized term queries in MappedFieldType.extractTerm(Query) === Upgrades Core:: - Upgrade to Lucene 6.4.0 - Update Jackson to 2.8.6 - Upgrade to lucene-6.4.0-snapshot-084f7a0. - Upgrade to lucene-6.4.0-snapshot-ec38570
2017-02-14Update databases/redis to 3.2.8.fhajny2-7/+7
================================================================================ Redis 3.2.8 Released Sun Feb 12 16:11:18 CET 2017 ================================================================================ Two important bug fixes, the first of one is critical: 1. Apparently Jemalloc 4.4.0 may contain a deadlock under particular conditions. See https://github.com/antirez/redis/issues/3799. We reverted back to the previously used Jemalloc versions and plan to upgrade Jemalloc again after having more info about the cause of the bug. 2. MIGRATE could crash the server after a socket error. See for reference: https://github.com/antirez/redis/issues/3796. ================================================================================ Redis 3.2.7 Released Tue Jan 31 16:21:41 CET 2017 ================================================================================ Main bugs fixes and improvements in this release: 1. MIGRATE could incorrectly move keys between Redis Cluster nodes by turning keys with an expire set into persisting keys. This bug was introduced with the multiple-keys migration recently. It is now fixed. Only applies to Redis Cluster users that use the resharding features of Redis Cluster. 2. As Redis 4.0 beta and the unstable branch already did (for some months at this point), Redis 3.2.7 also aliases the Host: and POST commands to QUIT avoiding to process the remaining pipeline if there are pending commands. This is a security protection against a "Cross Scripting" attack, that usually involves trying to feed Redis with HTTP in order to execute commands. Example: a developer is running a local copy of Redis for development purposes. She also runs a web browser in the same computer. The web browser could send an HTTP request to http://127.0.0.1:6379 in order to access the Redis instance, since a specially crafted HTTP requesta may also be partially valid Redis protocol. However if POST and Host: break the connection, this problem should be avoided. IMPORTANT: It is important to realize that it is not impossible that another way will be found to talk with a localhost Redis using a Cross Protocol attack not involving sending POST or Host: so this is only a layer of protection but not a definitive fix for this class of issues. 3. A ziplist bug that could cause data corruption, could crash the server and MAY ALSO HAVE SECURITY IMPLICATIONS was fixed. The bug looks complex to exploit, but attacks always get worse, never better (cit). The bug is very very hard to catch in practice, it required manual analysis of the ziplist code in order to be found. However it is also possible that rarely it happened in the wild. Upgrading is required if you use LINSERT and other in-the-middle list manipulation commands. 4. We upgraded to Jemalloc 4.4.0 since the version we used to ship with Redis was an early 4.0 release of Jemalloc. This version may have several improvements including the ability to better reclaim/use the memory of system.
2017-02-14Update python 3.x status after py-twisted now supports 3.x.wiz1-2/+2
2017-02-14Update HOMEPAGE.wiz1-3/+2
2017-02-13SQLite Release 3.17.0 On 2017-02-13adam7-23/+24
* Approximately 25% better performance from the R-Tree extension. * Uses compiler built-ins (ex: __builtin_bswap32() or _byteswap_ulong()) for byteswapping when available. * Uses the sqlite3_blob key/value access object instead of SQL for pulling content out of R-Tree nodes * Other miscellaneous enhancements such as loop unrolling. * Add the SQLITE_DEFAULT_LOOKASIDE compile-time option. * Increase the default lookaside size from 512,125 to 1200,100 as this provides better performance while only adding 56KB of extra memory per connection. Memory-sensitive applications can restore the old default at compile-time, start-time, or run-time. * Use compiler built-ins __builtin_sub_overflow(), __builtin_add_overflow(), and __builtin_mul_overflow() when available. (All compiler built-ins can be omitted with the SQLITE_DISABLE_INTRINSIC compile-time option.) * Added the SQLITE_ENABLE_NULL_TRIM compile-time option, which can result in significantly smaller database files for some applications, at the risk of being incompatible with older versions of SQLite. * Change SQLITE_DEFAULT_PCACHE_INITSZ from 100 to 20, for improved performance. * Added the SQLITE_UINT64_TYPE compile-time option as an analog to SQLITE_INT64_TYPE. * Perform some UPDATE operations in a single pass instead of in two passes. * Enhance the session extension to support WITHOUT ROWID tables. * Fixed performance problems and potential stack overflows when creating views from multi-row VALUES clauses with hundreds of thousands of rows. * Added the sha1.c extension. * In the command-line shell, enhance the ".mode" command so that it restores the default column and row separators for modes "line", "list", "column", and "tcl". * Enhance the SQLITE_DIRECT_OVERFLOW_READ option so that it works in WAL mode as long as the pages being read are not in the WAL file. * Enhance the LEMON parser generator so that it can store the parser object as a stack variable rather than allocating space from the heap and make use of that enhancement in the amalgamation. * Other performance improvements. Uses about 6.5% fewer CPU cycles. Bug Fixes: * Throw an error if the ON clause of a LEFT JOIN references tables to the right of the ON clause. This is the same behavior as PostgreSQL. Formerly, SQLite silently converted the LEFT JOIN into an INNER JOIN. * Use the correct affinity for columns of automatic indexes. * Ensure that the sqlite3_blob_reopen() interface can correctly handle short rows.
2017-02-12Recursive revbump from fonts/harfbuzzryoon12-24/+24
2017-02-11The PostgreSQL Global Development Group has released an update to all ↵adam23-56/+90
supported versions of our database system, including 9.6.2, 9.5.6, 9.4.11, 9.3.16, and 9.2.20. This release includes fixes that prevent data corruption issues in index builds and in certain write-ahead-log replay situations, which are detailed below. It also patches over 75 other bugs reported over the last three months.
2017-02-06Recursive bump for harfbuzz's new graphite2 dependency.wiz12-22/+24
2017-02-03Fix build with clang and libedit.roy4-98/+36
2017-02-01Release 1.1.5 has many bug fixes across the ORM and Core components as well ↵adam3-17/+36
as within the Postgresql, Mysql, Oracle, and SQL Server dialects. There is also one new feature allowing MySQL index prefixes to be specified.
2017-01-26Allow db6 and set up the environment correctly so this buildswiz1-2/+4
automatically against it. Users have to have accepted the db6 license already for installing it anyway.
2017-01-26Updated py-bsddb3 to 6.2.4.wiz2-7/+7
6.2.4: * More complete fix for pkgsrc. 6.2.3: * Update copyright notices. * Solve a conflict between different installations of Berkeley DB on some pkgsrc configurations. 6.2.2: * Correctly detect Berkeley DB installations in SmartOS native zones. * "Probably" (not tested) correctly detect Berkeley DB in pkgsrc systems.
2017-01-26Changes 6.2.23:adam7-61/+202
New Features/Improvements ------------------------- Added support for global message prefixes. Added Replication Manager write forwarding, which enables a client to perform simple put and delete operations by forwarding them to the master. Improved the way we mark a password as consumed. Added support for IPv6. Added support for Java 8. Added support for ARMv7 and above, and for ARM64. ARMv6 and below are no longer supported. Add a new SMP-optimized data model that is especially valuable for highly multithreaded applications. A sliced Berkeley DB instance contains a collection of related Berkeley DB environments, known as slices, each containing a disjoint subset of records. Transactional consistency is individually maintained within each slice, rather than across multiple slices. DB now supports the client-server architecture by providing a stand-alone server program and Java client driver APIs. The server program offers remote access to DB features. The client driver APIs provide building blocks for applications that communicate with a database server. Multiple client applications can communicate with a single server simultaneously. Enabled support of the SQLite user authentication extension. Added Visual Studio 2012 projects. Encryption and checksum can now be enabled with external files (formerly known as BLOBs). Note that only the data stored in the database will be encrypted and checksum protected. The data in the external files will not be encrypted or checksum protected. The BLOB files feature has been renamed external files to reduce confusion with the SQL BLOB datatype. The BLOB related functions have been deprecated, and replaced with new function names; for example, ext_file_threshold has replaced blob_threshold, and blob_threshold is deprecated. See the Upgrading section of the documentation for more details.
2017-01-22Postgis no longer supports PostgreSQL < 9.2.fhajny1-2/+2
2017-01-21Update databases/erlang-p1_pgsql to 1.1.2.fhajny3-9/+9
- Add SSL support.
2017-01-19Convert all occurrences (353 by my count) ofagc8-38/+38
MASTER_SITES= site1 \ site2 style continuation lines to be simple repeated MASTER_SITES+= site1 MASTER_SITES+= site2 lines. As previewed on tech-pkg. With thanks to rillig for fixing pkglint accordingly.
2017-01-18Support postgresql96.jperkin1-2/+2
2017-01-17Update databases/elasticsearch to 5.1.2.fhajny2-7/+7
Aggregations:: - Allow terms aggregations on pure boolean scripts. - IP range masks exclude the maximum address of the range. - Fix `other_bucket` on the `filters` agg to be enabled if a key is set. Allocation:: - Promote shadow replica to primary when initializing primary fails - Trim in-sync allocations set only when it grows Analysis:: - Pre-built analysis factories do not implement MultiTermAware correctly. CRUD:: - Reject external versioning and explicit version numbers on create Core:: - Support negative numbers in readVLong Exceptions:: - Fixing shard recovery error message to report the number of docs correctly for each node Index APIs:: - Ensure shrunk indices carry over version information from its source Internal:: - Don't output null source node in RecoveryFailedException Java REST Client:: - Don't use null charset in RequestLogger Logging:: - Restores the original default format of search slow log Mapping:: - Only update DocumentMapper if field type changes - The `_all` default mapper is not completely configured. - Fix MapperService.allEnabled(). Network:: - Disable the Netty recycler - Tell Netty not to be unsafe in transport client Nested Docs:: - Fix bug in query builder rewrite that ignores the ignore_unmapped option Packaging:: - Another fix for handling of paths on Windows Percolator:: - Fix NPE in percolator's 'now' range check for percolator queries with range queries Plugins:: - Provide helpful error message if a plugin exists - Add shutdown hook for closing CLI commands Plugin Lang Painless:: - Update Painless Loop Counter to be Higher Plugin Repository Azure:: - readonly on azure repository must be taken into account Recovery:: - Fix primary relocation for shadow replicas - Don't close store under CancellableThreads - Use a fresh recovery id when retrying recoveries - Allow flush/force_merge/upgrade on shard marked as relocated Reindex API:: - Don't close rest client from its callback Search:: - Improve concurrency of ShardCoreKeyMap. - Make `-0` compare less than `+0` consistently. - FiltersAggregationBuilder: rewriting filter queries, the same way as in FilterAggregationBuilder Stats:: - Implement stats for geo_point and geo_shape field - Use reader for doc stats - Avoid NPE in NodeService#stats if HTTP is disabled - Add support for "include_segment_file_sizes" in indices stats REST handler Term Vectors:: - Fix _termvectors with preference to not hit NPE - Return correct term statistics when a field is not found in a shard
2017-01-16Reset PKGREVISION after sqlrelay master package update.fhajny10-20/+10