summaryrefslogtreecommitdiff
path: root/databases/skytools
AgeCommit message (Collapse)AuthorFilesLines
2014-12-31Mark as not ready for python-3.x. Remove unnecessary line.wiz1-3/+2
2014-05-17Bump applications PKGREVISIONs for python users that might be usingwiz1-1/+2
python3, since the default changed from python33 to python34. I probably bumped too many. I hope I got them all.
2014-04-24Update skytools to 3.2.obache3-21/+27
Patch from rudolf via private mail. 2014-03-31 - SkyTools 3.2 - "Hit any user to continue" = Features = * scripts/data_maintainer.py: can use csv file as source * debian: support Postgres 9.3, 9.4 = Minor features = * londiste: added ignore_truncate handler option * londiste add-table: added lock_timeout option to avoid possible locking issues * scripts/data_maintainer.py: added dynamic throttling support (via sql) * skytools.scripting: added options to lower log level for exceptions * skytools.scripting: simple retriable execute (for sql) = Fixes = * londiste.create_partition: fixed to avoid deadlocks from concurrent workers * londiste.handlers.dispatch: fixed "ignore events aiming at obsolete partitions" bug * pgq.cascade.admin: do not allow subscribing to itself (same node) * pgq.consumer: fixed RetriableEvent and RetriableWalkerEvent * skytools.dbstruct: quote sequence names * skytools.set_tcp_keepalive: add compat with newer OSX, simplify, enable win32 * scripts/data_maintainer.py: fixed to survive null in stats column of sql_modify * sql/londiste: fixed londiste.table_info trigger issue * sql/pgq: fix retry-queue vs. newgrants * sql/pgq: tag pgq.batch_id_seq as dumpable (extension) = Cleanups = * londiste.drop_obsolete_partitions: drop tables in alphabetical order (that is from the oldest) * londiste.handlers: removed duplicate debug logging * londiste: moved config processing from dispatch to base handler * pgq.localconsumer: added file path check on config load * scripts/data_maintainer.py: clean-up * debian: include data_maintainer3 in package * Get rid of dictfetch*() usage, it's obsolete.
2014-03-06Import skytools-3.1.5 as databases/skytools.obache4-0/+277
Based on PR pkg/48639 by rudolf. SkyTools is a package of tools in use in Skype for replication and failover. It also includes a generic queuing mechanism called PgQ and a utility library for Python scripts, as well as a script for setting up and managing WAL based standby servers. PgQ is a queuing system written in PL/pgSQL, Python and C code. It is based on snapshot-based event handling ideas from Slony-I, and is written for general usage. PgQ provides an efficient, transactional, queueing system with multi-node support (including work sharing and splitting, failover and switchover, for queues and for consumers). PgQ is split into 3 layers: Producers, Ticker and Consumers. Londiste is a replication tool written in Python, using PgQ as event transport. Walmgr is a script that will setup WAL archiving, does the initial backup, and runtime WAL archive and restore. It can also be used for up-to-last-second partial file copying, so that less than the whole file is lost in case of loss of the master database server.