Update to 1.10.1:

Release 1.10.1 (2015-06-15)
'''''''''''''''''''''''''''

User Interface / Configuration Changes
--------------------------------------

The "``tahoe cp``" CLI command's ``--recursive`` option is now more predictable,
but behaves slightly differently than before. See below for details. Tickets
`#712`_, `#2329`_.

The SFTP server can now use public-key authentication (instead of only
password-based auth). Public keys are configured through an "account file",
just like passwords. See docs/frontends/FTP-and-SFTP for examples of the
format. `#1411`_

The Tahoe node can now be configured to disable automatic IP-address
detection. Using "AUTO" in tahoe.cfg [node]tub.location= (which is now the
default) triggers autodetection. Omit "AUTO" to disable autodetection. "AUTO"
can be combined with static addresses to e.g. use both a stable
UPnP-configured tunneled address and a DHCP-assigned dynamic (local subnet
only) address. See `configuration.rst`_ for details. `#754`_

The web-based user interface ("WUI") Directory and Welcome pages have been
redesigned, with improved CSS for narrow windows and more-accessible icons
(using distinctive shapes instead of just colors). `#1931`_ `#1961`_ `#1966`_
`#1972`_ `#1901`_

.. _`#712`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/712
.. _`#754`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/754
.. _`#1411`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1411
.. _`#1901`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1901
.. _`#1931`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1931
.. _`#1961`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1961
.. _`#1966`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1966
.. _`#1972`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1972
.. _`#2329`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2329
.. _`configuration.rst`: docs/configuration.rst

"tahoe cp" changes
------------------

The many ``cp``-like tools in the Unix world (POSIX ``/bin/cp``, the ``scp``
provided by SSH, ``rsync``) all behave slightly differently in unusual
circumstances, especially when copying whole directories into a target that
may or may not already exist. The most common difference is whether the user
is referring to the source directory as a whole, or to its contents. For
example, should "``cp -r foodir bardir``" create a new directory named
"``bardir/foodir``"? Or should it behave more like "``cp -r foodir/* bardir``"?
Some tools use the presence of a trailing slash to indicate which behavior
you want. Others ignore trailing slashes.

"``tahoe cp``" is no exception to having exceptional cases. This release fixes
some bad behavior and attempts to establish a consistent rationale for its
behavior. The new rule is:

- If the thing being copied is a directory, and it has a name (e.g. it's not
  a raw Tahoe-LAFS directorycap), then you are referring to the directory
  itself.
- If the thing being copied is an unnamed directory (e.g. raw dircap or
  alias), then you are referring to the contents.
- Trailing slashes do not affect the behavior of the copy (although putting
  a trailing slash on a file-like target is an error).
- The "``-r``" (``--recursive``) flag does not affect the behavior of the
  copy (although omitting ``-r`` when the source is a directory is an error).
- If the target refers to something that does not yet exist:
  - and if the source is a single file, then create a new file;
  - otherwise, create a directory.

There are two main cases where the behavior of Tahoe-LAFS v1.10.1 differs
from that of the previous v1.10.0 release:

- "``cp DIRCAP/file.txt ./local/missing``" , where "``./local``" is a
  directory but "``./local/missing``" does not exist. The implication is
  that you want Tahoe to create a new file named "``./local/missing``" and
  fill it with the contents of the Tahoe-side ``DIRCAP/file.txt``. In
  v1.10.0, a plain "``cp``" would do just this, but "``cp -r``" would do
  "``mkdir ./local/missing``" and then create a file named
  "``./local/missing/file.txt``". In v1.10.1, both "``cp``" and "``cp -r``"
  create a file named "``./local/missing``".
- "``cp -r PARENTCAP/dir ./local/missing``", where ``PARENTCAP/dir/``
  contains "``file.txt``", and again "``./local``" is a directory but
  "``./local/missing``" does not exist. In both v1.10.0 and v1.10.1, this
  first does "``mkdir ./local/missing``". In v1.10.0, it would then copy
  the contents of the source directory into the new directory, resulting
  in "``./local/missing/file.txt``". In v1.10.1, following the new rule
  of "a named directory source refers to the directory itself", the tool
  creates "``./local/missing/dir/file.txt``".

Compatibility and Dependency Updates
------------------------------------

Windows now requires Python 2.7. Unix/OS-X platforms can still use either
Python 2.6 or 2.7, however this is probably the last release that will
support 2.6 (it is no longer receiving security updates, and most OS
distributions have switched to 2.7). Tahoe-LAFS now has the following
dependencies:

- Twisted >= 13.0.0
- Nevow >= 0.11.1
- foolscap >= 0.8.0
- service-identity
- characteristic >= 14.0.0
- pyasn1 >= 0.1.4
- pyasn1-modules >= 0.0.5

On Windows, if pywin32 is not installed then the dependencies on Twisted
and Nevow become:

- Twisted >= 11.1.0, <= 12.1.0
- Nevow >= 0.9.33, <= 0.10

On all platforms, if pyOpenSSL >= 0.14 is installed, then it will be used,
but if not then only pyOpenSSL >= 0.13, <= 0.13.1 will be built when directly
invoking `setup.py build` or `setup.py install`.

We strongly advise OS packagers to take the option of making a tahoe-lafs
package depend on pyOpenSSL >= 0.14. In order for that to work, the following
additional Python dependencies are needed:

- cryptography
- cffi >= 0.8
- six >= 1.4.1
- enum34
- pycparser

as well as libffi (for Debian/Ubuntu, the name of the needed OS package is
`libffi6`).

Tahoe-LAFS is now compatible with Setuptools version 8 and Pip version 6 or
later, which should fix execution on Ubuntu 15.04 (it now tolerates PEP440
semantics in dependency specifications). `#2354`_ `#2242`_

Tahoe-LAFS now depends upon foolscap-0.8.0, which creates better private keys
and certificates than previous versions. To benefit from the improvements
(2048-bit RSA keys and SHA256-based certificates), you must re-generate your
Tahoe nodes (which changes their TubIDs and FURLs). `#2400`_

.. _`#2242`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2242
.. _`#2354`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2354
.. _`#2400`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2400

Packaging
---------

A preliminary OS-X package, named "``tahoe-lafs-VERSION-osx.pkg``", is now
being generated. It is a standard double-clickable installer, which creates
``/Applications/tahoe.app`` that embeds a complete runtime tree. However
launching the ``.app`` only brings up a notice on how to run tahoe from the
command line. A future release may turn this into a fully-fledged application
launcher. `#182`_ `#2393`_ `#2323`_

Preliminary Docker support was added. Tahoe container images may be available
on DockerHub. `PR#165`_ `#2419`_ `#2421`_

Old and obsolete Debian packaging tools have been removed. `#2282`_

.. _`#182`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/182
.. _`#2282`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2282
.. _`#2323`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2323
.. _`#2393`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2393
.. _`#2419`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2419
.. _`#2421`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2421
.. _`PR#165`: https://github.com/tahoe-lafs/tahoe-lafs/pull/165

Minor Changes
-------------

- Welcome page: add per-server "(space) Available" column. `#648`_
- check/deep-check learned to accept multiple location arguments. `#740`_
- Checker reports: remove needs-rebalancing, add count-happiness. `#1784`_ `#2105`_
- CLI ``--help``: cite (but don't list) global options on each command. `#2233`_
- Fix ftp "``ls``" to work with Twisted 15.0.0. `#2394`_

.. _`#648`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/648
.. _`#740`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/740
.. _`#1784`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1784
.. _`#2105`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2105
.. _`#2233`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2233
.. _`#2394`: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/2394

Roughly 75 tickets were closed in this release: 623 648 712 740 754 898 1146
1159 1336 1381 1411 1634 1674 1698 1707 1717 1737 1784 1800 1807 1842 1847
1901 1918 1953 1960 1961 1966 1969 1972 1974 1988 1992 2005 2008 2023 2027
2028 2034 2048 2067 2086 2105 2121 2128 2165 2193 2208 2209 2233 2235 2242
2245 2248 2249 2249 2280 2281 2282 2290 2305 2312 2323 2340 2354 2380 2393
2394 2398 2400 2415 2416 2417 2433. Another dozen were referenced but not
closed: 182 666 982 1064 1258 1531 1536 1742 1834 1931 1935 2286. Roughly 40
GitHub pull-requests were closed: 32 48 50 56 57 61 62 62 63 64 69 73 81 82
84 85 87 91 94 95 96 103 107 109 112 114 120 122 125 126 133 135 136 137 142
146 149 152 165.

For more information about any ticket, visit e.g.
https://tahoe-lafs.org/trac/tahoe-lafs/ticket/754

3 files changed, 57 insertions, 19 deletions

diff --git a/filesystems/tahoe-lafs/Makefile b/filesystems/tahoe-lafs/Makefile
index 39a1503af28..ef10d7027b7 100644
--- a/filesystems/tahoe-lafs/Makefile
+++ b/filesystems/tahoe-lafs/Makefile
@@ -1,7 +1,6 @@
-# $NetBSD: Makefile,v 1.24 2015/04/20 07:30:56 wiz Exp $
+# $NetBSD: Makefile,v 1.25 2015/07/01 13:58:21 wiz Exp $
 
-VERSION=	1.10.0
-PKGREVISION=	3
+VERSION=	1.10.1
 DISTNAME=	allmydata-tahoe-${VERSION}
 PKGNAME=	tahoe-lafs-${VERSION}
 CATEGORIES=	filesystems
@@ -35,13 +34,15 @@ DEPENDS+=	${PYPKGPREFIX}-pyutil-[0-9]*:../../devel/py-pyutil
 DEPENDS+=	${PYPKGPREFIX}-mock-[0-9]*:../../devel/py-mock
 # Included egg setuptools_trial, not used.
 # Included egg setuptools_darcs, used (no package yet).
-DEPENDS+=	${PYPKGPREFIX}-foolscap>=0.6.3:../../net/py-foolscap
-DEPENDS+=	${PYPKGPREFIX}-twisted-[0-9]*:../../net/py-twisted
-DEPENDS+=	${PYPKGPREFIX}-asn1-[0-9]*:../../security/py-asn1
+DEPENDS+=	${PYPKGPREFIX}-foolscap>=0.8.0:../../net/py-foolscap
+DEPENDS+=	${PYPKGPREFIX}-twisted>=13.0.0:../../net/py-twisted
+DEPENDS+=	${PYPKGPREFIX}-asn1>=0.1.4:../../security/py-asn1
+DEPENDS+=	${PYPKGPREFIX}-asn1-modules>=0.0.5:../../security/py-asn1-modules
+DEPENDS+=	${PYPKGPREFIX}-characteristic>=14.0.0:../../devel/py-characteristic
 DEPENDS+=	${PYPKGPREFIX}-crypto-[0-9]*:../../security/py-crypto
 DEPENDS+=	${PYPKGPREFIX}-cryptopp-[0-9]*:../../security/py-cryptopp
-DEPENDS+=	${PYPKGPREFIX}-OpenSSL-[0-9]*:../../security/py-OpenSSL
-DEPENDS+=	${PYPKGPREFIX}-nevow-[0-9]*:../../www/py-nevow
+DEPENDS+=	${PYPKGPREFIX}-OpenSSL>=0.14:../../security/py-OpenSSL
+DEPENDS+=	${PYPKGPREFIX}-nevow>=0.11.1:../../www/py-nevow
 DEPENDS+=	${PYPKGPREFIX}-service_identity-[0-9]*:../../security/py-service_identity
 
 PYTHON_VERSIONS_INCOMPATIBLE=	33 34 # py-twisted, py-xml via py-nevow, py-zbase32, py-cryptopp
diff --git a/filesystems/tahoe-lafs/PLIST b/filesystems/tahoe-lafs/PLIST
index d79018835fa..5c3cc2abeeb 100644
--- a/filesystems/tahoe-lafs/PLIST
+++ b/filesystems/tahoe-lafs/PLIST
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.6 2013/05/01 23:59:53 gdt Exp $
+@comment $NetBSD: PLIST,v 1.7 2015/07/01 13:58:21 wiz Exp $
 bin/tahoe
 ${PYSITELIB}/allmydata/__init__.py
 ${PYSITELIB}/allmydata/__init__.pyc
@@ -192,6 +192,9 @@ ${PYSITELIB}/allmydata/scripts/create_node.pyo
 ${PYSITELIB}/allmydata/scripts/debug.py
 ${PYSITELIB}/allmydata/scripts/debug.pyc
 ${PYSITELIB}/allmydata/scripts/debug.pyo
+${PYSITELIB}/allmydata/scripts/default_nodedir.py
+${PYSITELIB}/allmydata/scripts/default_nodedir.pyc
+${PYSITELIB}/allmydata/scripts/default_nodedir.pyo
 ${PYSITELIB}/allmydata/scripts/keygen.py
 ${PYSITELIB}/allmydata/scripts/keygen.pyc
 ${PYSITELIB}/allmydata/scripts/keygen.pyo
@@ -306,6 +309,9 @@ ${PYSITELIB}/allmydata/test/common_web.pyo
 ${PYSITELIB}/allmydata/test/no_network.py
 ${PYSITELIB}/allmydata/test/no_network.pyc
 ${PYSITELIB}/allmydata/test/no_network.pyo
+${PYSITELIB}/allmydata/test/test_auth.py
+${PYSITELIB}/allmydata/test/test_auth.pyc
+${PYSITELIB}/allmydata/test/test_auth.pyo
 ${PYSITELIB}/allmydata/test/test_backupdb.py
 ${PYSITELIB}/allmydata/test/test_backupdb.pyc
 ${PYSITELIB}/allmydata/test/test_backupdb.pyo
@@ -318,6 +324,27 @@ ${PYSITELIB}/allmydata/test/test_checker.pyo
 ${PYSITELIB}/allmydata/test/test_cli.py
 ${PYSITELIB}/allmydata/test/test_cli.pyc
 ${PYSITELIB}/allmydata/test/test_cli.pyo
+${PYSITELIB}/allmydata/test/test_cli_backup.py
+${PYSITELIB}/allmydata/test/test_cli_backup.pyc
+${PYSITELIB}/allmydata/test/test_cli_backup.pyo
+${PYSITELIB}/allmydata/test/test_cli_check.py
+${PYSITELIB}/allmydata/test/test_cli_check.pyc
+${PYSITELIB}/allmydata/test/test_cli_check.pyo
+${PYSITELIB}/allmydata/test/test_cli_cp.py
+${PYSITELIB}/allmydata/test/test_cli_cp.pyc
+${PYSITELIB}/allmydata/test/test_cli_cp.pyo
+${PYSITELIB}/allmydata/test/test_cli_create_alias.py
+${PYSITELIB}/allmydata/test/test_cli_create_alias.pyc
+${PYSITELIB}/allmydata/test/test_cli_create_alias.pyo
+${PYSITELIB}/allmydata/test/test_cli_list.py
+${PYSITELIB}/allmydata/test/test_cli_list.pyc
+${PYSITELIB}/allmydata/test/test_cli_list.pyo
+${PYSITELIB}/allmydata/test/test_cli_mv.py
+${PYSITELIB}/allmydata/test/test_cli_mv.pyc
+${PYSITELIB}/allmydata/test/test_cli_mv.pyo
+${PYSITELIB}/allmydata/test/test_cli_put.py
+${PYSITELIB}/allmydata/test/test_cli_put.pyc
+${PYSITELIB}/allmydata/test/test_cli_put.pyo
 ${PYSITELIB}/allmydata/test/test_client.py
 ${PYSITELIB}/allmydata/test/test_client.pyc
 ${PYSITELIB}/allmydata/test/test_client.pyo
@@ -372,6 +399,9 @@ ${PYSITELIB}/allmydata/test/test_introducer.pyo
 ${PYSITELIB}/allmydata/test/test_iputil.py
 ${PYSITELIB}/allmydata/test/test_iputil.pyc
 ${PYSITELIB}/allmydata/test/test_iputil.pyo
+${PYSITELIB}/allmydata/test/test_json_metadata.py
+${PYSITELIB}/allmydata/test/test_json_metadata.pyc
+${PYSITELIB}/allmydata/test/test_json_metadata.pyo
 ${PYSITELIB}/allmydata/test/test_keygen.py
 ${PYSITELIB}/allmydata/test/test_keygen.pyc
 ${PYSITELIB}/allmydata/test/test_keygen.pyo
@@ -405,6 +435,9 @@ ${PYSITELIB}/allmydata/test/test_stats.pyo
 ${PYSITELIB}/allmydata/test/test_storage.py
 ${PYSITELIB}/allmydata/test/test_storage.pyc
 ${PYSITELIB}/allmydata/test/test_storage.pyo
+${PYSITELIB}/allmydata/test/test_storage_client.py
+${PYSITELIB}/allmydata/test/test_storage_client.pyc
+${PYSITELIB}/allmydata/test/test_storage_client.pyo
 ${PYSITELIB}/allmydata/test/test_system.py
 ${PYSITELIB}/allmydata/test/test_system.pyc
 ${PYSITELIB}/allmydata/test/test_system.pyo
@@ -423,9 +456,6 @@ ${PYSITELIB}/allmydata/test/test_version.pyo
 ${PYSITELIB}/allmydata/test/test_web.py
 ${PYSITELIB}/allmydata/test/test_web.pyc
 ${PYSITELIB}/allmydata/test/test_web.pyo
-${PYSITELIB}/allmydata/test/trial_coverage.py
-${PYSITELIB}/allmydata/test/trial_coverage.pyc
-${PYSITELIB}/allmydata/test/trial_coverage.pyo
 ${PYSITELIB}/allmydata/test/trialtest.py
 ${PYSITELIB}/allmydata/test/trialtest.pyc
 ${PYSITELIB}/allmydata/test/trialtest.pyo
@@ -456,6 +486,9 @@ ${PYSITELIB}/allmydata/util/cachedir.pyo
 ${PYSITELIB}/allmydata/util/consumer.py
 ${PYSITELIB}/allmydata/util/consumer.pyc
 ${PYSITELIB}/allmydata/util/consumer.pyo
+${PYSITELIB}/allmydata/util/dbutil.py
+${PYSITELIB}/allmydata/util/dbutil.pyc
+${PYSITELIB}/allmydata/util/dbutil.pyo
 ${PYSITELIB}/allmydata/util/deferredutil.py
 ${PYSITELIB}/allmydata/util/deferredutil.pyc
 ${PYSITELIB}/allmydata/util/deferredutil.pyo
@@ -582,11 +615,15 @@ ${PYSITELIB}/allmydata/web/root.pyc
 ${PYSITELIB}/allmydata/web/root.pyo
 ${PYSITELIB}/allmydata/web/static/css/bootstrap.css
 ${PYSITELIB}/allmydata/web/static/css/new-tahoe.css
-${PYSITELIB}/allmydata/web/static/d3-2.4.6.min.js
-${PYSITELIB}/allmydata/web/static/d3-2.4.6.time.min.js
+${PYSITELIB}/allmydata/web/static/d3-2.4.6.js
+${PYSITELIB}/allmydata/web/static/d3-2.4.6.time.js
 ${PYSITELIB}/allmydata/web/static/download_status_timeline.js
 ${PYSITELIB}/allmydata/web/static/icon.png
-${PYSITELIB}/allmydata/web/static/jquery-1.6.1.min.js
+${PYSITELIB}/allmydata/web/static/img/connected-no.png
+${PYSITELIB}/allmydata/web/static/img/connected-not-configured.png
+${PYSITELIB}/allmydata/web/static/img/connected-yes.png
+${PYSITELIB}/allmydata/web/static/img/logo.png
+${PYSITELIB}/allmydata/web/static/jquery-1.11.0.js
 ${PYSITELIB}/allmydata/web/static/tahoe.css
 ${PYSITELIB}/allmydata/web/statistics.xhtml
 ${PYSITELIB}/allmydata/web/status.py
diff --git a/filesystems/tahoe-lafs/distinfo b/filesystems/tahoe-lafs/distinfo
index fdf7492119b..1165bb93625 100644
--- a/filesystems/tahoe-lafs/distinfo
+++ b/filesystems/tahoe-lafs/distinfo
@@ -1,5 +1,5 @@
-$NetBSD: distinfo,v 1.9 2013/05/01 23:59:53 gdt Exp $
+$NetBSD: distinfo,v 1.10 2015/07/01 13:58:21 wiz Exp $
 
-SHA1 (allmydata-tahoe-1.10.0.tar.bz2) = 9932ddc1d364a1efe8afddf83572b4de0329f1fc
-RMD160 (allmydata-tahoe-1.10.0.tar.bz2) = bf7aa8f3e09ae1feb7bcec0847e64a5a840d3893
-Size (allmydata-tahoe-1.10.0.tar.bz2) = 1174044 bytes
+SHA1 (allmydata-tahoe-1.10.1.tar.bz2) = b689847399eede07627d232d49818967f9f0c1cb
+RMD160 (allmydata-tahoe-1.10.1.tar.bz2) = c27b838deb4b5b62b4399b35ffad66fa15f70e28
+Size (allmydata-tahoe-1.10.1.tar.bz2) = 1375024 bytes