summaryrefslogtreecommitdiff
path: root/shells
AgeCommit message (Collapse)AuthorFilesLines
2019-10-25bash: make nls option enabled by defaulttriaxx1-1/+2
2019-10-24shells/pbosh: Update to 20191007micha2-8/+8
Based on SchilyTools Release from 2019-10-07. Changelog ========= - configure: Some shells report a syntax error with "< file (cmd)" and need the redirection statement to be *after* the command. Our changes to support the V7 shell by adding round braces caused ash variants like "dash" to fail. Thanks to Harald van Dijk for reporting - cont/cc-config.sh: canged some :>some-file statements into (:)>some-file. they have meen missed when introducing work arounds for the V7 Shell on Ultrix that does not support I/O redirection for builtin commands. Thanks to Robert Clausecker for reporting - libschily/comerr.c: If the environment COMERR_EXCODE has been set to a value that starts with '0', the normal exit code mapping is switched off, but all potential exit code values != 0 that follow the rule (excode % 256) == 0 are mapped to -64. This helps to avoid unexpected behavior with historic shells that still use the old waitpid() and modern shells (using waitid() but in a backward compatible default mode) where a program that terminates with exit(256); is evaluated in conditional statements as if the exit code was 0. - Bourne Shell: Missing Makefile.dot added. - Bourne Shell / bsh / ved: The dotdiles TAR archives are now again named */dotfiles.tar.bz2 as the change in the previous release caused problems. Thanks for Gabriele Balducci balducci@units.it and Robert Clausecker for reporting - Bourne Shell: Cstyle changes (long lines removed) in io.c & expand.c - Bourne Shell: Fixed a bug that prevented to forward the special exit cause (NOTFOUND or NOEXEC) to the vfork() parent process via. struct siginfo.si_code in some cases. These values are added beyond the POSIX CLD_* values in siginfo.si_code from the POSIX standard. They are passed back from the vfork()ed child to the parent via the shared memory from the vfork() implementation. - Bourne Shell: introduced shared memory to be able to forward the special exit cause (NOTFOUND or NOEXEC) to the parent even in case it used fork() instead of vfork(). - Bourne Shell: Added support for a new automatic parameter "$/" to complement the existing parameter "$?". This is a result from a discussion in a POSIX teleconference from April 2016. This new parameter returns *decimal numbers* for a normal command termination and *text* for abnormal command termination: number<>Exit code from normal termination. This is a signed 32 bit value from the exit() parameter on POSIX systems and a 8 bit value on pre-POSIX systems like Linux. signame>A signal name (see kill -l) if the command has been terminated by a signal. This is the signal name with the leading "SIG" stripped off. NOEXEC<>The command was found but could not be executed, e.g. as a result of missing permissions or because the name points to a directory. NOTFOUND The command could not be found. Note that currently, the strings "NOEXEC" and "NOTFOUND" are passed back reliably from vfork(2) childs or when the related state is already known by the cache. In other cases, the reliability of $/ with respect to "NOEXEC" and "NOTFOUND" has not yet been verified. It thus may return 126 or 127 as with $?. The string values "NOEXEC" and "NOTFOUND" cannot be passed back from a subshell, using only the waitid() mechanism. To circumvent that problem, from fork()ed subshells,. shared memory or non-fork()ed virtual subshells would work. If you detect a complex command where you get 126 or 127 instead of the exoected "NOEXEC" or "NOTFOUND", please send a report. We for now choose to use shared memory as this is easier to implement. Later versions will mosy likely implement virtual fork()less subshells. - Bourne Shell: minor Cstyle changes on word.c and macro.c - Bourne Shell: New version date
2019-10-24shells/bosh: Update to 20191007micha2-8/+8
Based on SchilyTools Release from 2019-10-07. Changelog ========= - configure: Some shells report a syntax error with "< file (cmd)" and need the redirection statement to be *after* the command. Our changes to support the V7 shell by adding round braces caused ash variants like "dash" to fail. Thanks to Harald van Dijk for reporting - cont/cc-config.sh: canged some :>some-file statements into (:)>some-file. they have meen missed when introducing work arounds for the V7 Shell on Ultrix that does not support I/O redirection for builtin commands. Thanks to Robert Clausecker for reporting - libschily/comerr.c: If the environment COMERR_EXCODE has been set to a value that starts with '0', the normal exit code mapping is switched off, but all potential exit code values != 0 that follow the rule (excode % 256) == 0 are mapped to -64. This helps to avoid unexpected behavior with historic shells that still use the old waitpid() and modern shells (using waitid() but in a backward compatible default mode) where a program that terminates with exit(256); is evaluated in conditional statements as if the exit code was 0. - Bourne Shell: Missing Makefile.dot added. - Bourne Shell / bsh / ved: The dotdiles TAR archives are now again named */dotfiles.tar.bz2 as the change in the previous release caused problems. Thanks for Gabriele Balducci balducci@units.it and Robert Clausecker for reporting - Bourne Shell: Cstyle changes (long lines removed) in io.c & expand.c - Bourne Shell: Fixed a bug that prevented to forward the special exit cause (NOTFOUND or NOEXEC) to the vfork() parent process via. struct siginfo.si_code in some cases. These values are added beyond the POSIX CLD_* values in siginfo.si_code from the POSIX standard. They are passed back from the vfork()ed child to the parent via the shared memory from the vfork() implementation. - Bourne Shell: introduced shared memory to be able to forward the special exit cause (NOTFOUND or NOEXEC) to the parent even in case it used fork() instead of vfork(). - Bourne Shell: Added support for a new automatic parameter "$/" to complement the existing parameter "$?". This is a result from a discussion in a POSIX teleconference from April 2016. This new parameter returns *decimal numbers* for a normal command termination and *text* for abnormal command termination: number<>Exit code from normal termination. This is a signed 32 bit value from the exit() parameter on POSIX systems and a 8 bit value on pre-POSIX systems like Linux. signame>A signal name (see kill -l) if the command has been terminated by a signal. This is the signal name with the leading "SIG" stripped off. NOEXEC<>The command was found but could not be executed, e.g. as a result of missing permissions or because the name points to a directory. NOTFOUND The command could not be found. Note that currently, the strings "NOEXEC" and "NOTFOUND" are passed back reliably from vfork(2) childs or when the related state is already known by the cache. In other cases, the reliability of $/ with respect to "NOEXEC" and "NOTFOUND" has not yet been verified. It thus may return 126 or 127 as with $?. The string values "NOEXEC" and "NOTFOUND" cannot be passed back from a subshell, using only the waitid() mechanism. To circumvent that problem, from fork()ed subshells,. shared memory or non-fork()ed virtual subshells would work. If you detect a complex command where you get 126 or 127 instead of the exoected "NOEXEC" or "NOTFOUND", please send a report. We for now choose to use shared memory as this is easier to implement. Later versions will mosy likely implement virtual fork()less subshells. - Bourne Shell: minor Cstyle changes on word.c and macro.c - Bourne Shell: New version date
2019-10-24bash: bump revisiontriaxx1-1/+2
2019-10-24bash: add missing options.mktriaxx1-0/+21
2019-10-24bash: make nls support optionaltriaxx2-57/+42
pkgsrc changes: - remove broken static option - add nls option (disable by default) - change LOCALBASE to PREFIX (appease pkglint)
2019-10-12shells/bash2-doc: fix location of HTML documentationrillig2-15/+8
2019-10-04pbosh: Switch to latest distfile.micha3-9/+9
Changelog ========= Release 2019-03-29: - Bourne Shell: local(1), export(1) and readonly(1) now all support to. expand the '~' character in environment variables like e.g. PATH. - Bourne Shell: Added unit tests for the tilde expansion and the related changes. Release 2019-04-29: - libshedit/bsh/Bourne Shell: The TAB file name expansion now uses a new expansion funtion that is not based on pattern matching but on strstr() and thus is no longer fooled by file names that contain pattern matching meta characters. - Bourne Shell: "trap -- ..." now correctly handles "--" even if the next argument is "-". - Bourne Shell: trap now supports a new option -p that allows to restore the whole trap state using the following commands: old_traps=$(trap -p) trap "some commands" INT QUIT ... eval "$old_traps" This is possible because "trap -p" outputs the state for all signals and not only for those signals that are not in the default state. The new trap interfase was agreed on in the 2019-04-11 POSIX teleconference. Bourne Shell: The exception for "while true; do date; done | uniq -c" in job control handling that has been introduced in November 2015 has been refined to prevent it from causing "(bosh)" to stop from SIGTTIN. Thanks to Robert Elz <kre@munnari.OZ.AU> for reporting. - Bourne Shell: A new #define JOB_DEBUG has been added. - Bourne Shell: The command: (trap '' SEGV; $SHELL -c 'kill -s SEGV $$; echo survived') caused the shell not to print "survived" because a previous exception for SIGSEGV from the 1977 Bourne Shell version had not been removed for the POSIX variant of the shell. The problem occured because it was possible to unignore an ignored (at startup) SIGSEGV. Thanks to Robert Elz <kre@munnari.OZ.AU> for reporting. - Bourne Shell: The code now uses SIG2STR_MAX for the size of the sig2str() output buffer. - Bourne Shell: the behavior related to SIGINT on the command line in the case that the history editor is enabled has been changed to match the behavior of ksh. The Bourne Shell now calls trap commands for SIGINT when ^C is typed on the command line. Note that the classical Bourne Shell behavior (which is still active in case the history editor has been disabled via "set +o ved") is that the trap command is called after ^C is followed by a CR if both are typed on a PS1 prompt. Note: The behavior for "trap" in this area is currently not specified in POSIX. - Bourne Shell: After jobcontrol has been introduced into the Bourne Shell: When in jobcontrol mode, the shell could no longer get signals at the same time as foreground jobs because when using jobcontrol, the shell is in a different process group than the foreground job. The Bourne Shell now derives the information about a delivered signal from the waitid() return data and thus is now able to work the same way as it has been designed in 1977. This is the same way as ksh works. If a foreground program catches such signals, the shell is still not able to detect the signal, but it is now closer to the original behavior from 1977. - Bourne Shell: new version date 2019-04-17 Release 2019-05-28: - Bourne Shell: Similar to what ksh88 does, scripts are now checked before they are run. If there is a nul byte before a newline in the first 256 bytes, a file is rejected as alien binary instead of trying to interpret it as a script. Release 2019-06-13: - Bourne Shell: A new option "set -o globskipdot" has been added. If set, the entries "." and ".." are skipped and not shown in globbing results. If not set, the entries "." and ".." are always returned, even when they are not part of the readdir(3) results. - Bourne Shell: The option "set -o globskipdot" has been made the new dfault behavior for "bosh", but not for "pbosh" Note that this new shell option has been introduced as a result of a related BUG discussion in the Austin Group telephone conference. The background is to permit shell scripts to check whether a shell grants to hide the "." and ".." for all filesystems. Release 2019-07-15: - Bourne Shell: If OPTIND is set to a new value, the getopt() internal variable "_sp" is now reset to 1. This is needed in order to make sure that a combined option string can be parsed correctly. - Bourne Shell/libshedit/bsh: The TAB expander now again gives .. as a. result if the pattern is .. This is needed in order to let ..TAB result in ../ on the command line editor. Release 2019-09-22: - Bourne Shell: The new function isbinary() that has been introduced in May and that should prevent the shell from interpreting binary files as shell scripts had a problem: In case that a disconnected TCP/IP based remote login caused a SIGTERM followed by the read() function on stdin returning EIO, the shell could go into a complex endless loop as the failing read() with "trapnote" set caused a longjmp() before the next prompt without first clearing "trapnote". As a result, the shell did hang endlessly around while just consuming CPU time. The shell now avoids to call the read() routine inside isbinary() when "trapnote" is set and this way is able to avoid the longjmp() on error. - Bourne Shell: Fixed some typos in comment Thanks to Robert Clausecker for reporting - Bourne Shell: print.c: Changed err++ for a BOOL typed variable into err = TRUE. Thanks to Robert Clausecker for reporting - Bourne Shell, with obosh compilation type: Avoid an "unused" warning with word.c - Bourne Shell: defs.h now includes an "extern int optopt;" in order to support Ultrix where this delcaration is missing in unistd.h. Thanks to Robert Clausecker for reporting - bsh/Bourne Shell: test.c Now using a #if defined(S_IFPORT) && S_IFPORT != S_IFIFO to work around a strange definition on Ultrix Thanks to Robert Clausecker for reporting - Bourne Shell: New version date
2019-10-04bosh: Switch to latest distfile.micha3-9/+9
Changelog ========= Release 2019-03-29: - Bourne Shell: local(1), export(1) and readonly(1) now all support to. expand the '~' character in environment variables like e.g. PATH. - Bourne Shell: Added unit tests for the tilde expansion and the related changes. Release 2019-04-29: - libshedit/bsh/Bourne Shell: The TAB file name expansion now uses a new expansion funtion that is not based on pattern matching but on strstr() and thus is no longer fooled by file names that contain pattern matching meta characters. - Bourne Shell: "trap -- ..." now correctly handles "--" even if the next argument is "-". - Bourne Shell: trap now supports a new option -p that allows to restore the whole trap state using the following commands: old_traps=$(trap -p) trap "some commands" INT QUIT ... eval "$old_traps" This is possible because "trap -p" outputs the state for all signals and not only for those signals that are not in the default state. The new trap interfase was agreed on in the 2019-04-11 POSIX teleconference. Bourne Shell: The exception for "while true; do date; done | uniq -c" in job control handling that has been introduced in November 2015 has been refined to prevent it from causing "(bosh)" to stop from SIGTTIN. Thanks to Robert Elz <kre@munnari.OZ.AU> for reporting. - Bourne Shell: A new #define JOB_DEBUG has been added. - Bourne Shell: The command: (trap '' SEGV; $SHELL -c 'kill -s SEGV $$; echo survived') caused the shell not to print "survived" because a previous exception for SIGSEGV from the 1977 Bourne Shell version had not been removed for the POSIX variant of the shell. The problem occured because it was possible to unignore an ignored (at startup) SIGSEGV. Thanks to Robert Elz <kre@munnari.OZ.AU> for reporting. - Bourne Shell: The code now uses SIG2STR_MAX for the size of the sig2str() output buffer. - Bourne Shell: the behavior related to SIGINT on the command line in the case that the history editor is enabled has been changed to match the behavior of ksh. The Bourne Shell now calls trap commands for SIGINT when ^C is typed on the command line. Note that the classical Bourne Shell behavior (which is still active in case the history editor has been disabled via "set +o ved") is that the trap command is called after ^C is followed by a CR if both are typed on a PS1 prompt. Note: The behavior for "trap" in this area is currently not specified in POSIX. - Bourne Shell: After jobcontrol has been introduced into the Bourne Shell: When in jobcontrol mode, the shell could no longer get signals at the same time as foreground jobs because when using jobcontrol, the shell is in a different process group than the foreground job. The Bourne Shell now derives the information about a delivered signal from the waitid() return data and thus is now able to work the same way as it has been designed in 1977. This is the same way as ksh works. If a foreground program catches such signals, the shell is still not able to detect the signal, but it is now closer to the original behavior from 1977. - Bourne Shell: new version date 2019-04-17 Release 2019-05-28: - Bourne Shell: Similar to what ksh88 does, scripts are now checked before they are run. If there is a nul byte before a newline in the first 256 bytes, a file is rejected as alien binary instead of trying to interpret it as a script. Release 2019-06-13: - Bourne Shell: A new option "set -o globskipdot" has been added. If set, the entries "." and ".." are skipped and not shown in globbing results. If not set, the entries "." and ".." are always returned, even when they are not part of the readdir(3) results. - Bourne Shell: The option "set -o globskipdot" has been made the new dfault behavior for "bosh", but not for "pbosh" Note that this new shell option has been introduced as a result of a related BUG discussion in the Austin Group telephone conference. The background is to permit shell scripts to check whether a shell grants to hide the "." and ".." for all filesystems. Release 2019-07-15: - Bourne Shell: If OPTIND is set to a new value, the getopt() internal variable "_sp" is now reset to 1. This is needed in order to make sure that a combined option string can be parsed correctly. - Bourne Shell/libshedit/bsh: The TAB expander now again gives .. as a. result if the pattern is .. This is needed in order to let ..TAB result in ../ on the command line editor. Release 2019-09-22: - Bourne Shell: The new function isbinary() that has been introduced in May and that should prevent the shell from interpreting binary files as shell scripts had a problem: In case that a disconnected TCP/IP based remote login caused a SIGTERM followed by the read() function on stdin returning EIO, the shell could go into a complex endless loop as the failing read() with "trapnote" set caused a longjmp() before the next prompt without first clearing "trapnote". As a result, the shell did hang endlessly around while just consuming CPU time. The shell now avoids to call the read() routine inside isbinary() when "trapnote" is set and this way is able to avoid the longjmp() on error. - Bourne Shell: Fixed some typos in comment Thanks to Robert Clausecker for reporting - Bourne Shell: print.c: Changed err++ for a BOOL typed variable into err = TRUE. Thanks to Robert Clausecker for reporting - Bourne Shell, with obosh compilation type: Avoid an "unused" warning with word.c - Bourne Shell: defs.h now includes an "extern int optopt;" in order to support Ultrix where this delcaration is missing in unistd.h. Thanks to Robert Clausecker for reporting - bsh/Bourne Shell: test.c Now using a #if defined(S_IFPORT) && S_IFPORT != S_IFIFO to work around a strange definition on Ultrix Thanks to Robert Clausecker for reporting - Bourne Shell: New version date
2019-09-02Changed PYTHON_VERSIONS_INCOMPATIBLE to PYTHON_VERSIONS_ACCEPTED; needed for ↵adam1-2/+2
future Python 3.8
2019-09-01Include bash patches 10 & 11 (becomes bash-5.0.11)kre2-4/+13
10: fix var-assigns before special builtins & fn calls in posix mode 11: fixed missing quoted nul removal (in one odd case). See the patch files (once fetched) for more details of what was altered.
2019-08-15Update to bash 5.0.9 (5.0 patchlevel 9)kre2-4/+12
patch8: fix potential core dump if HISTSIZE is set to 0 patch9: fix fd leak if history file reading finds empty file
2019-08-11Bump PKGREVISIONs for perl 5.30.0wiz3-5/+6
2019-07-24oksh: update to 6.5maya4-9/+45
Note release version goes backwards. Version now follows openbsd version numbering. No changes available. Patched to eliminate compilation warnings on netbsd.
2019-07-01Redirect the last few search.cpan.org packages that I missed.nia1-3/+3
2019-05-19tcsh: Uncomment HOMEPAGE (now available again)leot1-2/+2
2019-05-15tcsh: Add upstream patch to address filename expansion test failuresleot3-1/+51
When $HOME environment variable is set, e.g. in pkgrsc where a fake homedir is injected, ~ is expanded to $HOME while ~user is expanded to the passwd(5) home_dir field leading to inconsistency in the test. No PKGREVISION bump since that change only affects tests.
2019-05-11Update MAINTAINERkim1-2/+2
2019-05-09tcsh: Add support for testsleot1-1/+4
2019-05-09tcsh: Add a newline to make the comment more readable (NFC)leot2-3/+4
2019-05-09{standalone-,static-,}tcsh: Update to 6.21.00leot11-166/+140
pkgsrc changes: - Add patch-nls_Makefile.in to avoid +x bit in *.cat files - Remove no longer needed patches (all applied upstream): patch-ed.chared.c, patch-ed.inputl.c, patch-nls-catgen, patch-sh.func.c, patch-tw.init.c Changes: V6.21.00 - 20190508 ------------------- - Abort history loading on words and lines too long https://bugzilla.redhat.com/show_bug.cgi?id=1598502 - PR/37: Introduce GetCmdChar() to avoid open coding array access. make closem() not close sockets so as not to affect nss_ldap. tcsh never creates sockets so that's ok (Miloslav Trmac) - PR/597: Make rmstar work with aliased rm - convert match() from recursive to backtracking. - Handle 8 bit characters in bindkey (Werner Fink) - Look for tgetent in libtinfo as well (Werner Fink) - Don't play pointer tricks that are undefined in modern c (Brooks Davis) - Fix out of bounds read (Brooks Davis) - Fix type of read in prompt confirmation (eg. rmstar) (David Kaspar) - PR/471: Delay arginp parsing ok <kim>, thanks!
2019-04-26fix some whitespace, mostly introduced in the previousmaya1-2/+2
python 3.4 / 3.5 removal commit.
2019-04-26Omit mentions of python 34 and 35, after those were removed.maya1-2/+2
- Includes some whitespace changes, to be handled in a separate commit.
2019-04-25PKGREVISION bump for anything using python without a PYPKGPREFIX.maya4-6/+8
This is a semi-manual PKGREVISION bump.
2019-04-24Update to 5.0.7 - the first 7 patches to bash 5.0kre2-14/+35
The patches fix: 1. Under certain circumstances, the glob expansion code did not remove backslashes escaping characters in directory names (or portions of a pattern preceding a slash). 2. When an alias value ends with an unquoted literal tab (not part of a quoted string or comment), alias expansion cannot correctly detect the end of the alias value after expanding it. 3. There are several incompatibilities in how bash-5.0 processes pathname expansion (globbing) of filename arguments that have backslashes in the directory portion. 4. In bash-5.0, the `wait' builtin without arguments waits for all children of the shell. This includes children it `inherited' at shell invocation time. This patch modifies the behavior to not wait for these inherited children, some of which might be long-lived. 5. In certain cases, bash optimizes out a fork() call too early and prevents traps from running. 6. Bash-5.0 did not build successfully if SYSLOG_HISTORY was defined without also defining SYSLOG_SHOPT. 7. Running `exec' when job control was disabled, even temporarily, but after it had been initialized, could leave the terminal in the wrong process group for the executed process.
2019-04-17zsh-autosuggestions: update to 0.5.2.wiz2-7/+7
## v0.5.2 - Allow disabling automatic widget re-binding for better performance (#418) - Fix async suggestions when `SH_WORD_SPLIT` is set - Refactor async mode to use process substitution instead of zpty (#417) ## v0.5.1 - Speed up widget rebinding (#413) - Clean up global variable creations (#403) - Respect user's set options when running original widget (#402)
2019-03-19pbosh: update to 20190311.wiz2-8/+8
Update provided by Michael Bäuerle via pksrc-wip. Changelog ========= Release 2019-02-18: - libgetopt: The undocumented variable "_sp" from SVr4 has been renamed to "opt_sp" and (on platforms that support "#pragma weak") there is a weak reference _sp to that new variable, giving backwards compatibility. The reason for doing this is to make sure that people on Illumos or Oracle Solaris, who still have an outdated version of getopt() in their local libc, do not try to link the Bourne Shell only against their old getopt(). If they did this, they would not get the documented enhanced getopt() features from the Bourne Shell. - Bourne Shell: The shell now uses "opt_sp" as the name for the undocumented additional getopt() interface from AT&T. This has been done to avoid being able to link the Bourne Shell on Illumos or Oracle Solaris without using our libgetopt. If this was done, we could not support UNIX/MULTICS style long options and we could not support -help/--help, since the latter is implemented via long options that are not an alias to short options. - Bourne Shell: added a new timestamp to the Bourne Shell version. Release 2018-11-21: - Bourne Shell: make it exit the whole shell with set -e after a command substitution failed on the right side of a variable assignment that has no command. This is required by POSIX. - Bourne Shell: added a unit tests for the above case. - Bourne Shell: New version date set to 2018-12-08 the this change. Release 2019-01-22: - bsh / Bourne Shell / star: the function hop_dirs() no longer checks for p2 != NULL before calling *p2 = '/' as p2 has been granted to be != NULL from a break with strchr(p, '/') == NULL Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Added a missing /* FALLTHROUGH */ comment.. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: added a range check for $OPTIND to tge getopts(1) implementation Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Removed a nonsense variable in expand() that caused Coverity not to understand that a directory was correctly closed() Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Added a paranoia comparison to make Coverity quiet. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: avoid to call catpath() with a NULL pointer for path Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: check the write() return code in io.c Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Added a paranopia check for "test -o" to make Coperity quiet. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Added (void) before fcntl() in hope to make Coverity quiet. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Removed dead code from readwc() Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Cstyle changes to xec.c - Bourne Shell: "builtin -d ..." did access free()d memory. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: expand.c: added a check for fd == -1 to avoid calling openat() with that fd. Thanks to Pavel Raiskup for poiting to a related Coverity message. -Bourne Shell: func.c: added a check for fd == -1 to avoid calling read()/close() with that fd. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: jobs.c: enlarged a buffer to be of same size as numbuf[] to avoid a potential buffer overflow. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: print.c::prt_cntl() had a very old (AT&T) bug with printing byte sequences that get an error with mbtowc() and it did not print byte sequences correctly that refer to legal but "nonprintable" multi byte characters. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: xec.c: the reserved word "time" could cause to access uninitialized memory if the string in $TIMEFORMAT contains the format %J Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: xec.c: added a paranoia check on whether findnam("funcname") returns NULL even though the existence of a function with that name already has been verified via the hash service. Thanks to Pavel Raiskup for poiting to a related Coverity message. Release 2019-02-18: - Bourne Shell: Another vfork() problem has been fixed. "trap cmd EXIT" has incorrectly called "cmd" after a non-existing command was. called by the shell. This was a result of the shared data from vfork(). Thanks to Martijn Dekker for reporting. - Bourne Shell: A unit test case for the above bug has been added. - Bourne Shell: __growstak() now always uses realloc() on modern platforms. This may speed up things up to 15%. Thanks to Jan Engelhardt for reporting. Release 2019-03-11: - libgetopt/Bourne Shell: added an #ifndef __CYGWIN__ in order to avoid overwriting non-standard definitions by standard definitions on Cygwin for the global getopt() variables. Thanks to Heiko Ei[eszett]feldt for proposing this fix. - Bourne Shell: better comment in bltin.c
2019-03-19bosh: update to 20190311.wiz2-8/+8
Update provided by Michael Bäuerle via pkgsrc-wip. Changelog ========= Release 2019-02-18: - libgetopt: The undocumented variable "_sp" from SVr4 has been renamed to "opt_sp" and (on platforms that support "#pragma weak") there is a weak reference _sp to that new variable, giving backwards compatibility. The reason for doing this is to make sure that people on Illumos or Oracle Solaris, who still have an outdated version of getopt() in their local libc, do not try to link the Bourne Shell only against their old getopt(). If they did this, they would not get the documented enhanced getopt() features from the Bourne Shell. - Bourne Shell: The shell now uses "opt_sp" as the name for the undocumented additional getopt() interface from AT&T. This has been done to avoid being able to link the Bourne Shell on Illumos or Oracle Solaris without using our libgetopt. If this was done, we could not support UNIX/MULTICS style long options and we could not support -help/--help, since the latter is implemented via long options that are not an alias to short options. - Bourne Shell: added a new timestamp to the Bourne Shell version. Release 2018-11-21: - Bourne Shell: make it exit the whole shell with set -e after a command substitution failed on the right side of a variable assignment that has no command. This is required by POSIX. - Bourne Shell: added a unit tests for the above case. - Bourne Shell: New version date set to 2018-12-08 the this change. Release 2019-01-22: - bsh / Bourne Shell / star: the function hop_dirs() no longer checks for p2 != NULL before calling *p2 = '/' as p2 has been granted to be != NULL from a break with strchr(p, '/') == NULL Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Added a missing /* FALLTHROUGH */ comment.. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: added a range check for $OPTIND to tge getopts(1) implementation Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Removed a nonsense variable in expand() that caused Coverity not to understand that a directory was correctly closed() Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Added a paranoia comparison to make Coverity quiet. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: avoid to call catpath() with a NULL pointer for path Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: check the write() return code in io.c Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Added a paranopia check for "test -o" to make Coperity quiet. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Added (void) before fcntl() in hope to make Coverity quiet. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Removed dead code from readwc() Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: Cstyle changes to xec.c - Bourne Shell: "builtin -d ..." did access free()d memory. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: expand.c: added a check for fd == -1 to avoid calling openat() with that fd. Thanks to Pavel Raiskup for poiting to a related Coverity message. -Bourne Shell: func.c: added a check for fd == -1 to avoid calling read()/close() with that fd. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: jobs.c: enlarged a buffer to be of same size as numbuf[] to avoid a potential buffer overflow. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: print.c::prt_cntl() had a very old (AT&T) bug with printing byte sequences that get an error with mbtowc() and it did not print byte sequences correctly that refer to legal but "nonprintable" multi byte characters. Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: xec.c: the reserved word "time" could cause to access uninitialized memory if the string in $TIMEFORMAT contains the format %J Thanks to Pavel Raiskup for poiting to a related Coverity message. - Bourne Shell: xec.c: added a paranoia check on whether findnam("funcname") returns NULL even though the existence of a function with that name already has been verified via the hash service. Thanks to Pavel Raiskup for poiting to a related Coverity message. Release 2019-02-18: - Bourne Shell: Another vfork() problem has been fixed. "trap cmd EXIT" has incorrectly called "cmd" after a non-existing command was. called by the shell. This was a result of the shared data from vfork(). Thanks to Martijn Dekker for reporting. - Bourne Shell: A unit test case for the above bug has been added. - Bourne Shell: __growstak() now always uses realloc() on modern platforms. This may speed up things up to 15%. Thanks to Jan Engelhardt for reporting. Release 2019-03-11: - libgetopt/Bourne Shell: added an #ifndef __CYGWIN__ in order to avoid overwriting non-standard definitions by standard definitions on Cygwin for the global getopt() variables. Thanks to Heiko Ei[eszett]feldt for proposing this fix. - Bourne Shell: better comment in bltin.c
2019-03-16zsh: remove --enable-zsh-mem from default arguments.wiz2-7/+4
Bump PKGREVISION.
2019-03-16Add comments for next update or revbump to use external mallocryoon2-2/+5
2019-03-15Update to 5.7.1ryoon4-10/+12
* Move --enable-zsh-mem configure option to non-debug part to stabilize zsh with NetBSD's new jemalloc Changelog: 2019-02-03 dana <dana@dana.is> * unposted: Config/version.mk, Etc/FAQ.yo, README: Update for 5.7.1 * 44034: Completion/Unix/Type/_date_formats: Complete %9./%N, adjust some wording * 44033: Completion/Unix/Command/_dos2unix: Add completion for dos2unix/unix2dos * 44030: Src/prompt.c, Test/D01prompt.ztst: Return error for unrecognised colour name 2019-01-28 Fredric Silberberg <fred@silberberg.xyz> * github #32: Completion/Unix/Command/_git: Fix a typo in the git tag completion. 2018-01-27 dana <dana@dana.is> * unposted: Etc/creating-a-release.txt: Document additional release steps * 44020: Functions/VCS_Info/Backends/VCS_INFO_detect_p4: Fix infinite recursion
2019-03-14zsh: add debug option, default offwiz1-2/+12
This makes zsh much more stable on -current for me.
2019-03-10Update mksh to R57.bsiegert3-13/+13
R57 rolls up bugfixes, with few hard changes: * [gecko2] Update operating environment reporting for the Macintosh * [Martijn Dekker] make ${foo#'bar'} in here document behave like ksh93 * [Martijn Dekker] quote empty strings for re-entry into shell * [tg, G.raud Meyer] Improve documentation, especially for tty states * [tg] Protect against entering line editing with bad saved tty state * [tg] Fix set -o allexport for arrays (which we apparently do) * [tg] Handle lseek(2) returning -1 as pointed out by Coverity Scan * [tg] Fix left-padding UTF-8 strings * [tg, G.raud Meyer] Fix using the ?-m? flag on the command line * [tg] Update to UCD 11.0.0 * [multiplexd] Fix a segfault using ^W during search in Vi mode * [tg] Fix an error message; add a test for controlling tty * [tg] Permit unsetting LINES and COLUMNS, for those who need it * [tg] Fix manpage bug (RedHat BZ#1612173) * [tg] Minor spelling cleanup * [tg] Unbreak high-bit7 (n?n-ASCII) heredoc separators (LP#1779179) * [tg] Allow dumping high-bit7-char-containing strings in DEBUG mode * [tg] Add some testcases for behaviour questions popped up in IRC * [tg] Trick a GCC warning, to make up for it ignoring lint(1) hints * [tg] Add O_MAYEXEC support for CLIP OS * [tg] Make dup-to-self with ksh-style fd?3 closing work; catern via IRC * [tg] Add compat glue for newer GNU groff mdoc to the manpages * [tg] Trigger EXIT trap after single-command subshells (Debian #910276) * [tg] Document set -eo pipefail caveat (LP#1804504) * [tg] Fix MKSH_EARLY_LOCALE_TRACKING warning * [tg] Document that, when your Unix is broken, GIGO applies (LP#1817959) * [tg] Improve error message for inaccessible executables (LP#1817789)
2019-02-28bash: handle O_CLOEXEC not being defined (Solaris 10)maya2-1/+37
(While this says "example", it's built during the "make install" phase) Reported by Hiroshi Hakoyama in PR pkg/52045
2019-02-24zsh-autosuggestions: update to 0.5.0.wiz2-7/+7
## v0.5.0 - Don't overwrite config with default values (#335) - Support fallback strategies by supplying array to suggestion config var - Rename "default" suggestion strategy to "history" to name it based on what it actually does - Reset opts in some functions affected by `GLOB_SUBST` (#334) - Support widgets starting with dashes (ex: `-a-widget`) (#337) - Skip async tests in zsh versions less than 5.0.8 because of reliability issues - Fix handling of newline + carriage return in async pty (#333)
2019-02-13fish: temporarily disable the functionality of man.fishmaya3-2/+48
if MANPATH is empty but the environment variable is respected, we won't be able to find any man pages, because fish set it to PREFIX/share/fish/man bump PKGREVISION
2019-02-12fish: update to 3.0.0maya10-163/+275
Add a "doc" option, default on, to avoid a doxygen dependency. requested by martin & also in PR pkg/53934. # fish 3.0.0 (released December 28, 2018) fish 3 is a major release, which introduces some breaking changes alongside improved functionality. Although most existing scripts will continue to work, they should be reviewed against the list contained in the 3.0b1 release notes below. Compared to the beta release of fish 3.0b1, fish version 3.0.0: - builds correctly against musl libc (#5407) - handles huge numeric arguments to `test` correctly (#5414) - removes the history colouring introduced in 3.0b1, which did not always work correctly There is one significant known issue which was not able to be corrected before the release: - fish 3.0.0 builds on Cygwin (#5423), but does not run correctly (#5426) and will result in a hanging terminal when started. Cygwin users are encouraged to continue using 2.7.1 until a release which corrects this is available. If you are upgrading from version 2.7.1 or before, please also review the release notes for 3.0b1 (included below). --- # fish 3.0b1 (released December 11, 2018) fish 3 is a major release, which introduces some breaking changes alongside improved functionality. Although most existing scripts will continue to work, they should be reviewed against the list below. ## Notable non-backward compatible changes - Process and job expansion has largely been removed. `%` will no longer perform these expansions, except for `%self` for the PID of the current shell. Additionally, job management commands (`disown`, `wait`, `bg`, `fg` and `kill`) will expand job specifiers starting with `%` (#4230, #1202). - `set x[1] x[2] a b`, to set multiple elements of an array at once, is no longer valid syntax (#4236). - A literal `{}` now expands to itself, rather than nothing. This makes working with `find -exec` easier (#1109, #4632). - Literally accessing a zero-index is now illegal syntax and is caught by the parser (#4862). (fish indices start at 1) - Successive commas in brace expansions are handled in less surprising manner. For example, `{,,,}` expands to four empty strings rather than an empty string, a comma and an empty string again (#3002, #4632). - `for` loop control variables are no longer local to the `for` block (#1935). - Variables set in `if` and `while` conditions are available outside the block (#4820). - Local exported (`set -lx`) vars are now visible to functions (#1091). - The new `math` builtin (see below) does not support logical expressions; `test` should be used instead (#4777). - Range expansion will now behave sensibly when given a single positive and negative index (`$foo[5..-1]` or `$foo[-1..5]`), clamping to the last valid index without changing direction if the list has fewer elements than expected. - `read` now uses `-s` as short for `--silent` (à la `bash`); `--shell`'s abbreviation (formerly `-s`) is now `-S` instead (#4490). - `cd` no longer resolves symlinks. fish now maintains a virtual path, matching other shells (#3350). - `source` now requires an explicit `-` as the filename to read from the terminal (#2633). - Arguments to `end` are now errors, instead of being silently ignored. - The names `argparse`, `read`, `set`, `status`, `test` and `[` are now reserved and not allowed as function names. This prevents users unintentionally breaking stuff (#3000). - The `fish_user_abbreviations` variable is no longer used; abbreviations will be migrated to the new storage format automatically. - The `FISH_READ_BYTE_LIMIT` variable is now called `fish_byte_limit` (#4414). - Environment variables are no longer split into arrays based on the record separator character on startup. Instead, variables are not split, unless their name ends in PATH, in which case they are split on colons (#436). - The `history` builtin's `--with-time` option has been removed; this has been deprecated in favor of `--show-time` since 2.7.0 (#4403). - The internal variables `__fish_datadir` and `__fish_sysconfdir` are now known as `__fish_data_dir` and `__fish_sysconf_dir` respectively. ## Deprecations With the release of fish 3, a number of features have been marked for removal in the future. All users are encouraged to explore alternatives. A small number of these features are currently behind feature flags, which are turned on at present but may be turned off by default in the future. A new feature flags mechanism is added for staging deprecations and breaking changes. Feature flags may be specified at launch with `fish --features ...` or by setting the universal `fish_features` variable. (#4940) - The use of the `IFS` variable for `read` is deprecated; `IFS` will be ignored in the future (#4156). Use the `read --delimiter` option instead. - The `function --on-process-exit` switch will be removed in future (#4700). Use the `fish_exit` event instead: `function --on-event fish_exit`. - `$_` is deprecated and will removed in the future (#813). Use `status current-command` in a command substitution instead. - `^` as a redirection deprecated and will be removed in the future. (#4394). Use `2>` to redirect stderr. This is controlled by the `stderr-nocaret` feature flag. - `?` as a glob (wildcard) is deprecated and will be removed in the future (#4520). This is controlled by the `qmark-noglob` feature flag. ## Notable fixes and improvements ### Syntax changes and new commands - fish now supports `&&` (like `and`), `||` (like `or`), and `!` (like `not`), for better migration from POSIX-compliant shells (#4620). - Variables may be used as commands (#154). - fish may be started in private mode via `fish --private`. Private mode fish sessions do not have access to the history file and any commands evaluated in private mode are not persisted for future sessions. A session variable `$fish_private_mode` can be queried to detect private mode and adjust the behavior of scripts accordingly to respect the user's wish for privacy. - A new `wait` command for waiting on backgrounded processes (#4498). - `math` is now a builtin rather than a wrapper around `bc` (#3157). Floating point computations is now used by default, and can be controlled with the new `--scale` option (#4478). - Setting `$PATH` no longer warns on non-existent directories, allowing for a single $PATH to be shared across machines (eg via dotfiles) (#2969). - `while` sets `$status` to a non-zero value if the loop is not executed (#4982). - Command substitution output is now limited to 10 MB by default, controlled by the `fish_read_limit` variable (#3822). Notably, this is larger than most operating systems' argument size limit, so trying to pass argument lists this size to external commands has never worked. - The machine hostname, where available, is now exposed as the `$hostname` reserved variable. This removes the dependency on the `hostname` executable (#4422). - Bare `bind` invocations in config.fish now work. The `fish_user_key_bindings` function is no longer necessary, but will still be executed if it exists (#5191). - `$fish_pid` and `$last_pid` are available as replacements for `%self` and `%last`. ### New features in commands - `alias` has a new `--save` option to save the generated function immediately (#4878). - `bind` has a new `--silent` option to ignore bind requests for named keys not available under the current terminal (#4188, #4431). - `complete` has a new `--keep-order` option to show the provided or dynamically-generated argument list in the same order as specified, rather than alphabetically (#361). - `exec` prompts for confirmation if background jobs are running. - `funced` has a new `--save` option to automatically save the edited function after successfully editing (#4668). - `functions` has a new ` --handlers` option to show functions registered as event handlers (#4694). - `history search` supports globs for wildcard searching (#3136) and has a new `--reverse` option to show entries from oldest to newest (#4375). - `jobs` has a new `--quiet` option to silence the output. - `read` has a new `--delimiter` option for splitting input into arrays (#4256). - `read` writes directly to stdout if called without arguments (#4407). - `read` can now read individual lines into separate variables without consuming the input in its entirety via the new `/--line` option. - `set` has new `--append` and `--prepend` options (#1326). - `set` has a new `--show` option to show lots of information about variables (#4265). - `string match` with an empty pattern and `--entire` in glob mode now matches everything instead of nothing (#4971). - `string split` supports a new `--no-empty` option to exclude empty strings from the result (#4779). - `string` has new subcommands `split0` and `join0` for working with NUL-delimited output. - `string` no longer stops processing text after NUL characters (#4605) - `string escape` has a new `--style regex` option for escaping strings to be matched literally in `string` regex operations. - `test` now supports floating point values in numeric comparisons. ### Interactive improvements - A pipe at the end of a line now allows the job to continue on the next line (#1285). - Italics and dim support out of the box on macOS for Terminal.app and iTerm (#4436). - `cd` tab completions no longer descend into the deepest unambiguous path (#4649). - Pager navigation has been improved. Most notably, moving down now wraps around, moving up from the commandline now jumps to the last element and moving right and left now reverse each other even when wrapping around (#4680). - Typing normal characters while the completion pager is active no longer shows the search field. Instead it enters them into the command line, and ends paging (#2249). - A new input binding `pager-toggle-search` toggles the search field in the completions pager on and off. By default, this is bound to Ctrl-S. - Searching in the pager now does a full fuzzy search (#5213). - The pager will now show the full command instead of just its last line if the number of completions is large (#4702). - Abbreviations can be tab-completed (#3233). - Tildes in file names are now properly escaped in completions (#2274). - Wrapping completions (from `complete --wraps` or `function --wraps`) can now inject arguments. For example, `complete gco --wraps 'git checkout'` now works properly (#1976). The `alias` function has been updated to respect this behavior. - Path completions now support expansions, meaning expressions like `python ~/<TAB>` now provides file suggestions just like any other relative or absolute path. (This includes support for other expansions, too.) - Autosuggestions try to avoid arguments that are already present in the command line. - Notifications about crashed processes are now always shown, even in command substitutions (#4962). - The screen is no longer reset after a BEL, fixing graphical glitches (#3693). - vi-mode now supports ';' and ',' motions. This introduces new {forward,backward}-jump-till and repeat-jump{,-reverse} bind functions (#5140). - The `*y` vi-mode binding now works (#5100). - True color is now enabled in neovim by default (#2792). - Terminal size variables (`$COLUMNS`/`$LINES`) are now updated before `fish_prompt` is called, allowing the prompt to react (#904). - Multi-line prompts no longer repeat when the terminal is resized (#2320). - `xclip` support has been added to the clipboard integration (#5020). - The Alt-P keybinding paginates the last command if the command line is empty. - `$cmd_duration` is no longer reset when no command is executed (#5011). - Deleting a one-character word no longer erases the next word as well (#4747). - Token history search (Alt-Up) omits duplicate entries (#4795). - The `fish_escape_delay_ms` timeout, allowing the use of the escape key both on its own and as part of a control sequence, was applied to all control characters; this has been reduced to just the escape key. - Completing a function shows the description properly (#5206). - Added completions for - `ansible`, including `ansible-galaxy`, `ansible-playbook` and `ansible-vault` (#4697) - `bb-power` (#4800) - `bd` (#4472) - `bower` - `clang` and `clang++` (#4174) - `conda` (#4837) - `configure` (for autoconf-generated files only) - `curl` - `doas` (#5196) - `ebuild` (#4911) - `emaint` (#4758) - `eopkg` (#4600) - `exercism` (#4495) - `hjson` - `hugo` (#4529) - `j` (from autojump #4344) - `jbake` (#4814) - `jhipster` (#4472) - `kitty` - `kldload` - `kldunload` - `makensis` (#5242) - `meson` - `mkdocs` (#4906) - `ngrok` (#4642) - OpenBSD's `pkg_add`, `pkg_delete`, `pkg_info`, `pfctl`, `rcctl`, `signify`, and `vmctl` (#4584) - `openocd` - `optipng` - `opkg` (#5168) - `pandoc` (#2937) - `port` (#4737) - `powerpill` (#4800) - `pstack` (#5135) - `serve` (#5026) - `ttx` - `unzip` - `virsh` (#5113) - `xclip` (#5126) - `xsv` - `zfs` and `zpool` (#4608) - Lots of improvements to completions (especially `darcs` (#5112), `git`, `hg` and `sudo`). - Completions for `yarn` and `npm` now require the `all-the-package-names` NPM package for full functionality. - Completions for `bower` and `yarn` now require the `jq` utility for full functionality. - Improved French translations. ### Other fixes and improvements - Significant performance improvements to `abbr` (#4048), setting variables (#4200, #4341), executing functions, globs (#4579), `string` reading from standard input (#4610), and slicing history (in particular, `$history[1]` for the last executed command). - Fish's internal wcwidth function has been updated to deal with newer Unicode, and the width of some characters can be configured via the `fish_ambiguous_width` (#5149) and `fish_emoji_width` (#2652) variables. Alternatively, a new build-time option INTERNAL_WCWIDTH can be used to use the system's wcwidth instead (#4816). - `functions` correctly supports `-d` as the short form of `--description`. (#5105) - `/etc/paths` is now parsed like macOS' bash `path_helper`, fixing $PATH order (#4336, #4852) on macOS. - Using a read-only variable in a `for` loop produces an error, rather than silently producing incorrect results (#4342). - The universal variables filename no longer contains the hostname or MAC address. It is now at the fixed location `.config/fish/fish_variables` (#1912). - Exported variables in the global or universal scope no longer have their exported status affected by local variables (#2611). - Major rework of terminal and job handling to eliminate bugs (#3805, #3952, #4178, #4235, #4238, #4540, #4929, #5210). - Improvements to the manual page completion generator (#2937, #4313). - `suspend --force` now works correctly (#4672). - Pressing Ctrl-C while running a script now reliably terminates fish (#5253). ### For distributors and developers - fish ships with a new build system based on CMake. CMake 3.2 is the minimum required version. Although the autotools-based Makefile and the Xcode project are still shipped with this release, they will be removed in the near future. All distributors and developers are encouraged to migrate to the CMake build. - Build scripts for most platforms no longer require bash, using the standard sh instead. - The `hostname` command is no longer required for fish to operate.
2019-01-27Update to 5.7wen3-11/+26
Upstream changes: 2019-01-24 : Release 5.7 Bug fix release with a few user visible additions. 2018-01-24 dana <dana@dana.is> * unposted: Config/version.mk, README: Update for 5.7 2018-01-23 dana <dana@dana.is> * 44012: Test/X04zlehighlight.ztst: Fix spurious test failures on OpenBSD 2019-01-23 Mikael Magnusson <mikachu@gmail.com> * 44011: Doc/Zsh/zle.yo, Src/prompt.c, Test/X04zlehighlight.ztst: Only use fg_start_code for non-truecolor
2019-01-21bash: Adjust dollar_dollar_pid type (pid_t, not int)leot2-1/+17
Pointed out by pkgsrc-upstream-trunk32 SmartOS Joyent bulk builds.
2019-01-16posh is BROKEN_ON_PLATFORM.dholland1-2/+4
2019-01-15posh: mark as not for NetBSD and Solariswiz1-2/+3
Needs GNU getopt to work properly. Reported by Michael Bäuerle.
2019-01-15PR/53841: Update shells/xonsh to 0.8.8.nonaka6-105/+184
==================== Xonsh Change Log ==================== v0.8.8 ==================== **Added:** * ``vox new`` has an added ``-p --interpreter`` flag for choosing the python interpreter to use for virtualenv creation * The default Python intrepreter vox uses to create virtual environments can be set using the ``$VOX_DEFAULT_INTERPRETER`` environment variable. **Changed:** * ``lib.ChainDB`` now resolves results to the type of the inputs if possible v0.8.7 ==================== **Added:** * New xonsh syntax ``pf`` strings -- combining path strings with f-strings. Usage: .. code-block:: bash gil@bad_cat ~ $ repos = 'github.com' gil@bad_cat ~ $ pf"~/{repos}" PosixPath('/home/gil/github.com') gil@bad_cat ~ $ pf"{$HOME}" PosixPath('/home/gil') gil@bad_cat ~ $ pf"/home/${'US' + 'ER'}" PosixPath('/home/gil') **Fixed:** * Set ``ls`` to ``predict_true`` in ``default_threadable_predictors``. This prevents ``ls`` on OSX from being flagged on OSX as unthreadable (incorrectly) because it relies on ``ncurses``. v0.8.6 ==================== **Added:** * Doco about how to update xonsh and how to set and unset environment variables **Fixed:** * Updated behavior of the ``cat`` coreutils function so that it properly handles as vareity of cases such as: * Exits after concatenating normal files which have a finite size * Continues to run for special files which do not have a size, such as ``/dev/random`` * Is interruptable in all cases with Crtl-C. * Callable aliases were not properly raising a ``CalledProcessError`` when they returned a non-zero exist status when ``$RAISE_SUBPROC_ERROR = True``. This has been fixed. * Fixed interpretation of color names with PTK2 and Pygments 2.3.1. v0.8.5 ==================== **Added:** * Add alias to `base16 shell <https://github.com/chriskempson/base16-shell>`_ * Installation / Usage 1. To install use pip .. code-block:: bash python3 -m pip install xontrib-base16-shell 2. Add on ``~/.xonshrc`` .. code:: python :number-lines: $BASE16_SHELL = $HOME + "/.config/base16-shell/" xontrib load base16_shell 3. See image .. image:: https://raw.githubusercontent.com/ErickTucto/xontrib-base16-shell/master/docs/terminal.png :width: 600px :alt: terminal.png * New ``DumbShell`` class that kicks in whenever ``$TERM == "dumb"``. This usually happens in emacs. Currently, this class inherits from the ``ReadlineShell`` but adds some light customization to make sure that xonsh looks good in the resultant terminal emulator. * Aliases from foreign shells (e.g. Bash) that are more than single expressions, or contain sub-shell executions, are now evaluated and run in the foreign shell. Previously, xonsh would attempt to translate the alias from sh-lang into xonsh. These restrictions have been removed. For example, the following now works: .. code-block:: sh $ source-bash 'alias eee="echo aaa \$(echo b)"' $ eee aaa b * New ``ForeignShellBaseAlias``, ``ForeignShellFunctionAlias``, and ``ForeignShellExecAlias`` classes have been added which manage foreign shell alias execution. **Changed:** * String aliases will now first be checked to see if they contain sub-expressions that require evaluations, such as ``@(expr)``, ``$[cmd]``, etc. If they do, then an ``ExecAlias`` will be constructed, rather than a simple list-of-strs substitutiuon alias being used. For example: .. code-block:: sh $ aliases['uuu'] = "echo ccc $(echo ddd)" $ aliases['uuu'] ExecAlias('echo ccc $(echo ddd)\n', filename='<exec-alias:uuu>') $ uuu ccc ddd * The ``parse_aliases()`` function now requires the shell name. * ``ForeignShellFunctionAlias`` now inherits from ``ForeignShellBaseAlias`` rather than ``object``. **Fixed:** * Fixed issues where the prompt-toolkit v2 shell would print an extra newline after Python evaluations in interactive mode. v0.8.4 ==================== **Added:** * Added the possibility of arbitrary paths to the help strings in ``vox activate`` and ``vox remove``; also updated the documentation accordingly. * New ``xonsh.aliases.ExecAlias`` class enables multi-statement aliases. * New ``xonsh.ast.isexpression()`` function will return a boolean of whether code is a simple xonsh expression or not. * Added top-level ``run-tests.xsh`` script for safely running the test suite. **Changed:** * String aliases are no longer split with ``shlex.split()``, but instead use ``xonsh.lexer.Lexer.split()``. * Update xonsh/prompt/cwd.py _collapsed_pwd to print 2 chars if a directory begins with "." * test which determines whether a directory is a virtualenv previously it used to check the existence of 'pyvenv.cfg' now it checks if 'bin/python' is executable **Fixed:** * Fixed issue with ``and`` & ``or`` being incorrectly tokenized in implicit subprocesses. Auto-wrapping of certain subprocesses will now correctly work. For example:: $ echo x-and-y x-and-y * Fix EOFError when press `control+d` * fix no candidates if no permission files in PATH * Fixed interpretation of color names with PTK2 and Pygments 2.3. * Several ResourceWarnings: unclosed file in tests * AttributeError crash when using --timings flag * issue #2929 v0.8.3 ==================== **Added:** * Dociumentation paragrapgh about gow to run xonsh in Emacs shell **Changed:** * Updated what pip requirements are needed to build the documnetaion * ``$XONSH_TRACEBACK_LOGFILE`` now beside strings also accepts ``os.PathLike`` objects. * Updated vended version of ``ply`` to 3.11 * Deprecation warnings now print from stacklevel 3. **Fixed:** * Annotation assignment statements (e.g. ``x : int = 42``) are now supported. * Fixed error output wording for fg and bg commands * Flake8 errors * xonsh can now properly parse import statements with trailing comma within parentheses, e.g.:: from x import (y, z,) * ResourceWarning: unclosed scandir iterator in imphooks.py * Removed use of deprecated ``inspect.formatargspec()`` for ``inspect.signature()`` * ``Makefile`` directive that updates vended version of ``ply`` v0.8.2 ==================== **Changed:** * Now there is only a single instance of ``string.Formatter()`` in the code base, which is called ``xonsh.tools.FORMATTER``. **Fixed:** * f-strings (``f"{expr}"``) are now fully capable of executing xonsh expressions. The one exception to this is that ``![cmd]`` and ``!(cmd)`` don't work because the ``!`` character interferes with Python string formatting. If you need to run subprocesses inside of f-strings, use ``$[cmd]`` and ``$(cmd)`` instead. * Fixed occasional "no attribute 'settitle' error" v0.8.1 ==================== **Added:** * ``SubprocSpec`` has a new ``pipeline_index`` integer attribute that indicates the commands position in a pipeline. For example, in .. code-block:: sh p = ![ls -l | grep x] The ``ls`` command would have a pipeline index of 0 (``p.specs[0].pipeline_index == 0``) and ``grep`` would have a pipeline index of 1 (``p.specs[1].pipeline_index == 1``). This may be usefule in callable alaises which recieve the spec as an argument. **Changed:** * Removed ``fish`` from list of supported foreign shells in the wizard. * Circle CI config updated to use a pinned version of ``black`` (18.9b0) * Pytest plugin now uses ``xonsh.main.setup()`` to setup test environment. * Linux platform discovery will no longer use ``platform.linux_distribution()`` on Python >=3.6.6. due to pending deprecation warning. * Updated Linux Guide as Xonsh is now available in Arch Linux official repositories. **Fixed:** * Builtin dynamic proxies and deprecation warning proxies were not deleting attributes and items properly. * Fixed stdout/sdterr writing infinite recurssion error that would occur in long pipelines of callable aliases. * Fixed a bug which under very rare conditions could cause the shell to die with PermissionError exception while sending SIGSTOP signal to a child process. * Fixed further raw string deprecation warnings thoughout the code base. v0.8.0 ==================== **Added:** * Windows CI jobs on Azure Pipelines * The ``cryptop`` command will no longer have its output captured by default. * Added new env-var ``PTK_STYLE_OVERRIDES``. The variable is a dictionary containing custom prompt_toolkit style definitions. For instance:: $PTK_STYLE_OVERRIDES['completion-menu'] = 'bg:#333333 #EEEEEE' will provide for more visually pleasing completion menu style whereas:: $PTK_STYLE_OVERRIDES['bottom-toolbar'] = 'noreverse' will prevent prompt_toolkit from inverting the bottom toolbar colors (useful for powerline extension users) Note: This only works with prompt_toolkit 2 prompter. **Changed:** * All ``__xonsh_*__`` builtins have been migrated to a ``XonshSession`` instance at ``__xonsh__``. E.g. ``__xonsh_env__`` is now ``__xonsh__.env``. * Other xonsh-specific builtins (such as ``XonshError``) have been proxied to the ``__xonsh__`` session object as well. **Deprecated:** * All ``__xonsh_*__`` builtins are deprected. Instead, the corresponding ``__xonsh__.*`` accessor should be used. The existing ``__xonsh_*__`` accessors still work, but issue annoying warnings. **Fixed:** * Fixed deprecation warnings from unallowed escape sequences as well as importing abstract base classes directly from ``collections`` * Fix for string index error in stripped prefix * bash_completions to include special characters in lprefix Previously, glob expansion characters would not be included in lprefix for replacement .. code-block:: sh $ touch /tmp/abc $ python >>> from bash_completion import bash_completions >>> >>> def get_completions(line): ... split = line.split() ... if len(split) > 1 and not line.endswith(' '): ... prefix = split[-1] ... begidx = len(line.rsplit(prefix)[0]) ... else: ... prefix = '' ... begidx = len(line) ... endidx = len(line) ... return bash_completions(prefix, line, begidx, endidx) ... >>> get_completions('ls /tmp/a*') ({'/tmp/abc '}, 0) Now, lprefix begins at the first special character: .. code-block:: sh $ python >>> from bash_completion import bash_completions >>> >>> def get_completions(line): ... split = line.split() ... if len(split) > 1 and not line.endswith(' '): ... prefix = split[-1] ... begidx = len(line.rsplit(prefix)[0]) ... else: ... prefix = '' ... begidx = len(line) ... endidx = len(line) ... return bash_completions(prefix, line, begidx, endidx) ... >>> get_completions('ls /tmp/a*') ({'/tmp/abc '}, 7) * The ``xonsh.main.setup()`` function now correctly passes the ``shell_type`` argument to the shell instance. * try_subproc_toks now works for subprocs with trailing and leading whitespace Previously, non-greedy wrapping of commands would fail if they had leading and trailing whitespace: .. code-block:: sh $ true && false || echo a xonsh: For full traceback set: $XONSH_SHOW_TRACEBACK = True NameError: name 'false' is not defined $ echo; echo && echo a xonsh: For full traceback set: $XONSH_SHOW_TRACEBACK = True NameError: name 'echo' is not defined Now, the commands are parsed as expected: .. code-block:: sh $ true && false || echo a a $ echo; echo && echo a a v0.7.10 ==================== **Added:** * 'off' can be passed as falsy value to all flags accepting boolean argument. - DragonFly BSD support * Format strings (f-strings) now allow environment variables to be looked up. For example, ``f"{$HOME}"`` will yield ``"/home/user"``. Note that this will look up and fill in the ``detype()``-ed version of the environment variable, i.e. it's native string representation. **Changed:** * Running ``aurman`` command will now be predicted to be unthreaded by default. **Fixed:** * The xonsh ``xonfig wizard`` would crash if an unknown foreign shell was provided. This has been fixed. * The ``hg split`` command will now predict as unthreadable. * Fixed path completer crash on attempted f-string completion v0.7.9 ==================== **Added:** * The python-mode ``@(expr)`` syntax may now be used inside of subprocess arguments, not just as a stand-alone argument. For example: .. code-block:: sh $ x = 'hello' $ echo /path/to/@(x) /path/to/hello This syntax will even properly expand to the outer product if the ``expr`` is a list (or other non-string iterable) of values: .. code-block:: sh $ echo /path/to/@(['hello', 'world']) /path/to/hello /path/to/world $ echo @(['a', 'b']):@('x', 'y') a:x a:y b:x b:y Previously this was not possible. * New ``$DOTGLOB`` environment variable enables globs to match "hidden" files which start with a literal ``.``. Set this variable to ``True`` to get this matching behavior. Cooresponding API changes have been made to ``xonsh.tools.globpath()`` and ``xonsh.tools.iglobpath()`` * New environment variable ``$FOREIGN_ALIASES_SUPPRESS_SKIP_MESSAGE`` enables the removal of skipping foreign alias messages. * New ``--suppress-skip-message`` command line option for skipping foreign alias messages when sourcing foreign shells. **Fixed:** * In Bash completions, if there are no files to source, a ``set()`` will no longer be inserted into the completion script. * Fixed issue with TAB completion in readline not replacing values with spaces properly when the prefix was unquoted. v0.7.8 ==================== **Added:** * ``xonsh.lib.collections.ChainDB``, a chain map which merges mergable fields **Fixed:** * Pass all params to voxapi.create * PTK tab-completion now auto-accepts completion if only one option is present (note that fix is only for PTK2) v0.7.7 ==================== **Added:** * A xontrib which adds support for autojump to xonsh * Added new env-var ``XONSH_HISTORY_MATCH_ANYWHERE``. If set to ``True`` then up-arrow history matching will match existing history entries with the search term located anywhere, not just at the beginning of the line. Default value is ``False`` **Changed:** * Improved iteration over virtual environments in ``Vox.__iter__`` **Fixed:** * Fix for ``Enter`` not returning from Control-R search buffer * Fixed automatic wrapping of many subprocesses that spanned multiple lines via line continuation characters with logical operators separating the commands. For example, the following now works: .. code-block:: sh echo 'a' \ and echo 'b' * Environment swapping would not properly reraise errors due to weird Python name binding issue. v0.7.6 ==================== **Added:** * Callable aliases may now accept a ``stack`` argument. If they do, then the stack, as computed from the aliases call site, is provided as a list of ``FrameInfo`` objects (as detailed in the standard library ``inspect`` module). Otherwise, the ``stack`` parameter is ``None``. * ``SubprocSpec`` now has a ``stack`` attribute, for passing the call stack to callable aliases. This defaults to ``None`` if the spec does not need the stack. The ``resolve_stack()`` method computes the ``stack`` attribute. **Changed:** * xonsh/environ.py Exceptions are caught in the code executed under Env.swap() **Fixed:** * Scripts are now cached by their realpath, not just abspath. * Fixed a potential crash (``AssertionError: wrong color format``) on Python 3.5 and prompt_toolkit 1. * The ``completer`` command now correctly finds completion functions when nested inside of other functions. * Fixed a crash when using the ``$XONSH_STDERR_PREFIX/POSTFIX`` with prompt_toolkit and Pygments 2.2. v0.7.5 ==================== **Fixed:** * Recent command history in ptk2 prompt now returns most recently executed commands first (as expected) * Fixed a regression taat prevented the readline backend from beeing used. This regression was caused by the new ansi-color names, which are incompatible with pygments 2.2. v0.7.4 ==================== **Added:** * New ``xonsh-cat`` command line utility, which is a xonsh replacement for the standard UNIX ``cat`` command. * The new ``xonsh.xoreutils.cat.cat_main()`` enables the ``xonsh.xoreutils.cat`` module to be run as a command line utility. * New ``CommandsCache.is_only_functional_alias()`` and ``CommandsCache.lazy_is_only_functional_alias()`` methods for determining if if a command name is only implemented as a function, and thus has no underlying binary command to execute. * ``xonsh.xontribs.xontribs_load()`` is a new first-class API for loading xontribs via a Python function. * ``$COMPLETIONS_DISPLAY`` now supports readline-like behavior on prompt-toolkit v2. **Changed:** * The xonsh Jupyter kernel now will properly redirect the output of commands such as ``git log``, ``man``, ``less`` and other paged commands to the client. This is done by setting ``$PAGER = 'cat'``. If ``cat`` is not available on the system, ``xonsh-cat`` is used instead. * The ``setup()`` function for starting up a working xonsh has ``aliases``, ``xontribs``, and ``threadable_predictors`` as new additional keyword arguments for customizing the loading of xonsh. **Fixed:** * Fixed a bug with converting new PTK2 colors names to old names when using PTK1 or Jupyter as the shell type. * ``CommandsCache.locate_binary()`` will now properly return None when ``ignore_alias=False`` and the command is only a functional alias, such as with ``cd``. Previously, it would return the name of the command. * Fixed issue with ``$COMPLETIONS_DISPLAY`` raising an error on prompt-toolkit v2 when the value was not set to ``multi``. * ValueError when executing ``vox list`` v0.7.3 ==================== **Added:** * Add the ``PROMPT_TOOLKIT_COLOR_DEPTH`` environment to xonsh default environment. Possible values are ``DEPTH_1_BIT``/``MONOCHROME``, ``DEPTH_4_BIT``/``ANSI_COLORS_ONLY``, ``DEPTH_8_BIT``/``DEFAULT``, or ``DEPTH_24_BIT``/``TRUE_COLOR``. Note: not all terminals support all color depths. * New way to fix unreadable default terminal colors on Windows 10. Windows 10 now supports true color in the terminal, so if prompt toolkit 2 is installed Xonsh will use a style with hard coded colors instead of the default terminal colors. This will give the same color experience as on linux an mac. The behaviour can be disabled with ``$INTENSIFY_COLORS_ON_WIN`` environment variable. * New ``JupyterShell`` for interactive interfacing with Jupyter. **Changed:** * All ansicolor names used in styles have ben updated to the color names used by prompt_toolkit 2. The new names are are much easier to understand (e.g. ``ansicyan``/``ansibrightcyan`` vs. the old ``#ansiteal``/``#ansiturquoise``). The names are automatically translated back when using prompt_toolkit 1. **Removed:** * Removed support for pygments < 2.2. **Fixed:** * New ansi-color names fixes the problem with darker colors using prompt_toolkit 2 on windows. * Fixed a problem with the color styles on prompt toolkit 2. The default pygment style is no longer merged into style selected in xonsh. * The JupyterKernel has been fixed from a rather broken state. v0.7.2 ==================== **Added:** * ``history show`` builtin now supports optional ``-0`` parameter that switches the output to null-delimited. Useful for piping history to external filters. **Fixed:** * If exception is raised in indir context manager, return to original directory * Fixed issue that autocomplete menu does not display at terminal's maximum height v0.7.1 ==================== **Added:** * Added feature to aliases. * ``xonsh.lib.os.rmtree()`` an rmtree which works on windows properly (even with git) **Changed:** * set default value of ``$AUTO_SUGGEST_IN_COMPLETIONS=False`` * Use the ``pygments_cache.get_all_styles()`` function instead of interacting directly with pygments. **Fixed:** * Fixed issue with ``$ARG<N>`` varaibles not being passed to subprocesses correctly. * Fixed issue with multiline string inside of ``@(expr)`` in unwrapped subprocesses. For example, the following now works:: echo @("""hello mom""") * ``CommandPipeline.output`` now does properly lazy, non-blocking creation of output string. ``CommandPipeline.out`` remains blocking. * Fix regression in ``INTENSIFY_COLORS_ON_WIN`` functionality due to prompt_toolkit 2 update. * Fixed issue that can't insert quotation marks and double quotes for completion. * Fixed issue with ``SyntaxErrors`` being reported on the wrong line when a block of code contained multiple implicit subprocesses. * ``prompt_toolkit >= 2`` will start up even if Pygments isn't present * Fixed a regression with ``xonfig styles`` reporting ``AttributeError: module 'pygments' has no attribute 'styles'`` * ptk dependent xontribs (that use custom keybindings) now work with both ptk1 and ptk2 * Fixed async tokenizing issue on Python v3.7. v0.7.0 ==================== **Added:** * Added a hook for printing a spcial display method on an object. * Support for ``prompt_toolkit 2.0`` * The ``--shell-type`` (``$SHELL_TYPE``) may now be specified using shortcuts, such as ``rl`` for ``readline`` and ``ptk2`` for ``prompt_toolkit2``. See ``xonsh --help`` for a full listing of available aliases. **Fixed:** - Restored AUGASSIGN_OPS definition, which was inadvertently removed. v0.6.10 ==================== **Added:** * ``xonsh.lib.subprocess.check_output`` as a ``check_output`` drop in **Fixed:** * ``xonsh.lib.subprocess.run`` doesn't change dirs unless asked v0.6.9 ==================== **Added:** * New xonsh standard library ``xonsh.lib`` subpackage * ``xonsh.lib.os.indir`` a context manager for temporarily entering into a directory * ``xonsh.lib.subprocess.run`` and ``xonsh.lib.subprocess.check_call`` subprocess stubs using ``xonsh`` as the backend **Fixed:** * update xoreutils._which.which() for python 3.x support. * Fixed issue with incorrect strip lengths for prefixes with quotes in them * Fixed bash script to also consider leading double quotes and not just single quotes * Launching xonsh with prompt_toolkit version 2.x no longer fails, and instead fallsback to readline shell. This is a patch for until prompt_toolkit 2.x support is fully implemented. See PR #2570 v0.6.8 ==================== **Fixed:** * completions relative to ``CDPATH`` only trigger when used with ``cd`` * Import of ``ctypes.util`` is now explictly performed, as needed. Python v3.7 no longer imports this module along with ``ctypes``. * Fixed issue with pygments-cache not properly generating a cache the first time when using prompt-toolkit. This was due to a lingering lazy import of ``pkg_resources`` that has been removed. * Removed duplicate ``pip`` completer * ``bash_completion`` no longer returns invalid prefix lengths for directories containing escape file names * Fixed error when using redirection (e.g., >) on Windows. v0.6.7 ==================== **Changed:** * Xonsh live example has been re-added back to the documentation. **Fixed:** * Fixed issue where xonsh would fail to properly return the terminal prompt (and eat up 100% CPU) after a failed subprocess command in interactive mode if ``$RAISE_SUBPROC_ERROR = True``. * ``xonsh.tokenize.tok_name`` no longer mutates the standard library ``tokenize.tok_name``. A copy is made on import instead. v0.6.6 ==================== **Added:** * A multipurpose add method to EnvPath. For example: .. code-block:: xonshcon $ $PATH EnvPath( ['/usr/bin', '/usr/local/bin', '/bin'] ) $ $PATH.add('~/.local/bin', front=True); $PATH EnvPath( ['/home/user/.local/bin', '/usr/bin', '/usr/local/bin', '/bin'] ) $ $PATH.add('/usr/bin', front=True, replace=True); $PATH EnvPath( ['/usr/bin', '/home/user/.local/bin', '/usr/local/bin', '/bin'] ) * Added ``pygments-cache`` project in order to reduce startup time. **Changed:** * built_ins.py, corrected a typo. * test/test_news.py It now uses regex to verify the format of rst files * Mercurial (``hg``) will no longer run in a threadable subprocess when it is run in interactive mode. **Fixed:** * issue 2313 v0.6.5 ==================== **Added:** * Wizard ``FileInsterter`` node class now has ``dumps()`` method for converting a mapping to a string to insert in a file. **Fixed:** * Fixed issue with ``xonfig wizard`` writer failing to write valid run control files for environment variables that are containter types. In particular, the storage of ``$XONSH_HISTORY_SIZE`` has been fixed. v0.6.4 ==================== **Changed:** * Error message improved for sourcing foreign shells, when file cannot be found or there is a syntax error. **Fixed:** * Fixed issues with readline completer tab completing entries with spaces. * Fixed ``xonsh.tools.columnize()`` bug the prevented single-row input from being columnized correctly. * Now honor ASYNC and AWAIT as keywords in tokenizer on Python 3.7. v0.6.3 ==================== **Added:** * Docs for using ``@(<expr>)`` as a way to run commands and a gotcha about list of strings vs single string expressions. * Ubuntu versions which xonsh is packaged for (with xonsh versions) **Changed:** * When reporting errors without a traceback (i.e. ``$XONSH_SHOW_TRACEBACK = False``) and the error is a ``XonshError`` the exception type is not longer printed. * ``CommandPipeline.proc`` may now be ``None``, to accomodate when the process fails to even start (i.e. a missing command or incorrect permisions). **Fixed:** * The ``curl`` command will now be run in a thread, which prevents documents that do not end in a newline from writing over the next prompt and vice versa. * Fix bug on Windows when ``PATHEXT`` environment variable did not exist. This also fixes building the xonsh documentation on Windows. * Fixed a bug in the `free_cwd <http://xon.sh/xontribs.html#free-cwd>`__ Windows Xontrib, which caused the prompt to error if the current directory is deleted/renamed from an other process. * Fixed issue with ``$XONSH_SHOW_TRACEBACK`` not being respected in subprocess mode when the command could not be found or had incorrect permissions. v0.6.2 ==================== **Added:** * Release tarballs now include licenses and minimal documentation for xonsh and ply * Wizard now has a ``FileInserter`` node that allows blocks to be inserted and replaced inside of a file. This adheres to conversion rules fordumping as provided on this node. * New ``xonsh.wizard.StateVisitor.flatten()`` method for flattening the current state. **Changed:** * The xonsh startup wizard will only be triggered if no xonshrc files exist and the file ``~/.local/config/xonsh/no-wizard`` is not present. * The ``xonfig wizard`` command will now run write out to the xonshrc file. * Wizard nodes ``Save`` and ``Load`` had their names changed to ``SaveJSON`` and ``LoadJSON``. **Removed:** * Static configuration is dead (``config.json``), long live run control (``xonshrc``)! * The following evironment variables have been removed as they are no longer needed: ``$LOADED_CONFIG`` and ``$XONSHCONFIG``. * Many support functions for static configuration have also been removed. **Fixed:** * Files starting with ``#`` are auto-escaped by TAB completion v0.6.1 ==================== **Added:** * Support for MSYS2. * New ``xonsh.main.setup()`` function for starting up xonsh in 3rd party packages. **Changed:** * Updated CircleCI to use circle version 2.0 * Replaced StopIteration with return in CommandPipeline.iterraw. * Xonsh run control now also looks for the XDG-compliant file ``~/.config/xonsh/rc.xsh`` at startup. **Fixed:** * Clean out ``$LINES`` and ``$COLUMNS`` if set, preventing some programs from drawing weirdly * cat from xoreutils now outputs in configured encoding * Fixed hanging issue with pipelines whose middle processes exit before the first or last process. * Fixed issue where xonsh would deduplicate spaces from bash autocompletions. * Fixed failing redirections from stderr to stdout when the command being executed was a callable alias. * Ensure that the ``free_cwd`` contrib can only be active on pure Windows. * Made an exceptional case in ``iglobpath()`` more robust when Python globbing fails for due to strange scrandir issue. * Unexpected process suspension on Cygwin and MSYS2. * ``$XONSH_APPEND_NEWLINE`` will now default to True when in interactive mode. * Fixed issue with uncalled lambdas being run in subproc mode. * Lambda nodes not have proper line and column numbers in AST. * Properly throw ``SyntaxError`` when no kwargs are defined in a kwarg-only function. This used to throw a ``TypeError: 'NoneType' object is not iterable``. * Addressed issue where encoding and errors were None when teeing output. * Commands like ``git c`` would complete to ``git 'checkout '`` because git adds an extra space to the end of the completion, which was being captured in the completion. Xonsh now fixes the git issue while retaining all whitespace when there is other internal whitespace. v0.6.0 ==================== **Added:** * Added an alias command, matching bash's implementation, available as part of bashisms. * New ``$AUTO_SUGGEST_IN_COMPLETIONS`` environment variable that enables/disables whether the auto-suggestion result appears in the tab completions. * Added ``__add__()`` and ``__radd__()`` methods to ``EnvPath``. * Xonsh now supports f-strings, as in Python v3.6+. * Added ``ipython`` as unthreadable in command cache threadabilty predictors. * Added ``whole_word_jumping`` xontrib * Added ``$XONSH_APPEND_NEWLINE`` environment variable * Support for PEP 515: Underscores in Numeric Literals * ``xonsh.color_tools.make_palette()`` Simple rename of the pre-existing ``xonsh.color_tools.make_pallete()`` function. * ``xonsh.tools.decorator()`` function/method decorator. This allows for an API function to be annotated with a decorator that documents deprecation, while also tying in functionality that will warn a user that the function has been deprecated, and, raise an ``AssertionError`` if the function has passed its expiry date. * New xontrib ``schedule`` (Xonsh Task Scheduler) **Changed:** * ``on_pre_prompt`` is now fired before prompt calculations are made, allowing modifications to the prompt. * ``emacsclient`` will now return false in the threadable predictors. * Improved the autopair behavior to match that of popular code editors. * Moved the lazy ``pkg_resources`` package back to its original place. The will hopefully address some of the slowdown issues experiances on some platforms. * When xonsh is used to run an ``xsh`` script, the ``xonshrc`` is not loaded * Change in the behavior of the default predictor with binary analysis. The pattern ``libgpm`` is use, assuming when ``gpm`` is used the program is not threadable. This change solves issues with programs as ``links``. * Error messages added to the ``source`` command if it is used with a language that is not xonsh or Python. **Deprecated:** * ``xonsh.color_tools.make_pallette()`` Deprecated in release 0.5.10 and will be removed in release 0.6.0. **Fixed:** * Now f-strings can be used inside @() without explicit enclosing command in ![] * Fix for ``x, y, *z = ...`` unpacking. * Git branch detection now correctly passes the environment down to the subprocess call. This allows for branch detection when git is installed into a non-standard location. * Escape regex characters in ``path_complete`` to avoid regex parsing errors for certain combinations of characters in path completer * gistatus: Fixed hash not being shown when in detaced HEAD and there are no tags * Fix branch colorization when ``git`` or ``hg`` are aliases. * Fixed leftover ``.git/index.lock`` in ``gitstatus`` * Made JSON history loading more robust to corrupt files. * Starting a new command with an open parentheses will no longer throw a traceback when ``$UPDATE_COMPLETIONS_ON_KEYPRESS`` is ``True``. * Automatically wrapping subprocess calls would sometimes include semincolons and other line-ending tokens, rather than stopping at them. This has been fixed. * Numerous spelling errors in documentation, docstrings/comments, text strings and local variable names. * Spelling error in the ``xonsh.color_tools.make_pallete()`` public function declaration. This was fixed by renaming the function to ``xonsh.color_tools.make_palette()`` while maintaining a binding of ``make_pallete()`` to the new ``make_palette()`` in case users are already used to this API. * Fixed issue with starting triple quote strings being run as a command. * Fixed a problem with escaping charet (^) character for cmd.exe in the source-cmd function. * ``EOF in multi-line statement`` errors were misreported as being on line 0. Now they are correctly reported as being on the last line of the file. v0.5.12 ==================== **Fixed:** * Fixed ``release.xsh`` to prevent it from dirtying the repo on release and leading to an unwanted ``.dev`` suffix on the version number v0.5.11 ==================== **Added:** * ``release.xsh`` creates a github release with the merged news entries as the release body **Fixed:** * ``xonfig`` now displays the proper value for "on linux" v0.5.10 ==================== **Added:** * Added ``xclip`` and ``repo`` to default threadable predictors (Issues #2355 and #2348) * Pretty printing of the $PATH variable * Add "fzf-widgets" xontrib which provides fuzzy search productivity widgets with on custom keybindings to xontrib list. * New ``free_cwd`` xontrib for Windows, which prevent the current directory from being locked when the prompt is shown. This allows the other programs or Windows explorer to delete the current or parent directory. This is accomplished by resetting the CWD to the users home directory temporarily while the prompt is displayed. The directory is still locked while any commands are processed so xonsh still can't remove it own working directory. **Changed:** * Codecov threshold to 2% **Removed:** * On Windows environments variables in wrapped like``%foo%`` are no longer expanded automatically. **Fixed:** * Fixed the ``--rc`` option so it now runs xonsh with the specified rc file * ``@$`` operator now functions properly when returned command is an alias * Correct line continuation would not work on Windows if the line continuations were used in the ``xonshrc`` file. * Fixed a regression in the Windows ``sudo`` command, that allows users to run elevated commands in xonsh. * Fix echo command from xoreutils. * Fixed a bug on Windows which meant xonsh wasn't using PATH environment variable but instead relying on a default value from the windows registry. v0.5.9 ==================== **Added:** * Add ``Alt .`` keybinding to ``bashisms-xontrib`` to insert last argument of previous command into current buffer **Fixed:** * Fix crash when openSSH version of bash is on PATH on Windows. * Added missing ensurers to make sure that ``bool`` env_vars are bools and ``int`` env_vars are integers: * ``DIRSTACK_SIZE`` * ``EXPAND_ENV_VARS`` * ``PUSHD_MINUS`` * ``PUSHD_SILENT`` * ``SUGGEST_COMMANDS`` * ``SUGGEST_MAX_NUM`` * ``SUGGEST_THRESHOLD`` v0.5.8 ==================== **Changed:** * The ``xonsh.platform.os_environ`` wrapper is now case-insensitive and case-preserving on Windows. * The private ``_TeeStd`` class will no longer attempt to write to a standard buffer after the tee has been 'closed' and the standard buffer returned to the system. **Fixed:** * Fixed a bug on py34 where os.scandir was used by accident. * Line continuations (``\\``) is subproc mode will no longer consume the surrounding whitespace. * Fixed a bug if foreign_shell name was not written in lower case in the static configuration file ``config.json`` * Fixed a regression on Windows where caused ``which`` reported that the ``PATH`` environment variable could not be found. * Fixed issue with foregrounding jobs that were started in the background. * Fixed that ``Ctrl-C`` crashes xonsh after running an invalid command. * Fixed an potential ``ProcessLookupError`` issue, see #2288. v0.5.7 ==================== **Added:** * New ``color_tools`` module provides basic color tools for converting to and from various formats as well as creating palettes from color strings. * Redirections may now be used in string and list-of-strings aliases. * Subprocess redirection may now forego the whitespace between the redirection and a file name. For example, ``echo hello world >/dev/null``. * Add a ``-P`` flag to the ``cd`` function in order to change directory and following symlinks. * ``xonfig tutorial`` command to launch the http://xon.sh/tutorial in the browser. * ``@(...)`` syntax now supports generators and tuples without parentheses. * Sourcing foreign shells now have the ``--show`` option, which lets you see when script will be run, and the ``--dryrun`` option which prevents the source from actually taking place. Xonsh's foreign shell API also added these keyword arguments. * Subprocess mode now supports subshells. Place any xonsh code between two parentheses, e.g. ``(cmd)``, to run this command in a separate xonsh subprocess. * Foreign shell aliases now have the ability to take extra arguments, if needed. * Xonsh will issue a warning message when the current working directory has been remove out from under it and not replaced prior to running the next command. * Line continuation backslashes are respected on Windows in the PTK shell if the backspace is is preceded by a space. * Added ``ponysay`` as a command which will usually not run in a threaded mode in the commands cache. * New ``jsonutils`` module available for serializing special xonsh objects to JSON. **Changed:** * The literal tokens ``and`` and ``or`` must be surrounded by whitespace to delimit subprocess mode. If they do not have whitespace on both sides in subproc mode, they are considered to be part of a command argument. * The ``xontrib`` command is now flagged as unthreadable and will be run on the main Python thread. This allows xontribs to set signal handlers and other operations that require the main thread. * nvim (Neovim) has been flagged as unthreadable * The interactive prompt will now catch ``SystemExit`` and, instead of exiting the session, will refresh the prompt. This is the same process as for keyboard interrupts. * Xonsh no longer launches the wizard for new users. Instead a welcome screen is shown which says how to launch the wizard. * Added Windows ``expanduser()``-like function which prevents the expansion of ``~`` that are not followed by a path separator. * Collecting xonsh history files was reported to have random runtime OSError failures. This exception is now handled, just in case. The The exception will still be printed in debug mode. * ``Shell.stype`` has been renamed to ``Shell.shell_type``. * The configuration wizard now displays the proper control sequence to leave the wizard at the to start of the wizard itself. Note that this is Ctrl+D for readline and Ctrl+C for prompt-toolkit. * Callable alias proxy functions are now more friendly to ``functools.partial()``. * ``prompt.vc.get_hg_branch`` now uses ``os.scandir`` to walk up the filetree looking for a ``.hg`` directory. This results in (generally) faster branch resolution compared to the subprocess call to ``hg root``. * Xonsh's script and code caches will are now invalidated whenever the xonsh version changes for a given Python version. * Autowrapping of subprocess globs has been improved to cover more cases that are ambiguous with Python syntax. * Job control info when foregrounding or backgrounding jobs will now only be displayed when xonsh is in interactive mode. * Enabled virtual terminal processing in the prompt-toolkit shell for Windows. **Fixed:** * 3rd party pygments styles (like solorized or monokailight) are now able to be used in xonsh. These styles are dynamically created upon first use, rather than being lazily loaded by xonsh. * On Windows, ``os.environ`` is case insensitive. This would potentially change the case of environment variables set into the environment. Xonsh now uses ``nt.environ``, the case sensitive counterpart, to avoid these issues on Windows. * Fix how ``$PWD`` is managed in order to work with symlinks gracefully * ``history replay`` no longer barfs on ``style_name`` when setting up the environment * ``Shell.shell_type`` is now properly set to the same value as ``$SHELL_TYPE``. * Fixed ``source-zsh`` to work with zsh v5.2. * Fixed issue where ``del (x, y)`` would raise a syntax error. * Certain vim commands issue commands involving subshells, and this is now supported. * Null bytes handed to Popen are now automatically escaped prior to running a subprocess. This prevents Popen from issuing embedded null byte exceptions. * Xonsh will no longer crash is the current working directory is removed out from under it. * Multiline strings can now be written in subprocess mode. * PTK completions will now correctly deduplicate autosuggest completions and display completions values based on the cursor position. * Fixed bug where trailing backspaces on Windows paths could be interpreted as line continuations characters. Now line continuation characters must be preceded by a space on Windows. This only applies to xonsh in interactive mode to ensure scripts are portable. * Importing ``*.xsh`` files will now respect the encoding listed in that file and properly fallback to UTF-8. This behaviour follows the rules described in PEP 263. * Wizard is now able to properly serialize environment paths. v0.5.6 ==================== **Added:** * New core utility function aliases (written in pure Python) are now available in ``xonsh.xoreutils``. These include: ``cat``, ``echo``, ``pwd``, ``tee``, ``tty``, and ``yes``. These are not enabled by default. Use the new ``coreutils`` xontrib to load them. * CircleCI test post codecov run * The ``trace`` will automatically disable color printing when stdout is not a TTY or stdout is captured. * New ``jedi`` xontrib enables jedi-based tab completions when it is loaded. This supersedes xonsh's default Python-mode completer. * The lexer has a new ``split()`` method which splits strings according to xonsh's rules for whitespace and quotes. * New events for hooking into the Python import process are now available. You can now provide a handler for: - ``on_import_pre_find_spec`` - ``on_import_post_find_spec`` - ``on_import_pre_create_module`` - ``on_import_post_create_module`` - ``on_import_pre_exec_module`` - ``on_import_post_exec_module`` **Changed:** * The prompt toolkit shell's first completion will now be the current token from the auto-suggestion, if available. * Sourcing foreign shells will now safely skip applying aliases with the same name as existing xonsh aliases by default. This prevents accidentally overwriting important xonsh standard aliases, such as ``cd``. **Fixed:** * Threadable prediction for subprocesses will now consult both the command as it was typed in and any resolved aliases. * The first prompt will no longer print in the middle of the line if the user has already started typing. * Windows consoles will now automatically enable virtual terminal processing with the readline shell, if available. This allows the full use of ANSI escape sequences. * On the Windows readline shell, the tab-completion suppression prompt will no longer error out depending on what you press. * Fixed issue with subprocess mode wrapping not respecting line continuation backslashes. * Handle a bug where Bash On Windows causes platform.windows_bash_command() to raise CalledProcessError. * Fixed issues pertaining to completing from raw string paths. This is particularly relevant to Windows, where raw strings are inserted in path completion. * Replace deprecated calls to ``time.clock()`` by calls to ``time.perf_counter()``. * Use ``clock()`` to set the start time of ``_timings`` in non-windows instead of manually setting it to ``0.0``. * The ``trace`` utility will now correctly color output and not print extraneous newlines when called in a script. * The ``@$(cmd)`` operator now correctly splits strings according to xonsh semantics, rather than just on whitespace using ``str.split()``. * The ``mpl`` xontrib has been updated to improve matplotlib handling. If ``xontrib load mpl`` is run before matplotlib is imported and xonsh is in interactive mode, matplotlib will automatically enter interactive mode as well. Additionally, ``pyplot.show()`` is patched in interactive mode to be non-blocking. If a non-blocking show fails to draw the figure for some reason, a regular blocking version is called. * Fixed issues like ``timeit ls`` causing OSError - "Inappropriate ioctl for device". * Fixed a potential "OSError: [Errno 22] Invalid argument" to increase job control stability. v0.5.5 ==================== **Added:** * New ``--rc`` command line option allows users to specify paths to run control files from the command line. This includes both xonsh-based and JSON-based configuration. * New ``$UPDATE_COMPLETIONS_ON_KEYPRESS`` controls whether or not completions will automatically display and update while typing. This feature is only available in the prompt-toolkit shell. **Changed:** * Xonsh scripts now report ``__file__`` and ``__name__`` when run as scripts or sourced. These variables have the same meaning as they do in Python scripts. * ``$XONSHRC`` and related configuration variables now accept JSON-based static configuration file names as elements. This unifies the two methods of run control to a single entry point and loading system. * The ``xonsh.shell.Shell()`` class now requires that an Execer instance be explicitly provided to its init method. This class is no longer responsible for creating an execer an its dependencies. * Moved decorators ``unthreadable``, ``uncapturable`` from ``xonsh.proc`` to ``xonsh.tools``. * Some refactorings on jobs control. **Deprecated:** * The ``--config-path`` command line option is now deprecated in favor of ``--rc``. **Removed:** * ``xonsh.environ.DEFAULT_XONSHRC`` has been removed due to deprecation. For this value, please check the environment instead, or call ``xonsh.environ.default_xonshrc(env)``. **Fixed:** * Command pipelines that end in a callable alias are now interruptable with ``^C`` and the processes that are piped into the alias have their file handles closed. This should ensure that the entire pipeline is closed. * Fixed issue where unthreadable subprocs were not allowed to be captured with the ``$(cmd)`` operator. * The ``ProcProxy`` class (unthreadable aliases) was not being executed and would hang if the alias was capturable. This has been fixed. * Fixed a ``tcsetattr: Interrupted system call`` issue when run xonsh scripts. * Fixed issue with ``ValueError`` being thrown from ``inspect.signature()`` when called on C-extension callables in tab completer. * Fixed issue that ``ls | less`` crashes on Mac. * Threadable prediction was incorrectly based on the user input command, rather than the version where aliases have been resolved. This has been corrected. v0.5.4 ==================== **Added:** * Add alias ``xip`` ("kip") so that xonsh's Python environment (whatever that is) can be modified. * HistoryEntry, a SimpleNamespace object that represents a command in history. * ``xonsh.completers.bash_completion`` module * Added option to report timing information of xonsh startup times. Start xonsh with the ``--timings`` flag to use the feature. * The Python tab completer will now complete the argument names of functions and other callables. * Uptime module added to ``xonsh.xoreutils``. This can report the system boot time and up time. * The environment variable ``XONSH_HISTORY_BACKEND`` now also supports a value of class type or a History Backend instance. * ``on_envvar_new`` event that fires after a new envvar is created. * ``on_envvar_change`` event that fires after an envvar is changed. **Changed:** * history indexing api to be more simple, now returns HistoryEntry. * Decoupled ``bash_completion`` from xonsh project and added shim back to xonsh. * The JSON history backend will now unlock history files that were created prior to the last reboot. **Fixed:** * Fixed broken bash completions on Windows if 'Windows Subsystem for Linux' is installed. * Readline history would try to read the first element of history prior to actually loading any history. This caused an exception to be raised on Windows at xonsh startup when using pyreadline. * Fixed issue with readline tab completer overwriting initial prefix in some instances. * Fixed issue wherein if ``git`` or (presumably) ``hg`` are aliased, then branch information no longer appears in the ``$PROMPT`` * Fixed an issue with commands that background themselves (such as ``gpg-connect-agent``) not being able to be run from within xonshrc. v0.5.3 ==================== **Added:** * Tab completion xontrib for python applications based on click framework. * Added ``on_transform_command`` event for pre-processing that macros can't handle. * Autodetection of backgroundability by binary analysis on POSIX. * New argument ``expand_user=True`` to ``tools.expand_path``. * New ``$COMPLETION_QUERY_LIMIT`` environment variable for setting the number of completions above which the user will be asked if they wish to see the potential completions. * Users may now redirect stdout to stderr in subprocess mode. **Changed:** * The ``Block`` and ``Functor`` context managers from ``xonsh.contexts`` have been rewritten to use xonsh's macro capabilities. You must now enter these via the ``with!`` statement, e.g. ``with! Block(): pass``. * The ``distributed`` xontrib now needs to use the ``with!`` statement, since it relies on ``Functor``. * ``telnet`` has been flagged as unthreadable. * When ``$DYNAMIC_CWD_ELISION_CHAR`` is non empty and the last dir of cwd is too long and shortened, the elision char is added at the end. * ``pygments`` is no longer a strict dependency of the ``prompt_toolkit`` backend. If ``pygments`` is not installed, the PTK backend will use the default ansi color settings from the terminal. Syntax highlighting requires that ``pygments`` is installed. * Events are now keyword arguments only * Restored ``on_precommand`` to its original signature. * Move ``built_ins.expand_path`` to ``tools.expand_path``. * Rename ``tools.expandpath`` to ``tools._expandpath``. * Added ``gvim`` command to unthreadable predictors. * The ``source`` alias now passes ``$ARGS`` down to file it is sourcing. **Removed:** * ``XonshBlockError`` has been removed, since it no longer serves a purpose. **Fixed:** * ``PopenThread`` will now re-issue SIGINT to the main thread when it is received. * Fixed an issue that using sqlite history backend does not kill unfinished jobs when quitting xonsh with a second "exit". * Fixed an issue that xonsh would fail over to external shells when running .xsh script which raises exceptions. * Fixed an issue with ``openpty()`` returning non-unix line endings in its buffer. This was causing git and ssh to fail when xonsh was used as the login shell on the server. See https://mail.python.org/pipermail/python-list/2013-June/650460.html for more details. * Restored the ability to ^Z and ``fg`` processes on posix platforms. * CommandPipelines were not guaranteed to have been ended when the return code was requested. This has been fixed. * Introduce path expansion in ``is_writable_file`` to fix ``$XONSH_TRACEBACK_LOGFILE=~/xonsh.log``. * Backgrounding a running process (^Z) now restores ECHO mode to the terminal in cases where the subprocess doesn't properly restore itself. A major instance of this behaviour is Python's interactive interpreter. * Readline backend would not ask the user to confirm the printing of completion options if they numbered above a certain value. Instead they would be dumped to the screen. This has been fixed. * Jupyter kernel was no longer properly running subprocess commands. This has been fixed. * The filename is applied to the target of the ``source`` alias, providing better tracebacks. v0.5.2 ==================== **Added:** * Added ``weechat`` to default predictors * ``$DYNAMIC_CWD_ELISION_CHAR`` environment variable to control how a shortened path is displayed. **Changed:** * ``_ret_code`` function of ``prompt_ret_code`` xontrib return now ``None`` when return code is 0 instead of empty string allowing more customization of prompt format. **Fixed:** * Minor Python completer token counting bug fix. * multiline syntax error in PTK shell due to buffer not being reset * Segfaults and other early exit signals are now reported correctly, again. * ``tests/bin/{cat,pwd,wc}`` shebang changed to python3 v0.5.1 ==================== **Fixed:** * Fixed xonfig raising error when xonsh is not installed from source. v0.5.0 ==================== **Added:** * $XONTRIB_MPL_MINIMAL environment variable can be set to change if plots are minimalist or as-seen * xontrib-mpl now supports iTerm2 inline image display if iterm2_tools python package is installed * Xonsh now will fallback to other shells if encountered errors when starting up. * Added entry to customization faq re: ``dirs`` alias (#1452) * Added entry to customization faq re: tab completion selection (#1725) * Added entry to customization faq re: libgcc core dump (#1160) * Section about quoting in the tutorial. * The ``$VC_HG_SHOW_BRANCH`` environment variable to control whether to hide the hg branch in the prompt. * xonfig now contains the latest git commit date if xonsh installed from source. * Alt+Enter will execute a multiline code block irrespective of cursor position * Windows now has the ability to read output asynchronously from the console. * Use `doctr <https://drdoctr.github.io/doctr/>`_ to deploy dev docs to github pages * New ``xonsh.proc.uncapturable()`` decorator for declaring that function aliases should not be run in a captured subprocess. * New history backend sqlite. * Prompt user to install xontrib package if they try to load an uninstalled xontrib * Callable aliases may now take a final ``spec`` argument, which is the corresponding ``SubprocSpec`` instance. * New ``bashisms`` xontrib provides additional Bash-like syntax, such as ``!!``. This xontrib only affects the command line, and not xonsh scripts. * Tests that create testing repos (git, hg) * New subprocess specification class ``SubprocSpec`` is used for specifying and manipulating subprocess classes prior to execution. * New ``PopenThread`` class runs subprocesses on a a separate thread. * New ``CommandPipeline`` and ``HiddenCommandPipeline`` classes manage the execution of a pipeline of commands via the execution of the last command in the pipeline. Instances may be iterated and stream lines from the stdout buffer. These pipelines read from the stdout & stderr streams in a non-blocking manner. * ``$XONSH_STORE_STDOUT`` is now available on all platforms! * The ``CommandsCache`` now has the ability to predict whether or not a command must be run in the foreground using ``Popen`` or may use a background thread and can use ``PopenThread``. * Callable aliases may now use the full gamut of functions signatures: ``f()``, ``f(args)``, ``f(args, stdin=None)``, ``f(args, stdin=None, stdout=None)``, and ` ``f(args, stdin=None, stdout=None, stderr=None)``. * Uncaptured subprocesses now receive a PTY file handle for stdout and stderr. * New ``$XONSH_PROC_FREQUENCY`` environment variable that specifies how long loops in the subprocess framework should sleep. This may be adjusted from its default value to improved performance and mitigate "leaky" pipes on slower machines. * ``Shift+Tab`` moves backwards in completion dropdown in prompt_toolkit * PromptFormatter class that holds all the related prompt methods * PromptFormatter caching when building the prompt * p-strings: ``p'/foo/bar'`` is short for ``pathlib.Path('/foo/bar')`` * byte strings: prefixes other than ``b'foo'`` (eg, ``RB'foo'``) now work * Backticks for regex or glob searches now support an additional modifier ``p``, which causes them to return Path objects instead of strings. * New ``BOTTOM_TOOLBAR`` environment variable to control a bottom toolbar as specified in prompt-toolkit * New ``$XONSH_STDERR_PREFIX`` and ``$XONSH_STDERR_POSTFIX`` environment variables allow the user to print a prompt-like string before and after all stderr that is seen. For example, say that you would like stderr to appear on a red background, you might set ``$XONSH_STDERR_PREFIX = "{BACKGROUND_RED}"`` and ``$XONSH_STDERR_PREFIX = "{NO_COLOR}"``. * New ``xonsh.pyghooks.XonshTerminal256Formatter`` class patches the pygments formatter to understand xonsh color token semantics. * Load events are now available * New events added: ``on_post_init``, ``on_pre_cmdloop``, ``on_pre_rc``, ``on_post_rc``, ``on_ptk_create`` * Completion for ``xonsh`` builtin functions ``xontrib`` and ``xonfig`` * Added a general customization FAQ page to the docs to collect various tips/tricks/fixes for common issues/requests * ``test_single_command`` and ``test_redirect_out_to_file`` tests in ``test_integrations`` * Add note that the target of redirection should be separated by a space. **Changed:** * CircleCI now handles flake8 checks * Travis doesn't allow failures on nightly * ``get_hg_branch`` runs ``hg root`` to find root dir and check if we're in repo * The default style will now use the color keywords (#ansired, #ansidarkred) to set colors that follow the terminal color schemes. Currently, this requires prompt_toolkit master (>1.0.8) and pygments master (2.2) to work correctly. * ``vox activate`` now accepts relative directories. * Updated the effectivity of ``$XONSH_DEBUG`` on debug messages. * Better documentation on how to get nice colors in Windows' default console * All custom prompt_toolkit key binding filters now declared with the ``@Condition`` decorator * The style for the prompt toolkit completion menu is now lightgray/darkgray instead of turquoise/teal * landscape.io linting now ignores ply directory * ``history`` help messages to reflect subcommand usage * Quote all paths when completion if any of the paths needs be quoted, so that bash can automatically complete to the max prefix of the paths. * Tee'd reads now occur in 1kb chunks, rather than character-by-character. * The ``which`` alias no longer has a trailing newline if it is captured. This means that ``$(which cmd)`` will simply be the path to the command. * The following commands are, by default, predicted to be not threadable in some circumstances: * bash * csh * clear * clear.exe * cls * cmd * ex * fish * htop * ksh * less * man * more * mutt * nano * psql * ranger * rview * rvim * scp * sh * ssh * startx * sudo * tcsh * top * vi * view * vim * vimpager * xo * xonsh * zsh * The ``run_subproc()`` function has been replaced with a new implementation. * Piping between processes now uses OS pipes. * ``$XONSH_STORE_STDIN`` now uses ``os.pread()`` rather than ``tee`` and a new file. * The implementation of the ``foreground()`` decorator has been moved to ``unthreadable()``. * ``voxapi.Vox`` now supports ``pathlib.Path`` and ``PathLike`` objects as virtual environment identifiers * Renamed FORMATTER_DICT to PROMPT_FIELDS * BaseShell instantiates PromptFormatter * readline/ptk shells use PromptFormatter * Updated the bundled version of ``ply`` to current master available * vended ``ply`` is now a git subtree to help with any future updates * ``WHITE`` color keyword now means lightgray and ``INTENSE_WHITE`` completely white * Removed ``add_to_shell`` doc section from ``*nix`` install pages and instead relocated it to the general customization page * Moved a few ``*nix`` customization tips from the linux install page to the general customization page **Removed:** * coverage checks * ``CompletedCommand`` and ``HiddenCompletedCommand`` classes have been removed in favor of ``CommandPipeline`` and ``HiddenCommandPipeline``. * ``SimpleProcProxy`` and ``SimpleForegroundProcProxy`` have been removed in favor of a more general mechanism for dispatching callable aliases implemented in the ``ProcProxyThread`` and ``ProcProxy`` classes. * ``test_run_subproc.py`` in favor of ``test_integrations.py`` * Unused imports in many tests * Many duplicated tests (copypasta) **Fixed:** * xontrib-mpl now preserves the figure and does not permanently alter it for viewing * Fix up small pep8 violations * Fixed a bug where some files are not showing using bash completer * Fixed some issues with subprocess capturing aliases that it probably shouldn't. * ``safe_readable()`` now checks for ``ValueError`` as well. * The scroll bars in the PTK completions menus are back. * Jupyter kernel installation now respects the setuptools ``root`` parameter. * Fix ``__repr__`` and ``__str__`` methods of ``SubprocSpec`` so they report correctly * Fixed the message printed when which is unable to find the command. * Fixed a handful of sphinx errors and warnings in the docs * Fixed many PEP8 violations that had gone unnoticed * Fix failure to detect an Anaconda python distribution if the python was install from the conda-forge channel. * current_branch will try and locate the vc binary once * May now Crtl-C out of an infinite loop with a subprocess, such as ```while True: sleep 1``. * Fix for stdin redirects. * Backgrounding works with ``$XONSH_STORE_STDOUT`` * ``PopenThread`` blocks its thread from finishing until command has completed or process is suspended. * Added a minimum time buffer time for command pipelines to check for if previous commands have executed successfully. This is helpful for pipelines where the last command takes a long time to start up, such as GNU Parallel. This also checks to make sure that output has occurred. This includes piping 2+ commands together and pipelines that end in unthreadable commands. * ``curr_branch`` reports correctly when ``git config status.short true`` is used * ``pip`` completion now filters results by prefix * Fixed streaming ``!(alias)`` repr evaluation where bytes where not streamed. * Aliases that begin with a comma now complete correctly (no spurious comma) * Use ``python3`` in shebang lines for compatibility with distros that still use Python 2 as the default Python * STDOUT is only stored when ``$XONSH_STORE_STDOUT=True`` * Fixed issue with alias redirections to files throwing an OSError because the function ProcProxies were not being waited upon. * Fixed issue with callable aliases that happen to call sys.exit() or raise SystemExit taking out the whole xonsh process. * Safely flushes file handles on threaded buffers. * Proper default value and documentation for ``$BASH_COMPLETIONS`` * Fixed readline completer issues on paths with spaces * Fix bug in ``argvquote()`` functions used when sourcing batch files on Windows. The bug meant an extra backslash was added to UNC paths. Thanks to @bytesemantics for spotting it, and @janschulz for fixing the issue. * pep8, lint and refactor in pytest style of ``test_ptk_multiline.py``, ``test_replay.py`` * Tab completion of aliases returned a upper cased alias on Windows. * History show all action now also include current session items. * ``proc.stream_stderr`` now handles stderr that doesn't have buffer attribute * Made ``history show`` result sorted. * Fixed issue that ``history gc`` does not delete empty history files. * Standard stream tees have been fixed to accept the possibility that they may not be backed by a binary buffer. This includes the pipeline stdout tee as well as the shell tees. * Fixed a bug when the pygments plugin was used by third party editors etc. * CPU usage of ``PopenThread`` and ``CommandPipeline`` has been brought down significantly. v0.4.7 ==================== **Added:** * Define alias for 'echo' on startup for Windows only. * New coredev `astronouth7303 <https://github.com/astronouth7303>`_ added * ``which -a`` now searches in ``__xonsh_ctx__`` too * Info about the xontrib cookiecutter template on xontrib tutorial * xonsh's optional dependencies may now be installed with the pip extras ``ptk``, ``proctitle``, ``linux``, ``mac``, and ``win``. * Env ``help`` method to format and print the vardocs for an envvar * test_news fails if no empty line before a category * more info on test_news failures * Added ``on_precommand`` and ``on_postcommand`` `events </events.html>`_ * New ``FORMATTER_DICT`` entry ``gitstatus`` to provides informative git status * FOREIGN_ALIASES_OVERRIDE envvar to control whether foreign aliases should override xonsh aliases with the same name. * Warning on tutorial about foreign aliases being ignored if a xonsh alias exist with the same name if not FOREIGN_ALIASES_OVERRIDE. * The prompt-toolkit shell now auto-inserts matching parentheses, brackets, and quotes. Enabled via the ``XONSH_AUTOPAIR`` environment variable * Better syntax highlights in prompt-toolkit, including valid command / path highlighting, macro syntax highlighting, and more * More info on tutorial about history interaction * Entry on bash_to_xsh * Macro context managers are now available via the ``with!`` syntax. **Changed:** * Devguide reflects the current process of releasing through ``release.xsh`` * moved ``which`` from ``xonsh.aliases`` into ``xoreutils.which`` * ``xonsh.prompt.gitstatus.gitstatus`` now returns a namedtuple * implementation of ``xonsh.prompt.vc_branch.get_git_branch`` and ``xonsh.prompt.vc_branch.git_dirty_working_directory`` to use 'git status --procelain' * moved prompt formatting specific functions from ``xonsh.environ`` to ``xonsh.prompt.base`` * All prompt formatter functions moved to ``xonsh.prompt`` subpackage * Printing the message about foreign aliases being ignored happens only if XONSH_DEBUG is set. * Use ``SetConsoleTitleW()`` on Windows instead of a process call. * Tutorial to reflect the current history command argument functionality * Macro function arguments now default to ``str``, rather than ``eval``, for consistency with other parts of the macro system. **Removed:** * aliases that use '!' in their name cause they clash with the macro syntax **Fixed:** * Fix regression where bash git completions where not loaded automatically when GitForWindows is installed. * More tokens are now supported in subproc args, such as ``==``. * Python completions now work without space delimiters, e.g. ``a=matpl<TAB>`` will complete to ``a=matplotlib`` * Parser would fail on nested, captured suprocess macros. Now, it works, hooray!? * now fires chdir event if OS change in working directory is detected. * ``xonsh.prompt.vc_branch.git_dirty_working_directory`` uses ``porcelain`` option instead of using the bytestring ``nothing to commit`` to find out if a git directory is dirty * Fix bug where know commands where not highlighted on windows. * Fixed completer showing executable in upper case on windows. * Fixed issue where tilde expansion was occurring more than once before an equals sign. * test_dirstack test_cdpath_expansion leaving stray testing dirs * Better completer display for long completions in prompt-toolkit * Automatically append newline to target of ``source`` alias, so that it may be exec'd. * test_news fails when single graves around word * Slashes in virtual environment names work in vox * non string type value in $FORMATTER_DICT turning prompt ugly * whole prompt turning useless when one formatting function raises an exception * Fix completion after alias expansion * Fix hard crash when foreign shell functions fails to run. #1715 * Bug where non-default locations for ``XDG_DATA_HOME`` and ``XONSH_DATA_DIR`` would not expand ``~`` into the home directory * Auto quote path completions if path contains 'and' or 'or' * Completion now works on subcommands after pipe, ``&&``, ``||`` and so on. * cd . and cd <singleCharacter> now work. Fix indexerror in AUTO_PUSHD case, too. * Fixed issue with accidentally wrapping generators inside of function calls. * History indexing with string returns most recent command. v0.4.6 ==================== **Added:** * New option ``COMPLETIONS_CONFIRM``. When set, ``<Enter>`` is used to confirm completion instead of running command while completion menu is displayed. * NetBSD is now supported. * Macro function calls are now available. These use a Rust-like ``f!(arg)`` syntax. * Macro subprocess call now available with the ``echo! x y z`` syntax. * A new `event subsystem <http://xon.sh/tutorial_events.html>`_ has been added. * howto install sections for Debian/Ubuntu and Fedora. * ``History`` methods ``__iter__`` and ``__getitem__`` * ``tools.get_portions`` that yields parts of an iterable * Added a py.test plugin to collect ``test_*.xsh`` files and run ``test_*()`` functions. * ``__repr__`` and ``__str__`` magic method on LazyObject **Changed:** * ``create_module`` implementation on XonshImportHook * Results of the ``bash`` tab completer are now properly escaped (quoted) when necessary. * Foreign aliases that match xonsh builtin aliases are now ignored with a warning. * ``prompt_toolkit`` completions now only show the rightmost portion of a given completion in the dropdown * The value of ``'none'`` is no longer allowed for ``$SHELL_TYPE`` just during the initial load from the environment. ``-D``, later times, and other sources still work. * ``yacc_debug=True`` now load the parser on the same thread that the Parser instance is created. ``setup.py`` now uses this synchronous form as it was causing the parser table to be missed by some package managers. * Tilde expansion for the home directory now has the same semantics as Bash. Previously it only matched leading tildes. * Context sensitive AST transformation now checks that all names in an expression are in scope. If they are, then Python mode is retained. However, if even one is missing, subprocess wrapping is attempted. Previously, only the left-most name was examined for being within scope. * ``dirstack.pushd`` and ``dirstack.popd`` now handle UNC paths (of form ``\\<server>\<share>\...``), but only on Windows. They emulate behavior of `CMD.EXE` by creating a temporary mapped drive letter (starting from z: down) to replace the ``\\<server>\<share>`` portion of the path, on the ``pushd`` and unmapping the drive letter when all references to it are popped. * And ``dirstack`` suppresses this temporary drive mapping funky jive if registry entry ``HKCU\software\microsoft\command processor\DisableUNCCheck`` (or HKLM\...) is a DWORD value 1. This allows Xonsh to show the actual UNC path in your prompt string and *also* allows subprocess commands invoking `CMD.EXE` to run in the expected working directory. See https://support.microsoft.com/en-us/kb/156276 to satisfy any lingering curiosity. * ``lazy_locate_binary`` handles binary on different drive letter than current working directory (on Windows). * ``_curr_session_parser`` now iterates over ``History`` * New implementation of bash completer with better performance and compatibility. * ``$COMPLETIONS_BRACKETS`` is now available to determine whether or not to include opening brackets in Python completions * ``xonsh.bat`` tries to use `pylauncher <https://www.python.org/dev/peps/pep-0397/>`_ when available. **Removed:** * ``History`` method ``show`` * ``_hist_get_portion`` in favor of ``tools.get_portions`` * Unused imports in proc, flake8. **Fixed:** * xonsh modules imported now have the __file__ attribute * Context sensitive AST transformer was not adding argument names to the local scope. This would then enable extraneous subprocess mode wrapping for expressions whose leftmost name was function argument. This has been fixed by properly adding the argument names to the scope. * Foreign shell functions that are mapped to empty filenames no longer receive aliases since they can't be found to source later. * Correctly preserve arguments given to xon.sh, in case there are quoted ones. * Environment variables in subprocess mode were not being expanded unless they were in a sting. They are now expanded properly. * Fixed a bug that prevented xonsh from running scripts with code caching disabled. * Text of instructions to download missing program now does not get off and appears in whole. * Fix some test problems when win_unicode_console was installed on windows. * Fixed bug that prompt string and ``$PWD`` failed to track change in actual working directory if the invoked Python function happened to change it (e.g via ```os.chdir()```. Fix is to update ``$PWD`` after each command in ```BaseShell.default()```. * The interactive prompt now correctly handles multiline strings. * ``cd \\<server>\<share>`` now works when $AUTO_PUSHD is set, either creating a temporary mapped drive or simply setting UNC working directory based on registry ``DisableUNCCheck``. However, if $AUTO_PUSHD is not set and UNC checking is enabled (default for Windows), it issues an error message and fails. This improves on prior behavior, which would fail to change the current working directory, but would set $PWD and prompt string to the UNC path, creating false expectations. * fix parsing for tuple of tuples (like `(),()`) * ``sys.stdin``, ``sys.stdout``, ``sys.stderr`` no longer complete with opening square brackets * xonsh now properly handles syntax error messages arising from using values in inappropriate contexts (e.g., ``del 7``).
2019-01-08Update to 5.0ryoon5-44/+26
Changelog: This is a terse description of the new features added to bash-5.0 since the release of bash-4.4. As always, the manual page (doc/bash.1) is the place to look for complete descriptions. 1. New Features in Bash a. The `wait' builtin can now wait for the last process substitution created. b. There is an EPOCHSECONDS variable, which expands to the time in seconds since the Unix epoch. c. There is an EPOCHREALTIME variable, which expands to the time in seconds since the Unix epoch with microsecond granularity. d. New loadable builtins: rm, stat, fdflags. e. BASH_ARGV0: a new variable that expands to $0 and sets $0 on assignment. f. When supplied a numeric argument, the shell-expand-line bindable readline command does not perform quote removal and suppresses command and process substitution. g. `history -d' understands negative arguments: negative arguments offset from the end of the history list. h. The `name' argument to the `coproc' reserved word now undergoes word expansion, so unique coprocs can be created in loops. i. A nameref name resolution loop in a function now resolves to a variable by that name in the global scope. j. The `wait' builtin now has a `-f' option, which signfies to wait until the specified job or process terminates, instead of waiting until it changes state. k. There is a define in config-top.h that allows the shell to use a static value for $PATH, overriding whatever is in the environment at startup, for use by the restricted shell. l. Process substitution does not inherit the `v' option, like command substitution. m. If a non-interactive shell with job control enabled detects that a foreground job died due to SIGINT, it acts as if it received the SIGINT. n. The SIGCHLD trap is run once for each exiting child process even if job control is not enabled when the shell is in Posix mode. o. A new shopt option: localvar_inherit; if set, a local variable inherits the value of a variable with the same name at the nearest preceding scope. p. `bind -r' now checks whether a key sequence is bound before binding it to NULL, to avoid creating keymaps for a multi-key sequence. q. A numeric argument to the line editing `operate-and-get-next' command specifies which history entry to use. r. The positional parameters are now assigned before running the shell startup files, so startup files can use $@. s. There is a compile-time option that forces the shell to disable the check for an inherited OLDPWD being a directory. t. The `history' builtin can now delete ranges of history entries using `-d start-end'. u. The `vi-edit-and-execute-command' bindable readline command now puts readline back in vi insertion mode after executing commands from the edited file. v. The command completion code now matches aliases and shell function names case-insensitively if the readline completion-ignore-case variable is set. w. There is a new `assoc_expand_once' shell option that attempts to expand associative array subscripts only once. x. The shell only sets up BASH_ARGV and BASH_ARGC at startup if extended debugging mode is active. The old behavior of unconditionally setting them is available as part of the shell compatibility options. y. The `umask' builtin now allows modes and masks greater than octal 777. z. The `times' builtin now honors the current locale when printing a decimal point. aa. There is a new (disabled by default, undocumented) shell option to enable and disable sending history to syslog at runtime. bb. Bash no longer allows variable assignments preceding a special builtin that changes variable attributes to propagate back to the calling environment unless the compatibility level is 44 or lower. cc. You can set the default value for $HISTSIZE at build time in config-top.h. dd. The `complete' builtin now accepts a -I option that applies the completion to the initial word on the line. ee. The internal bash malloc now uses mmap (if available) to satisfy requests greater than 128K bytes, so free can use mfree to return the pages to the kernel. ff. The shell doesn't automatically set BASH_ARGC and BASH_ARGV at startup unless it's in debugging mode, as the documentation has always said, but will dynamically create them if a script references them at the top level without having enabled debugging mode. gg. The localvar_inherit option will not attempt to inherit a value from a variable of an incompatible type (indexed vs. associative arrays, for example). hh. The `globasciiranges' option is now enabled by default; it can be set to off by default at configuration time. ii. Associative and indexed arrays now allow subscripts consisting solely of whitespace. jj. `checkwinsize' is now enabled by default. kk. The `localvar_unset' shopt option is now visible and documented. ll. The `progcomp_alias' shopt option is now visible and documented. mm. The signal name processing code now understands `SIGRTMIN+n' all the way up to SIGRTMAX. nn. There is a new `seq' loadable builtin. oo. Trap execution now honors the (internal) max invocations of `eval', since traps are supposed to be executed as if using `eval'. pp. The $_ variable doesn't change when the shell executes a command that forks. qq. The `kill' builtin now supports -sSIGNAME and -nSIGNUM, even though conforming applications aren't supposed to use them. rr. POSIX mode now enables the `shift_verbose' option. 2. New Features in Readline a. Non-incremental vi-mode search (`N', `n') can search for a shell pattern, as Posix specifies (uses fnmatch(3) if available). b. There are new `next-screen-line' and `previous-screen-line' bindable commands, which move the cursor to the same column in the next, or previous, physical line, respectively. c. There are default key bindings for control-arrow-key key combinations. d. A negative argument (-N) to `quoted-insert' means to insert the next N characters using quoted-insert. e. New public function: rl_check_signals(), which allows applications to respond to signals that readline catches while waiting for input using a custom read function. f. There is new support for conditionally testing the readline version in an inputrc file, with a full set of arithmetic comparison operators available. g. There is a simple variable comparison facility available for use within an inputrc file. Allowable operators are equality and inequality; string variables may be compared to a value; boolean variables must be compared to either `on' or `off'; variable names are separated from the operator by whitespace. h. The history expansion library now understands command and process substitution and extended globbing and allows them to appear anywhere in a word. i. The history library has a new variable that allows applications to set the initial quoting state, so quoting state can be inherited from a previous line. j. Readline now allows application-defined keymap names; there is a new public function, rl_set_keymap_name(), to do that. k. The "Insert" keypad key, if available, now puts readline into overwrite mode.
2018-12-02bash-completion: install pkgconfig file in pkgsrc standard location.wiz2-4/+12
Use OWN_DIRS to create directory. Bump PKGREVISION.
2018-11-10shells/Makefile: + bosh, pboshwiz1-1/+3
2018-11-10shells/pbosh: import pbosh-20181030wiz4-0/+74
Packaged for wip by Michael Bäuerle. The Schily Bourne Shell The Schily Bourne Shell was derived from the Bourne Shell sources from OpenSolaris. The Schily Bourne Shell is actively maintained and enhanced on a regular base. It can be compiled into three variants: - The non-POSIX SVr4/OpenSolaris variant (obosh) - The minimal POSIX compliant variant (pbosh) - The POSIX compliant extended variant (bosh) This package contains the second variant.
2018-11-10shells/bosh: import bosh-20181030wiz4-0/+78
Packaged for wip by Michael Bäuerle. The Schily Bourne Shell The Schily Bourne Shell was derived from the Bourne Shell sources from OpenSolaris. The Schily Bourne Shell is actively maintained and enhanced on a regular base. It can be compiled into three variants: - The non-POSIX SVr4/OpenSolaris variant (obosh) - The minimal POSIX compliant variant (pbosh) - The POSIX compliant extended variant (bosh) This package contains the third variant.
2018-11-09shells: +okshmaya1-1/+2
2018-11-09Add oksh, portable version of OpenBSD ksh.maya4-0/+27
2018-10-19bash-completion: Update shells/bash-completion to 2.8leot6-82/+141
Patch provided by Attila Fülöp via netbsd/pkgsrc#36, thanks! pkgsrc changes: - Update MASTER_SITES and HOMEPAGE Changes: Unfortunately the changelog is very long. Only new/removed completions/helpers are documented here (since 2.1): The following completions were added: - 2to3, 7z, 7za, _cal, _chfn, _chsh, _dmesg, _eject, _hexdump, _hwclock, _ionice, _look, _mock, _modules, _newgrp, _nmcli, _renice, _repomanage, _reptyr, _rfkill, _rtcwake, _runuser, _su, _svn, _svnadmin, _svnlook, _udevadm, _write, _yum, aclocal-1.10, aclocal-1.12, aclocal-1.13, aclocal-1.14, aclocal-1.15, adb, appdata-validate, aptitude-curses, automake-1.10, automake-1.12, automake-1.13, automake-1.14, automake-1.15, bind, bts, ccze, checksec, createuser, deja-dup, dropuser, ebtables, f77, f95, flake8, freebsd-update, g95, geoiplookup, geoiplookup6, getconf, gfortran, gm, gnokii, hostname, jpegoptim, jshint, lsscsi, lsusb, lz4, lz4c, micropython, mr, nproc, oggdec, optipng, pdftotext, perltidy, pngfix, portsnap, pv, py.test, py.test-2, py.test-3, pycodestyle, pyflakes, pylint-2, pylint-3, pypy, pypy3, pyvenv, pyvenv-3.4, pyvenv-3.5, qemu-kvm, qemu-system-i386, qemu-system-x86_64, radvdump, sidedoor, ssh-keygen, synclient, timeout, tipc, tox, xdg-mime, xdg-settings, zopfli, zopflipng, python, The following completions were removed: - cal, chsh, dmesg, eject, hexdump, hwclock, ionice, look, newgrp, nmcli, renice, reptyr, rfkill, rtcwake, su, The following helpers were added: - python