summaryrefslogtreecommitdiff
path: root/parallel/sge
AgeCommit message (Collapse)AuthorFilesLines
2022-06-28*: recursive bump for perl 5.36wiz1-2/+2
2022-04-02sge: get slightly further building, still BROKENnia3-5/+29
2021-10-26parallel: Replace RMD160 checksums with BLAKE2s checksumsnia1-2/+2
All checksums have been double-checked against existing RMD160 and SHA512 hashes
2021-10-07parallel: Remove SHA1 hashes for distfilesnia1-2/+1
2021-05-24*: recursive bump for perl 5.34wiz1-2/+2
2020-08-31*: bump PKGREVISION for perl-5.32.wiz1-2/+2
2020-01-18*: Recursive revision bump for openssl 1.1.1.jperkin1-2/+2
2019-11-04parallel: align variable assignmentsrillig1-3/+3
pkglint -Wall -F --only aligned --only indent -r No manual corrections.
2019-08-11Bump PKGREVISIONs for perl 5.30.0wiz1-2/+2
2018-08-22Recursive bump for perl5-5.28.0wiz1-2/+2
2018-07-04*: Move SUBST_STAGE from post-patch to pre-configurejperkin1-2/+2
Performing substitutions during post-patch breaks tools such as mkpatches, making it very difficult to regenerate correct patches after making changes, and often leading to substituted string replacements being committed.
2016-10-03Call sun-iss sissl-1.1 to match OSI.wiz1-3/+2
2016-07-09Bump PKGREVISION for perl-5.24.0 for everything mentioning perl.wiz1-2/+2
2016-06-01Include correct directory and rpath for finding bdb.joerg2-1/+15
2016-03-05Bump PKGREVISION for security/openssl ABI bump.jperkin1-2/+2
2015-11-25Remove mk/find-prefix.mk usage from the parallel category.jperkin1-11/+4
The find-prefix infrastructure was required in a pkgviews world where packages installed from pkgsrc could have different installation prefixes, and this was a way for a dependency prefix to be determined. Now that pkgviews has been removed there is no longer any need for the overhead of this infrastructure. Instead we use BUILDLINK_PREFIX.pkg for dependencies pulled in via buildlink, or LOCALBASE/PREFIX where the dependency is coming from pkgsrc. Provides a reasonable performance win due to the reduction of `pkg_info -qp` calls, some of which were redundant anyway as they were duplicating the same information provided by BUILDLINK_PREFIX.pkg.
2015-11-02Add SHA512 digests for distfiles for parallel categoryagc1-1/+2
Existing SHA1 digests verified, all found to be the same on the machine holding the existing distfiles (morden). Existing SHA1 digests retained for now as an audit trail.
2015-06-29Deal with linux 4.xmarkd2-1/+17
2015-06-12Recursive PKGREVISION bump for all packages mentioning 'perl',wiz1-2/+2
having a PKGNAME of p5-*, or depending such a package, for perl-5.22.0.
2014-05-29Bump for perl-5.20.0.wiz1-2/+2
Do it for all packages that * mention perl, or * have a directory name starting with p5-*, or * depend on a package starting with p5- like last time, for 5.18, where this didn't lead to complaints. Let me know if you have any this time.
2014-02-12Recursive PKGREVISION bump for OpenSSL API version bump.tron1-1/+2
2014-01-14Update to sge 8.1.6markd11-384/+165
Version 8.1.6 ------------- * Bug fixes Version 8.1.5 ------------- * Bug fixes Version 8.1.4 ------------- Milestone version: over 1000 patches since the last from Sun * Bug fixes * Enhancements * qacct: print category information; support -A like -P ; make -u a synonym for -o; -E selects on job end times read from standard input with -f * Move manager/operator setup in startup scripts * Installation creates an environment modules file * Add monitor_qmaster.sh script * Write shepherd panic messages to syslog, not into /tmp * Add .desktop file for qmon * rpm/dpkg packaging allows building against motif (recent Debian/Fedora) * Accounting reports qmaster-enforced resource limits (only on master PE task if accounting_summary is false) * Add "smp" to the default queue PE list * install_execd doesn't check the presence of (mostly irrelevant) binaries * Add configuration for logcheck * Potentially incompatible changes * renew_all_certs.ksh re-named to renew_all_certs.sh * Expand $ja_task_id to 0 for non-array jobs * Move manager/operator setup in startup scripts * For security reasons, installation defaults for min_uid, min_gid in sge_conf(5) are now 100 without CSP. See <http://arc.liv.ac.uk/SGE/howto/sge-security.html> * RPM layout changed to put relevant ones under noarch (on RHEL6 and recent Fedora), with a separate guiinst package * Memory values can be input and output in TB or tB (possible incompatibility parsing output) * Reduce execd CPU time reading large smaps files from Linux /proc and provide USE_SMAPS in execd_params to turn it on (default now off because huge smaps are generated by some programs) * Remove redundant -verify option from qsh, qlogin (per doc) Version 8.1.3 ------------- * Bug fixes * Enhancements * Document Interix building explicitly * qstat reports array task maximum concurrency * qstatus removes [] suffix for non-array jobs if -t was requested * Read /etc/default/{sgeexecd,sgemaster} to allow customizing rc scripts * Location of daemon pid files can be specified with SGE_QMASTER_PIDFILE, SGE_EXECD_PIDFILE * Debian packaging (as an add-on, installing into /opt/sge) * Expand $sge_root and $sge_cell in the definitions of prolog and similar methods * Check in init script that shepherd will load * Add lx-armhf architecture * On Linux and NetBSD, report jobs' virtual memory usage as accurately as possible * Add -nobincheck installation option to avoid checking binaries * Add some build hooks, useful for Debian particularly. * Potentially incompatible changes * qacct prints units (might affect parsing the output) * Correct spelling of "comunication_error" in qstat XML error output * Fix problems submitting to ARs (printing times now doesn't use a days field in qstat etc.) * Java version >= 1.5 required * Lower default MAX_DYN_EC somewhat to avoid warning on typical Linux configurations * Other changes * Don't install the ckpt directory (contents obsolete) Version 8.1.2 ------------- * Bug fixes * Enhancements * Use cpusets for process containment on fairly recent Linux-based systems (see USE_CGROUPS in sge_conf(5)) * Add bootstrap build script * Make SGE template an RPM conf file * Incompatible changes * Make CRL and certificate expiry consistent Version 8.1.1 ------------- * Bug fixes * Security * Don't pass any user environment to remote startup daemons -- better fix for half of CVE-2012-0208 * Enhancements * SGE_BINDING is set in the environment for all types of binding * New jobstats(1) provides historical job summary * Berkeleydb spools can optionally be opened "private" to allow operation on NFS3 filesystems. Currently no installer support, but see bootstrap(5) and the health warning * Environment variable SGE_DRMAA_ALLOW_JOB_ERROR_STATE allows DRMAA jobs to enter the error state; see drmaa_submit(3) * Define SGE_JOBEXIT_STAT environment variable in epilog; see submit(1) * The user from which mail is sent can be configured in sge_conf(5) * Topology items are now static load values; see load_parameters(5) * qstat now prints array job dependency info * Default to support for qsort_args in sge_pe(5) * Include an example of logrotate usage * Install an "smp" PE * Distribute/document sge_share_mon(1) to print share tree * Improve install template defaults * GPU load sensor (dist/util/resources/loadsensors/gpu-loadsensor.c) * Allow building Kerberos/GSSAPI security modules against Heimdal (but GSS is still not properly usable) * Support arm and mipsel on GNU/Linux, completing the set of official Debian Linux-based ports * Support for OpenBSD (untested) * Preliminary support for Cygwin: everything builds, clients work (lightly tested), daemons need fixing * Add ja_task_id to expandable variables in ckpt_command and similar methods * distinst supports installation with install(1) for use with -local * Incompatible changes * The CA directory is now /var/lib/sgeCA instead of /var/sgeCA but installation will offer to move it [fixme] * Drop (any pretence at) support for Cray/Unicos, NEC SX, Darwin 6 * The spool format for parallel job tasks has changed from any previous version built with qsort_args (as above), which will make live upgrades from such a version fail on nodes running parallel jobs * Other changes * Extensive internal changes to improve robustness, e.g. of string-handling against buffer overruns -- somewhat error-prone and may have caused regressions; more required * Install script allows rsh et al to be omitted from binary distribution in favour of ssh Version 8.1.0 ------------- * Security fix * Prevent users other than root deleting entries with sgepasswd * Version numbering * Switch to a more logical numbering scheme now that the Univa baseline is irrelevant * Bug fixes * Other changes * Hadoop support now for a more recent Hadoop distribution (see README.BUILD) Version 8.0.0e -------------- Mostly build and security issues * Bug fixes * Security fixes The first fix is for a trivial remote root by a valid user. The others, including fixes for potential buffer overruns in daemon and setuid programs, may or may not be exploitable. * Sanitize the environment before executing remote startup programs etc. Somewhat incompatible: LD_LIBRARY_PATH etc. may need to be set differently. See the security notes in remote_startup(5) and sge_conf(5). (CVE-2012-0208, thanks to William Hay) * Don't write initial log messages in /tmp. Somewhat incompatible: initial messages now in syslog. * Avoid using mktemp. (Probably not a significant problem.) * Control core dumps under setuid etc. with SGE_ENABLE_COREDUMP. (Not normally a security issue.) * Bounds checking in replace_params * Avoid execd crash and possible overruns * Fixes for buffer overrun and other improvements for (setuid program) sgepasswd
2014-01-11Revbump after updating tcl/tk.adam1-2/+2
2013-10-31Fix PKG_USERS usage.jperkin1-2/+3
2013-10-20Fix rpath options to use -Wl prefix.joerg2-8/+8
2013-07-12Bump PKGREVISION of all packages which create users, to pick up change ofjperkin1-2/+2
sysutils/user_* packages.
2013-05-31Bump all packages for perl-5.18, thatwiz1-2/+2
a) refer 'perl' in their Makefile, or b) have a directory name of p5-*, or c) have any dependency on any p5-* package Like last time, where this caused no complaints.
2013-05-23Add missing include for NetBSD/current.joerg2-2/+18
2013-04-11Re-sync with reality -- Not only is there no settings.{,c}sh tohauke1-14/+1
source, there is not even a {PREFIX}/sge/default directory.
2013-02-06PKGREVISION bumps for the security/openssl 1.0.1d update.jperkin1-2/+2
2012-12-15Restructure in preparation for adding a java option.markd1-5/+9
2012-12-15Support 64bit linux.markd1-1/+6
2012-10-03Bump all packages that use perl, or depend on a p5-* package, orwiz1-2/+2
are called p5-*. I hope that's all of them.
2012-09-11"user-destdir" is default these daysasau1-3/+1
2012-08-21Recursive PKGREVISION bump for tcl and tk upgrade to 8.5.12marino1-2/+2
2012-06-02Set USE_TOOLS instead of BUILD_DEPENDS to get csh, and use ${CSH}dholland1-5/+3
instead of "tcsh". This builds ok for me on NetBSD; if it turns out to cause trouble for anyone, revert it. The motivation was that the BUILD_DEPENDS accepted either tcsh or standalone-tcsh, and distbb was latching onto the latter and then failing trying to install it. If the package turns out to really need tcsh in some contexts, there are probably other ways to deal with this issue.
2012-04-18Fixup DESTDIR handling in do-install.markd1-5/+6
Add LICENSE (sun-iss + 2-clause-bsd + gpl + lgpl)
2012-04-15Add missing pam.bl3.mk. (but, it builds on LP64 platforms now. yay!)dholland1-1/+2
2012-04-15Reinstate patch-source-utilbin_Makefile (aka patch-ak)markd6-30/+168
Dont install *.orig files Fix build on 64bit systems Fix arch name for Linux Bump PKGREVISION
2012-04-07Mark sge and gridscheduler not for ${LP64PLATFORMS}. They crash duringdholland1-1/+4
build.
2012-03-20Update to the Son of Grid Engine 8.0.0dasau20-374/+289
The Son of Grid Engine is a community project to continue Sun Grid Engine. Notable changes in Son of Grid Engine ------------------------------------- Version 8.0.0d -------------- * Bug fixes * Man and fixes * Fix building with older gcc versions * Provide load average in qstat XML output [#446, #454] * Partially back out Univa change which broke classic spooling * Fix -terse in sge_request [#777] * Other changes (possibly-incompatible) * Message fixes Version 8.0.0c -------------- * Bug fixes * Man and other documentation fixes * Build/installation fixes (particularly for Red Hat 6 and Linux 3) * Fix group ids for submitted jobs [U] * Fix default value of boolean with JSV [U] * Windows fixes for helper crashes and Vista GUI jobs [U] * Ensure parallel jobs are dispatched to the least loaded host [U] * Correct ownership of qsub -pty output file; was owned by admin user [U] * Fix format of Windows loadcheck.exe output [U] * Read from stderr even if stdout is already closed in IJS [U] * Fix PDC_INTERVAL=NEVER execd parameter [U] * Fix accounting information for Windows GUI jobs [U] * Increase default MAX_DYN_EC qmaster param [U] * Fix qsub -sync y error message and enforce MAX_DYN_EC correctly [U] * Fix job validation (-w e) behaviour [#716] [U] * Fix qrsh input redirection [U] * Avoid warning when submitting a qrsh job [U] * Print start time in qstat -j -xml output [U] * Don't raise an error changing resource request on waiting job [#806] * Don't exit 0 on error with qconf -secl or -sep * Include string.h in drmaa.h [#712] * Fix process-scheduler-log with host aliases * Enhancements * Base qmake and qtcsh on the current gmake and tcsh source [#289, #504, #832] * Support "-binding linear" and "-binding linear:slots" * Use the hwloc library for all topology information and core binding, supporting more operating systems (now: AIX, Darwin, FreeBSD, GNU/Linux, HPUX, MS Windows, OSF/1, Solaris), and more hardware types (specifically AMD Magny Cours and similar) * Add task number to execd "exceeds job ... limit" * Other changes (possibly-incompatible) * Modify default paths in build files and elsewhere [U] * Assorted message fixes * In RPMs, move qsched to qmaster package, and separate drmaa4ruby * Default to newijs in load_sge_config.sh * Default to sh, not csh for configured shell Version 8.0.0b -------------- * Bug fixes * Build/installation fixes [including #424, #1349] [(U)] * Fix execd init script [#1348] * Man and other documentation fixes [including #614, #764] [(U)] * Fix contents of admin mail properly [#1307, #1345] * Fix qalter messages for -tc * Fix build with -DSGE_PQS_API * Fix group ids for submitted jobs [U] * Enhancements * Update qsched and add man page * Other changes (possibly-incompatible) * Avoid the use of /bin/ksh [#1306] * Change installation defaults to classic spooling, not adding shadow hosts, and not JMX. [(U)] Version 8.0.0a -------------- This is roughly a superset of Univa's 8.0.0 (the V800_TAG from https://github.com/gridengine/gridengine), with thanks for that. Changes made there which haven't been included in this version: PLPA source not removed; some different build/installation defaults (e.g. for JMX); Univa/UGE "branding" (partly because trademark status is unknown); authuser not removed (for SDM and testing use), * Bug fixes * Many man and other documentation fixes [including #790, #776, #769, #733, #610, #587, #581, #459, #456, #439, #255, #1288, #797, #1271, #773] [(U)] * Some program message fixes [(U)] * Various build and installation fixes [including #761, #709, #656, #616, #546, #536, #521, #491, #438, #414, #411, #383, #381, #138, #455, #344, #438, #1311, #1272, #1273] [(U)] * Ask for keystore password twice on installation * Fix qmaster crashes with tightly integrated parallel jobs or un-discoverable qinstance [#789] [U] * Report 0 cores and sockets on unsupported Solaris hosts [U] * Fix malloc hooks which caused crashes, particularly with SuSE 11 [#792, #748, #749] [U] * Verify the pe task start user in execd in non-CSP mode [U] * Fix binding parameters parsing [U] * Fix JSV logging with multiple users submitting jobs on same submit host [U] * Fix unresponsive qmaster when modifying the global configuration in a huge cluster [U] * Speed up finishing tightly integrated jobs [U] * Check consistency of JSV binding information properly [U] * Fix broken project spooling, which caused loss of project when restarting master when using core binding [U] * Fix slotwise preemption failure to unsuspend one job per host [#775] [U] * Fix problems retrieving passwd and group information with large responses [#1295] [(U)] * Fix JSV changing default of boolean [U] * Fix ENABLE_RESCHEDULE_SLAVE=1 [U] * Allow comma in CMDNAME with Perl JSV scripts [#803] * Don't put queue into error state when supplementary group id cannot be set [#185] [U] * Don't convert LF to CRLF with qrsh -pty [U] * Fix qconf segfault on bad subordination string [U] * Fix group ids of submitted jobs [U] * Disallow -masterq with serial jobs [#155] [U] * Fix 100% CPU use by shepherd of qsh [U] * Removed unnecessary binding warning on job starts [U] * Fix qconf error reports when tmp directory has 755 permissions [U] * Fix suspending of remote process on qrsh -pty yes <cmd> on Solaris [U] * Fix starting jobs after global host changed [U] * Reject invalid load_formula value [U] * Fix handling of implicitly-requested exclusive resources [U] * Fix execd vmem reporting on 64-bit Linux [U] * Fix startup of execd on Windows Vista [U] * Set xterm's path more appropriately on GNU/Linux [#557] * Fix generation of admin email from failed jobs [#1307] * Fix some ill-formed output from qstat -xml [#314] * Fix handling of multi-line environment variables propagated to shepherd [#395] * Fix example MPI PE templates * Fix bad quoting in JSV sh library * Fix checking of consumables for parallel jobs across multiple hosts [U] * Enhancements * Additional and clarified documentation * PAM modules for ssh tight integration and access control for interactive jobs * Initial core binding support for Solaris/SPARC64 [U] * Some efficiency improvements and memory leaks fixed [U] * Ports to S/390 and PARISC GNU/Linux [U] * New complex m_thread [U] * Show topology by default in qhost [U] * qsub -pty switch [#704] [U] * Improved qmon graphics [#530] [(U)] * Include bash in default shell list [U] * A JSV that rejects all jobs [U] * Files for Scali-MPI * Ruby DRMAA implementation * Enable easy building against shared system libraries and use system openssl and bdb binaries * New scripts: "qsched" reports resource reservations; "status" wraps qstat; enable/disable submission; node-selection (idle etc.) * Restart argument for daemon init scripts * Improved efficiency of shell JSV if used with bash * Core dumps from crashing daemons enabled under Linux [U] * Example host_aliases file [#154] * Spec file for RPM packaging [#820] * Other changes (possibly-incompatible) * Show core binding by default in qstat, qhost (use -ncb for compatibility) [U] * Removed Berkeley DB RPC support (recently dropped by BDB) [U] * Changed position in pending job list for user-rescheduled jobs (exit99, qmod -rj) and OLD_RESCHEDULE_BEHAVIOR, OLD_RESCHEDULE_BEHAVIOR_ARRAY_JOB parameters [U] * Unified GNU/Linux arch strings (lx-*, from lx24-* and lx26-*) [U] * Default to enabling core binding on GNU/Linux [U] * Removed Sun service tags support [U] * Removed obsolete SunHPCT5 files
2011-12-09PKGREV bump for libXp-less openmotifdrochner1-2/+2
2011-07-05If it's going to install tcl scripts, and use REPLACE_INTERPRETER on them,dholland1-2/+3
it needs to depend on tcl. PKGREVISION -> 4
2011-02-17Teach pkg about linux (only i386 at this stage).markd7-11/+201
2010-12-08Fix build on NetBSD-current: rename getline() and openssl>=1.0 issues.markd5-9/+85
2010-06-02Revision bump for db4 updateadam1-2/+2
2010-01-17Recursive PKGREVISION bump for jpeg update to 8.wiz1-2/+2
2009-08-19Fix installed manual pages to correctly refer to SGE rather than GE.markd1-3/+10
Also fix some interpreter paths. Bump PKGREVISION.
2009-06-14Remove @dirrm entries from PLISTsjoerg1-58/+1
2009-06-11regen distinfo to refrect last update.obache1-11/+16