summaryrefslogtreecommitdiff
path: root/mk/install
AgeCommit message (Collapse)AuthorFilesLines
2006-10-13Added a new post-installation check to see whether the files have theirrillig1-1/+4
permissions properly set. See mk/check/check-perms.mk and sysutils/checkperms for details.
2006-10-09Main infrastructure for DESTDIR support.joerg1-13/+26
Packages may set PKG_DESTDIR_SUPPORT to either "destdir" or "user-destdir" to flag support for this, following the same rules as PKG_INSTALLATION_TYPES (e.g. define before first include of bsd.prefs.mk). The user activates it via USE_DESTDIR. When set to "yes", packages with "user-destdir" are handled as "destdir". The installation of the package will not go to ${LOCALBASE}, but a subdirectory of ${WRKDIR} instead. pre/post install scripts are not run and the package is not registered either. A binary package can be created instead to be installed normally with pkg_add. For "user-destdir" packages, everything is run as normal user and ownership is supposed to be correctled by pkg_create later. Since the current pkg_install code uses pax and it doesn't allow overwriting owners, this does not work yet. For "destdir" packages, installation, packaging and cleaning is run as root. This commit does not change the handling of DEPENDS_TARGET or bin-install to allow recursive usage.
2006-10-09Add variable to control whether the install target is run as root.joerg1-1/+5
2006-10-06Added more error checking: If a directory is specified inrillig1-1/+5
INSTALLATION_DIRS but a regular file of the same name already exists, the BSD install(1) program doesn't care but exits successfully. To avoid much more confusing error messages, this is checked here, and a _good_ error message is printed.
2006-10-05Both, the pkgsrc user and the package maintainer must agree that thisrillig1-3/+3
package should run the CHECK_FILES test. Otherwise we cannot prevent the broken shells/standalone-tcsh from scanning the whole filesystem. (hi agc!)
2006-10-03Rewrote the bin-install target so that it doesn't lock LOCALBASErillig1-20/+31
recursively. This bug was reported by Hans Rosenfeld in http://mail-index.netbsd.org/tech-pkg/2006/10/03/0002.html As a side effect, when bin-install fails to install a binary package, the package is still built from source, but not as a privileged user.
2006-09-09Rename variable MAKEFILE to MAKE_FILE, as suggested in PR 28392.obache1-2/+2
2006-08-09Drop .ORDER declarations since pkgsrc doesn't support "make -j ...".jlam2-4/+2
2006-08-09Only acquire the localbase lock after acquiring root privileges. Thisjlam1-3/+9
fixes "make install" using just-in-time su-to-root.
2006-08-04Fixed the locking, as suggested by Johnny on the tech-pkg mailing list.rillig3-8/+17
Added two targets acquire-localbase-lock and release-localbase-lock, which mark the complete LOCALBASE directory as locked, so that multiple packages cannot run the install, deinstall or bin-install targets at the same time. The install target aquires locks in both WRKSRC and LOCALBASE, the other two targets only need the LOCALBASE lock, since they may be run without WRKSRC being present on the system. locking.mk must be included before tools.mk and the PKG_FAIL_REASON check.
2006-08-04Rewrote the header comment so that "bin-install" can be found by "bmakerillig1-4/+6
help".
2006-08-04Moved the bin-install target from bsd.pkg.mk to install/bin-install.mk.rillig1-0/+64
Added documentation. Added locking around the real installation.
2006-08-03When installing or deinstalling a package, it is not enough to lock therillig1-2/+2
WRKDIR against foreign processes. Instead, the PKG_DBDIR is locked, preventing other (pkgsrc) processes from modifying the set of installed packages while another one is doing that. This allows to use "bmake update" efficiently on multi-processor machines by just running it in four different package directories. Note that the pkg_add and pkg_delete tools may still interfere with this locking when they are directly run.
2006-07-27Whenever we invoke a recursive make, we need to ensure that the properjlam1-2/+2
environment ${PKGSRC_MAKE_ENV} is also passed along. Create a convenience variable RECURSIVE_MAKE that does exactly this and that can be used in place of MAKE when invoking make recursively. Use RECURSIVE_MAKE everywhere in pkgsrc/mk that we invoke make recursively.
2006-07-22Modify the barrier so that we always invoke the recursive make processjlam3-6/+6
when passing through the barrier. This ensures the PATH (passed via PKGSRC_MAKE_ENV) is correctly set for all phases after the barrier. This fixes a bug in "interactive" pkgsrc use, where if you have no work directory and type "make build && make install", then the "install" step does not have a PATH set to include all the wrapper and tools directories.
2006-07-20The package directory path is "PKGPATH", not "PKG_PATH", which is usedjlam1-2/+2
by pkg_add(1).
2006-07-14Add a "bootstrap-register" target used specially by the bootstrap scriptjlam1-1/+10
to register packages that were installed by the bootstrap script.
2006-07-13* Add a new stage "bootstrap-depends" that happens before all otherjlam1-4/+3
stages, and that installs dependencies listed in BOOTSTRAP_DEPENDS. The bootstrap-depends step works just like the normal depends step and honors the value of DEPENDS_TARGET. It's now possible to add dependencies solely to facilitate fetching the distfiles, e.g. BOOTSTRAP_DEPENDS+= curl-[0-9]*:../../www/curl * Teach the tools framework about ":bootstrap" as a tools modifier which indicates the tool should be added as a dependency via BOOTSTRAP_DEPENDS. * Add "digest" to the tools framework. * Use USE_TOOLS+=digest:bootstrap to force pkgsrc to install digest before anything else. Get rid of unused "uptodate-digest" target and related digest version-checking code. * Finish the refactoring work: split checksum-related code out of bsd.pkg.mk and into pkgsrc/mk/checksum and replace the "checksum" target command list with a script that does all the real work. * Make DIGEST_ALGORITHMS and PATCH_DIGEST_ALGORITHM into private variables by prepending them with an underscore. Also, rename _PATCH_DIGEST_ALGORITHM to _PATCH_DIGEST_ALGORITHMS and adjust the makepatchsum target to allow that variable to contain a list of algorithms, all of which are used when creating the patch checksums for ${DISTINFO_FILE}.
2006-07-07Rename <phase>_COOKIE variables to _COOKIE.<phase>. These are privatejlam3-19/+19
variables so there are no user-visible changes. This change just makes it a little easier to write for loops.
2006-07-07Make configure, install, and package barrier-aware even if NO_CONFIGURE,jlam1-2/+4
NO_INSTALL, or NO_PACKAGE are defined.
2006-07-06The cookie files are indirectly made using *-cookie targets, so verifyjlam1-1/+3
that they are never being created more than once by inserting a check into the *-cookie targets.
2006-07-05Flatten out recursive makes into a single re-invocation of make byjlam3-16/+28
introducing the concept of a "barrier". We separate the user-invokable targets into ones that must happen before the barrier, and ones that must happen after the barrier. The ones that happen after the barrier are run in a sub-make process. In this case, the targets that must be run after the barrier are from the "wrapper" step and beyond. We rewrite the various "flow" targets, e.g. wrapper, configure, build, etc., so that they of the right form to use the barrier target. This now completely removes the concept of PKG_PHASE from pkgsrc. It is replaced with the concept of "before" and "after" the barrier, and this state can be checked by testing for the existence of the barrier cookie file. Because we've removed most of the recursive makes, there is now nowhere to hook the PKG_ERROR_HANDLER.* commands, so remove them for now. As part of this commit, put back the logic that conditionalized the sources for the various cookie files. Because the sources are all "phony" targets, they were always run, regardless of whether or not the cookie file already existed. Now, if a cookie file exists, then that entire phase associated with that cookie file is skipped. Lastly, fix a thinko in configure/bsd.configure.mk where setting NO_CONFIGURE in a package Makefile would manage to skip the "wrapper" step altogether. Fix this by correctly noting "wrapper" and not "patch" as the preceding step to "configure".
2006-07-05Make the check-vulnerable target more self-sufficient, by moving somejlam2-8/+9
of the logic from fetch/fetch.mk into flavor/pkg/check.mk, so that check-vulnerable can be used as a source target. Make check-vulnerable a source target for every phase of the build workflow, which ensures that it is always run if the user starts a new phase from the command line. Fix the cookie-generation targets so that they don't append, only overwrite to the cookie file. This works around potential problems due to recursive makes. Move the cookie checks so that they surround the corresponding phase target. The presence of the cookie should now inform the make process to avoid doing any processing of phases that occur before the phase corresponding to the cookie.
2006-06-14Insert cookie checks into the "real-install" and "real-package" targets,jlam1-1/+3
which are invoked in recursive make calls for the "install" and "package" targets respectvely. These recursive make calls prevent the top-level make from seeing all of the targets and computing a full dependency graph, so it becomes possible for some targets to be invoked more than once. This change passes enough information along to the recursive make calls and ensures that the source targets for the real-* targets are only invoked once.
2006-06-10Restore missing ${SETENV} ${BUILD_ENV} that was dropped during the initialjlam1-2/+2
package system flavors commit.
2006-06-09Introduce the capability to gather all the warnings and errors thatjlam1-1/+2
are generated for a target and output them all at once at the conclusion of the target's invocation. The implementation is in bsd.pkg.error.mk, which defines a macro target "error-check" that will print out any non-empty warning and error files in ${WARNING_DIR} and ${ERROR_DIR} and exit appropriately if there were errors. Convert some targets that were just long sequences of ${ERROR_MSG} or ${WARNING_MSG} within a single shell statement to use the new delayed error output via error-check. Modify the compiler "fail" wrappers for C++ and Fortran to be less verbose during invocation. Instead collect the warnings and only print them at the end of the completed phase, e.g. after "configure" and/or "build" completes.
2006-06-08If the install cookie file exists, then we don't need to do anything.jlam1-8/+23
Also, move the interactive check into a separate target as a prelude to removing the recursive make for invoking "real-install".
2006-06-071.) Remove all instances of '@${WARNING_MSG} "Warning: ...' which resultedtron1-6/+6
in error message like 'WARNING: Warning: ...'. 2.) Replace "WARN_MSG" with "WARNING_MSG" which makes the "make package" target work again for restricted packages like "acroread7".
2006-06-06Move some variable definitions out of bsd.prefs.mk and back intojlam1-4/+4
bsd.pkg.mk. They didn't actually need to be defined in bsd.prefs.mk, just somewhere before the "main" bsd.<phase>.mk files were included. This moves some conditional (?=) definitions back into bsd.pkg.mk so they won't conflict with any conditional definitions in package Makefiles. This should fix the "checksum" problems in lang/php-gd as noted here: http://mail-index.netbsd.org/pkgsrc-users/2006/06/05/0012.html where EXTRACT_SUFX had the wrong value due to the order in while *.mk files were included.
2006-06-06Remove trailing blank line.jlam1-2/+1
2006-06-05Use PHASE_MSG, STEP_MSG, WARNING_MSG, and ERROR_MSG in place of ECHO_MSGjlam3-18/+18
in various places.
2006-06-05Allow overrides of the public targets, e.g. "install", "package", etc.jlam4-4/+16
if PKG_SKIP_REASON or PKG_FAIL_REASON is defined. This commit adds !target(...) guards around those target definitions to avoid "duplicate target definition" warnings.
2006-06-05Move definitions for UPDATE_TARGET and DEPENDS_TARGET closer to wherejlam1-3/+3
they are used. Also, move UPDATE_RUNNING into the install module where it is used, and make it "private" by prepending with an underscore.
2006-06-03First pass at implementing support for package system flavors otherjlam5-0/+510
than pkgsrc's current one. This is an important lead-up to any project that redesigns the pkg_* tools in that it doesn't tie us to past design (mis)choices. This commit mostly deals with rearranging code, although there was a considerable amount of rewriting done in cases where I thought the code was somewhat messy and was difficult to understand. The design I chose for supporting multiple package system flavors is that the various depends, install, package, etc. modules would define default targets and variables that may be overridden in files from pkgsrc/mk/flavor/${PKG_FLAVOR}. The default targets would do the sensible thing of doing nothing, and pkgsrc infrastructure would rely on the appropriate things to be defined in pkgsrc/mk/flavor to do the real work. The pkgsrc/mk/flavor directory contains subdirectories corresponding to each package system flavor that we support. Currently, I only have "pkg" which represents the current pkgsrc-native package flavor. I've separated out most of the code where we make assumptions about the package system flavor, mostly either because we directly use the pkg_* tools, or we make assumptions about the package meta-data directory, or we directly manipulate the package meta-data files, and placed it into pkgsrc/mk/flavor/pkg. There are several new modules that have been refactored out of bsd.pkg.mk as part of these changes: check, depends, install, package, and update. Each of these modules has been slimmed down by rewriting them to avoid some recursive make calls. I've also religiously documented which targets are "public" and which are "private" so that users won't rely on reaching into pkgsrc innards to call a private target. The "depends" module is a complete overhaul of the way that we handle dependencies. There is now a separate "depends" phase that occurs before the "extract" phase where dependencies are installed. This differs from the old way where dependencies were installed just before extraction occurred. The reduce-depends.mk file is now replaced by a script that is invoked only once during the depends phase and is used to generate a cookie file that holds the full set of reduced dependencies. It is now possible to type "make depends" in a package directory and all missing dependencies will be installed. Future work on this project include: * Resolve the workflow design in anticipation of future work on staged installations where "package" conceptually happens before "install". * Rewrite the buildlink3 framework to not assume the use of the pkgsrc pkg_* tools. * Rewrite the pkginstall framework to provide a standard pkg_* tool to perform the actions, and allowing a purely declarative file per package to describe what actions need to be taken at install or deinstall time. * Implement support for the SVR4 package flavor. This will be proof that the appropriate abstractions are in place to allow using a completely different set of package management tools.
2006-05-21Move mk/install to mk/pkginstall to better reflect the contents (thejlam18-3646/+0
pkginstall framework).
2006-05-21Avoid a difference in shell implementation between IRIX 5.3 and newerjlam1-2/+2
UNIX systems which caused recursive script invocations to not work. Patch from Georg Schwarz in private email.
2006-05-10Fix missing quotes that were causing the group and user existence checksjlam1-3/+3
to break.
2006-05-01Use the meta-data directory as the location for all temporary filesjlam6-90/+111
used by the various scriptlets. Also, consistently use the idiom of creating a temporary directory with mode 700 and creating temporary files underneath that directory to avoid race conditions.
2006-04-29Ensure that @VAR@ placeholders in usergroupfuncs are properly substitutedjlam1-3/+3
for by running it through a separate FILES_SUBST_SED filter. This fixes the case where the user wasn't being created if USERGROUP_PHASE was defined.
2006-04-29Always remove the intermediate files, even if the +USERGROUP scriptjlam1-6/+10
determines the users and/or groups don't exist. This makes "make clean" work properly for non-root users.
2006-04-29Remove the test file in all exit conditions.jlam3-9/+9
2006-04-29Allow for just-in-time su when creating users and groups ifjlam1-5/+13
USERGROUP_PHASE is defined.
2006-04-27Use a better default user comment if none is specified -- if the usernamejlam3-6/+18
matches ${PKGBASE}, then use "${PKGBASE} user", otherwise we use "${PKGBASE} $user user".
2006-04-26Allow a package to specify the ownership and permission onjlam1-3/+15
${PKG_SYSCONFDIR} if PKG_SYSCONFSUBDIR is defined and non-empty. A package may now set PKG_SYSCONFDIR_PERMS to an "owner group mode" triplet, which defaults to "${ROOT_USER} ${ROOT_GROUP} 755".
2006-04-25Rename the test directory to a more suggestive name.jlam2-4/+4
2006-04-25Modify the DIRS line format to match the FILES one, where the modejlam2-29/+42
precedes the user and group.
2006-04-25Use colons as separators instead of slashes on the off-chance that "/"jlam2-27/+27
is used in either the user or group name due to some bizarro set of circumstances.
2006-04-25First try at fixing a deficiency in the package +INSTALL scripts,jlam5-24/+263
where they don't verify that any pre-existing config files and directories have the correct permissions. For example, if you are upgrading a package to a newer version and the config files and directories used by the package need to have different permissions than in previous versions of the package, then the new package may fail to work because it can't access pre-existing files and directories. This commit improves on this by doing the following: (1) Teach the +FILES and +DIRS scriptlets two new actions "PERMS" and "CHECK-PERMS". "PERMS" fixes permissions on existing files and directories. "CHECK-PERMS" will verify those same bits and warn the user when they are wrong. The "CHECK-PERMS" actions for the two scriptlets are run immediately after the "ADD" actions. (2) Add a new variable PKG_CONFIG_PERMS that controls whether the "PERMS" action will automatically fix permissions. PKG_CONFIG_PERMS is only consulted if PKG_CONFIG is "yes". PKG_CONFIG_PERMS can be set in the shell environment when running pkg_add, e.g.: export PKG_CONFIG=yes export PKG_CONFIG_PERMS=yes pkg_add /path/to/binary/package.tgz The default value of PKG_CONFIG_PERMS embedded into the +INSTALL script may also be set in /etc/mk.conf. This value defaults to "no", so that by default, the +INSTALL script will not modify or destroy any existing configuration files or directories. The +INSTALL script will now always warn you if there are files or directories whose permissions differ from what the package is expecting to use, and if PKG_CONFIG_PERMS is set to "yes", then it will go ahead and fix those permissions for you automatically.
2006-04-24Fix typos in comments, noted by Yoshito Komatsu in private email.jlam3-6/+6
2006-04-24Fix {group,user}_exists functions when the numeric ID is not set. Fixjlam3-9/+27
provided in PR pkg/33346 by Yoshito Komatsu.