summaryrefslogtreecommitdiff
path: root/mk/bulk/post-build
AgeCommit message (Collapse)AuthorFilesLines
2004-11-23Fix the find command used to print out all of the .broken* files. It nowjlam1-2/+2
prints out both the .broken.html and .broken.work.html files instead of just the latter.
2004-11-22Change perlfiles var to look for files from perl*,wiz1-2/+2
not only perl, so that perl-thread files are not marked as leftovers.
2004-11-16Preserve the .work.log file from a broken build as .broken.work.htmljlam1-3/+4
in the package directory, and add a link to it from .broken.html at the point where the build fails. Also adjust the auxilliary scripts to handle/cleanup .broken.work.html files. This should enhance the ability of developers to debug broken builds by providing important information about what is happening as a build progresses and fails.
2004-07-15add anchors for jumping to the top and each section of the HTML report.grant1-4/+22
2004-07-15only include broken packages in the email output.grant1-6/+9
2004-04-09Commentary cleanup:jschauma1-5/+6
- If it's a full sentence, start capitalize first letter and end with a period. - Break comments at ~80 chars so it fits into a terminal.[*] (* This should be done for the code as well, but then it'll need testing. I'll do this at another point in time.)
2004-04-07Add support in the bulk build code to properly deal with SPECIFIC_PKGS=1.dmcmahill1-2/+5
In particular, when SPECIFIC_PKGS is set in /etc/mk.conf, you can now do sh mk/bulk/build and have the right thing happen. Only those packages explicitly listed and those which are depended upon are considered for the build. Other than the restricted list of packages, the bulk build works the same way as a full bulk build.
2004-03-28Rearrange the wording slightly in an informational message, to avoidagc1-2/+2
some email filters and false positives.
2004-03-22If BULK_BUILD_CONF points to an absolute path, don't try to use itjschauma1-2/+6
with a leading "./".
2004-03-18don't assume there will always be broken packages. noted by wiz.grant1-2/+5
2004-03-13Remove some more of the "last touched by" code.wiz1-4/+2
2004-03-11Remove 'blame' column, OK'd by grant@.hubertf1-7/+5
2004-02-25GNU tar on netbsd-1-6 doesn't grok "-T -" at the end, but pax-as-targrant1-3/+4
does, so rearrange the arguments so that "-f -" is always at the end. noted by krister@. while I'm here, make sure we use the same tar(1) program pkgsrc does.
2004-02-15avoid another long command line calling tar(1).grant1-2/+2
2004-02-14when copying the broken files, use find(1) instead of a shell globgrant1-2/+2
to avoid a command line too long for sh(1) on some platforms.
2004-02-08print date and time in UTC.grant1-3/+5
2004-02-08include the total number of binary pkgs created in the report. fixgrant1-6/+17
some HTML nits.
2004-02-05show build start time in localtime, not seconds-since-epoch :)grant1-2/+6
2004-02-05Remove a local change which crept in with the last update.sketch1-3/+1
2004-01-31improve report layout:grant1-197/+376
- move the build summary to the top and include build start/end times. - break the report up into three sections for easier navigation: Broken, Broken dependencies, and Not packaged. - HTML report now uses a subset of the www.NetBSD.org stylesheet. - improve some of the text.
2004-01-26Use $FIND with "-print". Noted by Georg Schwarz in PR pkg/24248heinz1-4/+5
2004-01-20make this work on Solaris by using perl's internal grep(). it isgrant1-15/+28
faster, and (f)grep can't handle very long word lists.
2003-09-02Merge pkgviews-mk branch into the HEAD by running:jlam1-1/+1
cd pkgsrc/mk cvs update -Pd -A cvs update -Pd -j pkgviews-mk-base -j pkgviews-mk
2003-08-19Avoid keyword substitution in keyword matching patterngavan1-2/+2
2003-08-19Remove dependence on ident and awk. This aids portability to Solaris.gavan1-9/+19
2003-08-18Get the OS name from "uname -s" instead of assuming NetBSD.cjep1-4/+6
Observed from Gavan's Solaris bulk build.
2003-05-06Drop trailing whitespace. Ok'ed by wiz.jmmv1-17/+17
2002-08-22Merge pkgsrc/mk from the buildlink2 branch back into the main trunk.jlam1-1/+1
2002-08-12Don't assume that this is a shell script - instead, realise that it'sagc1-11/+11
written in perl, and call the environment variable "BMAKE" accordingly (it's set to the name of the NetBSD make(1) program).
2002-08-07Make these scripts useful on platforms other than NetBSD by using a BMAKEagc1-11/+11
environment variable, which contains the name of the make(1) program to invoke - suggestion by Julien Letessier some time ago, the confusion mine, since I thought he was referring to something else completely. Don't rely on there being a POSIX tr(1) in the path by default - test explicitly for both "yes" and "YES". Set the default for PRUNEDISTFILES to "no", since we can't assume that the user wants us to delete something which he may have been keeping around, and there are other ways of accomplishing this aim (lintpkgsrc -o, for example). Clean up some superfluous white space at the end of lines.
2002-06-29don't hard code the start time stamp file as .start.${arch} but allowdmcmahill1-3/+7
OBJMACHINE and OBJHOSTNAME to work. Also don't hardcode /usr/pkg and /usr/X11R6 for LOCALBASE and X11BASE. Finally, fix a few typos in messages while here.
2001-10-16fix quoteshubertf1-2/+2
2001-10-15Change alignment of "Broken" column to right-justified - this makeshubertf1-2/+2
the (colored) numbers stand out better, visually.
2001-10-15Narrow doen the "Pkgs broken by" column by renaming it to "Breaks"hubertf1-4/+4
This gives this a bit of a chance to fit into 80 columns.
2001-10-15At the end of the build, remove the contents of the "perl" packagehubertf1-2/+2
from the leftovers list - "perl-base" is long gone.
2001-05-03keep a snapshot of the bulk cache files.dmcmahill1-1/+32
2001-03-19-add support for a BULK_PREREQ make variable. BULK_PREREQ contains a listdmcmahill1-2/+3
of packages which must stay installed during the build, but are not pulled in by the DEPENDS for each package. Currently, BULK_PREREQ will always include pkgtools/digest. At this time, the primary use will be to add BULK_PREREQ+=pkgtools/xpkgwedge in /etc/mk.conf to do an xpkgwedge'd bulk build. It is up to the user to make sure that the list of packages in BULK_PREREQ is a flattened list (ie all the DEPENDS are listed too). Again, at this time, xpkgwedge is really the only package that should be added to the list. -add an ADMINSIG build.conf variable. This is the signature at the end of the email report. Maybe now I'll quit forwarding reports signed as "-Hubert". -while here, eliminate grep|awk lines and `grep >/dev/null` replacing them with pure awk and grep -q.
2001-02-23make the column headings line up a little better. Patch from Hubert.dmcmahill1-4/+4
2001-02-08when a package fails to package, keep a count of how many others packagesdmcmahill1-5/+19
fail as a result. Then report this number in the generated email and html summary. The goal is to help the pkgsrc crew focus our efforts on the broken packages which have the largest impact. Thanks to Christoph Badura for suggesting that I do this and Hubert Feyrer who suggested an easier to read output format.
2001-02-01This commit incorporates several speed improvements which have been testeddmcmahill1-13/+23
over several bulk builds on an alpha: - At the start of a bulk build, 4 files are created to allow fast lookup of various dependency tree things. These files are .index == maps package name (foo-2.3) to directory (bar/foo) .dependstree == contains the complete pkgsrc dependency tree in a tsort(1) compatible format. .depends == contains 1 line per package and lists all the build depends for the package. .supports == contains 1 line per package and lists all packages which depend on this package. - When a package fails to build, the list of all packages which depend upon it is read from .supports. Each of those packages is immediately marked as broken. This prevents us from trying to build those packages which can have significant overhead if lots of other depends are installed before the system notices the broken one. In addition, the post-build postprocessing will now indicate that a package is 'truely broken' (ie, bad PLIST, failed compilation) vs. a package which is broken because it depends on a failed package. This assists in determining where to focus our efforts in fixing broken packages. - In the old approach, all packages are removed after each one is built. The purpose was to a) conserve disk space, b) verify that all required dependencies are in fact listed, and c) prevent conflicts. The problem was that often times several packages in a row have similar depends. For example we might want to build several perl packages in a row. In the old approach, we would install perl, build the pkg, deinstall perl and continue with the next one. In the new approach, when it is decided that a pkg is out of date and should be rebuilt, the .depends file is used to obtain a list of pkgs we require. Then and pkgs which are no longer needed are removed. This helps to minimize the total number of pkg_add/pkg_delete's in a bulk build. - Since the order of the build is controlled by the depends tree, all depends for a given package will have been built by the time the pkg in question needs them. If any of the depends failed to build, then the pkg which needs the failed one will have been marked as broken. Given this, the complete depends list for a pkg is read from .depends and the depends installed via pkg_add rather than relying on recursive make calls to install the depends. - while here, fix a few minor bugs x - don't leave .make log files around when the build succeeds x - make sure we refer to the correct report file in the email x - use '.order' for the build order file instead of '.l' x - use 'grep -c' instead of 'grep | wc -l'
2000-12-31move the code which determines the BROKENFILE and BUILDLOG file names outdmcmahill1-9/+5
of the top level build script and into the {pre,post}-build scripts. This ensures that either of those scripts may be run directly and not rely on a variable being set by the top level script. Thanks to Hubert Feyrer for pointing out the problem in a private email. These changes do not require any user changes to the build.conf file and should be transparent to the user.
2000-12-30further cleanup of handling the .broken.files and .make.filesdmcmahill1-2/+7
- set BROKENF and BLDLOG in the 'build' script and pass those variables down to {pre,post}-build in the environment to make sure we only set them in one place. The values are determined by a make show-var VARNAME=BROKENFILE This causes the default (set in bsd.bulk-pkg.mk) or the user overridden value from /etc/mk.conf or the environment to be correctly determined. This is more robust that relying on a build.conf setting which may or may not be correctly set. - have pre-build only clean up BROKENF and BLDLOG files instead of .broken* and .make* This avoids conflicts when pkgsrc is shared among different machines.
2000-12-30Don't die without a proper error messagehubertf1-2/+2
2000-12-26don't break the hyperlinks to the broken files....dmcmahill1-2/+3
2000-12-26- get the BROKENFILE setting from `make show-var VARNAME=BROKENFILE` rather thandmcmahill1-6/+6
hard coding it. - explicitly only add $BROKENFILE's to the output rather than .broken.* This makes things work correctly when /usr/pkgsrc is shared among several machines which might use .broken.`hostname` for its broken file logs.
2000-09-17Read FTPHOST from config filehubertf1-1/+2
2000-09-15rcs id policehubertf1-1/+1
2000-09-15Bulk build frameworkhubertf1-0/+231