summaryrefslogtreecommitdiff
path: root/mk/fetch
AgeCommit message (Collapse)AuthorFilesLines
2006-09-25Adjust MASTER_SITE_MOZILLA.salo1-8/+6
2006-09-03Update MASTER_SITES (mirror.switch.ch).wiz1-4/+3
From Jukka Salmi in PR 34457.
2006-09-02Added http://qgpop.dl.sourceforge.jp/ in MASTER_SITE_SOURCEFORGE_JP.obache1-2/+3
2006-09-02SUNSITE in Tokyo University of Science has been closed,obache1-3/+1
so remove sunsite.{tus,sut}.ac.jp
2006-09-02Canonical name of SourceForge.jp's DNS round robin download server isobache1-2/+2
`download', not `downloads'.
2006-08-06add an http: urls for gnome and gnu for the benefit of those withperry1-1/+3
broken ftp proxies
2006-08-03Typo in comment.jlam1-2/+2
2006-08-02Removed dead mirror "ftp.uk.kde.org" from list of KDE master sites.tron1-2/+1
2006-08-02http://prdownloads.sourceforge.jp/ doesn't work for me. Remove it.uebayasi1-2/+1
2006-07-27Whenever we invoke a recursive make, we need to ensure that the properjlam1-3/+3
environment ${PKGSRC_MAKE_ENV} is also passed along. Create a convenience variable RECURSIVE_MAKE that does exactly this and that can be used in place of MAKE when invoking make recursively. Use RECURSIVE_MAKE everywhere in pkgsrc/mk that we invoke make recursively.
2006-07-27Rename "SITES_* to "SITES.*" for file-specific lists of sites from whichjlam1-7/+4
to fetch the file. This completes the renaming described in revision 1.1799 of bsd.pkg.mk.
2006-07-27Document the targets in fetch-list.mk.jlam1-2/+30
2006-07-27Note that "fetch-list" is a public target.jlam1-2/+2
2006-07-27Remove an unnecessary recursive make invocation.jlam1-18/+11
2006-07-27Replace this:jlam1-14/+13
for i in `cmd`; do ...; done with this: cmd | while read i; do ...; done
2006-07-27All of the other *SITES* variables are plural, so rename DYNAMIC_SITE_*jlam2-8/+8
to DYNAMIC_SITES_* for consistency.
2006-07-27Apply the "convention over configuration" principle:jlam2-7/+9
If ${FILESDIR}/getsite.sh exists, then use it to determine the fetch URL for each of the distfiles for the package. Otherwise, use SITE_<file> and MASTER_SITES, in order, to determine the URL for each distfile. If the script path differs from ${FILESDIR}/getsite.sh, then set DYNAMIC_SITE_SCRIPT to the full path to that script. Remove the need to set DYNAMIC_MASTER_SITES explicitly in the package Makefile for: graphics/ns-cult3d wm/sawfish-themes www/apache-tomcat55 www/jakarta-tomcat4 www/jakarta-tomcat5
2006-07-27The ORDERED_SITES variable defined in fetch.mk was made private injlam1-3/+3
revision 1.14, so reflect that in the usage in fetch-list.mk. This fixes PR pkg/34075.
2006-07-27Documented DIST_PATH and fixed two typos (${TARGET} is not ${.TARGET}).rillig2-15/+17
2006-07-23Remove mirrors.sunsite.dk because it causes hangs in thewiz1-2/+1
weekly distfiles fetch.
2006-07-23Remove cran.dk -- causes hangs for weekly distfiles mirror job.wiz1-2/+1
2006-07-20verify_file() returns a non-zero result whenever the distfile does notjoerg1-3/+1
currently exist. This triggers a bug in the Bourne shell of at least DragonFly and Irix, when set -e is also active. Remove set -e to avoid this. Discussed with jlam@, shown by DragonFly bulk builds, complains on DragonFly's user list and PR 34036. A test case for this shell bug is, which should return 0: set -e testf () { test -f /nonexistent || return 1 return 0 } if testf; then exit 1 fi exit 0
2006-07-19Make "mirror-distfiles" less verbose by not printing out anything if nojlam1-3/+5
bootstrap dependencies need to be built and installed.
2006-07-19Comment the code a bit more.jlam1-1/+4
2006-07-19Only pass -v to the fetch script if PKG_VERBOSE is set.jlam1-2/+2
2006-07-19Restore original quoting from old fetch.mk for _ORDERED_SITES to resolvejlam1-3/+5
the problem with MASTER_SORT*. XXX The whole MASTER_SORT* thing should just be a standalone script.
2006-07-19Add a verbose flag to the fetch script to output the actual fetch command.jlam1-4/+11
2006-07-19Make some variables "private":jlam1-10/+10
MASTER_SORT_AWK SORT_SITES_CMD ORDERED_SITES These variables are purely internal to pkgsrc.
2006-07-19Work around incomprehensible quoting mess surrounding MASTER_SORT* byjlam1-2/+2
in do-fetch-file (formerly they were inserted by the old _FETCH_FILE inserting some quotes that are no longer added by the fetch command list macro). This makes fetching with MASTER_SORT* set work again.
2006-07-19PASSIVE_FETCH only affects "ftp", so move it to the ftp-related FETCH_*jlam1-8/+7
variables.
2006-07-18Convert _FETCH_MESSAGE to plain old FETCH_MESSAGE. Remove _FETCH_MESSAGEjlam2-17/+4
processing from mk/fetch/*.mk.
2006-07-18Overhaul fetch module:jlam6-382/+458
* All the smarts is now encapsulated in the "fetch" script. The fetch script understands how to use the distinfo file (if specified) to look up the size and checksums of the file to fetch and will use that information to verify checksums of the fetched files or resume transfers of interrupted fetches. * Move the default settings for FETCH_RESUME_ARGS and FETCH_OUTPUT_ARGS for "ftp" from mk/defaults/mk.conf into mk/fetch/fetch.mk. We rewrite it to avoid needing conditional statements. * Avoid spawning a new make(1) process just to mirror a distfile. * Split out fetch-list targets into a separate file fetch-list.mk. These targets should probably be moved into a standalone script. * Fix distclean target to properly remove partial downloads.
2006-07-17First cut at a fetch script to replace the humungous fetch "macros" injlam1-0/+173
fetch.mk. This script currently completely replaces the functionality in _FETCH_FILE. I will eventually add the ability to resume a file transfer to this script.
2006-07-17Remove duplicate files from ${ALLFILES}. This doesn't affect theschmonz1-1/+2
"fetch" target, but it does affect the "checksum" target's shell script, which errors out on the second occurrence of a file. The shell script should perhaps also be fixed, but it seems sensible regardless for ${ALLFILES} not to contain duplicate filenames. As a side effect, the file list is sorted. Regression found by building mail/qmail with the "qmail-netqmail" option, which adds to PATCHFILES a file that's already in ${DISTFILES}. Arguably this is gross, but it worked before, and now works again. Tested on my usual pkg_comp(8) build of 200+ packages, with an initially empty ${DISTDIR} and ${PACKAGES}. Thanks seb@ for the more idiomatic make(1) construction.
2006-07-15Split the variable BUILD_DEFS into those that are defined by packagesrillig1-2/+2
and those that are defined by the infrastructure (_BUILD_DEFS). This allows the build-defs-message target to be moved to the end of bsd.pkg.mk. Now it prints the correct result even in unprivileged builds, which had been wrong due to the order in which the files have been included. For example, ${UNPRIVILEGED_USER} was displayed as (not defined) although its value was defined, which could be checked with "bmake show-var". Tested with one package that _does_ define BUILD_DEFS and with one that doesn't. The behavior stays the same.
2006-07-13DIGEST is no longer defined, so use TOOLS_DIGEST instead.jlam1-2/+2
2006-07-13* Add a new stage "bootstrap-depends" that happens before all otherjlam2-4/+9
stages, and that installs dependencies listed in BOOTSTRAP_DEPENDS. The bootstrap-depends step works just like the normal depends step and honors the value of DEPENDS_TARGET. It's now possible to add dependencies solely to facilitate fetching the distfiles, e.g. BOOTSTRAP_DEPENDS+= curl-[0-9]*:../../www/curl * Teach the tools framework about ":bootstrap" as a tools modifier which indicates the tool should be added as a dependency via BOOTSTRAP_DEPENDS. * Add "digest" to the tools framework. * Use USE_TOOLS+=digest:bootstrap to force pkgsrc to install digest before anything else. Get rid of unused "uptodate-digest" target and related digest version-checking code. * Finish the refactoring work: split checksum-related code out of bsd.pkg.mk and into pkgsrc/mk/checksum and replace the "checksum" target command list with a script that does all the real work. * Make DIGEST_ALGORITHMS and PATCH_DIGEST_ALGORITHM into private variables by prepending them with an underscore. Also, rename _PATCH_DIGEST_ALGORITHM to _PATCH_DIGEST_ALGORITHMS and adjust the makepatchsum target to allow that variable to contain a list of algorithms, all of which are used when creating the patch checksums for ${DISTINFO_FILE}.
2006-07-12Removed the leading "-" of a shell command. The unexpected error messagerillig1-3/+5
that it had produced had confused me.
2006-07-05Make the check-vulnerable target more self-sufficient, by moving somejlam1-20/+2
of the logic from fetch/fetch.mk into flavor/pkg/check.mk, so that check-vulnerable can be used as a source target. Make check-vulnerable a source target for every phase of the build workflow, which ensures that it is always run if the user starts a new phase from the command line. Fix the cookie-generation targets so that they don't append, only overwrite to the cookie file. This works around potential problems due to recursive makes. Move the cookie checks so that they surround the corresponding phase target. The presence of the cookie should now inform the make process to avoid doing any processing of phases that occur before the phase corresponding to the cookie.
2006-06-25add .cz KDE mirrorjdolecek1-2/+3
2006-06-23Remove "apache.towardex.com" (down) and "sunsite.tus.ac.jp" (redirectstron1-3/+1
to new version) from the list of Apache master sites.
2006-06-20If FAILOVER_FETCH is defined, then we need the digest binary to alreadyjlam1-2/+2
be installed, so let uptodate-digest do that crazy thing it does.
2006-06-20Fix FAILOVER_FETCH usage to actually match documentation -- it'sjlam1-2/+2
supposed to be just defined/undefined, but was previously being used as non-empty/emtpy.
2006-06-06Move some variable definitions out of bsd.prefs.mk and back intojlam1-5/+7
bsd.pkg.mk. They didn't actually need to be defined in bsd.prefs.mk, just somewhere before the "main" bsd.<phase>.mk files were included. This moves some conditional (?=) definitions back into bsd.pkg.mk so they won't conflict with any conditional definitions in package Makefiles. This should fix the "checksum" problems in lang/php-gd as noted here: http://mail-index.netbsd.org/pkgsrc-users/2006/06/05/0012.html where EXTRACT_SUFX had the wrong value due to the order in while *.mk files were included.
2006-06-06Improve the warning message if the vulnerabilities file is not found.jlam1-5/+5
2006-06-06Add documentation about which are the public targets for the fetch module.jlam1-1/+9
2006-06-06Refactor "fetch" and "extract" code into correspondingly namedjlam5-0/+908
subdirectories of pkgsrc/mk. Move the following files around for locality: pkgsrc/mk/scripts/extract -> pkgsrc/mk/extract/extract pkgsrc/mk/bsd.sites.mk -> pkgsrc/mk/fetch/sites.mk Also get rid of the recursive make for the "fetch" and "extract" targets. This basically merges the "fetch" and "extract" phases into the "patch" phase. There is still much more work to do to simplify the fetch code, but this is a good start.