summaryrefslogtreecommitdiff
path: root/mk/fetch
AgeCommit message (Collapse)AuthorFilesLines
2022-11-14Also update MASTER_SITE_MOZILLAadam1-3/+3
2022-11-14mk: fix mozilla master sitewiz1-3/+3
Reported by Mike Pumford on pkgsrc-users
2022-10-02mk: remove obsolete KDE mirrorwiz1-2/+1
2022-05-24gitlab: underscore is a valid character in gitlab project/user names.nikita1-3/+3
2022-05-23Add USE_GITLAB, based on github.mk, to make gitlab MASTER_SITEnikita4-3/+116
handling less repetitive. To use, set in Makefile: DISTNAME= exampleproject-1.2 MASTER_SITES= ${MASTER_SITE_GITLAB:=accountname/} The following variables alter gitlab.mk behavior: GITLAB_PROJECT defaults to PKGBASE GITLAB_TAG defaults to PKGVERSION_NOREV sometimes you want to override with v${PKGVERSION_NOREV} SHA-1 commit ids are also acceptable GITLAB_RELEASE defaults to not defined, set this to ${DISTNAME} when packaging a release not based on a git tag. GITLAB_SUBMODULES manually set submodule information: values should be: GitLab_user GitLab_project tag_or_hash submodule_path GITLAB_TYPE overrides the autodetected MASTER_SITE URL scheme:
2022-05-21sites.mk: update primary Apache sitesgutteridge1-2/+3
2021-12-16The non-writability check for DISTDIR is intended to prevent wastingschmonz1-5/+3
resources when fetchers wouldn't be able to save what they download. On my build farm with pkgsrc (and pkgsrc/distfiles) mounted over NFS, however, the check gives false positives for NetBSD 9.2 and -current. Downgrade it to a warning so that these fetches can succeed, while leaving a breadcrumb in case someone encounters a true positive. It would of course be interesting to sort out why, in my environment, a wide variety of other OSes get 1 for "${TEST} ! -w $fetchdir" while NetBSD gets 0. In the meantime, joerg@ suggested this workaround and gdt@ agrees it's reasonable to try.
2021-08-31mk: download.kde.org redirects to httpsmarkd1-2/+2
2021-06-21Remove all MySQL mirrors that 404 or fail to respondnia1-18/+1
2021-06-21Remove broken MySQL mirrornia1-3/+1
2021-06-21Remove extremely slow MySQL mirrornia1-3/+1
2021-04-28mk: master site xorg now prefers httpswiz1-2/+2
2021-04-21mk: remove dead download sitewiz1-3/+2
2021-04-10correct documentationnia1-2/+2
2021-03-30mk: Introduce GITHUB_SUBMODULES to get and place Git submodules for GitHubryoon2-5/+28
2021-02-14mk: remove ftp.dante.de, it does not offer FTP any longerwiz1-2/+1
2021-01-07Switch to HTTP for cpan.pair.com, the FTP service has been discontinued.fcambus1-2/+2
2020-11-11ftp.gnu.org redirects to https.nia1-2/+2
2020-11-05sites: add some working GNOME mirrorsnia1-2/+5
2020-11-05sites: remove GNOME master sites that now either fail or redirectnia1-3/+1
2020-09-02Use http with ftp.funet.fikim1-5/+5
2020-08-27mk: Rewrite the checksum script in awk.jperkin1-2/+2
The previous shell script version's runtime was quadratic against the number of distfiles to verify. Historically this has not been an issue, with usually only a handful of files per package. However, with the introduction of Go modules the number of distfiles used by a single package can be very high. For example, in an upcoming update of www/grafana to version 7.1.5, the number of GO_MODULE_FILES is 821. Running 'bmake checksum' takes: real 18m20.743s user 17m27.975s sys 0m49.239s With the awk code, this is reduced to a far more sensible: real 0m4.330s user 0m3.241s sys 0m0.875s The script has been written to emulate the previous version precisely, preserving the same output and error messages and supporting all of its behaviour, with the one exception that previous exit values of 128 have been changed to 3, in order to avoid any potential signed 8-bit issues. The one change in the pkgsrc infrastructure is that the mk/fetch/fetch script no longer sets a working default value for ${CHECKSUM}. This is not a problem in a pkgsrc environment as all of the required variables are set correctly, but if there happen to be any users who are using this script in a standalone environment, they will need to set it accordingly. This was probably required in many situations previously anyway, as none of the script's environment variables were set, and trying to support this would be fragile at best.
2020-08-09Add URLs to the MASTER_SITE_R_CRAN listbrook1-1/+7
At some point CRAN added the https protocol to its repositories, but this was never reflected in MASTER_SITE_R_CRAN. Add analogues for all the http sites with responsive https servers.
2020-08-04mk/fetch/fetch.mk: add keywords for "bmake help"rillig1-1/+2
2020-06-18mk: do not check vulnerability when just fetching distfileswiz1-2/+2
This is intended to reduce the log output on ftp.NetBSD.org when fetching all distfiles. Also, we call the target in basically every step of package creation (extract, patch, configure, build, install, package) - perhaps we should trim this down some more.
2020-04-25mk/fetch/fetch.mk: Use -f with ofhttpjs1-2/+2
pkgsrc wants to be able to override files when the checksum didn't match.
2020-04-25mk/fetch/fetch.mk: Add ofhttp as fetcherjs1-1/+7
2020-04-21(mk/fetch/site.mk) ftp.cse.buffalo.edu has not been responded for a weekmef1-2/+1
2020-03-30mk/fetch/fetch.mk: don't print double-slash in pathnamerillig1-2/+2
2019-11-22mk/fetch: add SITES.* to the variables for the show-all-fetch targetrillig1-2/+3
2019-11-04mk/fetch: sort variables for bmake show-all-githubrillig1-3/+5
2019-05-05doc/guide: fill in the MASTER_SITE variables automaticallyrillig1-3/+2
Keeping these two lists in sync is not something that humans should do.
2019-02-04*: mirror.switch.ch does not provide ftp/http service any longerwiz1-7/+2
2019-01-14mk/sites: cpan.perl.org advertises Strict-Transport-Securitytnn1-2/+2
2018-11-30mk/misc: make configuration for show-all targets more configurablerillig2-2/+4
Up to now, there was a central list of variable name patterns that defined whether a variable was printed as a sorted list, as a list or as a single value. Now each variable group decides on its own which of the variables are printed in which way, using the usual glob patterns. This is more flexible since different files sometimes differ in their naming conventions. Two variable groups are added: license (for everything related to LICENSE) and go (for lang/go).
2018-10-23Remove dead mozilla mirrors. ESR mirrors are not used.maya1-10/+1
2018-10-13drop ftp://ftp.gnu.org, they have a notice stating they intend to shut downmaya1-3/+2
ftp services. (http remains)
2018-08-22Remove clauses 3,4 from TNF-only copyright blocks.maya1-8/+1
This is based on the decision The NetBSD Foundation made in 2008 to do so, which was already applied to src. This change has been applied to code which is likely not in other repositories. ok board@, reviewed by riastradh@
2018-08-01mk/fetch/github.mk: document that PKGBASE influences GitHub variablesrillig1-1/+2
See https://mail-index.netbsd.org/pkgsrc-users/2018/07/thread1.html#027251
2018-04-21*: gd.tuwien.ac.at/ftp.tuwien.ac.at is gone, remove it from various mastersiteswiz1-5/+1
2018-04-08mk/fetch: add documentation for show-all-githubrillig1-1/+5
2018-02-18Reorder MASTER_SITES_GNU:maya1-6/+8
- Put the main mirror at the lowest priority. it seems to be struggling. - Add two mirrors that seem decent at the highest priority.
2018-01-11Add FETCH_PROXY and FETCH_PROXY.{ftp,http,https}.alnsn1-5/+39
2017-12-03mk: Remove ftp.kddlabs.co.jp from sites, does not provide ftp servicewiz1-5/+1
2017-11-08define MASTER_SITE_CRATESIO (for downloading rust crates)tnn1-1/+4
2017-09-29remove ftp variant when http server already existsmaya1-3/+1
pretty sure these are the same server but ftp is considerably slower on a high latency connection
2017-09-17fetch/sites.mk: ftp.tuwien.ac.at times out, remove itwiz1-3/+1
2017-08-10Update MASTER_SITE_XEMACS list.hauke1-3/+9
2017-08-01Do not perform checksum tests when explicitly calling a make target thatjperkin1-2/+3
creates or updates the checksum. Allows users to set FAILOVER_FETCH in mk.conf unconditionally and be able to update distinfo files without first having to remove them.
2017-06-12Reorder so cpan http mirrors are firstmaya1-3/+3
at least with nbftp, ftp downloads involve several slow back and forth 'cd' commands and end up being noticeably slower for lots of little files