diff options
| author | Philip Paeps <philip@FreeBSD.org> | 2026-10-09 06:06:04 +0000 |
|---|---|---|
| committer | Philip Paeps <philip@FreeBSD.org> | 2026-10-15 14:34:34 +0000 |
| commit | a9b746406a0d9f1ee1d68a6785d9f6d28433ccf5 (patch) | |
| tree | fd22874f0ba1d9ea1b41f783129ba85388f2a94c | |
| parent | 1f4bec71e2618afd94bd835f3bd36ca27cdbe212 (diff) | |
Status/2026Q3/clusteradm.adoc: Add report
Reviewed by: adrian, dch, salvadore
| -rw-r--r-- | website/content/en/status/report-2026-07-2026-09/clusteradm.adoc | 103 |
1 files changed, 103 insertions, 0 deletions
diff --git a/website/content/en/status/report-2026-07-2026-09/clusteradm.adoc b/website/content/en/status/report-2026-07-2026-09/clusteradm.adoc new file mode 100644 index 0000000000..69cb6e7c9a --- /dev/null +++ b/website/content/en/status/report-2026-07-2026-09/clusteradm.adoc @@ -0,0 +1,103 @@ +=== Cluster Administration Team + +Links: + +link:https://www.freebsd.org/administration/#t-clusteradm[Cluster Administration Team members] URL: link:https://www.freebsd.org/administration/#t-clusteradm[] + +Contact: Cluster Administration Team <clusteradm@FreeBSD.org> + +Contact: Philip Paeps <philip@FreeBSD.org> + +FreeBSD Cluster Administration Team members are responsible for managing the machines the Project relies on to synchronize its distributed work and communications. + +In this quarter, the team has worked on the following: + +* Regular support for FreeBSD.org user accounts. +* Regular disk and parts support (and replacement) for all physical hosts and mirrors. +* Cluster software refresh. +* Coordinate community mirrors. +* Ports repository history rewrite. +* Frequent interventions to thwart denial of service by bots. +* Improvements to cgit on our global mirror network. + +==== Cluster refresh + +Work continues to refresh the software running on FreeBSD.org cluster machines. +We have started putting production workloads on stable/15. +As part of this work some workloads are being moved around to different machines. +This work is ongoing at the end of the quarter. + +The clusteradm team refreshes the production package builders (circa 35 physical machines) on a roughly six- to eight-week cadence. +These machines run FreeBSD current snapshots. + +Other machines are upgraded on an as-needed basis, keeping up with security fixes depending on how exposed they are. + +At the time of this writing there are 143 physical machines in the cluster. +We have 45 machines on current, 33 on stable/15 and 59 on stable/14. + +Most of the remaining stable/13 installations will be upgraded to stable/15 or decommissioned. + +[.screen] +---- + 12.x: Regular 0, Jails 7 + 13.x: Regular 6, Jails 28 + 14.x: Regular 59, Jails 223 + 15.x: Regular 33, Jails 60 +>16.x: Regular 45, Jails 6 +Total: Regular 143, Jails 324 +Total installations: 467 +Running -RELEASE|{-p*}: 0 +Total geographic sites: 14 +---- + +==== FreeBSD official mirrors + +Current locations are Australia, Brazil, Japan (two full mirror sites), Malaysia, South Africa, Sweden, Taiwan and United States of America -- California, Chicago, New Jersey, and Washington. + +Our mirror site in Taiwan is experiencing an extended outage. +A new mirror site in Taiwan is being deployed at the beginning of 2026Q4. + +One of our mirror sites in Japan will get a complete hardware refresh in 2026Q4. + +The hardware and network connection have been generously provided by: + +* Cloud and SDN Laboratory at link:https://www.bbtower.co.jp/en/corporate/[BroadBand Tower, Inc] +* link:https://www.cs.nycu.edu.tw/[Department of Computer Science, National Yang Ming Chiao Tung University] +* link:https://internet.asn.au/[Internet Association of Australia] +* link:https://www.isc.org/[Internet Systems Consortium] +* link:https://www.inx.net.za/[INX-ZA] +* link:https://www.kddi-webcommunications.co.jp/english/[KDDI Web Communications Inc] +* link:https://www.mohe.gov.my/en/services/research/myren[Malaysian Research & Education Network] +* link:https://www.metapeer.com/[MetaPeer] +* link:https://www.nyi.net/[New York Internet] +* link:https://nic.br/[NIC.br] +* link:https://sonic.net[Sonic] +* link:https://www.teleservice.net/[Teleservice Skåne AB] +* link:https://your.org/[Your.Org] + +New official mirrors are always welcome. +We have noted the benefits of hosting single mirrors at Internet Exchange Points globally, as evidenced by our existing mirrors in Australia, Brazil, and South Africa. +If you are affiliated with or know of any organizations willing to sponsor a single mirror server, please contact us. +We are particularly interested in locations in Europe. + +See link:https://wiki.freebsd.org/Teams/clusteradm/generic-mirror-layout[generic mirrored layout] for full mirror site specs and link:https://wiki.freebsd.org/Teams/clusteradm/tiny-mirror[tiny-mirror] for a single mirror site. + +==== Ports repository history rewrite + +In July a committer inadvertently pushed a large binary file to the ports repository, necessitating a freeze and subsequent rewrite of the history. +The clusteradm team rewrote the history of the ports tree and ensured that the new history was visible on all our internal and external mirrors in the shortest possible time. +Improvements were made to our Git infrastructure and automation to prevent this happening again. + +==== Large language model scraping + +The FreeBSD Project's infrastructure continues to be under constant attack from scrapers collecting training data for large language models ("AI"). +The companies training these models have largely moved scraping operations from their own -- easy to identify -- infrastructure to botnets ("residential proxies"), making them difficult to block at the network edges without significant collateral damage. +The Cluster Administration Team spent a considerable amount of time again this quarter mitigating these distributed denial of service attacks. + +==== Improvements to cgit on our global mirror network + +https://cgit.FreeBSD.org is a particularly popular target for trainers of probabilistic malware. +We experience a constant torrent of scrapers running on infected computers and appliances all around the world. +To spread the load of these attacks, the clusteradm team increased the number of cgit nodes on our mirrors. +This quarter we deployed additional https://cgit.FreeBSD.org mirrors in California and in Paris. + +Sponsor: Anonymous individuals and companies + +Sponsor: https://github.com/sponsors/ppaeps |
