refactor: use ftpmirror.gnu.org for gnu packages #8

Merged
jakehamilton merged 1 commit from srxl/foundation:ftpmirror into main 2025-10-04 21:25:07 +00:00
Member

https://ftp.gnu.org is very, very slow. From the GNU downloads page:

[...]please try to use one of the many mirrors of our site listed below: the mirrors will give you faster response. [...] You can use the generic URLs https://ftpmirror.gnu.org and http://ftpmirror.gnu.org to automatically choose a nearby and up-to-date mirror.

Indeed, in my experience the mirrors are much faster. I don't see a reason we shouldn't default to them personally, so I've changed the default here.

Also see: auxolotl/labs#26

https://ftp.gnu.org is very, *very* slow. From the [GNU downloads page](https://www.gnu.org/prep/ftp.en.html): > [...]please try to use one of the many mirrors of our site listed below: the mirrors will give you faster response. [...] You can use the generic URLs https://ftpmirror.gnu.org and http://ftpmirror.gnu.org to automatically choose a nearby and up-to-date mirror. Indeed, in my experience the mirrors are much faster. I don't see a reason we shouldn't default to them personally, so I've changed the default here. Also see: auxolotl/labs#26
srxl added 1 commit 2025-09-30 12:21:12 +00:00
ftp.gnu.org is very, *very* slow. ftpmirror.gnu.org will instead download from a mirror of the GNU server, which is
almost always much faster.
Member
Seems to evaluate OK on hydra: https://hydra.aux-cache.dev/jobset/aux-prs/foundation-pr8.1
First-time contributor

I get several hash mismatches with this change:

       error: hash mismatch in file downloaded from 'https://ftpmirror.gnu.org/gnu/coreutils/coreutils-5.0.tar.gz':
         specified: sha256-wnznXj9iRV9PrPTz/VW8njh30KsdXAQmyU2haMw0mIM=
         got:       sha256-1k0P1yECe/rStrLYbISqIUphx5Gn7DV2ajD8FAlewDw=

       error: hash mismatch in file downloaded from 'https://ftpmirror.gnu.org/gnu/gcc/gcc-4.6.4/gcc-core-4.6.4.tar.gz':
         specified: sha256-5TSlywWrg51897JJb9XfQudjUpJsHPDZTedhhMJqc5w=
         got:       sha256-9wNwl9AA3gke+lhE4VqqdrIFSS62GHYhViZ2oTo0V/4=

What's weird, is that when I download the files, they actually hash to the same value. And when I manually select a mirror instead of ftpmirror.gnu.org, then it also works. So it seems that this mirror sometimes responds with wrong responses?

I get several hash mismatches with this change: ``` error: hash mismatch in file downloaded from 'https://ftpmirror.gnu.org/gnu/coreutils/coreutils-5.0.tar.gz': specified: sha256-wnznXj9iRV9PrPTz/VW8njh30KsdXAQmyU2haMw0mIM= got: sha256-1k0P1yECe/rStrLYbISqIUphx5Gn7DV2ajD8FAlewDw= error: hash mismatch in file downloaded from 'https://ftpmirror.gnu.org/gnu/gcc/gcc-4.6.4/gcc-core-4.6.4.tar.gz': specified: sha256-5TSlywWrg51897JJb9XfQudjUpJsHPDZTedhhMJqc5w= got: sha256-9wNwl9AA3gke+lhE4VqqdrIFSS62GHYhViZ2oTo0V/4= ``` What's weird, is that when I download the files, they actually hash to the same value. And when I manually select a mirror instead of `ftpmirror.gnu.org`, then it also works. So it seems that this mirror sometimes responds with wrong responses?
Author
Member

Interesting, maybe some mirrors in the rotation aren't complete, and it's returning 404 pages or something similar? Or maybe it's mirror downtime?

I wonder if there's a way to select from a more reliable subset...

Interesting, maybe some mirrors in the rotation aren't complete, and it's returning 404 pages or something similar? Or maybe it's mirror downtime? I wonder if there's a way to select from a more reliable subset...
Author
Member
Seems like it is indeed an incomplete mirror in the rotation (https://mirror.clientvps.com, see https://matrix.to/#/#general:auxolotl.org/$0h1bQTlpeNXHN7K43q9g433cxDTHf9aHo2OtcvSls4k).
Contributor

Yeah, I emailed them(clientvps.com) about it. Even if there is a flaky mirror in the pool, it's much better than the current state of "it doesn't build at all because ftp.gnu.org is so slow it's effectively down", so this should be merged even before the mirror.clientvps.com issue is fixed(either on their end, or by being removed from the pool) IMO.

In any case, I'll leave a note in #general if i get a reply about the mirror.

Got a reply, it shouldn't be an issue anymore.

~~Yeah, I emailed them(clientvps.com) about it. Even if there is a flaky mirror in the pool, it's much better than the current state of "it doesn't build at all because ftp.gnu.org is so slow it's effectively down", so this should be merged even before the mirror.clientvps.com issue is fixed(either on their end, or by being removed from the pool) IMO.~~ ~~In any case, I'll leave a note in `#general` if i get a reply about the mirror.~~ Got a reply, it shouldn't be an issue anymore.
jakehamilton merged commit 9a32c3d132 into main 2025-10-04 21:25:07 +00:00
jakehamilton deleted branch ftpmirror 2025-10-04 21:25:07 +00:00
Irenes referenced this pull request from a commit 2025-10-23 21:46:52 +00:00
Sign in to join this conversation.
No reviewers
No milestone
No project
No assignees
4 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: auxolotl/foundation#8
No description provided.