Moving git.openwrt.org behind Fastly CDN

[Hannu Nyman]

Petr & others,

a few suggestions regarding git.openwrt.org load:

Should we try to decrease our own load to git.openwrt.org by

a) setting feeds.conf.default to point to the actual root feeds at GitHub 
(e.g. https://github.com/openwrt/packages) instead of the git.openwrt.org 
mirror?
   Or alternatively, set feeds.conf.default to point to the new 
git.cdn.openwrt.org?

b) Set buildbot to fetch sources from git.cdn.openwrt.org (and also do the 
changes to the feeds locations def...)


Hannu


Petr Štetiar kirjoitti 4.12.2024 klo 15.07:
> Hi,
>
> git.openwrt.org is currently served by a single VPS server, which is no longer
> suitable in this age of AI scraping. That server is being overloaded on daily
> basis with spikes of requests, leading quite often to 500s, causing build
> failures on our buildbots during feed syncs.
>
> As a first quick fix attempt, I've prepared git.cdn.openwrt.org, which is a
> Fastly CDN-backed mirror of git.openwrt.org and would like to serve all the
> traffic via Fastly CDN which I hope should alleviate the gitweb based load on
> the server as it could be served from the CDN cache.
>
> The CDN is generously provided by Fastly, without any cost to us. If we decide
> to keep using this service, we're going to put information about it somewhere
> on the gitweb page.
>
> The setup is going to use Fastly's relatively recent CA Certainly[1], using
> certs with 30-day certificate validity.
>
> In case you bump into any issues, please let us know via standard channels
> (lists, IRC, GitHub issues, etc.) so we can address them or eventually revert
> the change.
>
>
> 1.  https://www.fastly.com/blog/announcing-certainly-fastlys-own-tls-certification-authority
>
>
> Happy Git cloning!
>
> Cheers,
>
> Petr
>
> _______________________________________________
> openwrt-adm mailing list
> openwrt-adm at lists.openwrt.org
> https://lists.openwrt.org/mailman/listinfo/openwrt-adm