Moving git.openwrt.org behind Fastly CDN

[nick]

I prefer using git.cdn.openwrt.org over github because of its IPv6 
support. ;)

On 12/4/24 4:23 PM, Hannu Nyman wrote:
> Petr & others,
>
> a few suggestions regarding git.openwrt.org load:
>
> Should we try to decrease our own load to git.openwrt.org by
>
> a) setting feeds.conf.default to point to the actual root feeds at 
> GitHub (e.g. https://github.com/openwrt/packages) instead of the 
> git.openwrt.org mirror?
>   Or alternatively, set feeds.conf.default to point to the new 
> git.cdn.openwrt.org?
>
> b) Set buildbot to fetch sources from git.cdn.openwrt.org (and also do 
> the changes to the feeds locations def...)
>
>
> Hannu
>
>
> Petr Štetiar kirjoitti 4.12.2024 klo 15.07:
>> Hi,
>>
>> git.openwrt.org is currently served by a single VPS server, which is 
>> no longer
>> suitable in this age of AI scraping. That server is being overloaded 
>> on daily
>> basis with spikes of requests, leading quite often to 500s, causing 
>> build
>> failures on our buildbots during feed syncs.
>>
>> As a first quick fix attempt, I've prepared git.cdn.openwrt.org, 
>> which is a
>> Fastly CDN-backed mirror of git.openwrt.org and would like to serve 
>> all the
>> traffic via Fastly CDN which I hope should alleviate the gitweb based 
>> load on
>> the server as it could be served from the CDN cache.
>>
>> The CDN is generously provided by Fastly, without any cost to us. If 
>> we decide
>> to keep using this service, we're going to put information about it 
>> somewhere
>> on the gitweb page.
>>
>> The setup is going to use Fastly's relatively recent CA Certainly[1], 
>> using
>> certs with 30-day certificate validity.
>>
>> In case you bump into any issues, please let us know via standard 
>> channels
>> (lists, IRC, GitHub issues, etc.) so we can address them or 
>> eventually revert
>> the change.
>>
>>
>> 1. 
>> https://www.fastly.com/blog/announcing-certainly-fastlys-own-tls-certification-authority
>>
>>
>> Happy Git cloning!
>>
>> Cheers,
>>
>> Petr
>>
>> _______________________________________________
>> openwrt-adm mailing list
>> openwrt-adm at lists.openwrt.org
>> https://lists.openwrt.org/mailman/listinfo/openwrt-adm
>
>
>
> _______________________________________________
> openwrt-adm mailing list
> openwrt-adm at lists.openwrt.org
> https://lists.openwrt.org/mailman/listinfo/openwrt-adm