Looks like my gitea server was being scraped. I've taken some preliminary steps to mitigate that and suddenly everything's gotten much more responsive.
I keep hearing friends on/off Fedi worry about aggressive AI/web scrapers or mention them hitting their servers.
I've been experimenting with different defenses for the last few months and want to share this setup, even if helps just one other person directly or indirectly. It has reduced the load on our servers usually by 80% by CPU as well as log entries.
@Maddie I'll certainly have a look. Most of my services are being run on a local machine, reverse proxied over a private VPN to a public VPS, so this does complicate IP-based bans. Though I suppose that the filtering should happen at the VPS anyway.
Lizette aka the original SpudCell
in reply to Jonathan Lamothe • • •Jonathan Lamothe
in reply to Lizette aka the original SpudCell • •Lizette aka the original SpudCell
in reply to Jonathan Lamothe • • •Maddie
in reply to Jonathan Lamothe • • •Could this help? mastodon.mit.edu/@almonds/1168…
Maddie
2026-07-07 21:26:28
Jonathan Lamothe
in reply to Maddie • •Maddie
in reply to Jonathan Lamothe • • •