For me at least, for months now, this instance is unavailable for multiple hours a day. Given the recent posts about the lemmy eco system being on a slight downwards trend, I don't think this additional load is caused by more users using this instance. Rather, I think that AI scrapers are using this instance to scrape lemmy. If I am correct, though only someone with access to the logs can check, I'd like to kindly ask for some sort of protection from AI scrapers. Both because I like being able to actually browse the instance and because I hate AI companies.
11 Comments
WolfLink@sh.itjust.works · 20 pts · 228d
I use an app for my Lemmy browsing and I’d really like that to not break :/
artwork@lemmy.world · 2 pts · 228d
I am not sure how an app crashing is related to a certain Lemmy Community, but just in case there's a marvelous Thunder (source) that is working like a charm ✨
nao@sh.itjust.works · 1 pts · 227d
As an alternative, is it possible to disable the guest mode (reading without being logged in) on a lemmy instance?
On the downside, it would make it less accessible for new users or users who simply don't want to use an account. But maybe it would be worth it, if it would help to stop scrapers.
Or the middle ground, have a captcha only in front of of the guest mode.
partial_accumen@lemmy.world · 14 pts · 228d
Some Lemmy instances use Cloudflare for protection. I know that sopuli.xyz uses Anubis instead. Both these approaches would offer scraper protection without a captcha which would certainly be a high friction event for human users. Does shitjustworks use something like this?
artwork@lemmy.world · 2 pts · 228d
Related: Army of AI crawlers (...are extremely slowing us; AI crawlers learned how to solve the Anubis challenges... - Codeberg...)
sbv@sh.itjust.works · 9 pts · 228d
I've noticed the slowness too. It's lousy, because this is the instance I recommend to normies.
But picking a solution without knowing the problem is a bit premature.
TheDude@sh.itjust.works · 6 pts · 224d
Hey all,
I am very well aware of the slowness and timeouts that people are experiencing. I'm working on getting a few upgrade put into place to bring things back to where they need to be. Thanks for the patience!
Quacksalber@sh.itjust.works · 3 pts · 224d
Thanks
smuuthbrane@sh.itjust.works · 5 pts · 228d
Will that fix all the timeout issues sh.itjust.works has had?
Quacksalber@sh.itjust.works · 3 pts · 228d
The hope is that yes, it would.
Pandantic@midwest.social · 2 pts · 228d
You all should @ your instance admin.