I'm running a small instance just for myself and a friend. We basically use it to access the Lemmy fediverse.
I was under the impression that our instance would not download imagery that was not hosted on it but the pict-rs "files" directory ended up with 45 gig of data which ultimately filled up the VPS storage space.
Is there a command that I can automate to prune this regularly or does anyone have a solution?
10 Comments
poVoq@slrpnk.net · 10 pts · 3y
Sadly not yet. Hopefully this will be improved in the future.
However, this sounds like you used one of these follow everything bots, which is just a bad idea as it results in these kind of issues.
calr0x@lemmy.world · -1 pts · 3y
I did but "all" is useless without it and having to use a separate website to discover communities just doesn't make sense.
I think at some point I will figure something out.
housepanther@lemmy.goblackcat.com · 6 pts · 3y
I just took a look at the repository for pict-rs and unfortunately nothing in the official docs about cleaning up images. Did you happen to use a bot to assist you in finding communities? If so this might be the reason. After two weeks of running, my image size is only 2.2mb. I should also ask you what the size of your database is. The activity table can get awfully big and very quickly.
calr0x@lemmy.world · 1 pts · 3y
I did use a bot..
housepanther@lemmy.goblackcat.com · 2 pts · 3y
Ah, I see. I hope some maintenance tools will be forthcoming.
RunAwayFrog@sh.itjust.works · 4 pts · 3y
Imagine if media in Lemmy was all hosted in a distributed network filesystem like Iroh, where instances only function as inserters and exit nodes for that media.
This way, smaller instances can have a smaller cache corresponding to the media that was actually needed by it (recently). And independent peers can help by participating in the distributed file-system network without running instances themselves.
archengel@nichenerdery.duckdns.org · 2 pts · 3y
Woah, that seems really neat! What would be the cons to doing this (other than the implementation time and effort of course)?
Ocelot@lemmies.world · 2 pts · 3y
It would definitely be nice to have some image retention policy. If an image hasnt been accessed in say 6 months its probably safe to say I won’t care about it. And if need be it can pull it from the original server again.
Pleonasm@programming.dev · 1 pts · 3y
Can you just run a cronjob to delete files in that directory every day?
(Maybe there's a reason you can't do this, I don't know how Lemmy instance works)
calr0x@lemmy.world · 1 pts · 3y
I deleted all of them and the instant stopped running so I'm not sure we can do it in that manner.