I can confirm that an update was performed yesterday to 0.19.0 yesterday / today.
We hit some issues during the upgrade, but these have now been resolved and CompuVerse is running 0.19.0.
I can also confirm that we now have a Matrix server!
I will post an announcement shortly, but for reference, the homeserver is now located at
https://conduit.compuverse.uk/
I think the issue here is likely that any activity that occurred in the rest of the Lemmyverse whilst this instance was offline was never federated to us, so this instance doesn't know about the comments or which were posted before it came back online etc.
This will be problematic right now since lots of active threads will have been created or had comments and votes prior to this instance coming back online, but I believe any new content should come through correctly.
There's been a few notable events recently, and I like to keep important news up for a couple of weeks.
I've now cleaned up those that are no longer relevant however. So this should no longer be as problematic.
I think the general Welcome and Rules posts are always going to be relevant to new users, however I would like to be able to get rid of them for older users.
I may have a look into a solution that will allow me to do this. But, not sure how successful I'll be on that front!
From what I gather, the way it works is that once a user here has interacted with a remote community at least once, and subscribed to it, from then on, all activity that happens in that community is then automatically pulled across and stored inside this instance also.
So if I subscribed to the "technology" community on "lemmy.world", every post and comment, edit and deletion and I believe even votes and such made afterwards will then be synchronised across to this instance.
Checking the database however, it actually seems that the post and comment data etc isn't too large.
The majority of the storage is actually taken by the "Activity" table.
From what I can see, this table is used to basically store a log of everything the server has been told about. The actual contents are taken out into other tables. (Which are only a couple of hundred MB, rather than 20GB!)
Lemmy does have an automatic cleanup of this table, but it only removes content older than 6 months.
Since we only started in June, we've got an entire 4 months more data to go, and by the way things are going, that's liable to total to potentially hundreds of gigabytes of data.
The activity table had more data in it from the last 2 weeks than it did for the entire month and a half preceeding! (12 million activity records in 2 weeks, compared to only 11 million between the start of June and 2 weeks ago)
The storage required for lemmy is indeed quite significant!
I have no doubt further optimisations could be done there, but at present it's an unfortunate truth that lemmy likes its storage!
So far it's eaten 21GB of database space in less than 2 months, and again, that's all text!
I'm a software developer and my largest production database I've ever had has only been around 100GB after around 15 years of usage.
Posts and messages from hundreds of thousands of users globally just take a lot of space I guess haha! (Though it would be nice if lemmy only cached remote posts for say, a day or a week, and then wiped the content from its local cache and called out to the remote server thereafter)
I'm very averse to asking for donations! I don't want anyone to have to pay to access CompuVerse, and donations, whilst greatly appreciated would feel wrong to take. Plus there's then further complications regarding how to receive said donations, any taxes involved etc. etc. which I quite frankly can't be bothered to deal with haha!
I really do want to avoid taking donations if at all possible :)
I rent a couple of virtual servers (including the one this is running on) from a few providers.
I also host a couple of game servers on a Dedicated machine.
Don't have any physical hosting myself, don't have the resources for such a thing!
I used to self-host a few utilities like a cloud storage solution, link shortener, paste provider, image host etc. but got fed up of maintaining it all ha!
Nowadays I just run a small number of game servers, and CompuVerse!
Highly likely.
I suppose it'd add something actually worth having to the subscription because goodness knows none of the other features are worth it ha!
This is a good question, I'm not actually sure to be honest with you.
So far I've heard nothing about the main project receiving any sort of threats, and even the Steam page wasn't officially DMCAd or the like. It was more of a threat saying they WOULD officially DMCA if the project wasn't taken down.
It's very interesting that it was played like this rather than just officially issuing a DMCA takedown request. Almost like they weren't 100% convinced the official DMCA would actually hold up?
At present, it will create a post per deal. Which would be way too spammy!
However, the bot is currently offline whilst I'm trying to make some changes.
I want to get it into a state where it aggregates multiple deals into a single post. Rather than posting a post per deal that is found!
I don't know if this is something that is possible to do unfortunately.
It's not something I've seen available in any of the settings and such I'm afraid :(
Hi, many thanks for the compliments!
The bot is having a couple of problems atm which I'm trying to solve, so it's not live at present.
The downvote button being enabled / disabled is set by the home instance you are using.
For example, the downvote button is enabled on my own compuverse.uk instance, however it appears Beehaw does not enable the downvote option, and thus you don't have the option there.
Hi,
Thanks for your suggestions!
I can confirm that an update was performed yesterday to 0.19.0 yesterday / today. We hit some issues during the upgrade, but these have now been resolved and CompuVerse is running 0.19.0.
I can also confirm that we now have a Matrix server! I will post an announcement shortly, but for reference, the homeserver is now located at https://conduit.compuverse.uk/
We have a client hosted also on https://chat.compuverse.uk/
Feel free to join! :)
Thanks, Cameron
Hi @Flipflop@compuverse.uk,
I think the issue here is likely that any activity that occurred in the rest of the Lemmyverse whilst this instance was offline was never federated to us, so this instance doesn't know about the comments or which were posted before it came back online etc.
This will be problematic right now since lots of active threads will have been created or had comments and votes prior to this instance coming back online, but I believe any new content should come through correctly.
I am investigating federation issues.
Do you have any exact examples which I could use as a starting point to investigate this please?
They would be greatly appreciated :)
Thanks,
Cameron
Hi, thanks for your support of Compuverse.
I have just posted an announcement regarding this downtime and aim to improve things for future.
We came back online after resolving the host issues a couple of days ago.
Pinned temporarily until downtime is over.
I would like games to arrive as a single complete package, but I was relatively fond of expansion packs from games like RollerCoaster Tycoon.
They took the game you already had, and pretty much doubled it, they were fantastic!
Far better than any modern DLC for sure.
Hi, many thanks for the suggestions.
There's been a few notable events recently, and I like to keep important news up for a couple of weeks.
I've now cleaned up those that are no longer relevant however. So this should no longer be as problematic.
I think the general Welcome and Rules posts are always going to be relevant to new users, however I would like to be able to get rid of them for older users.
I may have a look into a solution that will allow me to do this. But, not sure how successful I'll be on that front!
That's fantastic news! I guess they realised that the way it was previously handled was HUGELY unsustainable!
Thanks for letting me know about this :)
From what I gather, the way it works is that once a user here has interacted with a remote community at least once, and subscribed to it, from then on, all activity that happens in that community is then automatically pulled across and stored inside this instance also.
So if I subscribed to the "technology" community on "lemmy.world", every post and comment, edit and deletion and I believe even votes and such made afterwards will then be synchronised across to this instance.
Checking the database however, it actually seems that the post and comment data etc isn't too large.
The majority of the storage is actually taken by the "Activity" table.
From what I can see, this table is used to basically store a log of everything the server has been told about. The actual contents are taken out into other tables. (Which are only a couple of hundred MB, rather than 20GB!)
Lemmy does have an automatic cleanup of this table, but it only removes content older than 6 months.
Since we only started in June, we've got an entire 4 months more data to go, and by the way things are going, that's liable to total to potentially hundreds of gigabytes of data.
The activity table had more data in it from the last 2 weeks than it did for the entire month and a half preceeding! (12 million activity records in 2 weeks, compared to only 11 million between the start of June and 2 weeks ago)
I did actually set up a Mastodon server previously, but decided to swap over to hosting Lemmy instead.
However, for future downtime, I've created a maintenance page, which I'll switch over to, and provide whatever information I can.
You can see it over at https://holding.compuverse.uk/ :)
Hi Steve, Many thanks for this.
The storage required for lemmy is indeed quite significant!
I have no doubt further optimisations could be done there, but at present it's an unfortunate truth that lemmy likes its storage!
So far it's eaten 21GB of database space in less than 2 months, and again, that's all text!
I'm a software developer and my largest production database I've ever had has only been around 100GB after around 15 years of usage.
Posts and messages from hundreds of thousands of users globally just take a lot of space I guess haha! (Though it would be nice if lemmy only cached remote posts for say, a day or a week, and then wiped the content from its local cache and called out to the remote server thereafter)
I'm very averse to asking for donations! I don't want anyone to have to pay to access CompuVerse, and donations, whilst greatly appreciated would feel wrong to take. Plus there's then further complications regarding how to receive said donations, any taxes involved etc. etc. which I quite frankly can't be bothered to deal with haha!
I really do want to avoid taking donations if at all possible :)
Wow, quite the impressive hardware setup there!
I rent a couple of virtual servers (including the one this is running on) from a few providers.
I also host a couple of game servers on a Dedicated machine.
Don't have any physical hosting myself, don't have the resources for such a thing!
I used to self-host a few utilities like a cloud storage solution, link shortener, paste provider, image host etc. but got fed up of maintaining it all ha!
Nowadays I just run a small number of game servers, and CompuVerse!
Highly likely. I suppose it'd add something actually worth having to the subscription because goodness knows none of the other features are worth it ha!
Hmm,
Now this is very interesting.
I'm going to have to take a look into this. It's great to see how well it performs!
I use the OpenAI API for a couple of things at cost atm.
Self-hosting this could be really neat.
SummoningSalt always makes fantastic videos. Will definitely have to give this one a watch!
This is a good question, I'm not actually sure to be honest with you.
So far I've heard nothing about the main project receiving any sort of threats, and even the Steam page wasn't officially DMCAd or the like. It was more of a threat saying they WOULD officially DMCA if the project wasn't taken down.
It's very interesting that it was played like this rather than just officially issuing a DMCA takedown request. Almost like they weren't 100% convinced the official DMCA would actually hold up?
At present, it will create a post per deal. Which would be way too spammy!
However, the bot is currently offline whilst I'm trying to make some changes. I want to get it into a state where it aggregates multiple deals into a single post. Rather than posting a post per deal that is found!
I don't know if this is something that is possible to do unfortunately. It's not something I've seen available in any of the settings and such I'm afraid :(
Hi, many thanks for the compliments! The bot is having a couple of problems atm which I'm trying to solve, so it's not live at present. The downvote button being enabled / disabled is set by the home instance you are using. For example, the downvote button is enabled on my own compuverse.uk instance, however it appears Beehaw does not enable the downvote option, and thus you don't have the option there.
Source Code
I do plan on making the source code for this bot public eventually.
It's a lot better than it was when I first started, but still an absolute travesty with a lot of hardcoded nonsense.
Once the code is cleaned up, I will be posting the source code on my GitHub over at https://github.com/CameronRedmore