Cr4yfish

u/Cr4yfish@lemmy.world
55 posts · 145 comments

Recent posts

Recent comments

Never heard of that actually. Main difference would be my web-based approach with a cloud, which works on any device. You also don't have to run the LLM on the same device (which seems to be a must with SillyTavern?).

The Character Cards database looks very interesting though! I will definitely look into writing an importer/connecting service.

Yeah agree, I’ll definitely implement that one.

Right now I’m working on “match the cards”.

Edit: For audio I’m not so sure on how I would do it. I don’t think most people would record it themselves when creating a course so I would need to generate it. Then you’d have the issue about correct pronunciation…

Fair opinion. Native Apps do have some huge advantages, but also some disadvantages.

I've coded both before (although way more PWAs) and with Native you also run into Platform issues as long as you don't ship exclusively for one Platform.

PWAs have a huge advantage here since they run the same everywhere as long as the Platform has a browser which is not safari.

Is it for self-host ppl too?

In theory not an issue. I use Supabase, which you can self host as well.

You can also self host the Mistral Client, but not Gemini. However, I am planning to move away from Gemini towards a more open solution which would also support self hosting, or in-browser AI.

I am looking for OIDC, S3 and PgSQL

Since I use Supabase, it runs on PgSQL and Supabase Storage, which is just an Adapter to AWS S3 - or any S3, really. For Auth, I use Supabase Auth which uses OAuth 2.0, that's the same as OIDC right?

Thanks. My general strategy regarding GenAI and reducing the amount of hallucinations is by not giving it the task to make stuff up, but to just work on existing text - that's why I'm not allowing users to create content without source material.

However, LLMs will be LLMs and I've been testing it out a lot and found already multiple hallucinations. I built in a reporting system, although only reporting stuff works right now, not viewing reported questions.

That's my short term plan to get a good content quality, at least. I also want to move away from Vercel AI & Gemini to a Langchain Agent system or Graph maybe, which will increase the output Quality.

Maybe in some parallel Universe this really takes off and many people work on high quality Courses together...

Thanks, haha. I'd love develop a Native App for it too but this is a zero-budget Project (aside from the Domain). PlayStore has a one-time fee so that's 25€ for Android + 8€/Month for the IOS AppStore just to have the App on there.

In theory, I could just have a downloadable .apk for Android to circumvent the fee but most people don't want to install a random .apk from the internet. And I'm not developing a Native App for like 3 people excluding myself (I'm an iPhone user).

Soo, yeah that'll probably not happen :(.