troed

u/troed@fedia.io
15 posts · 1.3k comments

Recent posts

Recent comments

When I start llama-server I point it to the models-config that have unique max context sizes per model - and they're allocated at their max size as soon as the server starts so since it comes up I will be able to use that context size too.

I'm actually a bit unsure as to how you run it since you get OOMs during usage :)

I also use the DCP plugin for Opencode to help manage the context cache and have less of a disruption as it gets compressed, but I wouldn't need to for the above to work. When I hit the context limit the context would still get compressed.

on Telenor köper Bahnhof · c/sweden · 9 pts · 13d

Jag har hittills haft åsikten att vad jag än kan välja för bredband så väljer jag (och rekommenderar andra) Bahnhof eftersom oavsett om de är billigast eller inte så vet jag att mina pengar går till något bra för oss alla.

Med Telenor som ägare kommer jag nu istället gå strikt på features vs kostnad. Antingen levererar de bäst eller inte.

on Stop Using OpenCode · c/hackernews · 4 pts · 14d

Yeah it was quite obvious from all the "clanker" that this is a typical run-of-the-mill AI-hater, but I found this funny anyway:

The weight count is too low to reproduce the training set verbatim

That's not what anyone wants. That's not how LLMs gain "intelligence", at all. The whole point of training on large datasets is to NOT internalize training data verbatim.

Yeah I run the Gemma 4 12B QAT on my homeserver. It has a 12GB GPU (Nvidia A2000) and that model gives the most bang for the buck being both fast and multimodal.

My daughter loves the Moana movies. I've told her about this one - and the anti-excitement of "the same movie but with actual persons" is quite obvious. I can only conclude that no actual parents were involved in its inception.

Lemmy and Mbin are roughly the same thing - "Reddit"

Mastodon is "Twitter"

... and there are more, with Loops being "TikTok" and Pixelfed being "Instagram".

They can all see the same content, but presented in ways that emphasize their unique aspects. That's what people call "Fediverse" but it's much simpler to just think of them as separate apps and ignore that technically true but confusing aspect.

Kan inte läsa materialet på något sätt som skulle innebära att Mastodon eller Lemmy skulle inkluderas. Faller både på att "små företag" exkluderas samt "civilsamhällets organisering".

IANAL