c/selfhosted · by RagingHungryPanda@lemm.ee · 1y

I finally got TruNas running an LLM on my AMD GPU!!!

https://gotosocial.michaeldileo.org/@mdileo/statuses/01JQA4M4Q33PMCADH9M2AWQSS8

And I'm making everyone go to my gotosocial post because the server is running, so I'm going to use it!

82 points · 8 comments · view on lemmy.world

8 Comments

possiblylinux127@lemmy.zip · 4 pts · 1y (2 replies)

You missed an e

RagingHungryPanda@lemm.ee · 1 pts · 1y (1 reply)

Because it doesn't feel real 😉

Edit: i thought you referred to TrueNas. I'm tired

possiblylinux127@lemmy.zip · 3 pts · 1y

I think you are still missing an e in the title.

Cool project though

JigglySackles@lemmy.world · 3 pts · 1y (2 replies)

Congrats!!

RagingHungryPanda@lemm.ee · 4 pts · 1y (1 reply)

Thank you! This took so long to figure out

JigglySackles@lemmy.world · 3 pts · 1y

I bet! That's a lot of technical info to sort through, understand and create.

liliumstar@lemmy.dbzer0.com · 2 pts · 1y

Congrats! I just got a similar running on Arch with a 5700 XT. When I looked at it a couple years ago, it wasn't really possible. Now, smooth sailing.

Condiment2085@lemm.ee · 2 pts · 1y

That's so cool!!