Soon you will be able to run LLMs natively in docker

https://www.docker.com/llm/

something like docker run xyz_org/xyz_model

21 points · 1 comments · view on lemmy.world

1 Comments

kevin2107@lemmy.world · 14 pts · 1y

this makes zero fucking sense because you already can