1-Bit LLM in the Browser

https://huggingface.co/spaces/webml-community/bonsai-webgpu

Comments

13 points · 3 comments · view on lemmy.world

3 Comments

dparticiple@sh.itjust.works · 2 pts · 38d

Haven't tried it yet, but as someone who used to design print media ads for Apple in the '90s, seeing Garamond Compressed used in their website brought back fond memories of that era.

LazyGit@feddit.org · 1 pts · 39d (1 reply)

This is really impressive, until it isn’t. It comes up with answers really fast. Only they are really really wrong.

5 out of 7 will try again

ShutUpWesley@piefed.zip · 4 pts · 39d

So basically like normal LLMs