Today marks a significant moment in our journey, and I am thrilled to share some important news with you. After much thoughtful consideration, I have decid
A New Chapter for Mozilla: Focused Execution and an Expanded Role in Charting the Internet’s Future
https://blog.mozilla.org/en/mozilla/a-new-chapter-for-mozilla-laura-chambers-expanded-role/
1 Comments
noroute@lemmy.world · 2 pts · 2y
falken@qoto.org · 3 pts · 2y
@noroute@lemmy.world @yoasif@fedia.io local LLM execution times can be very fast on recent consumer hardware. No need to send anywhere, just like their translation - do it all on-device.
As an example, with no optimization or GPU support, my @frameworkcomputer@fosstodon.org (AMD) generates around 5 characters/sec from a 4 gigabyte pre-quantized model.
DangerousInternet@lemmy.world · 1 pts · 2y