It should be a few gigabytes. Not 30. But at the end of the day, even if it was 1GB, you're still using an Apple product so you necessarily don't give a shit.
Care to elaborate on the size you’re referencing because that’s a very vague and arbitrary assertion.
A 7-billion-parameter LLM at say 32 bit precision would be around 30GB…
So, I’d assume that last part of your comment just says you don’t know what you’re talking about and just wanna hate on Apple users. But maybe I’m misunderstanding the intent.
My devices can’t run Apple AI because Apple thinks they can strongarm EU into deregulation by withholding it from us. Joke’s on them, it’s a feature and not a bug.
I'm pretty sure it's an option you can disable if you need the space. Definitely preferable to a cloud LLM like copilot that you're not allowed to uninstall
The only way to disable it involves workarounds like changing Siri language to some other non-supported region. This is pretty much mandatory with no opt-out otherwise.
8 Comments
panda_abyss@lemmy.ca · 6 pts · 3d
Meanwhile
PagPag@lemmy.world · 4 pts · 3d
Small price to pay if it’s actually on device processing.
endless_nameless@lemmy.world · 0 pts · 3d
It should be a few gigabytes. Not 30. But at the end of the day, even if it was 1GB, you're still using an Apple product so you necessarily don't give a shit.
PagPag@lemmy.world · 2 pts · 3d
Care to elaborate on the size you’re referencing because that’s a very vague and arbitrary assertion.
A 7-billion-parameter LLM at say 32 bit precision would be around 30GB…
So, I’d assume that last part of your comment just says you don’t know what you’re talking about and just wanna hate on Apple users. But maybe I’m misunderstanding the intent.
swagmoney@lemmy.ca · 4 pts · 3d
my mac cant run apple ai because i don't have enough RAM 💅
misk@piefed.social · 5 pts · 3d
My devices can’t run Apple AI because Apple thinks they can strongarm EU into deregulation by withholding it from us. Joke’s on them, it’s a feature and not a bug.
kayzeekayzee@lemmy.blahaj.zone · 2 pts · 3d
I'm pretty sure it's an option you can disable if you need the space. Definitely preferable to a cloud LLM like copilot that you're not allowed to uninstall
misk@piefed.social · 4 pts · 3d
The only way to disable it involves workarounds like changing Siri language to some other non-supported region. This is pretty much mandatory with no opt-out otherwise.