150M is extremely small. The B stands for billion parameters, so the M stands for million parameters. So we're talking 3% the size of recent mid-tier models.
What this means is someone made a tiny model, and it scored way better than we thought. The conclusion is (I assume) we can make models way smaller at the same quality.
That's huge, because that would mean in a matter of years anyone can deploy their own model on the most dog shit hardware. This would kill AI companies, it would neuter Nvidia and it would mean PC components will decrease to suitable prices. And it also means even in poor countries people have access to AI which I personally think is one of the most noble things to finally make people more equal by giving them lots of knowledge.
Mostly right but don't forget that technological advancement never leads to cheaper more affordable components, and more equality for the people
Just the opposite the big techs continues growing faster utilizing even more ressources
yes, models can be much smaller than people think. esp when they're fit to purpose. I have a couple models I deploy in apps that perform better than the 27 gig models models and are only 20-100MB. its about training, data processing, and understanding how information theory plays into the domain space you're solving for.
9 Comments
BlueberryWalnut@sopuli.xyz · 4 pts · 11d
hoshikarakitaridia@lemmy.world · 7 pts · 11d
29% is probably somewhere between meh and ok-ish.
150M is extremely small. The B stands for billion parameters, so the M stands for million parameters. So we're talking 3% the size of recent mid-tier models.
What this means is someone made a tiny model, and it scored way better than we thought. The conclusion is (I assume) we can make models way smaller at the same quality.
That's huge, because that would mean in a matter of years anyone can deploy their own model on the most dog shit hardware. This would kill AI companies, it would neuter Nvidia and it would mean PC components will decrease to suitable prices. And it also means even in poor countries people have access to AI which I personally think is one of the most noble things to finally make people more equal by giving them lots of knowledge.
foremanguy92_@lemmy.ml · 1 pts · 9d
Mostly right but don't forget that technological advancement never leads to cheaper more affordable components, and more equality for the people Just the opposite the big techs continues growing faster utilizing even more ressources
hoshikarakitaridia@lemmy.world · 2 pts · 9d
I disagree. Look at how many poor countries have been transformed just by virtue of cheap smartphones.
Give them a device to communicate with one another and suddenly their life becomes a heck of a lot easier.
jatone@lemmy.dbzer0.com · 1 pts · 11d
yes, models can be much smaller than people think. esp when they're fit to purpose. I have a couple models I deploy in apps that perform better than the 27 gig models models and are only 20-100MB. its about training, data processing, and understanding how information theory plays into the domain space you're solving for.
yogthos@lemmy.ml · 0 pts · 11d
for the size it's inane
ultimate_worrier@lemmy.dbzer0.com · 3 pts · 11d
leanleft@lemmy.ml · 1 pts · 10d
thats only if it's from the insanity region. otherwise its just plain old inane
leanleft@lemmy.ml · 1 pts · 10d
i have seen sub-100 models perform excellent on some basic tasks
yogthos@lemmy.ml · 1 pts · 10d
which ones?