Efficient power delivery is achieved with startup PowerLattice's voltage regulator chiplets, boosting AI data center performance.
Could Tiny Chiplets Be the Key to AI’s Power Problem?
https://spectrum.ieee.org/voltage-regulator
https://spectrum.ieee.org/voltage-regulator
Efficient power delivery is achieved with startup PowerLattice's voltage regulator chiplets, boosting AI data center performance.
13 Comments
panda_abyss@lemmy.ca · 37 pts · 263d
No.
danc4498@lemmy.world · 17 pts · 263d
Did you tell them that? They’re gonna waste a lot of energy cause they think it will.
panda_abyss@lemmy.ca · 2 pts · 263d
We need analog and probabilistic chips to make this efficient.
if_only@sh.itjust.works · 6 pts · 263d
https://en.wikipedia.org/wiki/Betteridge's_law_of_headlines
sem@piefed.blahaj.zone · 3 pts · 263d
The comments never disappoint.
wewbull@lemmynsfw.com · 18 pts · 263d
Whilst there's loss in the power supplies of GPUs, most buck regulator circuits are 95+% efficient. So on a 400W GPU, maybe you're losing 20W to regulation. You also lose some to resistive voltage drop between the regulators and the GPU, but that will be a fraction of the regulator drop.
Better regulation closer to the core may save some watts, but it's such a small slice of the power pie. The main part is the GPU itself and its memory.
The savings the headline is talking about is all about dynamic voltage and frequency, which GPUs (and CPUs) already do and only give savings when the chip is below maximum load.
avidamoeba@lemmy.ca · 13 pts · 263d
And any reductions in power consumption would be eliminated by adding more compute capacity.
SalamenceFury@lemmy.world · 12 pts · 263d
How about we just get rid of LLMs entirely? Surely that would save even more power.
metallic_substance@lemmy.world · 5 pts · 263d
Yeah, but where's the profit in that?
Lodespawn@aussie.zone · 8 pts · 263d
I mean .. there appears to be no profit in LLMs either but they are still cranking along ..
metallic_substance@lemmy.world · 3 pts · 263d
I assumed I didn't need a /s, but I guess I did
jubilationtcornpone@sh.itjust.works · 4 pts · 263d
Reducing power consumption is good but those efficiency gains don't directly translate to better performance. That claim is a stretch at best.
The regulator is designed to be installed in very close proximity to the chip it powers. I wonder what kind of impact it would have on the chips ability to disapate heat since the regulator itself would be generating heat as well.
Tollana1234567@lemmy.today · 1 pts · 263d
no it wont, they still have to peddle AI as a product to buyers, right now its only c-suites and ceo obsessing overit.