Incidentally, this meme was inspired by having to use Microsoft Copilot to convert several screenshots of charts into Excel file format (which it only did successfully a few times despite identical verbiage).
Technically, you can control the randomness by using the same seed value. Although, it still remains a text completion or a next word (token) prediction model.
At the lowest level yes. But you're talking about millions of bits of entropy seeds being constantly gathered and spread across parameters with every new token. The industry approach to balancing stochasticity with determinism is Temperature: https://www.ibm.com/think/topics/llm-temperature
8 Comments
dual_sport_dork@lemmy.world · 62 pts · 13d
It works. I was having trouble getting my emails, so I consulted my magic eight ball. It said:
s@piefed.world · 4 pts · 13d
Incidentally, this meme was inspired by having to use Microsoft Copilot to convert several screenshots of charts into Excel file format (which it only did successfully a few times despite identical verbiage).
sundray@lemmus.org · 10 pts · 12d
nutbutter@discuss.tchncs.de · 9 pts · 13d
Technically, you can control the randomness by using the same seed value. Although, it still remains a text completion or a next word (token) prediction model.
urushitan@kakera.kintsugi.moe · 4 pts · 13d
At the lowest level yes. But you're talking about millions of bits of entropy seeds being constantly gathered and spread across parameters with every new token. The industry approach to balancing stochasticity with determinism is Temperature: https://www.ibm.com/think/topics/llm-temperature
cally@piefed.blahaj.zone · 7 pts · 12d
Let me consult my magic 8 ball.
...
It just says 8. Am I doing something wrong?
DarkCloud@lemmy.world · 5 pts · 13d
Huh, I've never seen an eight ball with visible brush marks on it.
Ertain@mast.linuxgamecast.com · 2 pts · 12d
@s Can't go wrong with the original prompt machine.