Claude bros know how to measure performance. They just don't.
https://www.youtube.com/watch?v=xeU208KqeRc&list=UU9rJrMVgcXTfa8xuMnbhAEA - video
https://pivottoai.libsyn.com/20260113-if-ai-coding-is-so-good-where-are-the-performance-numbers - podcast
time: 7 min 34 sec
17 Comments
CinnasVerses@awful.systems · 35 pts · 203d
There is an old principle in software development not to make the GUI too pretty until the back end works, because managers and customers will think its ready when they can click around buttons with nice shading and animations. I think slopware is like that. People see the demo that appears to work and don't see what maintaining it and integrating it with other systems is like.
YourNetworkIsHaunted@awful.systems · 6 pts · 201d
Hell, that's the whole thing with these LLM-based business/product structures, isn't it? The models are very good at creating something that looks right, leading to people being absolutely blindsided when they fail to actually do the thing that boosters and salesmen pretended they were doing.
Given that these are statistical models that function probabilistically, it seem like the obvious attitude to take would be to assume it's a question of when they fail and do something wrong, rather than if. But accounting for that inevitability undermines most if not all of the actual economic value of these things because it turns out it takes just about as much time, effort, and skill to monitor and check these things as it would to just do the damn work yourself. But as soon as you start giving these things permissions to operate independently you are setting up a time bomb and putting duct tape over the timer. You will get fucked eventually.
rafoix@lemmy.zip · 22 pts · 203d
When the bosses say “good” they don’t mean that it is better in any way. What they mean is that it is “good” enough to replace a human worker.
ozymandias@sh.itjust.works · 27 pts · 203d
it turns out that people who can’t code make terrible judges of how good ai is at coding
rafoix@lemmy.zip · 27 pts · 203d
The entire AI boom is management cumming all over their own faces at the thought of firing every human worker.
mi@fedia.io · 12 pts · 203d
Not any different than offshoring devs. Saves money short-term, cost savings look great, managers get promotions, and they move on from that garbage code base that was created
ozymandias@sh.itjust.works · 9 pts · 203d
don’t need to kink shame but yeah, pretty much… that and rich idiots who listen to excited grifters talking about how it’s the future… so fomo.
now in the future “ai free” is going to be a huge feature
resipsaloquitur@lemmy.world · 17 pts · 203d
10x, bro, trust me.
Tar_alcaran@sh.itjust.works · 3 pts · 202d
And now that you trust me, bonus me!
diz@awful.systems · 3 pts · 197d
It makes every bad programmer into a 10x bad programmer (equivalent to 10 bad programmers).
mi@fedia.io · 13 pts · 203d
We cant estimate how much effort it will take to fix or maintain it. That's the problem
HaraldvonBlauzahn@feddit.org · 6 pts · 202d
That's the expected result of selling stuff that doesn't exist or does not really work.
zqwzzle@lemmy.ca · 5 pts · 203d
What you’re saying is there will be lucrative billable hours to fix it when this all shakes out? I guess short term pain…
dgerard@awful.systems · 7 pts · 202d
In a few years. From the companies that haven't died. During Great Depression 2.
peoplebeproblems@midwest.social · 5 pts · 203d
Your not wrong, but I don't like that much uncertainty in my life.
BigMuffN69@awful.systems · 7 pts · 202d
In b4 METR drops the next shoddy study and the promptfondlers go wild
dgerard@awful.systems · 5 pts · 202d
the most robust study in AI coding! cos they built it from toothpicks instead of toilet paper
o7___o7@awful.systems · 1 pts · 202d