c/fuck_ai · by VerbFlow@lemmy.world · 2y

ChatGPT Answers Programming Questions Incorrectly 52% of the Time: Study

https://gizmodo.com/chatgpt-answers-wrong-programming-openai-52-study-1851499417

42 points · 5 comments · view on lemmy.world

5 Comments

IntentionallyAnon@lemm.ee · 8 pts · 2y (2 replies)

If you ask it how to say hello world or do a specific action (open a web browser to YouTube.com) It’ll get it right most of the time. If you ask it anything more complex it’ll fail

SpaceNoodle@lemmy.world · 2 pts · 2y

Yeah, it can absolutely regurgitate something that it's already ingested.

JeeBaiChow@lemmy.world · 1 pts · 2y

Yeah. Pretty much the same as simply searching for code snippets.

HawlSera@lemm.ee · 3 pts · 2y

I'm actually amazed it got them right 48% of hte time

SpaceNoodle@lemmy.world · 2 pts · 2y

I'm surprised it's that low.