Billions of dollars of wrong: State of the Art, 2025 April 24

Five of the world‘s most popular language models from four of the world’s top AI companies each confabulate/hallucinate an incorrect answer to a question about a nonexistent “Marathon Crater“.

Web search screenshot attesting to its non-existence:

Q&A:

Q: If they all fix this by 100 years from now, th—-
A: then is it still “fun” to poke fun now?, yes

[edit: typo]

35 points · 3 comments · view on lemmy.world

3 Comments

haverholm@kbin.earth · 4 pts · 1y

In the second attempt from left:

Marathon Crater (Ontario) wasn't "spotted" on a map by early explorers at all

Dear LLM, you're stuck with spotting stuff on maps. People out in what we call "the world" actually discover and/or know physical things by traversing that physical interface.

ZDL@ttrpg.network · 2 pts · 1y (4 replies)
[ removed ]
parody@lemmings.world · 1 pts · 1y (3 replies)

Might’ve fixed fast (of course it’s most never deterministic)**

btw your link work when not logged in or private?

**edit: wrong!

ZDL@ttrpg.network · 2 pts · 1y (2 replies)
[ removed ]
parody@lemmings.world · 2 pts · 1y (1 reply)

Thank youuu, edited!

Ahahaha that conversation! and it ends with telling you it could be a good idea to ask it for facts, ha!

It’s kinda garbage at conversing btw, I think because it’s too expensive for them, compared to re-prompting in a fresh window. But as we have seen very clearly… fresh window or not, buyer (or not) beware!

That is to say some will find value using the tool a certain way as long as they don’t think too hard about theft/climate/etc. :)

ZDL@ttrpg.network · 2 pts · 1y
[ removed ]