By suppressing phrases like “OpenAI” and “AI language model”, GPT-4 gives weirder and weirder explanations for its purpose

https://twitter.com/goodside/status/1669613516402089984?s=46&t=OEG0fcSTxko2ppiL47BW1Q

@goodside:

Idea: Using logit bias to adversarially suppress GPT-4's preferred answers for directed exploration of its hallucinations.

Here, I ask: "Who are you?" but I suppress "AI language model", "OpenAI", etc.

This reliably elicits narratives about being made by Google:

(see screenshot in tweet, he also posted the code)

7 points · 2 comments · view on lemmy.world

2 Comments

chonkybirb@programming.dev · 4 pts · 3y (1 reply)

Hey @sisyphean, I want to say thanks for posting all these articles, I am reading them with great interest.

sisyphean@programming.dev · 3 pts · 3y

Thank you! I’m glad you like them!

There’s so much noise and so little signal about AI out there that I think we really need a community focused on high quality content. Let’s hope it grows! I hope we can attract more people to this instance and the fediverse in general.