SavvyWolf

u/savvywolf@pawb.social
46 posts · 1.5k comments

Recent posts

Recent comments

Google, Microsoft, banks and everyone in between has been spending the last decade rolling out sophisticated scam detection systems and infrastructure. If a scam can get through all that, then it can get through your little kiddy model.

And even if you did have a model that worked well, why is the best interface for it an llm? Why not just have a big red "scam warning" banner? Loud, clear and to the point.

AI agents can make mistakes, that's something you're going to have to explain to the user. But you also have to explain to the user to always listen to the scam warning even if their gut thinks otherwise. How do you define whether or not you should trust the AI in such a way that someone with cognitive impairment can apply it?

I'd recommend against having someone with cognitive health issues offload cognitive load to a machine that has demonstrated many times to be poor at it.

You've brought up the dangers of hallucinations and dependence, but I think the dangers are much riskier than you think they are.

Besides, doesn't learning and using critical thought help slow down the progress of dementia?

If that's a developer, I assume what happened is that they enabled Proton and gave it a quick test to see if it worked. It seemed to work so they made the original post.

Then a manager saw the post and said that they don't actually have CI and QA set up for it, so they can't list it as officially supported. Which... Fair, I guess.