Dutch lawyers increasingly have to convince clients that they can’t rely on AI-generated legal advice because chatbots are often inaccurate, the Financieele Dagblad (FD) found when speaking to several lawfirms. A recent survey by Deloitte showed that 60 percent of lawfirms see clients trying to perform simple legal tasks with AI tools, hoping to achieve a faster turnaround or lower fees.
Lawyers increasingly have to convince clients that AI chatbots give bad advice
https://nltimes.nl/2026/02/16/lawyers-increasingly-convince-clients-ai-chatbots-give-bad-advice
46 Comments
qwestjest78@lemmy.ca · 72 pts · 221d
I find it useless for even basic tasks. The fact that some people follow it blindly like a god is so concerning.
ageedizzle@piefed.ca · 21 pts · 221d
PrettyFlyForAFatGuy@feddit.uk · 6 pts · 220d
My partners midwife googled stuff in front of us and parroted the AI summary back to us when we asked if a specific drug was okay for pregnant people
qwestjest78@lemmy.ca · 2 pts · 219d
No I don't think I would be actually. People have turned to Google for health advice for a long time now. Ai is the next logical step for them.
village604@adultswim.fan · 14 pts · 221d
It's great when I need a one-off powershell command or something basic like that.
sp3ctr4l@lemmy.dbzer0.com · 10 pts · 221d
A lot of people are very stupid, and also very easily tricked/conned.
We are basically just finding all the people who pretty much already were NPCs, and now, well, they're formalizing that.
To those people, well, the LLM probably just actually generally is more intelligent / informed than them.
George Carlin:
Imagine how stupid the average person is.
Now, realize half of all people are more stupid than that.
a4ng3l@lemmy.world · 9 pts · 221d
It’s been doing wonders to help me improve materials I produce so that they fit better to some audiences. Also I can use those to spot missing points / inconsistencies against the ton of documents we have in my shop when writing something. It’s quite useful when using it as a sparing partner so far.
The_Almighty_Walrus@lemmy.world · 15 pts · 221d
It's great when you have basic critical thinking skills and can use it like a tool.
Unfortunately, many people don't have those and just use AI as a substitute for their own brain.
a4ng3l@lemmy.world · 2 pts · 221d
Yeah well same applies for a lot of tools.. I’m not certified for flying a plane and look at me not flying one either… but I’m not shitting on planes…
ToTheGraveMyLove@sh.itjust.works · 5 pts · 221d
But planes don't routinely spit out false information.
WeavingSpider@lemmy.world · 3 pts · 220d
I understand what you mean, but... looks at Birgenair 301 and Aeroperu 603 looks at Qantas 72 looks at the 737 Max 8 crashes Planes have spat out false data, and in of the 5 cases mentioned, only one avoided disaster.
It is down to the humans in the cockpits to filter through the data and know what can be trusted. Which could be similar to LLMs except cockpits have a two person team to catch errors and keep things safe.
ToTheGraveMyLove@sh.itjust.works · 4 pts · 220d
So you found five examples in the history of human aviation, how often do you think AI hallucinates information? Because I can guarantee you its a hell of a lot more frequently than that.
WeavingSpider@lemmy.world · 2 pts · 220d
You should check out Air Crash Investigation, amigo, all 26 seasons, you'd be surprised what humans in metal life support machines can cause when systems breakdown.
a4ng3l@lemmy.world · 2 pts · 221d
If you can’t fly a plane chances are you’ll crash it. If you can’t use llms chances are you’ll get shit out of it… outcome of using a tool is directly correlated to one’s ability?
Sound logical enough to me.
DrunkenPirate@feddit.org · 6 pts · 221d
Sure. However, the outcome of the tool LLM always looks very likely. And if you aren‘t a subject matter expert the likely expected result looks very right. That‘s the difference - hard to spot the wrong things (even for experts)
a4ng3l@lemmy.world · -3 pts · 221d
So is a speedometer and an altimeter until you reaaaaaaaaly need to understand them.
I mean it all boils down to proper tool with proper knowledge and ability. It’s slightly exacerbated by the apparent simplicity but if you look at it as a tool it’s no different.
ToTheGraveMyLove@sh.itjust.works · 4 pts · 221d
Except with a plane, if you know how to fly it you're far less likely to crash it. Even if you "can use LLMs" there's still a pretty strong chance you're going to get shit back due to its very nature. One the machine works with you, the other the machine is always working against you.
a4ng3l@lemmy.world · -1 pts · 221d
Nha that’s just plain wrong…also you can also fantastically screw flying a plane but so long you use LLMs safely you’re golden.
It also has no will on its own; it is not « working against you ». Don’t give those apps a semblance of intent.
mech@feddit.org · 6 pts · 221d
Rule of thumb is that AI can be useful if you use it for things you already know.
They can save time and if they produce shit, you'll notice.
Don't use them for things you know nothing about.
a4ng3l@lemmy.world · 6 pts · 221d
LLM’s specifically bc ai as a range of practices encompass a lot of things where the user can be slightly more dumb.
You’re spot on in my opinion.
ParlimentOfDoom@piefed.zip · 2 pts · 221d
Rearranging text is a vastly different use case than diagnosis and relevant information retrieval
CriticalMiss@lemmy.world · 1 pts · 221d
I only found one usecase where it shines and even then I had to verify the output twice to make sure it doesn’t fuck up before I push it into production. String manipulation is pretty good with it instead of having to write a bash one liner with a lot of sed and awk
r00ty@kbin.life · 27 pts · 221d
I think my least favourite thing about AI is when customers tell me something won't take as long as I say, if I use AI. Look, if AI can do it why do you need me?
The fact I'm not out of a job (yet) is because apparently AI cannot do everything I can. The very second it can I'll be long gone.
So I am on the side of the lawyers here. For the first and only time.
ZeDoTelhado@lemmy.world · 14 pts · 221d
Law in particular is such a gnarly subject that you really want to have someone who knows what they are saying about anything. And even then they can be wrong too
Telorand@reddthat.com · 6 pts · 221d
And at least they won't hallucinate past cases in front of a judge.
r00ty@kbin.life · 4 pts · 221d
And it would have gotten away with it, if it weren't for that darn pesky judge!
whotookkarl@lemmy.dbzer0.com · 18 pts · 221d
Everyone with domain specific knowledge*
Language models do not reason or weigh evidence or evaluate or weigh risks, they predict what words and phrases are most likely to come next. Reinforcement learning can train language models to make better predictions in specific circumstances, but it's not a substitute for conscious thought.
elvis_depresley@sh.itjust.works · 10 pts · 221d
If a chatbot gives you bad advice, it's your responsibility to. If a lawyer gives you bad advice, it's the lawyer's responsibility.
village604@adultswim.fan · 9 pts · 221d
I guess lawyers are feeling the pain that doctors experienced when WebMD became a thing.
pinball_wizard@lemmy.zip · 8 pts · 221d
Yes please. More folks need to all in on the idiocy of trusting an AI for legal advice. Let's get this public lesson over with.
This is one of the cases where they can simply be a hilarious example for the rest of us, rather than getting a bunch of the rest of us killed.
Eternal192@anarchist.nexus · 6 pts · 221d
Honestly if you are that dependent on A.I. now when it's still in a test phase then you are already lost, A.I. won't make us smarter if anything it has the opposite effect.
kescusay@lemmy.world · 11 pts · 221d
I'm watching that happen in my industry (software development). There's this massive pressure campaign by damn near everyone's employers in software dev to use LLM tools.
It's causing developers to churn out terrible, fragile, unmaintainable code at a breakneck pace, while they're actively forgetting how to code for themselves.
bluGill@fedia.io · 5 pts · 221d
I find ai can turn out code fast - but then I spend a week or more turning it into good code and so the time saved isn't near as much. I'd be embarressd to call it my own and as a professional can't allow garbage-
phoenixz@lemmy.ca · 6 pts · 221d
That's not a new thing, doctors had this for at least a decade with WebMD.
No, you don't have cancer
Pringles@sopuli.xyz · 5 pts · 220d
Meanwhile I strongly suspect our legal reviewer of using chatgpt to review contracts, because he sends some laughably stupid comments that look fully AI generated.
osanna@thebrainbin.org · 5 pts · 221d
I can't stand AI, but the few times I've used it, I've used it as a starting point. Once it gives me advice, I then go and confirm that with other sources. But I don't use AI much.
silverneedle@lemmy.ca · 4 pts · 221d
Let's consider what you are doing on a purely abstract level.
We could also do the following:
nulluser@lemmy.world · 8 pts · 221d
That's great when you do, and you usually do, but sometimes you don't.
Case in point; A while back I was creating a 3D model for my 3D printer. It had a part that was essentially identical to a particular unusual pipe fitting that I have seen and knew existed, but didn't know the name of (spoiler: I'm not a plumber), and I wanted to give the sketch in the modeling software a proper name for the thing.
Just trying keywords that sort of described it's shape in search engines was useless. Search engines would focus more on the "pipe fitting" part of the keywords and just return links to articles about plumbing. Then I asked an LLM, and it responded with, "That sounds like X." Then I checked that it wasn't just making it up by searching for "X" and found online stores selling the very thing I was trying to figure out the name of.
ageedizzle@piefed.ca · 2 pts · 221d
sqgl@sh.itjust.works · 4 pts · 221d
I had it cite a case which didn't exist. It was perfect for what I was fighting (it tends to figure out what you want to hear then makes up stuff to satisfy you).
When I tried to search for a phrase from the case (hoping it just gave the wrong citation) it said there was no such case with that phrase.
I asked why it said there was such a case earlier. It confessed that AI sometimes hallucinates and promised to try better in future.
RamRabbit@lemmy.world · 2 pts · 220d
This part in particular really pisses me off. It isn't learning, it isn't 'going to do better', it's just saying what it thinks you want to hear.
I fucking hate sycophants.
Archer@lemmy.world · 4 pts · 221d
Seems pretty simple to me, you pay lawyers so that you don’t have to pay even more by getting legally screwed over. Why try and cheap out on the insurance policy against bigger losses and risk it all collapsing?
sqgl@sh.itjust.works · 3 pts · 221d
[edit: sorry I ended up on a tangent]
Lawyers are no guarantee. They are sloppy because they have no skin in the game, and they usually get paid regardless (although some have "uplift" fees which reward them for winning).
It is like hiring builders for your renovation. You still have to keep an eye on them and even tell them how to do their job, which of course is always a tense situation. If you develop a good relationship you can work as a team (requires a lawyer who is not insecure).
Best avoid situations which need a lawyer. Do not litigate lightly. There is no such thing as a watertight case. If you get a corrupt judge they can outright lie, there is no point appealing, and you can be gagged from telling anyone (even your wife, let alone a politician or journalist).
melfie@lemy.lol · 4 pts · 221d
chunes@lemmy.world · 1 pts · 220d
DGen@piefed.zip · 1 pts · 221d
People do Not make a difference. You can use it for Help, guidance or whatever.
But never, especially with law, Trust it. Fact Check.
Well. But Look at this cat playing a trombone.
sirico@feddit.uk · 1 pts · 221d
let them find out