A woman made her AI voice clone say “arse.” Then she got banned.

https://www.technologyreview.com/2025/02/14/1111900/ai-voice-clone-say-arse-then-banned/

cross-posted from: https://feddit.org/post/7978920

122 points · 8 comments · view on lemmy.world

8 Comments

phoenixz@lemmy.ca · 22 pts · 1y

Taking away someone's voice because they said naughty words

We truly do live in all black mirror episodes combined

thisbenzingring@lemmy.sdf.org · 13 pts · 1y

fucking hell, that is so bullshit

suck a dirty dick ElevenLabs

Contramuffin@lemmy.world · 6 pts · 1y

Genuine Black Mirror moment

dandelion@lemmy.blahaj.zone · 5 pts · 1y (1 reply)

arse

ogeist@lemmy.world · 4 pts · 1y

arse

AnUnusualRelic@lemmy.world · 4 pts · 1y

Noted. Don't rely on crazy and prudish US companies for anything vital. You never know what they'll be offended by next.

chiisana@lemmy.chiisana.net · 3 pts · 1y (1 reply)

There’s really compelling open source models like Zonos coming out; ElevenLabs will need to figure out how to thread the needle to keep everyone happy while other solutions eat into the pie.

Blass_Rose@pawb.social · 1 pts · 1y

Oh I'm glad this tech went somewhere useful! I remember reading the paper and toying with the models they released as a proof of concept like... 8 years ago? It was really powerful back then. The ability to do TTS of someone's voice given literally 3 seconds of training data?! (In fact I found that it worked best with short, nonsense audio clips than actually saying anything. Saying "test test test" worked way better than reading an actual sentence.) But now it looks like it can actually handle tone well. It's also probably way better now, and less... Asthmatic sounding.

tiramichu@lemm.ee · -1 pts · 1y
[ removed ]