The Trolley Problem

Also, a question remains of whether the law should dictate the ethical standards that all autonomous vehicles must use, or whether individual autonomous car owners or drivers should determine their car's ethical values, such as favoring safety of the owner or the owner's family over the safety of others.[13] Although most people would not be willing to use an automated car that might sacrifice themselves in a life-or-death dilemma, some[who?] believe the somewhat counterintuitive claim that using mandatory ethics values would nevertheless be in their best interest. According to Gogoll and Müller, "the reason is, simply put, that [personalized ethics settings] would most likely result in a prisoner’s dilemma."[50]

Concerning the negative votes -

My intention was not to upvote or downvote such an AI system.
My point was to bring it here for discussion and to think about it, neutrally 😁

Radiolab did a great episode on this very topic.

It gets really interesting when you think about the clash of corporate greed in this area. It's not hard to imagine car companies selling you a premium option (or worse, subscriptions) where the car will make decisions prioritizing your life and safety over people outside, even if it's multiple people who would get maimed or killed to keep the driver safe.