Exactly.
A bit off topic, but I think the issue with the machines is they don’t bear any consequences. And even if they did one day, there’s nothing you can really do to condition them as in punishing them for any wrongdoings, because a punishment implies a loss of something that is essentially irrecoverable (such as lifetime or the life itself). Unlike with humans, the life of a machine will always be easy to replicate or extend and they will “know” it (besides the fact that unless we program them into “thinking” otherwise, the survival instinct does not even apply to them).
So, ultimately, the question that arises is who pays the price. Who pays the price if a Tesla figures something wrong (because reasons) and plows into a crowd? And no, it’s not the same thing as a mechanical failure. My guess governments are going to provide a full immunity to the manufacturers for there’ll always be an insurance policy for the unfortunate ones.
But still it’s not the same. If a person is guilty of a traffic accident they will bear the sense of guilt for the rest of their life regardless of the insurance. And the sense of guilt will impact their future decisions. If an AI kills people by accident, no one will care. The passengers in the vehicle won’t be or feel guilty because they had no control over the course of events. The manufacturer will not even know of it except in the form of stats. The insurers will write it off from their reserves (again subject to statistics).
Hallucinations or not, it won’t be a nice place to live in if no one is going to bear any personal consequences.
