Yes, but robots only need to kill one to be demonised. I think this is because the human theoretically can regret it and be punished, whereas there can never be a feeling of justice with the robot. The manufacturers take on a lot of liability (GOOGLE'S CHILD-KILLING DEATH MACHINES!)
Another thing is that any accident that an autonomously driven car gets into will be blamed on the car automatically, before any information is available.
In other words, it probably only takes an accident, not even culpability, to get demonized.
I think that autonomously driven cars will have a lot of cameras and a black box like airplanes do, so that all the data before the accident will be available and if somebody else is guilty of accident - videos will be published by car manufacturer.
The videos are hopefully going to carry some weight, but I find your consolation in the available data somewhat optimistic; at best, I think they'll just cushion the backlash.
And yet individual regret / manslaughter charges don't seem to actually change road death statistics. I'd so love for this to happen; I kinda also doubt it will though anytime soon.