I don't think you're wrong, but I predict that this will be a complete non-problem: by the time people's skills have atrophied significantly, self-driving car technology will have improved to the point where it won't matter anymore.