FWIW, that is not exactly true (in the US). Driving is not an explicitly enumerated right, but it cannot be taken away without due process, so it's more than a privilege.