You pay that penalty already moving onto the car seat, which is already twice as slow as normal.
It currently takes 36 seconds (6 turns) to climb from the pavement into your car seat - not counting the time it takes to open the door, which would bring it to 42 seconds. 24 of that is moving from seat to door, because you’re paying the penalty for both actions, the other 12 is for door to street.
Besides, I’ve seen the Dukes of Hazard - boarding a vehicle through the open window of a closed door only takes, like, 2 seconds tops. 