If that would cause damage every car on the planet would have that damage. Engineers take those things into account when they design the car. Any damage would be caused by driving like that far and long enough for the brakes to overheat.

If you have drum brakes in the rear they are relatively ineffective when going backward. That's why you'll often find cars will go backward easily with the parking brake on but won't go forward.