How to replace a rear carrier (differential)

I have got a whining noise on the road, not associated with engine or tires. Tire shop says it is the differential. I am considering replacing the differential with a used one, to get another year or two out of it.
Q) Do I need to remove the wheels? Or will the differential just drop out after I remove bolts to axles, drive shaft, and frame?

Thanks for your help!