coolant leak from exhaust line where seems are

Have an 89 Ford Probe that over heated due to a leak in radiator. Changed radiator and thermostat. When coolant was added to new radiator after I connected everything its leaking out of the exhaust pipe at the seams of it and out the tail pipe. I have not started the car as of yet, not sure if its a pressure problem or it its the head or head gasket. What can I do to rule things out and find the problem.
Thank you