Exhaust problem

When I start the car and at idle the engine does not vibrate, but when I accelerate highly and remove my foot from the peddle at once, the exhaust shoots as if it blew, but when I check the exhaust it does not blow. Please help me solve this problem.