Sometimes the brake pedal goes half way down.

Hello, I have a 1991 toyota camry and sometimes the brake pedal will go down about halfway.I let up the pedal and press it back down and it is back to normal. I have checked and adjusted the rear brakes and replaced the front pads. It does not do it all the time. I was wondering if the brake booster is starting to go bad.