1995 Buick Roadmaster Replacing brake light switch

I removed the knee bolster and metal plates under the steering column on 1995 Buick Roadmaster to replace the brake light switch. I think I located it correctly at the end of brake pedal but I cannot get it to come out. Do you just pull straight backwards?? Looks like it will break if I do. It also have 2 electrical connections on the end. Thanks for your time, KG