What causes the starter to continue to run?

I started the engine and the starter motor continued to run, I had to disconnect the battery.
I replaced the starter, checked the fuses and relays, when I tried tio connect the battery the starter began to run even with out the key in.
The engine will not start unless the key is on then it will, but the starter contin=ues to run all the time.