How do i tell if the water pump is locked up or if it is the water pump pulley?

The pulley doesn't turn but i know the timing chain is fine because the car runs. I tried to replace the belt and idler pulley before i realized the water pump pulley is not turning and that is the cause of my belt burning up.