You will have to tap with a mallet on the opposite side of the frame and check frequently to reseat that pivot pin. Another way to move the pin back into the mainspring housing is to use the pistol like a mallet and strike it sideways lightly on a block of wood. Of course, you want to strike the side of the frame opposite of the pin protrusion to reseat the pin. The process works a lot like one of those kinetic bullet pullers. Also you must check frequently to ensure that the pin has not ventured too far and is sticking out of the other side of the housing.

Once removed you may need to restake that pivot pin to prevent this from happening again. You'll need a pointed punch and stake a heavy dimple into both ends of the pin.

R,
Bullseye