How can I replace the little magnet on the flip housing

I realized that my phone has not been able to respond when I close it - the front screen no longer changes to clock screen. I figured out that this is due to the magnet in the phone being unresponsive. But the thing is so tight that I can't budge it off the housing. Is there a workaround?