Once you've removed all the old adhesive, apply a few drops of highly-concentrated (greater than 90%) isopropyl alcohol to any residue left on the frame and wipe it away with a microfiber or lint-free cloth.

If you're having trouble, wrap the microfiber cloth around a spudger and use it to scrape the frame.