Carefully disconnect the UMD drive ribbon cable from the logic board. Use the PSP opening tools to push the black tabs on the connector horizantally to free the cable.

This connector cannot be removed vertically. Doing so will damage the connector and/or ribbon cable.

At this point it is useful to tape the loose metal parts with some masking tape so they don't fall out whilst you have the PSP the other way up.