Use the pointed tip of a spudger to carefully push on each side of the speaker connector to release it. Alternating from one side to the other, gently “walk” the connector out of its socket.

Always pull cables by their connectors and not the wires themselves.