While both switches are in their unlocked positions, use a plastic opening tool or your fingers to lift out the battery at the indent between the switches.

The right hand switch regardless of initial position will stay or return to the unlock position when a battery is placed back in the slot. To avoid any mishaps, be sure to set the switch back into the lock position while any battery is plugged in.