Microphone not working perfectly when on Loudspeaker

Other party can hear me clearly when i am using ear speaker (not loudpseaker). Problem occurs only when i switch to loudspeaker/speaker. Other party starts to hear too low sound. When i switch to ear speaker, other party starts to hear perfectly.

Whats the problem and how to solve it?

Thanks