It is normally because the amount of stimulation on your clitoris differs between intercourse and masturbation.
When you get that close, stick a finger down there and rub your clitoris, or change your position/action to provide more rubbing/grinding of your clitoris on him. This is not as unusual as you might think. Most women need this extra stimulation.
Take care