U weight lift? Let me guess, you benchpress alot right? If u working out, doing anything that works out ur pecs i.E. Bench, chest press, bicep curls, etc. Make sure u use free weights, not machines and not barbells, only single handed dumbells... Because one side of ur body is clearly doing much more work and it is becoming unbalanced... So use individual wieghts as opposed to machine and 2 handed barred weights i.E. A benchpress bar

No , I do not weight lift. But I do push-ups, what care I should take?

It's sorta elementary, man...
You take some of the emphasis off one side (the smaller side) and favor the other side more. That'll keep the big side from getting any bigger than the smaller sie and give the smaller side beter opportunity to grow.
I'm not saying don't work out the bigger side. Just not as hard as the smaller side.