I think exfoliation will help a little but it will not stop the acne and may irritate broken skin so don't do it too much. I have only recently developed acne on my lower buttocks, upper thighs and am trying everything. Clearasil didn't work but its worth a try, I wouldn't worry that its targeted for facial acne, its not that strong. I've just started using a low dose antibiotic cream recommended by pharmacist for all types of acne.
I suspect that in both our cases the acne is aggravated by the body being heated (during exercise) getting sweaty and then drying out a little before a shower. NB some soaps aggrevate acne so use a PH neutral soap when you shower.