Hi,
to clear up the dryness use a fragrance-free, low chemical moisturizer that won't leave you greasy. I use a lotion made by a company called sensitan Sensitan.Com which offers a fragrance-free, 96% natural re-hydration spray which comes out like a fine mist and wont leave you greasy. Good luck!

Benzyl peroxide is really hard on your skin. You should try to use products w/o it. If you are oily it may mean you aren't using enough moisturizer.