I think you may have taken them out a bit early. Generally, I think you have to wait 6-8 weeks to be on the safe side.
Certain products you use can also irritate a newer piercing.
If they were done with a gun, the likelihood of it becoming infected is higher because guns cannot be cleaned properly. They should only be done with needles.
If the jewlery is nickel-based, it is possible you could have an allergy. Surgical steel and backings are usually the way to go.
Although it it recommended to "spin" the jewelry, this can also cause irritation. What I did with mine (a professional peircer from the best place in town told me to) use sea salt and not spin the piercing. Use a cotton swab and dip it in a luke-warm water with the salt in it and dab a few minutes per ear. See if that helps. It will kill off bacteria.
If you are still having troubles, go back to the piercer or see someone in a shop that has had a very good reputation and safety inspection.
If it gets worse, see the doctor about it.
When I got my nose pierced, it bled off and on for a good month or more. I thought it was an infection, but the piercing place recommended an ointment called "Cortate." This eased my bleeding and bumps from the piercing.
Hope this helps!!