It doesn't sound safe, but check with your doctor.

This kind of thing is usually a matter of weighing the risks and benefits.

Is the danger to the baby from taking prozac because of the chemicals more or the less than the danger of not taking prozac because of the mental effects (if you stopped taking it, is it possible that you would do something to hurt yourself or your baby?)

Although prozac appears to be safe during pregnancy, there is no guarantee. If you're on prozac for mild purposes and think you can come off it during the pregnancy without adverse effects for you, then it's probably best to do that. Whether you decide to stay on it or go off of it, talk to your doctor. You'll need to be weaned off the drug.