Sorry for the very very long awaited apply.
My opinion, if you are trying to switch to organic and natural foods for your newborn baby. No, don't switch completely to organic foods. Why? This is more of a personal theory then actual research, but I have some knowledge about the health and body. We don't grow up in a world where our food is pathogen free and completely healthy. I have a good feeling that a child whose body is accustomed to only natural organic foods will have a lot of issues when they grow older and eat something that isn't so pure, which is something they are going to deal with often once they become a teen.
If its for yourself, and you got the money, hey why not, as we grow older we should try to eat less processed foods. It depends on what though, some organic food tastes blah, some are tolerable. I imagine organic fruits and vegetables are fine.
If you ask me, milk only tastes good with the growth hormones and who knows what else they put in there. I don't like organic food in general though, it has a.... artificial taste to it ironically haha.