cold sores and genital herpes from same person?

I recently had unprotected sex and oral sex but with a partner that I had in the past. He only had one other partner who he married since being with me. He is now divorced. Shortly after having sex I got a few cold sores on my mouth. I have had cold sores my whole life. But now I noticed a small red sore, just one, on the inside of my labia. Is it possible that I got herpes and was infected both in the mouth and in the genitals? I have had small sores in the past from ingrown hairs, etc. that are very similar. But, I am wondering if this is just a coincidence or if it is the case that I got herpes. I am getting tested soon, but I am concerned about having sex in the future. I have a regular partner and we have an open relationship and I am afraid that if I test positive he will never sleep with me or want to be with me again. What if I get tested for herpes and it is positive, how will I know it is just from the cold sores that I have had my whole life or from oral sex? I will be devastated if my partner leaves me.