Your doctor think you ovulated and conceived around Jan 23. So sex from around Jan 18 until Jan 24 could have gotten you pregnant. Even the most accurate estimation can be off by plus or minus 2 or 3 days so it is quite possible that sex with Mr Jan25 (B) got you pregnant.
You will have to have a paternity test done if you really want to know who your baby's father is.