Please tell him that with most forms of HPV, he CANNOT be effected by HPV. Men are simply carriers; literally, there are no signs for a male to indicate he has it.
He can get genital warts depending on the type of HPV. But, he shouldn't be making you feel bad. I would force him to get a test at the local free clinic or Planned Parenthood if he's going to be such a dick about it.
I have no patience for stuff like that. He shouldn't be constantly blaming you. He can take care of himself...he's a big boy!