Anxiety, he fears his primary doctor will take away benefit

Hello. My dad has a severe anxiety problem. His doctor is "slow" at responding to his needs, so we've explored other options, like the VA (Veterans Affair). The VA has given him a check-up, but now, he fears that his primary doctor will take away some of his benefits since he is with the VA now. He's extremely stressed about it, and it's the only thing on his mind. Is is possible that his primary doctor can do this? Or is it completely normal for people to explore other health cares without interfering with their primary one?