Swollen lymph node or fatty tissue ?

I was recently seen by a Head and Neck Specialist for a swollen lymph node on the left side of my neck above the collar bone. He said it wasn't my lymph node and that it was probably fatty tissue. He wants me to watch it for 2 months and if it gets worse will send me for a CT scan. After having him palpitate the area, my neck is so sore and swollen. If it's not a lymph node and is just fatty tissue, why does it hurt so much? Could it be pressing on a nerve? When it swells up, my neck hurts up through the side of my face and down through my shoulder. I'm nervous about letting it go for another 2 months. He mentioned that it could be a lipoma (he didn't think that) or Madelung's disease (he didn't really think it was that either).