Your symptoms of stiff, painful neck, shoulder and arm pain, tingling sensations in the arms, hands, numbness and weakness in the arms, hands, are suggestive for cervical spondylosis or osteoarthritis (age-related wear and tear process affecting the joints, discs and neck bones in your neck).
Numbness in arms is a sign that certain nerve is compressed and this should be evaluated by your physician.
Nerve that is under pressure is known as pinched nerve.
A pinched nerve at C7 will cause pain or numbness that travels down the arm to the middle finger and a pinched nerve at C6 will cause pain in your arm that runs down into your thumb.
Actually, numbness in arms along with worsening neck pain and pain that can't be eased by taking regular pain killers, are signs that the condition is getting worse and that you must seek a medical help to avoid further complications.
Best wishes!
Marija