That burning pain is more than likely, inflammation from nerve compression or a muscle spasm. You should probably have an MRI done to see if you have a buldging disc in your back.
How long has this been going on? What makes it worse? Sitting, walking, standing, bending? Do you have pain down your leg or into your feet?
Did you recently do alot of lifting?