No, not likely. Depression can do a lot of things, but not cause bulging disks in your spine. Also, your other symptoms sound too serious to just dismiss as depression. That doesn't make any sense to me. Don't let your doctor dismiss you, either. You need tests done.
Go to another General Practitioner and tell him or her that you are worried it is something else and that you want tests done. Have you been to an orthopedic surgeon about your disks? Perhaps at least some of your symptoms are connected to that issue.
Are you still feeling depressed, regardless of what your psychiatrist said? If so, then your doctor is right that it needs treatment. But that does not mean that every symptom you have is related to that. It is possible for you to have depression and a medical condition. Tell your doctor that and don't let them dismiss your symptoms.