I am one of those who benefit professionally from taking it, and lose socially from taking it. I lose an important part of me while on Adderall, so I stopped taking it after two years of daily.
I am in my fifties, diagnosed ADD at 49. Stopped the drugs when 51. I can tell you two things. First, I would be a better employee today if I was on: I would be less of a person as well. Second, the two years of dosage actually permitted me to change some patterns. the long-term effects of having the regimen permitted me to undo some very uncomplimentary daily practices and viewpoints that held me back. I kept my job after stopping and kept my new interest in life.
Point is, there comes a time when you set the synthetic goals aside and look for the human within you. Amphetemines are documented to deter and restict that process in lieu of more easily accomplished goals: immediate gratification vs. fundamentals and joy. Hitler is said to have lost himself there under this type of drug, and the list of wackos out there who bent themselves on speed is legion. I know many who have benefitted from Adderall (myself included), and I deeply wish it had been around when I was your age. I might have been President today.
So trade-off it is - you are correct, and I know I would have, in many ways, been right to stay on and was right in many others when I went off.