Very Low Sperm Count and motility !!

Sir,
Me and wife are trying for our first child.I am 36yrs old and wife is 28 yrs old.We have been trying for some time now..but to no success.So we went to a Gynaecologist and she did a examination of my wife and said all is fine.So she suggested me to go for a semen analysis.I did so and the results were disturbing.
Volume=3ml, pH=8.0, Rapid Motility(within 1 hour after ejaculation)= 5%,Slow progressive motility(after 1 hour)= 10 %, Non Progressive Motility=5 %, Immotility = 80% and Sperm Cocncentration= 16 million/ml,
Morphology- Normal= 88%
head defects= 5 %
Mid piece defects= 4 %
Tail defects= 3 %
Pus cells=2-3/hpf
And my condition is diagnosed as Oligoasthenozoospermia

About 1and half years back i had a semen analysis done at a lab and the results were much better compared to now.
After 30mins The count was 18million/ml and Active motile sperms=40%, sluggish motile=10% and non-motile=50%
After 2hours: Active motile=30%,sluggish motile=10% and non motile=60%
Normal forms=97% and pus cells=3-4/hpf


So i was told to see a Urologist who did a Doppler Scan and told me that i have Varicocele in my left testicles.After this i also noticed that my left testicle is slightly longer that the right one.But i dont have any pain or discomfort.The Urologist has suggested a surgery to correct this and he says that this should solve the problem with the low sperm count.But i wonder why there is so much Immotile SPerms(80%)after 1 hour ??
Also i have had Genital herpes infection for that last 7 years..but my wife has not got this till now...we have been trying for a child for some months now.My wife has some cysts in her left ovary which the doctor says are not a problem as they are not functional cysts and that they will disappear after a pregnancy.

I am worried about going for a Surgery.I need a second opinion...will surgery correct my low sperm count and the large percentage of immotile sperms??Could my herpes a cause for this??? Will the surgery affect my future life in any way as i work as a engineer on ships and am needed to do lots of physically demanding work?