TTC w/Male factors - poor motility, low count and low T

I am 43, DH is 39. We have 3 children together. I have RPL and am takign letrozole to improve my progesterone in the LP and trigger with mature follicles. DH had a semen analysis done and his results were as follows:
Semen Analysis/Patient Values/Normal Lab values

Liquification TIme/20/30 min

Appearance/white/white - opalescent

Consistency/liquid/liquified

Volume/4-2/2-5

pH/8/7.2-8.0

Concentration/6.4x10^6/>20x10^6ml

Motility/66%/>50%

Motility Grading/1-2/50%>2 (0=immotile, 4=rapid)

Total Motile Sperm/4.2x10^6/>16x10^6

Normal Morphology/14%/>14%=N 5-14%=G <5%=P

Agglutination/1/Absent (1=<5%, 4=>50%)

Comments: Poor forward progression (motility), low count

due to these results and other factors we decided to look into the possibility of low testosterone as a causal factor so he went in for a complete physical with bloodwork including all hormone levels and all were well within normal range with the exception of his testosterone level which was 303 with the low number for this lab being 348. Doctor wants to prescribe Androgel. My concern is exposing me or our children to this as I knwo it can be dangerous especially to woman TTC. I have alwo head that the androgel can cause low sperm count. Since his count is already low is this the best option for treatment? Or are other treatments preferable?

WE suspect that the low T could be stress related as this is not the first analysis we have had done but it is the first one we have had come back with below average results.

Thank you in advance for any information