bebem,
Yes, Chlamydia can lie dormant for many years. Also, some patients do not show overt symptoms of the infection, and may be infected without knowing it.
It could potentially flare up to cause a symptomatic infection, especially if there is an alteration in the persons immune system, such as a severe cold/flu, or some other severe illness.
So, yes, it is possible that one could be infected four years ago, but just now know that they have the infection.