Soya

Hi ladies, well I read last week that we should avoid soya products if trying to get pregnant. It was the first time I had heard about it. Does this include your partners aswell?
My husband is lactose intolerant and has soya milk every day.
The only soya products I have is margarine on my bread and toast.
Does anyone else know about this or has heard about this before??