Yes, the man's age does matter, and it's a complete and total myth that men remain fertile until they die. Fact is, men are most fertile from ages 15-25 -- same as women. Men's fertility starts to decline around age 30 -- same as women. Female fertility takes a sharp decline around age 35, men's fertility around age 39. Fathers older than 40 take longer to conceive on average and are more likely to father children with chromosomal abnormalities. This can be mitigated some if they have a younger partner, but not entirely. With your husband being as old as he is, his sperm count and quality is not going to be even remotely as good as that of a man closer to your own age. You may have difficulties in conceiving naturally, if you're able to conceive with him at all.