I went thru what your going thru now...and I was told by someone who also went thru it. This woman was 45, who had her first child, and two others shortly afterward. She told me what someone else told her. Here it is:
"If having a baby is something that is important to you, do not let the voice of others destroy your dreams. Follow your heart."
And that is what some of my friends, and I have been doing. We all are in our 40's.
Good Luck to you!! I do hope you go through it with sucess!