Have they only recently left or is it your last employer maybe?
The workplace should be able to give a bona fide reference from records eg the dates you worked there.
Do you have another employer who can give you more of a character reference? Preferably job related.
If it's explainable, employers should understand. Women take career breaks all the time to look after children so I'm guessing it might be a common scenario there.