If I remember correctly, she said she would look after Marigold to give her a good start in life. No-one knows she is the mother except for Lord and Lady Grantham.
Why is the farmer's wife so obsessed with Marigold when she has children of her own? If she was childless I agree it would be distressing and cruel to remove her but she isn't!