Hi I have been a vet nurse for 5 years and I firstly I have to say that you should wait until your pups are at least 5 weeks old to start weaning them. Please don't take them away from their mother full time until they are 7 or 8 weeks old.
Goats milk and ready brek!!! The best thing to use would be a puppy food specifically made for puppies, either tinned or dry although if you are using dry use warm water to mush it up at first. Don't think that it is expensive, not all of them are! Also they really aren't going to be eating much of it!!
Any kind of milk other than their mothers at this age isn't ideal for them, cows milk can make them put on too much weight. So use a puppy food and warm water.