Most fish lay eggs. Eggs (roe) develop inside the female, and when ripe they are laid. Sperm (milt) develops in the same way inside the male.
Most fish do not mate -- the eggs and milt are produced at the same time into the water, and the eggs are fertilised there.
Some fish do have internal mating, and in some of these the eggs hatch and develop inside the mother, being born as live little fish.
In sea-horses and some other pipefish, the eggs are laid into a pouch on the male's belly, who looks and behaves as if pregnant. They are eventually "born" as little fish.