There is water on mountains - in small streams and smaller lakes. The same sheep are kept on the same bit of mountainside every year - this is known as hefting - and the sheep know where to find water on the hills. This information is passed from mother to lamb every year.
This is one of the reasons why the foot and mouth outbreak was so bad - all the sheep were culled and the knowledge of where to find shelter/water etc was lost.