Question Author
Thank you for all your responses, although some really were rather unfriendly and unhelpful, I was not looking for the anti-dog brigade. (incidentally, i meant HE is not viscous, I have three children with whom he is wonderful and also a cat. I was not commenting on all border collies, my eldest was bitten by one years ago). Our own councils states that you are to contact the owners BEFORE the dog warden. Sorry for seeming defensive, but people can get really quite unpleasant when it comes to dogs if they don't like them.
A fence of any sort does not really work as he 'scales' the fence and hedge to escape and it tops 6 foot now. Also, our hedge is also the hedge of two other peoples gardens, so if we take it down, we are directly affecting them also.
I have tried tying him, but it is not a massive garden and to give him enough length meant that he got through that hedge and thus stuck next door. He has already been 'done'. *sigh*.
Thank you for the helpful replies, I shall look at moving where he can be tied to and also into building some kind of kennel thing. For the moment, we have put a strong metal mesh over the corner he gets out (like a roof) and so far he has not escaped. Not even on bin night! So we shall see how that goes too.
And to the haters, sometimes, when someone is anxious about something and asking for help, maybe it is not best to tear them down some more. Just don't respond, it is not helpful. I am an empathetic enough person to imagine how this must feel for the people he is 'visiting'. I came here for help, not to be judged.