I saw it while I was on holiday bagpuss and was lucky enough to see it in amongst a housing area where there were no crowds at all. But like you I wouldn't have bothered if it had meant jostling with others 10 people deep.
The torch bearer we saw made it quite a memorable occasion for us, but in general you could go a long way to see it and then you can blink and miss it.
Don't feel sad you missed it, instead follow it online and feel part of history that way.
http://www.london2012.com/torch-relay/