It would never even occur to me to removed my name and address from envelopes.
As Eddie says, the information is in the public domain anyway through simply visiting local council offices and asking to see the electoral roll. (They MUST provide it by law). If you've not marked the box on the electoral registration form requiring that your details be withheld from the 'edited' roll, they're also available to individuals who subscribe to 192.com or to any commercial organisation that buys a copy of the edited roll from your council.