Most rechargeable batteries supply 1.2V, rather than 1.5V, so not all devices will work with them - but I'd expect that your TV remote control would do so.
Most remote controls seem to use either 2 x AA batteries or 2 x AAA batteries. Given that you can buy a pack of 4 alkaline batteries (of either size) for a quid from Poundland (or similar), which will probably keep your remote control going until the end of the decade, it seems rather silly to use expensive rechargeable batteries in their place.
Chris