Here's the real answer, which you can test out with what your council says.
There are various exemption classes which you can see here.
http://www.westminster.gov.uk/councilgovernmen tanddemocracy/councils/counciltaxandfinance/no tes.cfm
I know this is Westminster council but it's the same across all England & Wales and Westminster are particularly helpful in explaining it on their website (scroll down the page a bit).
You will see that either Class F can be applied or Class C. They both give you total exemption for up to 6 months, but you'd be better making sure Class F applies because you get more exemption after the initial 6 months for ANOTHER 6 months after probate has been granted. Class C will cost you 90% of the assessed amount after the 6 months.
Some of the above statements are just plain wrong.
The comment that one can't be charged because the bill goes to the deceased owner for example. The bill would go against the estate of the deceased person if that were true (which it is not).