No that is not true. Yet another urban myth.
However if you give up work during a tax year, you will be entitled to a small rebate because the PAYE tax system deducts tax weekly (or monthly, depending on how frequently you are paid) based on an assumption you get an equal proportion of your personal tax allowance per week (or month), then pay tax on the balance of your income.
If you then give up before the end of the tax year the calculation is not correct and the tax office will rebate you a proportion.