For the price of a compression joint, I would replace....leaks when everything is back together AND it comes through the ceiling AND you need to redo all the work AND it always happens on a Sunday night...Do I need to go on?
Kenny, with compression joints, the olive is often squeezed into the pipe to such an extent that it won't come off without cutting the pipework.
If so, then, as Ratman has said, wind a few turns of PTFE tape around the olive first.