It's not a good idea, but probably an exaggeration to say it would destroy the wall in your life-time. It's not a good idea for several reasons.
The aerial roots of the climb stick themselves into the mortar between the bricks of the wall in their efforts to find moisture and support to the plant. Then they grow and expand, forcing gaps in nooks and crannies.
The very attachment of a large plant to the wall encourages dampness in the wall.
If the plant gets to the roof it will certainly force its way between tiles and dislodge them.