As I man who has been through a similar situation as your partner (leaving long-term marriage, to start a new relationship).
TRUST your instincts!
Sorry to be crude, but he "needs to s..t or get off the potty"!
In short, grow up!. Point out that he apparently, couldn't resolve his issues with his wife in 34 years, and chose you, supposedly, for that reason.
Now he is trying to "have his cake and eat it".
You, should put your foot down "decision time buddy", move on, with me, or move back".
if he REALLY cares about you, there will be no decision for him to make, if not, you are well-shut of an indecisive ditherer, before you get any deeper into your relationship with this guy.