Thought so ymb -- to be fair, Osborne (remember him?) the Remainer once gave an interview in which he explained how hard he had fought in favour of "leaving the EU -- sorry, of remaining in the EU", so it's an easy slip to make!
I don't think IDS is right. Obviously. But having said that, I'm not sure how Hammond is still in his job. At the level of Cabinet, at least, I wouldn't think it unreasonable to appoint ministers who agree with the PM's agenda, rather than openly disagree all the time. I'm not saying he should go, but I am saying that I'm surprised to see him stay.
Envoys are maybe closer to cabinet level than I give them credit for, so perhaps the argument is the same after all.