I've always thought that Charles was jealous of Andrew and I wasn't surprised when he told him he had to move to Frogmore Cottage, yet the good brother Edward was allowed to carry on living at his massive pile at Bagshot Park.
Ok, I know Edward hasn't been accused of anything like Andrew was, but I still think jealousy was involved.
I think Andrew has now been punished enough and should be left to get on with his life and to be honest, I'm sure Charles could find something for Andrew to do to help out with running The Firm.