As long as we all remember it's a drama not a documentary, then it's definitely binge-worthy viewing, imho. Not everything we see actually took place. Certain scenarios have been 'invented' in order to get a certain point across without dragging it on and on. I have read comments by Penny Junior and Jenny Bond, over the last couple of days, but not even they know what was, or wasn't, said at the meetings between HM and her Prime Ministers.
I believe the main thing The Crown has shown throughout the 4 seasons to date, is the unwavering way in which HM puts country before anything else. Including her own family.