I think the problem (if there is one) is that it is only possible to make pertinent (or indeed impertinent) remarks about people and involve them in this sort of chattering thread if you know something about them.
The 'usual suspects' are people who have opened up about themselves on AB/CB and so we know a bit about their likes/dislikes/hobbies/foibles whatever.
I recognise many other people by name and avatar, but wouldn't necessarily know where to start in bantering with them, because they (perfectly correctly) have kept their cards quite close to their chest in terms of who/where/what they are.
If you want to 'play' then you have to give a bit first. If you don't want to reveal a bit about yourself then that is fine, but then making comments about being excluded seems to want it both ways.