Like all politicians, Enoch was a bit of a time-nd-motion fan, so rather than fall out with black people individually, he made his 'rivers of blood' speech, and fell out with all of them simultaniously!
No, I seem to remember hearing or reading that Enoch Powell had a 'personal' altercation with a black man and I can't for the life of me remember how it went which is why I am hoping someone here can remember the anecdote.