I guess you could.
This desire to place music in 'boxes' is something peculiarly British - otrher cultures simply don't do this. When i was growing up (when dinosaurs roamed ...) if you liked 'progressive', you wouldn't like 'soul' and if you were a Mod, you couldn't like rock and roll because it was 'rocker' music.
Thankfully, most of these tribal trends have gone now, at least as far as adopting one genre preventing you from enjoying another! the media though still loves to stock bands in 'catagories' - even when they defy such narrow labelling.
For this reason, John Peel is sadly known as the champion of 'indie', which is nonsense. his ground-breaking attitude saw the first radio plays for bands as diverse as Tyranosaurus Rex, Pink Floyd, Tangerine Dream, plus his perenial and oft-played loves - Thin Lizzy and The Faces. That doesn't scratch the surface of the grime, punk, Mali, Brazlillian, Dutch etc. bands he championed, and not forgetting the ever-faithful Fall. I interviewed peel once, and i remember him saying that he simply cannot understand why not everyone adores The Fall as much as he does.
So - enjoy what you enjoy, ignore the labels!