To make sense of a description, the other person has to have experience of what you are using to describe it. So in that case you'd need to be more imaginative, eg describing in terms of the emotional effect of looking at the colour, or possibly in terms of sounds or oter sensations. Or you could go completely the other way, and rather than describe the colour itself, think about what other attributes the object has eg smell, texture, temperature etc.
I guess that is true in some respects, but think about how prevalent color is in our lives. It is the blue shirt, the green grass, and the white clouds. How do you describe a sunset without any mention of color?
Red is hot. Blue is ice. Pink is passion / love. Purple is rich and velvety. Green is the color of life. Use terms they understand. Once you get going it wont be hard to define colors yourself.