Goldfinches do have red faces but they have (funnily enough) very bright yellow on their wings, buff breasts and some black and white flashing on wing tips - that doesn't sound at all like your description.
What size was it? If really blue/black all over except for a red face it doesn't sound like any native wild bird I know.