Please don't fret yourself. Accents,I find, are intriguing and I always try to guess the origin.What pees me off are English/British people who adopt a phoney accent and various idioms from the country they have adopted.
My late sister emigrated and worked as a High School teacher in Canada in the 60's.She was a real English Rose and soon picked up the drawl of the Americas.It sounded phoney and crass.
Strange really because the Canadians,according to her,despised the water grabbing yanks but were happy to follow their diet,choice of cars and sayings.???
Please be happy and proud of your roots and don't let it worry you in this country.xx