They're not German, but could you be thinking about Barclay James Harvest. They played more on the continent than in Britain, gave a free concert on the steps of the Reichstag in 1980, which is reported to have been listened to by around half a million people on both sides of the wall. And one of their biggest songs was Berlin.