Simply change the home page to what you want; this is in the tools menu (tools>internet options, then general tab and the home page section of that).
Quite simply that setting has been changed by the site you visited, and I would doubt that any other damage has been done.
As the others have said DO NOT click on any buttons or links that appear in the UGLY DUCK page.