I don't think resetting the router would help a lot.
A big contributor to slow internet is spyware. Which can accumulate surprisingly in a short amount of time, if you've never checked you may be shocked to find you have a lot of unwanted files, most are harmless, the main downside being the decrease in speed.
Microsoft offers Windows Defender, a free scanning and removal tool, on the Microsoft website.
There's also AVG Anti-Spyware Free, which is a free (but still effective) program.
http://free.grisoft.com/doc/20/lng/us/tpl/v5
If spyware isn't the problem, remember that your internet speed can vary depending on the time of day, as many other people are also online. You may find the internet slows down at peak times such as the evening.
Hope this helps.