Forget cats, they usually cause the problem in the first place. Forget the sonic mouse deterrents, they rarely work, and when they do it is for a very limited time.
If you are just seeing light evidence of mice, get some break back traps and bait them with peanut butter or nutella. If you are seeing signs of a heavy infestation either call in a pest control company, or buy specific mouse poison, not a general rodenticide. Mice can be very difficult to get rid of unless you make a very determined and planned effort.