The word 'mouse' has long been applied to various technical things which resemble the creature in some way...eg the computer mouse has a squat body and a long 'tail'. As long ago as 1750, for example, it was used to mean a type of knot on a ship's rigging to prevent rope-slippage. Here's a quote from 1769...
"These mouses are particularly used on the stays of the lower mast."
(My underlining and it is unclear whether the 's' or 'z' pronunciation was used for the first 's'.)
So, in technical contexts, the 'es' plural form is relatively ancient. However, The Oxford English Dictionary has only one reference to the computer device in the plural and that is given as 'mice'.
Seems pretty clear that you can choose whichever form and pronunciation you prefer.