If it's the kind of player which just plugs into a USB port and appears on your 'puter as an additional drive, you can select the file in the normal way and delete it.
If you have to use manufacturer supplied software to put files onto the player, use the same software to delet the file.
Also have a look at the manual for your MP3 player - some of them may allow you to delete the file directly from the player.