They were originally called The Silver Beetles after a type of insect, and someone (probably John Lennon) came up with the pun on the name, so it was changed and shortened. The rest, as they say .....
The group members were big fans of Buddy Holly and The Crickets and liked the insect name (crickets). They started off as The Silver Beetles and then the Beat bit came from the type of music they made.