ummmm is quite right. If you email Amazon from your account, ask to cancel your Prime subscription.
When Prime first started I also accidentally ticked the dreaded free delivery box. I got a full refund and I'm now much more careful when using Amazon.
If you regularly order more than 30 items a year, Prime is a fairly good deal.