Gravatar can be quite long-winded, I notice when trying to upload a new photo there's a large (time) gap where nothing appears to be happening then all of a sudden it does.
This all stems from the fact that I have changed my e-mail address and although they are the same on gravatar and Ab my avatar will not download form my hard drive.
Unless you can see the 'blue box' you will not know if you are actually using the same E/mail address for both AB and Gravatar. Are you able to log into Gravatar? I can by just putting-in my password..no need for entering my e/mail address to log-in.
Although Gravatar has replied to your present E/mail address it doesn't follow that that is the one which is on Computer record against your Avatar.