Pull him towards you ?
It'd be useful to know your age to know what's appropriate, but basically do more or less what he did. Show interest. But be sure you aren't going to do this and then change your mind an immediately push him away again if he responds.