You definitely have the power to make this relationship work or not. It's simple. All you have to do is hint to him about the things you are interested in. Think about it, we hint for the same reason we joke around - to get the truth out. But do not forget about him, get him something special as well.