but i do not understand what you problem is in that

first WHO asked you to be so nice and give your number to him....?
You could have finish the conversation without giving him your number i think