Ofcourse disagree, the reason why he/she willnot come back is that you didnot him/her about your feeling.