Pal, this person worked hard and searched to find you an appartment and the 500 Qr was like a gurantee, so if you wanna change your mind and not take that appartment, it would sound to him as if you are playin some games and he is not able to bare your mood or personal circumstances...i think you cant get it back !
Anyways Gd luck !