it’s rude, socially, to reject someone's invitation…..
but, well that’s my personal point of view :)