Generally, it's not the done thing. However my husband - a carefree sort - wears knee-length shorts to the mall. My teenage son got accosted in a mall when he wore shorts (not by a Gulf Arab, some other Arab national), so I insist he wears trousers now.