Generally, it's not the done thing. My husband, a carefree sort, wears knee-length shorts to the mall. But my teenage son got accosted my a couple of non-Gulf Arabs when he wore shorts to the mall - so trousers for him.