To the OP

If the modestly dressed woman is stopping you she must have a point. Best not to insult locals by wearing such clothing. She who said something is minority only in that she will stand up to such rude dress. Most other locals agree with her but are not saying anything.

All should take notice of this lady's experience.