Depends on the place where you live and work. My wife wears skirts and she can carry the dress well and can handle the stares as well. Don’t be conscious of stares..Just get going. That stares are not meant for violating any local customs, but out of general male instinct.( Even when I go out with my wife, I can't escape from some head turners ;-)