If you feel uncomfortable getting into a lift with anyone for any reason, don't get into the lift. If you are already in the lift and it stops to let someone on, feel free to get off and wait for the next one to continue your ride. Don't worry about being rude or polite. Your own comfort level should come first.