i dont think its a impolite way if you dont want to move while he blinks you go much faster than him he will never hit you( if you are brave) if not move and let him go. he might needs some whr urgently. :) and he may have money for paying radar tickets as well

you can use middle or last track where no one will blinks light on you if someone does no need to move unless some police or ambulance..