That mean you must start searching for new job! no problem if they cancel the old visa.if you dont find a new job quickly ,That mean yes you must go out from the country and come back after you find another job.
Good Luck