Your contract or company policy has to state for how long the allowance is provided. If it's 4 years and they've already paid it to you, you will have to return 3/4 of it after year 1, 2/2 after year 2 etc. If it was a single allowance (again, check your company's policy or your contract), you might not have to return anything.