yes, you need to fill out the visa extension form, get air ticket (i usually take dummy ticket), take it to immigration along with the passport. It depends on your luck whether the captain will approve for 1 month or two weeks extension.
Good Luck