I think No need of Exit Permit for Babies. Please check with Immigration Dept. or with any Travel Agents.

May god make ease your Issues.