I have upgraded my ios4 to ios5 without any issue. Please try switching off the Notifications and location services and observe . Also noticed that some games with notification drains the battery very fast . Delete them f you can.

Regards.
Anil