AS5 keeps a lot more metadata for the deployed objects, plus it mediates access to the filesystem through an extra layer (VFS), so that increases the memory requirements.
Is it possible to attach a profiler (e.g. JBoss Profiler) and post your findings? i.e. where most of the time is spent plus the classes with the most objects, etc.