There is no overall or best steps guide. It depends on the application requirements what you need to do.
Does this Upgrade Guide - JBoss 4 to 5 helps?
If you have an application conform to the EE specification you might only have issues with the jboss specific descriptor or the server configuration.
If you have questions here you might ask the special questions here in the forum.