I'm updating my own posting just in case some else has a similar issue.
First off, I have a mistake in my initial posting. I stated the client code is able to call getInitialContext(). My point was that when it calls Context.lookup() it fails due to the RMI issue.
What I've found it by starting JBoss JVM with
-Djava.rmi.server.hostname=mymachine.mydomain.com which fixes some of my problems. I still need a solution for multiple interfaces. So if anyone has any ideas please share them. I'm looking at hacking jnp in the mean time.