Which version of JBoss do you use? And can you please post the JNDI tree output that shows the binding even after the bean is undeployed? And undeployment logs would also be helpful.
While posting logs or xml content or code, please remember to wrap it in a code block by using the Code button in the message editor window. Please use the Preview button to ensure that your post is correctly formatted.