Yes, this is what it was desgined for.
Currently it lives under the "perf" directory, but we plan to give it its own project, since it does not contain anything Messaging-specific.
Here you can find instructions on how to use it: http://wiki.jboss.org/wiki/Wiki.jsp?page=JBossJMSNewPerformanceBenchmark
Can I run it only putting client runtime into somewhere? or I should write Executor code for other JMS?(ActiveMQ, WebSphereMQ, and etc..)
In principle, you shouldn't write code, as long as you don't want to try something that's not JMS-compliant. However, keep in mind that it was only tested with Messaging and JBossMQ, so it may need polishing.