follow that blog entry instructions http://in.relation.to/Bloggers/GettingStartedWithRichFaces40Push
It's for Jboss but basically you need to do the same for Glassfish and I saw the guy from community in IRC who followed that sample successfuly. That demo designed to be run in JEE servers.
Simple push demo in dev samples uses external hornetQ impl instead of using JMS which is bundled with JEE server because it targetted to be run on tomcat and jetty so need to be configured additionally to work properly.
Thanks for your reply.
I've tried the push demo with RF4.1 M1 on GlassFish V3.1, all works fine.