1) not all the components migrated for now even in latest milestone. List of available components could be checked in readme-ui.txt or just in rich and a4j taglib.xml files.
2) to get already configured app you could use our archetype or just explore richfaces-showcase from distribution.
I've just realised I've too many components not yet in RF4 for me to be able to test yet - I'll monitor the releases and upgrade as soon as I can. I'm not using Maven.
In the meantime, I'm getting pressure to release the app on glassfish. I posted here about a 3.3.3.Final build which I'm desperate to get in - if you get a sec to have a look I'll be forever in your debt.