http://jira.jboss.com/jira/browse/JBINSTALL-41
Let's discuss the creation of a profile testsuite. We have to have this to avoid mistakes in the installer releases due to too many manual steps.
The most basic testing is startup/shutdown of a profile with valdiation that all expected services reached their started state.
Should we nail this down by implementing http://jira.jboss.com/jira/browse/JBAS-3234? If AS test suite uses installer to create server configs, this would be the best way to test installer.