this should work:
cacheManager.define(cacheName, new Configuration);
cache = cacheManager.get(cacheName); //starts the new cache as well
Won't work for the default cacha though.
Michal/Mircea, I've just finished implementing removal of a cache (as opposed to stopping it - https://issues.jboss.org/browse/ISPN-905), clone Infinispan Git and see the new API added in the master branch: