You should probably use more recent Infinispan vesion, such as 6.0 or 7.0.Beta. It seems you're using <= 5.2
Exception thrown by cache store should be really propagated to user - could you share your version and configuration? (But preferably really try on 6.0 or newer).
Thanks. I'll give Infinispan 6.0 a try.