0 Replies Latest reply on Mar 12, 2007 1:14 AM by Hari Sundharesan

    Problem using jboss cache with FileCacheLoader

    Hari Sundharesan Newbie

      i tried using the jboss cache with a simple filecache loader. it seems to work fine in the beginning. but after a while, when the size of the cache directory comes to about 270 MB, tats also about 12000 folders created in the cache directory i get the following exception while trying to write anything else after wards :

      i used a LFU policy with this. Then i wrote a custom LRU policy wherein it will remove the node from the in-memory cache leading to the node removed from the persistent storage as well (refer to http://www.jboss.com/index.html?module=bb&op=viewtopic&t=103452) and this worked, but i cant afford to remove it from storage...

      ava.lang.RuntimeException: java.io.IOException: No such file or directory
      17:03:58,050 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.TreeCache.invokeMethod(TreeCache.java:5526)
      17:03:58,050 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.TreeCache.put(TreeCache.java:3678)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.TreeCache.put(TreeCache.java:3616)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.reflect.GeneratedMethodAccessor88.invoke(Unknown Source)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      java.lang.reflect.Method.invoke(Method.java:585)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:141)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.server.Invocation.dispatch(Invocation.java:80)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.server.Invocation.invoke(Invocation.java:72)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:249)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:644)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.util.MBeanProxyExt.invoke(MBeanProxyExt.java:177)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      $Proxy51414.put(Unknown Source)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.rssecloader.RSJbossCache.updateCache(RSJbossCache.java:76)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.rssecloader.RSIndicativeDBProvider._intexMapBuilder(RSIndicativeDBProvider.java:645)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.rssecloader.RSIndicativeDBProvider.getFromIntexDB(RSIndicativeDBProvider.java:290)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.rssecloader.RSIndicativeLoader.loadCMO(RSIndicativeLoader.java:198)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.rssecloader.RSIndicativeLoader.loadIntexCMO(RSIndicativeLoader.java:242)
      17:03:58,051 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.rssecloader.RSSecurityLoader.validate(RSSecurityLoader.java:431)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.rssecloader.RSSecurityLoader.load(RSSecurityLoader.java:592)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.rssecloader.RSSecurityLoader.loadIndicatives(RSSecurityLoader.java:658)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      com.riskspan.services.indicservice.RSIndicativeService.serviceRequest(RSIndicativeService.java:56)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.reflect.GeneratedMethodAccessor85.invoke(Unknown Source)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      java.lang.reflect.Method.invoke(Method.java:585)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.invocation.Invocation.performCall(Invocation.java:345)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:214)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:185)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:130)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.webservice.server.ServiceEndpointInterceptor.invoke(ServiceEndpointInterceptor.java:51)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:48)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:105)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:335)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:166)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:139)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:192)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:122)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:624)
      17:03:58,052 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.ejb.Container.invoke(Container.java:873)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      java.lang.reflect.Method.invoke(Method.java:585)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:141)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.server.Invocation.dispatch(Invocation.java:80)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.server.Invocation.invoke(Invocation.java:72)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:249)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:644)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.invocation.jrmp.server.JRMPInvoker$MBeanServerAction.invoke(JRMPInvoker.java:805)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.invocation.jrmp.server.JRMPInvoker.invoke(JRMPInvoker.java:406)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.reflect.GeneratedMethodAccessor78.invoke(Unknown Source)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      java.lang.reflect.Method.invoke(Method.java:585)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:294)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.rmi.transport.Transport$1.run(Transport.java:153)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      java.security.AccessController.doPrivileged(Native Method)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.rmi.transport.Transport.serviceCall(Transport.java:149)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:460)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:701)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      java.lang.Thread.run(Thread.java:595)
      17:03:58,053 INFO [RMI TCP Connection(8779)-10.1.30.68] Caused by:
      java.io.IOException: No such file or directory
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      java.io.UnixFileSystem.createFileExclusively(Native Method)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      java.io.File.createNewFile(File.java:850)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.loader.FileCacheLoader.storeAttributes(FileCacheLoader.java:434)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.loader.FileCacheLoader.put(FileCacheLoader.java:124)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.CacheStoreInterceptor.invoke(CacheStoreInterceptor.java:216)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.CacheLoaderInterceptor.invoke(CacheLoaderInterceptor.java:197)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.UnlockInterceptor.invoke(UnlockInterceptor.java:32)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.ReplicationInterceptor.invoke(ReplicationInterceptor.java:34)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.TxInterceptor.handleNonTxMethod(TxInterceptor.java:345)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.TxInterceptor.invoke(TxInterceptor.java:156)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.Interceptor.invoke(Interceptor.java:68)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.interceptors.CacheMgmtInterceptor.invoke(CacheMgmtInterceptor.java:157)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] at
      org.jboss.cache.TreeCache.invokeMethod(TreeCache.java:5520)
      17:03:58,054 INFO [RMI TCP Connection(8779)-10.1.30.68] ... 58 more



      The same problem does not exist while using Bdje, and can write even contents which make up to 500 Mb in the persistent storage. I have no problem in using Bdje but was wondering why this happened with FileCacheLoader and if there was any solution to the problem....

      The machines memory was about 1400 MB out of the max ram of 1500 MB. once i shutdown jboss it came down by about 250 mb. but after deleting the cache directory itself the memory came down b y 250 Mb or so..