0 Replies Latest reply on Jun 19, 2013 8:48 AM by shenoy_seam

    Seeing very high cpu utilisation from some seam threads

    shenoy_seam

      Hi All,

       

      We are facing an issue where i see Seam threads using up lot of cpu. We are using Seam 2.1.0.GA and Rich faces 3.3 FInal, Glassfish appliaction server 3.1.2, jdk 1.7u9. Below is the ps output , with threads using up most CPU

       

      PID   LWP %CPU    VSZ COMMAND
      10659 10925 10.7 11629192 java
      10659 10682 16.8 11629192 java
      10659 10681 17.2 11629192 java
      10659 10663 25.5 11629192 java
      10659 10956 37.4 11629192 java
      10659 10951 37.5 11629192 java
      10659 10952 37.5 11629192 java
      10659 10953 37.5 11629192 java
      10659 10955 37.5 11629192 java
      10659 14053 59.3 11629192 java

       

      5 of the above threads are Seam related. These are using 37.5 * 5 , close to 200% cpu.

       

      The thread dump corresponding to these threads is  -

       

      Can someone help me understanf what these 5 threads are doing and why it is consuming so much of CPU.

       

      "Grizzly-kernel-thread(1)" daemon prio=10 tid=0x00007f58b0011000 nid=0x2aad runnable [0x00007f5940cce000]

         java.lang.Thread.State: RUNNABLE

          at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)

          at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)

          at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)

          at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

          - locked <0x0000000781934c80> (a sun.nio.ch.Util$2)

          - locked <0x0000000781934c70> (a java.util.Collections$UnmodifiableSet)

          - locked <0x00000007818f55a0> (a sun.nio.ch.EPollSelectorImpl)

          at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)

          at com.sun.grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:513)

          at com.sun.grizzly.SelectorHandlerRunner.doSelect(SelectorHandlerRunner.java:190)

          at com.sun.grizzly.SelectorHandlerRunner.run(SelectorHandlerRunner.java:132)

          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

          at java.lang.Thread.run(Thread.java:722)

       

      "C2 CompilerThread1" daemon prio=10 tid=0x00007f5954331800 nid=0x29ba waiting on condition [0x0000000000000000]

         java.lang.Thread.State: RUNNABLE

       

      "C2 CompilerThread0" daemon prio=10 tid=0x00007f595432f800 nid=0x29b9 waiting on condition [0x0000000000000000]

         java.lang.Thread.State: RUNNABLE

       

      "DestroyJavaVM" prio=10 tid=0x00007f595400b000 nid=0x29a7 waiting on condition [0x0000000000000000]

         java.lang.Thread.State: RUNNABLE

       

      "http-thread-pool-80(5)" daemon prio=10 tid=0x00007f58a403b000 nid=0x2acc runnable [0x00007f59403c4000]

         java.lang.Thread.State: RUNNABLE

          at org.apache.catalina.session.StandardSession.isForegroundLocked(StandardSession.java:1351)

          - locked <0x00000007f4b8bf10> (a org.apache.catalina.session.StandardSession)

          at org.apache.catalina.session.StandardSession.isValid(StandardSession.java:671)

          at org.apache.catalina.session.StandardSession.getAttribute(StandardSession.java:1225)

          at org.apache.catalina.session.StandardSessionFacade.getAttribute(StandardSessionFacade.java:152)

          at org.jboss.seam.servlet.ServletSessionMap.put(ServletSessionMap.java:75)

          at org.jboss.seam.servlet.ServletSessionMap.put(ServletSessionMap.java:23)

          at org.jboss.seam.contexts.BasicContext.set(BasicContext.java:84)

          at org.jboss.seam.Component.newInstance(Component.java:2152)

          at org.jboss.seam.contexts.Contexts.startup(Contexts.java:304)

          at org.jboss.seam.contexts.Contexts.startup(Contexts.java:278)

          at org.jboss.seam.contexts.Lifecycle.beginSession(Lifecycle.java:233)

          at org.jboss.seam.contexts.ServletLifecycle.beginSession(ServletLifecycle.java:182)

          at org.jboss.seam.servlet.SeamListener.sessionCreated(SeamListener.java:46)

          at org.apache.catalina.session.StandardSession.tellNew(StandardSession.java:475)

          at org.apache.catalina.session.StandardSession.setId(StandardSession.java:407)

          at org.apache.catalina.session.ManagerBase.createSession(ManagerBase.java:770)

          at org.apache.catalina.session.StandardManager.createSession(StandardManager.java:312)

          at org.apache.catalina.connector.Request.doGetSession(Request.java:2933)

          at org.apache.catalina.connector.Request.getSession(Request.java:2598)

          at org.apache.catalina.connector.RequestFacade.getSession(RequestFacade.java:933)

          at org.apache.catalina.connector.RequestFacade.getSession(RequestFacade.java:944)

          at org.jboss.seam.web.IdentityRequestWrapper.<init>(IdentityRequestWrapper.java:23)

          at org.jboss.seam.web.IdentityFilter.doFilter(IdentityFilter.java:40)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.MultipartFilter.doFilter(MultipartFilter.java:90)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.ExceptionFilter.doFilter(ExceptionFilter.java:64)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.RedirectFilter.doFilter(RedirectFilter.java:45)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.ajax4jsf.webapp.BaseXMLFilter.doXmlFilter(BaseXMLFilter.java:206)

          at org.ajax4jsf.webapp.BaseFilter.handleRequest(BaseFilter.java:290)

          at org.ajax4jsf.webapp.BaseFilter.processUploadsAndHandleRequest(BaseFilter.java:388)

          at org.ajax4jsf.webapp.BaseFilter.doFilter(BaseFilter.java:515)

          at org.jboss.seam.web.Ajax4jsfFilter.doFilter(Ajax4jsfFilter.java:56)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.LoggingFilter.doFilter(LoggingFilter.java:60)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.servlet.SeamFilter.doFilter(SeamFilter.java:158)

          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)

          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

          at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:278)

          at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)

          at org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:655)

          at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:595)

          at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:161)

          at org.apache.catalina.connector.CoyoteAdapter.doService(CoyoteAdapter.java:331)

          at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:231)

          at com.sun.enterprise.v3.services.impl.ContainerMapper$AdapterCallable.call(ContainerMapper.java:317)

          at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:195)

          at com.sun.grizzly.http.ProcessorTask.invokeAdapter(ProcessorTask.java:860)

          at com.sun.grizzly.http.ProcessorTask.doProcess(ProcessorTask.java:757)

          at com.sun.grizzly.http.ProcessorTask.process(ProcessorTask.java:1056)

          at com.sun.grizzly.http.DefaultProtocolFilter.execute(DefaultProtocolFilter.java:229)

          at com.sun.grizzly.DefaultProtocolChain.executeProtocolFilter(DefaultProtocolChain.java:137)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:104)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:90)

          at com.sun.grizzly.http.HttpProtocolChain.execute(HttpProtocolChain.java:79)

          at com.sun.grizzly.ProtocolChainContextTask.doCall(ProtocolChainContextTask.java:54)

          at com.sun.grizzly.SelectionKeyContextTask.call(SelectionKeyContextTask.java:59)

          at com.sun.grizzly.ContextTask.run(ContextTask.java:71)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:532)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.run(AbstractThreadPool.java:513)

          at java.lang.Thread.run(Thread.java:722)

       

      "http-thread-pool-80(1)" daemon prio=10 tid=0x00007f58a402f800 nid=0x2ac7 runnable [0x00007f59407c8000]

         java.lang.Thread.State: RUNNABLE

          at com.sun.ejb.base.sfsb.util.SimpleKeyGenerator.createSessionKey(SimpleKeyGenerator.java:92)

          - locked <0x000000078a233c28> (a com.sun.ejb.base.sfsb.util.SimpleKeyGenerator)

          at com.sun.ejb.base.sfsb.util.SimpleKeyGenerator.createSessionKey(SimpleKeyGenerator.java:57)

          at com.sun.ejb.containers.StatefulSessionContainer.createBeanInstance(StatefulSessionContainer.java:579)

          at com.sun.ejb.containers.StatefulSessionContainer.createEJBLocalBusinessObjectImpl(StatefulSessionContainer.java:528)

          at com.sun.ejb.containers.BaseContainer.createEJBLocalBusinessObjectImpl(BaseContainer.java:2495)

          at com.sun.ejb.containers.EJBLocalHomeImpl.createEJBLocalBusinessObjectImpl(EJBLocalHomeImpl.java:117)

          at com.sun.ejb.containers.EJBLocalHomeInvocationHandler.invoke(EJBLocalHomeInvocationHandler.java:177)

          at $Proxy286.create(Unknown Source)

          at com.sun.ejb.containers.JavaGlobalJndiNamingObjectProxy.create(JavaGlobalJndiNamingObjectProxy.java:65)

          at com.sun.enterprise.naming.impl.SerialContext.lookup(SerialContext.java:507)

          at com.sun.enterprise.naming.impl.SerialContext.lookup(SerialContext.java:455)

          at javax.naming.InitialContext.lookup(InitialContext.java:411)

          at javax.naming.InitialContext.lookup(InitialContext.java:411)

          at com.sun.enterprise.container.common.impl.JavaModuleNamingProxy.getJavaModuleOrAppEJB(JavaModuleNamingProxy.java:303)

          at com.sun.enterprise.container.common.impl.JavaModuleNamingProxy.handle(JavaModuleNamingProxy.java:133)

          at com.sun.enterprise.naming.impl.NamedNamingObjectManager.tryNamedProxies(NamedNamingObjectManager.java:89)

          at com.sun.enterprise.naming.impl.JavaURLContext.lookup(JavaURLContext.java:174)

          at com.sun.enterprise.naming.impl.SerialContext.lookup(SerialContext.java:498)

          at com.sun.enterprise.naming.impl.SerialContext.lookup(SerialContext.java:455)

          at javax.naming.InitialContext.lookup(InitialContext.java:411)

          at javax.naming.InitialContext.lookup(InitialContext.java:411)

          at org.jboss.seam.Component.instantiateSessionBean(Component.java:1403)

          at org.jboss.seam.Component.instantiate(Component.java:1367)

          at org.jboss.seam.Component.newInstance(Component.java:2148)

          at org.jboss.seam.Component.getInstance(Component.java:2024)

          at org.jboss.seam.Component.getInstance(Component.java:2003)

          at org.jboss.seam.Component.getInstance(Component.java:1997)

          at org.jboss.seam.Component.getInstance(Component.java:1992)

          at org.jboss.seam.transaction.AbstractUserTransaction.getSynchronizations(AbstractUserTransaction.java:79)

          at org.jboss.seam.transaction.UTTransaction.begin(UTTransaction.java:40)

          at org.jboss.seam.jsf.SeamPhaseListener.begin(SeamPhaseListener.java:592)

          at org.jboss.seam.jsf.SeamPhaseListener.begin(SeamPhaseListener.java:582)

          at org.jboss.seam.jsf.SeamPhaseListener.handleTransactionsBeforePhase(SeamPhaseListener.java:326)

          at org.jboss.seam.jsf.SeamPhaseListener.beforeServletPhase(SeamPhaseListener.java:143)

          at org.jboss.seam.jsf.SeamPhaseListener.beforePhase(SeamPhaseListener.java:117)

          at com.sun.faces.lifecycle.Phase.handleBeforePhase(Phase.java:228)

          at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:99)

          at com.sun.faces.lifecycle.RestoreViewPhase.doPhase(RestoreViewPhase.java:116)

          at com.sun.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:118)

          at javax.faces.webapp.FacesServlet.service(FacesServlet.java:593)

          at org.apache.catalina.core.StandardWrapper.service(StandardWrapper.java:1554)

          at org.apache.catalina.core.ApplicationDispatcher.doInvoke(ApplicationDispatcher.java:809)

          at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:670)

          at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:508)

          at org.apache.catalina.core.ApplicationDispatcher.doDispatch(ApplicationDispatcher.java:479)

          at org.apache.catalina.core.ApplicationDispatcher.dispatch(ApplicationDispatcher.java:355)

          at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:472)

          at org.apache.catalina.core.StandardHostValve.dispatchToErrorPage(StandardHostValve.java:669)

          at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:357)

          at org.apache.catalina.core.StandardHostValve.postInvoke(StandardHostValve.java:221)

          at org.apache.catalina.connector.CoyoteAdapter.doService(CoyoteAdapter.java:333)

          at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:231)

          at com.sun.enterprise.v3.services.impl.ContainerMapper$AdapterCallable.call(ContainerMapper.java:317)

          at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:195)

          at com.sun.grizzly.http.ProcessorTask.invokeAdapter(ProcessorTask.java:860)

          at com.sun.grizzly.http.ProcessorTask.doProcess(ProcessorTask.java:757)

          at com.sun.grizzly.http.ProcessorTask.process(ProcessorTask.java:1056)

          at com.sun.grizzly.http.DefaultProtocolFilter.execute(DefaultProtocolFilter.java:229)

          at com.sun.grizzly.DefaultProtocolChain.executeProtocolFilter(DefaultProtocolChain.java:137)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:104)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:90)

          at com.sun.grizzly.http.HttpProtocolChain.execute(HttpProtocolChain.java:79)

          at com.sun.grizzly.ProtocolChainContextTask.doCall(ProtocolChainContextTask.java:54)

          at com.sun.grizzly.SelectionKeyContextTask.call(SelectionKeyContextTask.java:59)

          at com.sun.grizzly.ContextTask.run(ContextTask.java:71)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:532)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.run(AbstractThreadPool.java:513)

          at java.lang.Thread.run(Thread.java:722)

       

      "http-thread-pool-80(2)" daemon prio=10 tid=0x00007f58a4034000 nid=0x2ac8 runnable [0x00007f59406c8000]

         java.lang.Thread.State: RUNNABLE

          at java.lang.Throwable.getStackTraceElement(Native Method)

          at java.lang.Throwable.getOurStackTrace(Throwable.java:826)

          - locked <0x00000007f4d66058> (a java.lang.Exception)

          at java.lang.Throwable.getStackTrace(Throwable.java:815)

          at java.lang.Thread.getStackTrace(Thread.java:1567)

          at javax.faces.context.FacesContext.<init>(FacesContext.java:90)

          at com.sun.faces.context.FacesContextImpl.<init>(FacesContextImpl.java:122)

          at com.sun.faces.context.FacesContextFactoryImpl.getFacesContext(FacesContextFactoryImpl.java:93)

          at javax.faces.webapp.FacesServlet.service(FacesServlet.java:583)

          at org.apache.catalina.core.StandardWrapper.service(StandardWrapper.java:1554)

          at org.apache.catalina.core.ApplicationDispatcher.doInvoke(ApplicationDispatcher.java:809)

          at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:670)

          at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:508)

          at org.apache.catalina.core.ApplicationDispatcher.doDispatch(ApplicationDispatcher.java:479)

          at org.apache.catalina.core.ApplicationDispatcher.dispatch(ApplicationDispatcher.java:355)

          at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:472)

          at org.apache.catalina.core.StandardHostValve.dispatchToErrorPage(StandardHostValve.java:669)

          at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:357)

          at org.apache.catalina.core.StandardHostValve.postInvoke(StandardHostValve.java:221)

          at org.apache.catalina.connector.CoyoteAdapter.doService(CoyoteAdapter.java:333)

          at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:231)

          at com.sun.enterprise.v3.services.impl.ContainerMapper$AdapterCallable.call(ContainerMapper.java:317)

          at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:195)

          at com.sun.grizzly.http.ProcessorTask.invokeAdapter(ProcessorTask.java:860)

          at com.sun.grizzly.http.ProcessorTask.doProcess(ProcessorTask.java:757)

          at com.sun.grizzly.http.ProcessorTask.process(ProcessorTask.java:1056)

          at com.sun.grizzly.http.DefaultProtocolFilter.execute(DefaultProtocolFilter.java:229)

          at com.sun.grizzly.DefaultProtocolChain.executeProtocolFilter(DefaultProtocolChain.java:137)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:104)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:90)

          at com.sun.grizzly.http.HttpProtocolChain.execute(HttpProtocolChain.java:79)

          at com.sun.grizzly.ProtocolChainContextTask.doCall(ProtocolChainContextTask.java:54)

          at com.sun.grizzly.SelectionKeyContextTask.call(SelectionKeyContextTask.java:59)

          at com.sun.grizzly.ContextTask.run(ContextTask.java:71)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:532)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.run(AbstractThreadPool.java:513)

          at java.lang.Thread.run(Thread.java:722)

       

      "http-thread-pool-80(3)" daemon prio=10 tid=0x00007f58a4036000 nid=0x2ac9 runnable [0x00007f59405c6000]

         java.lang.Thread.State: RUNNABLE

          at org.apache.catalina.session.StandardSession.isForegroundLocked(StandardSession.java:1351)

          - locked <0x00000007f4bf6728> (a org.apache.catalina.session.StandardSession)

          at org.apache.catalina.session.StandardSession.isValid(StandardSession.java:671)

          at org.apache.catalina.session.StandardSession.getAttribute(StandardSession.java:1225)

          at org.apache.catalina.session.StandardSessionFacade.getAttribute(StandardSessionFacade.java:152)

          at org.jboss.seam.servlet.ServletSessionMap.containsKey(ServletSessionMap.java:39)

          at org.jboss.seam.contexts.BasicContext.isSet(BasicContext.java:67)

          at org.jboss.seam.contexts.Contexts.startup(Contexts.java:301)

          at org.jboss.seam.contexts.Contexts.startup(Contexts.java:278)

          at org.jboss.seam.contexts.Lifecycle.beginSession(Lifecycle.java:233)

          at org.jboss.seam.contexts.ServletLifecycle.beginSession(ServletLifecycle.java:182)

          at org.jboss.seam.servlet.SeamListener.sessionCreated(SeamListener.java:46)

          at org.apache.catalina.session.StandardSession.tellNew(StandardSession.java:475)

          at org.apache.catalina.session.StandardSession.setId(StandardSession.java:407)

          at org.apache.catalina.session.ManagerBase.createSession(ManagerBase.java:770)

          at org.apache.catalina.session.StandardManager.createSession(StandardManager.java:312)

          at org.apache.catalina.connector.Request.doGetSession(Request.java:2933)

          at org.apache.catalina.connector.Request.getSession(Request.java:2598)

          at org.apache.catalina.connector.RequestFacade.getSession(RequestFacade.java:933)

          at org.apache.catalina.connector.RequestFacade.getSession(RequestFacade.java:944)

          at org.jboss.seam.web.IdentityRequestWrapper.<init>(IdentityRequestWrapper.java:23)

          at org.jboss.seam.web.IdentityFilter.doFilter(IdentityFilter.java:40)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.MultipartFilter.doFilter(MultipartFilter.java:90)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.ExceptionFilter.doFilter(ExceptionFilter.java:64)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.RedirectFilter.doFilter(RedirectFilter.java:45)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.ajax4jsf.webapp.BaseXMLFilter.doXmlFilter(BaseXMLFilter.java:206)

          at org.ajax4jsf.webapp.BaseFilter.handleRequest(BaseFilter.java:290)

          at org.ajax4jsf.webapp.BaseFilter.processUploadsAndHandleRequest(BaseFilter.java:388)

          at org.ajax4jsf.webapp.BaseFilter.doFilter(BaseFilter.java:515)

          at org.jboss.seam.web.Ajax4jsfFilter.doFilter(Ajax4jsfFilter.java:56)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.LoggingFilter.doFilter(LoggingFilter.java:60)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.servlet.SeamFilter.doFilter(SeamFilter.java:158)

          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)

          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

          at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:278)

          at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)

          at org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:655)

          at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:595)

          at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:161)

          at org.apache.catalina.connector.CoyoteAdapter.doService(CoyoteAdapter.java:331)

          at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:231)

          at com.sun.enterprise.v3.services.impl.ContainerMapper$AdapterCallable.call(ContainerMapper.java:317)

          at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:195)

          at com.sun.grizzly.http.ProcessorTask.invokeAdapter(ProcessorTask.java:860)

          at com.sun.grizzly.http.ProcessorTask.doProcess(ProcessorTask.java:757)

          at com.sun.grizzly.http.ProcessorTask.process(ProcessorTask.java:1056)

          at com.sun.grizzly.http.DefaultProtocolFilter.execute(DefaultProtocolFilter.java:229)

          at com.sun.grizzly.DefaultProtocolChain.executeProtocolFilter(DefaultProtocolChain.java:137)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:104)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:90)

          at com.sun.grizzly.http.HttpProtocolChain.execute(HttpProtocolChain.java:79)

          at com.sun.grizzly.ProtocolChainContextTask.doCall(ProtocolChainContextTask.java:54)

          at com.sun.grizzly.SelectionKeyContextTask.call(SelectionKeyContextTask.java:59)

          at com.sun.grizzly.ContextTask.run(ContextTask.java:71)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:532)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.run(AbstractThreadPool.java:513)

          at java.lang.Thread.run(Thread.java:722)

       

      "http-thread-pool-80(4)" daemon prio=10 tid=0x00007f58a4039800 nid=0x2acb runnable [0x00007f59404c5000]

         java.lang.Thread.State: RUNNABLE

          at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)

          at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)

          at java.io.File.exists(File.java:772)

          at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1057)

          at sun.misc.URLClassPath$FileLoader.findResource(URLClassPath.java:1024)

          at sun.misc.URLClassPath.findResource(URLClassPath.java:172)

          at java.net.URLClassLoader$2.run(URLClassLoader.java:551)

          at java.net.URLClassLoader$2.run(URLClassLoader.java:549)

          at java.security.AccessController.doPrivileged(Native Method)

          at java.net.URLClassLoader.findResource(URLClassLoader.java:548)

          at org.glassfish.web.loader.WebappClassLoader.findResource(WebappClassLoader.java:1043)

          at org.glassfish.web.loader.WebappClassLoader.getResource(WebappClassLoader.java:1165)

          at org.glassfish.web.loader.WebappClassLoader.getResourceFromJars(WebappClassLoader.java:1111)

          at org.apache.catalina.servlets.DefaultServlet.serveResource(DefaultServlet.java:803)

          at org.apache.catalina.servlets.DefaultServlet.doGet(DefaultServlet.java:466)

          at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)

          at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)

          at org.apache.catalina.core.StandardWrapper.service(StandardWrapper.java:1554)

          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:339)

          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:83)

          at org.jboss.seam.web.IdentityFilter.doFilter(IdentityFilter.java:40)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.MultipartFilter.doFilter(MultipartFilter.java:90)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.ExceptionFilter.doFilter(ExceptionFilter.java:64)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.RedirectFilter.doFilter(RedirectFilter.java:45)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.ajax4jsf.webapp.BaseXMLFilter.doXmlFilter(BaseXMLFilter.java:206)

          at org.ajax4jsf.webapp.BaseFilter.handleRequest(BaseFilter.java:290)

          at org.ajax4jsf.webapp.BaseFilter.processUploadsAndHandleRequest(BaseFilter.java:388)

          at org.ajax4jsf.webapp.BaseFilter.doFilter(BaseFilter.java:515)

          at org.jboss.seam.web.Ajax4jsfFilter.doFilter(Ajax4jsfFilter.java:56)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.web.LoggingFilter.doFilter(LoggingFilter.java:60)

          at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)

          at org.jboss.seam.servlet.SeamFilter.doFilter(SeamFilter.java:158)

          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)

          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

          at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:278)

          at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)

          at org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:655)

          at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:595)

          at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:161)

          at org.apache.catalina.connector.CoyoteAdapter.doService(CoyoteAdapter.java:331)

          at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:231)

          at com.sun.enterprise.v3.services.impl.ContainerMapper$AdapterCallable.call(ContainerMapper.java:317)

          at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:195)

          at com.sun.grizzly.http.ProcessorTask.invokeAdapter(ProcessorTask.java:860)

          at com.sun.grizzly.http.ProcessorTask.doProcess(ProcessorTask.java:757)

          at com.sun.grizzly.http.ProcessorTask.process(ProcessorTask.java:1056)

          at com.sun.grizzly.http.DefaultProtocolFilter.execute(DefaultProtocolFilter.java:229)

          at com.sun.grizzly.DefaultProtocolChain.executeProtocolFilter(DefaultProtocolChain.java:137)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:104)

          at com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:90)

          at com.sun.grizzly.http.HttpProtocolChain.execute(HttpProtocolChain.java:79)

          at com.sun.grizzly.ProtocolChainContextTask.doCall(ProtocolChainContextTask.java:54)

          at com.sun.grizzly.SelectionKeyContextTask.call(SelectionKeyContextTask.java:59)

          at com.sun.grizzly.ContextTask.run(ContextTask.java:71)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:532)

          at com.sun.grizzly.util.AbstractThreadPool$Worker.run(AbstractThreadPool.java:513)

          at java.lang.Thread.run(Thread.java:722)

       

      "__ejb-thread-pool6" daemon prio=10 tid=0x00007f582800a800 nid=0x36e5 runnable [0x00007f5938493000]

         java.lang.Thread.State: RUNNABLE

          at java.net.SocketInputStream.socketRead0(Native Method)

          at java.net.SocketInputStream.read(SocketInputStream.java:150)

          at java.net.SocketInputStream.read(SocketInputStream.java:121)

          at com.mysql.jdbc.util.ReadAheadInputStream.fill(ReadAheadInputStream.java:113)

          at com.mysql.jdbc.util.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:160)

          at com.mysql.jdbc.util.ReadAheadInputStream.read(ReadAheadInputStream.java:188)

          - locked <0x0000000782c8e2a8> (a com.mysql.jdbc.util.ReadAheadInputStream)

          at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1994)

          at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2411)

          at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2916)

          at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631)

          at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723)

          at com.mysql.jdbc.Connection.execSQL(Connection.java:3277)

          - locked <0x0000000782c8e5e0> (a java.lang.Object)

          at com.mysql.jdbc.Connection.execSQL(Connection.java:3206)

          at com.mysql.jdbc.Statement.executeQuery(Statement.java:1232)

          - locked <0x0000000782c8e5e0> (a java.lang.Object)

          at com.mysql.jdbc.jdbc2.optional.StatementWrapper.executeQuery(StatementWrapper.java:705)

          at com.sun.gjc.spi.jdbc40.StatementWrapper40.executeQuery(StatementWrapper40.java:234)

          at com.mavenir.sps.database.DbApi.execQuery(DbApi.java:175)

          at com.mavenir.sps.database.PerformanceCSVProcessor.getFileFormat(PerformanceCSVProcessor.java:738)

          at com.mavenir.sps.performance.TmmFileManager.acceptArray(TmmFileManager.java:181)

          at com.mavenir.sps.performance.TmmFileManager.filterFilesWithStorageMode(TmmFileManager.java:699)

          at com.mavenir.sps.database.StatisticsAction.loadTmmCSVToDb(StatisticsAction.java:117)

          at com.mavenir.sps.performance.PerformanceTimer.execute(PerformanceTimer.java:41)

          at com.mavenir.sps.util.TimerBean.ejbTimeout(TimerBean.java:78)

          at sun.reflect.GeneratedMethodAccessor124.invoke(Unknown Source)

          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

          at java.lang.reflect.Method.invoke(Method.java:601)

          at org.glassfish.ejb.security.application.EJBSecurityManager.runMethod(EJBSecurityManager.java:1052)

          at org.glassfish.ejb.security.application.EJBSecurityManager.invoke(EJBSecurityManager.java:1124)

          at com.sun.ejb.containers.BaseContainer.invokeBeanMethod(BaseContainer.java:5388)

          at com.sun.ejb.EjbInvocation.invokeBeanMethod(EjbInvocation.java:619)

          at com.sun.ejb.containers.interceptors.AroundInvokeChainImpl.invokeNext(InterceptorManager.java:800)

          at com.sun.ejb.EjbInvocation.proceed(EjbInvocation.java:571)

          at com.sun.ejb.containers.interceptors.SystemInterceptorProxy.doAround(SystemInterceptorProxy.java:162)

          at com.sun.ejb.containers.interceptors.SystemInterceptorProxy.aroundTimeout(SystemInterceptorProxy.java:149)

          at sun.reflect.GeneratedMethodAccessor118.invoke(Unknown Source)

          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

          at java.lang.reflect.Method.invoke(Method.java:601)

          at com.sun.ejb.containers.interceptors.AroundInvokeInterceptor.intercept(InterceptorManager.java:861)

          at com.sun.ejb.containers.interceptors.AroundInvokeChainImpl.invokeNext(InterceptorManager.java:800)

          at com.sun.ejb.containers.interceptors.InterceptorManager.intercept(InterceptorManager.java:370)

          at com.sun.ejb.containers.BaseContainer.__intercept(BaseContainer.java:5360)

          at com.sun.ejb.containers.BaseContainer.intercept(BaseContainer.java:5348)

          at com.sun.ejb.containers.BaseContainer.callEJBTimeout(BaseContainer.java:4058)

          at com.sun.ejb.containers.EJBTimerService.deliverTimeout(EJBTimerService.java:1832)

          at com.sun.ejb.containers.EJBTimerService.access$100(EJBTimerService.java:108)

          at com.sun.ejb.containers.EJBTimerService$TaskExpiredWork.run(EJBTimerService.java:2646)

          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)

          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)

          at java.util.concurrent.FutureTask.run(FutureTask.java:166)

          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

          at java.lang.Thread.run(Thread.java:722)