5 Replies Latest reply on Jun 18, 2013 2:26 PM by dominique bessette

    JBoss7 hangs/deadlock issue

    dominique bessette Newbie

      Hi

       

      My jboss7 hangs when I try to execute a geoserver wps process.  I contacted the geoserver group and they told me to up the JBoss threads since there is a deadlock happening in geoserver.  I upped the threads in the standalone.xml, but I'm seeing the same issues.  Is there any other ways to debug this?  Or does anyone have any ideas as to what is going on?

       

      Thank You

       

       

      standalone.xml

       

        <subsystem xmlns="urn:jboss:domain:threads:1.1">

                  <bounded-queue-thread-pool name="http-executor">

                      <core-threads count="200"/>

                      <queue-length count="200"/>

                      <max-threads count="200"/>

                  </bounded-queue-thread-pool>

              </subsystem>

       

        <subsystem xmlns="urn:jboss:domain:web:1.1" default-virtual-server="default-host" native="false">

                  <connector name="http" protocol="HTTP/1.1" scheme="http" socket-binding="http" executor="http-executor"/>

                  <virtual-server name="default-host" enable-welcome-root="true">

                      <alias name="localhost"/>

                      <alias name="example.com"/>

                      <access-log/>

                  </virtual-server>

              </subsystem>

       

       

      Email from geoserver:

       

      My guess is contention over the thread pool used to execute proceses. When a process executes it does so in a fixed size thread pool. If the thread pool is full (all threads are currently busy executing) the process execution will wait, and block if its a synchronous execution.

       

      So i think what has happened is deadlock, with process "A" waiting on process "B", but "B" waiting for a spot in the thread pool which won't become available until "A" is finished.

       

      By default the size of the thread pool is 2 times the number of cores in the machine. So worst case is 2 threads in size which means two invocations of your process in parallel can produce a deadlock. The thread pool size is configurable so you could increase it, but that is really a bandaid solution. But it could work in conjunction with the control flow module that can limit the overall number of max requests a service can handle. So you just need to make sure that the thread pool size is greater than the max number of WPS execute requests that the server can handle.

       

       

      server.log where it gets stuck:

       

      16:43:42,107 INFO  [org.geoserver.filters] (http-executor-threads - 5) "GET /geoserver/wps?service=WPS&version=1.0.0&request=Execute&identifier=py:ogp&datainputs=name=rest_test" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; InfoPath.3; .NET4.0E)" ""

      16:43:42,110 TRACE [org.geoserver.ows.OWSHandlerMapping] (http-executor-threads - 5) No handler mapping found for [/wps]

      16:43:42,110 TRACE [org.geoserver.ows.OWSHandlerMapping] (http-executor-threads - 5) No handler mapping found for [/wps]

      16:43:42,112 WARN  [org.geoserver.ows] (http-executor-threads - 5) Could not get a ServiceInfo for service wps thus could not check if the service is enabled

      16:43:42,149 DEBUG [org.geoserver.script.wps] (http-executor-threads - 5) Performing process lookup

      16:43:42,150 TRACE [org.vfny.geoserver.global] (http-executor-threads - 5) Looking up resource scripts/wps with parent null

      16:43:42,326 DEBUG [org.geoserver.script.wps] (http-executor-threads - 5) Performing process lookup

      16:43:42,327 TRACE [org.vfny.geoserver.global] (http-executor-threads - 5) Looking up resource scripts/wps with parent null

      16:43:42,334 DEBUG [org.geoserver.wps.resource] (http-executor-threads - 5) Associating process with execution id: 2612fc12-5353-4b31-91ea-6117a45adb04

      16:43:42,348 DEBUG [org.geoserver.script.wps] (http-executor-threads - 5) Performing process lookup

      16:43:42,348 TRACE [org.vfny.geoserver.global] (http-executor-threads - 5) Looking up resource scripts/wps with parent null

        • 1. Re: JBoss7 hangs/deadlock issue
          jaikiran pai Master

          Dominique, welcome to the forums!

           

          Please try the latest released version from the downloads page http://www.jboss.org/jbossas/downloads. I think we fixed an issue, in some other context, after 7.1.1.Final which might help you get past this. If you are still running into issues with that newer version, please post a thread dump showing the hang https://community.jboss.org/wiki/ThreadDump

          • 2. Re: JBoss7 hangs/deadlock issue
            dominique bessette Newbie

            Hi!  Thanks for responding so quickly.

            I am currently using version 7.1.1.Final and I dont see any updated versions on the downloads page.  Were you refering to EAP 6.1.0?  Or is there a patch? 

            Here's the thread dump.  I used jstack  "jstack -F -l PID > /tmp/jboss-jstack.txt"

             

             

            Deadlock Detection:

            No deadlocks found.

            Thread 20302: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt() @bci=1, line=834 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(int) @bci=72, line=994 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(int) @bci=24, line=1303 (Interpreted frame)
            - java.util.concurrent.FutureTask$Sync.innerGet() @bci=2, line=248 (Interpreted frame)
            - java.util.concurrent.FutureTask.get() @bci=4, line=111 (Interpreted frame)
            - org.geoserver.wps.executor.DefaultProcessManager.getOutput(java.lang.String, long) @bci=31, line=146 (Interpreted frame)
            - org.geoserver.wps.executor.WPSExecutionManager.getOutput(java.lang.String, long) @bci=37, line=173 (Interpreted frame)
            - org.geoserver.wps.Execute.run(net.opengis.wps10.ExecuteType) @bci=134, line=75 (Interpreted frame)
            - org.geoserver.wps.DefaultWebProcessingService.execute(net.opengis.wps10.ExecuteType) @bci=16, line=76 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=7, line=318 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint() @bci=12, line=183 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=19, line=150 (Interpreted frame)
            - org.geoserver.ows.util.RequestObjectLogger.invoke(org.aopalliance.intercept.MethodInvocation) @bci=131, line=54 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=101, line=172 (Interpreted frame)
            - org.springframework.aop.framework.JdkDynamicAopProxy.invoke(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=321, line=202 (Interpreted frame)
            - $Proxy190.execute(net.opengis.wps10.ExecuteType) @bci=16 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.geoserver.ows.Dispatcher.execute(org.geoserver.ows.Request, org.geoserver.platform.Operation) @bci=65, line=772 (Interpreted frame)
            - org.geoserver.ows.Dispatcher.handleRequestInternal(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=114, line=272 (Interpreted frame)
            - org.springframework.web.servlet.mvc.AbstractController.handleRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=58, line=153 (Interpreted frame)
            - org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, java.lang.Object) @bci=6, line=48 (Interpreted frame)
            - org.springframework.web.servlet.DispatcherServlet.doDispatch(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=279, line=923 (Interpreted frame)
            - org.springframework.web.servlet.DispatcherServlet.doService(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=292, line=852 (Interpreted frame)
            - org.springframework.web.servlet.FrameworkServlet.processRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=111, line=882 (Interpreted frame)
            - org.springframework.web.servlet.FrameworkServlet.doGet(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=3, line=778 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=35, line=734 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=30, line=847 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=390, line=329 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=3, line=23 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=62, line=74 (Interpreted frame)
            - org.geoserver.filters.SpringDelegatingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=11, line=45 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.platform.AdvancedDispatchFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=22, line=49 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=39, line=109 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=68, line=311 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(org.springframework.security.web.FilterInvocation) @bci=87, line=116 (Interpreted frame)
            - org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=15, line=83 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=17, line=113 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=30, line=53 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=54, line=150 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=16, line=82 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=165, line=87 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=142, line=173 (Interpreted frame)
            - org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=14, line=97 (Interpreted frame)
            - org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(javax.servlet.Filter, javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=5, line=346 (Interpreted frame)
            - org.springframework.web.filter.DelegatingFilterProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=71, line=259 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.LoggingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=581, line=71 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.GZIPFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=75, line=41 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.SessionDebugFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=25, line=46 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.apache.catalina.core.StandardWrapperValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=684, line=275 (Interpreted frame)
            - org.apache.catalina.core.StandardContextValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=200, line=161 (Interpreted frame)
            - org.jboss.as.web.security.SecurityContextAssociationValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=430, line=153 (Interpreted frame)
            - org.apache.catalina.core.StandardHostValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=233, line=155 (Interpreted frame)
            - org.apache.catalina.valves.ErrorReportValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=6, line=102 (Interpreted frame)
            - org.apache.catalina.valves.AccessLogValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=24, line=567 (Interpreted frame)
            - org.apache.catalina.core.StandardEngineValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=42, line=109 (Interpreted frame)
            - org.apache.catalina.connector.CoyoteAdapter.service(org.apache.coyote.Request, org.apache.coyote.Response) @bci=176, line=368 (Interpreted frame)
            - org.apache.coyote.http11.Http11Processor.process(java.net.Socket) @bci=379, line=877 (Interpreted frame)
            - org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(java.net.Socket) @bci=65, line=671 (Interpreted frame)
            - org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run() @bci=25, line=518 (Interpreted frame)
            - org.jboss.threads.SimpleDirectExecutor.execute(java.lang.Runnable) @bci=1, line=33 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.runTask(java.lang.Runnable) @bci=9, line=801 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.access$100(org.jboss.threads.QueueExecutor, java.lang.Runnable) @bci=2, line=45 (Interpreted frame)
            - org.jboss.threads.QueueExecutor$Worker.run() @bci=23, line=821 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20263: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt() @bci=1, line=834 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(int) @bci=72, line=994 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(int) @bci=24, line=1303 (Interpreted frame)
            - java.util.concurrent.FutureTask$Sync.innerGet() @bci=2, line=248 (Interpreted frame)
            - java.util.concurrent.FutureTask.get() @bci=4, line=111 (Interpreted frame)
            - org.geoserver.wps.executor.DefaultProcessManager.getOutput(java.lang.String, long) @bci=31, line=146 (Interpreted frame)
            - org.geoserver.wps.executor.WPSExecutionManager.getOutput(java.lang.String, long) @bci=37, line=173 (Interpreted frame)
            - org.geoserver.wps.Execute.run(net.opengis.wps10.ExecuteType) @bci=134, line=75 (Interpreted frame)
            - org.geoserver.wps.DefaultWebProcessingService.execute(net.opengis.wps10.ExecuteType) @bci=16, line=76 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=7, line=318 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint() @bci=12, line=183 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=19, line=150 (Interpreted frame)
            - org.geoserver.ows.util.RequestObjectLogger.invoke(org.aopalliance.intercept.MethodInvocation) @bci=131, line=54 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=101, line=172 (Interpreted frame)
            - org.springframework.aop.framework.JdkDynamicAopProxy.invoke(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=321, line=202 (Interpreted frame)
            - $Proxy190.execute(net.opengis.wps10.ExecuteType) @bci=16 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.geoserver.ows.Dispatcher.execute(org.geoserver.ows.Request, org.geoserver.platform.Operation) @bci=65, line=772 (Interpreted frame)
            - org.geoserver.ows.Dispatcher.handleRequestInternal(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=114, line=272 (Interpreted frame)
            - org.springframework.web.servlet.mvc.AbstractController.handleRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=58, line=153 (Interpreted frame)
            - org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, java.lang.Object) @bci=6, line=48 (Interpreted frame)
            - org.springframework.web.servlet.DispatcherServlet.doDispatch(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=279, line=923 (Interpreted frame)
            - org.springframework.web.servlet.DispatcherServlet.doService(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=292, line=852 (Interpreted frame)
            - org.springframework.web.servlet.FrameworkServlet.processRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=111, line=882 (Interpreted frame)
            - org.springframework.web.servlet.FrameworkServlet.doPost(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=3, line=789 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=131, line=754 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=30, line=847 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=390, line=329 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=3, line=23 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=62, line=74 (Interpreted frame)
            - org.geoserver.filters.SpringDelegatingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=11, line=45 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.platform.AdvancedDispatchFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=22, line=49 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=39, line=109 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=68, line=311 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(org.springframework.security.web.FilterInvocation) @bci=87, line=116 (Interpreted frame)
            - org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=15, line=83 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=17, line=113 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=30, line=53 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=54, line=150 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=16, line=82 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=165, line=87 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=142, line=173 (Interpreted frame)
            - org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=14, line=97 (Interpreted frame)
            - org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(javax.servlet.Filter, javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=5, line=346 (Interpreted frame)
            - org.springframework.web.filter.DelegatingFilterProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=71, line=259 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.LoggingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=581, line=71 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.GZIPFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=89, line=47 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.SessionDebugFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=25, line=46 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.apache.catalina.core.StandardWrapperValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=684, line=275 (Interpreted frame)
            - org.apache.catalina.core.StandardContextValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=200, line=161 (Interpreted frame)
            - org.jboss.as.web.security.SecurityContextAssociationValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=430, line=153 (Interpreted frame)
            - org.apache.catalina.core.StandardHostValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=233, line=155 (Interpreted frame)
            - org.apache.catalina.valves.ErrorReportValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=6, line=102 (Interpreted frame)
            - org.apache.catalina.valves.AccessLogValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=24, line=567 (Interpreted frame)
            - org.apache.catalina.core.StandardEngineValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=42, line=109 (Interpreted frame)
            - org.apache.catalina.connector.CoyoteAdapter.service(org.apache.coyote.Request, org.apache.coyote.Response) @bci=176, line=368 (Interpreted frame)
            - org.apache.coyote.http11.Http11Processor.process(java.net.Socket) @bci=379, line=877 (Interpreted frame)
            - org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(java.net.Socket) @bci=65, line=671 (Interpreted frame)
            - org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run() @bci=25, line=518 (Interpreted frame)
            - org.jboss.threads.SimpleDirectExecutor.execute(java.lang.Runnable) @bci=1, line=33 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.runTask(java.lang.Runnable) @bci=9, line=801 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.access$100(org.jboss.threads.QueueExecutor, java.lang.Runnable) @bci=2, line=45 (Interpreted frame)
            - org.jboss.threads.QueueExecutor$Worker.run() @bci=23, line=821 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20262: (state = IN_NATIVE)
            - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise)
            - java.net.SocketInputStream.read(byte[], int, int, int) @bci=79, line=150 (Compiled frame)
            - java.net.SocketInputStream.read(byte[], int, int) @bci=11, line=121 (Compiled frame)
            - java.io.BufferedInputStream.fill() @bci=175, line=235 (Compiled frame)
            - java.io.BufferedInputStream.read() @bci=12, line=254 (Compiled frame)
            - org.apache.commons.httpclient.HttpParser.readRawLine(java.io.InputStream) @bci=19, line=78 (Interpreted frame)
            - org.apache.commons.httpclient.HttpParser.readLine(java.io.InputStream, java.lang.String) @bci=11, line=106 (Interpreted frame)
            - org.apache.commons.httpclient.HttpConnection.readLine(java.lang.String) @bci=19, line=1116 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodBase.readStatusLine(org.apache.commons.httpclient.HttpState, org.apache.commons.httpclient.HttpConnection) @bci=36, line=1973 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodBase.readResponse(org.apache.commons.httpclient.HttpState, org.apache.commons.httpclient.HttpConnection) @bci=21, line=1735 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodBase.execute(org.apache.commons.httpclient.HttpState, org.apache.commons.httpclient.HttpConnection) @bci=68, line=1098 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(org.apache.commons.httpclient.HttpMethod) @bci=135, line=398 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodDirector.executeMethod(org.apache.commons.httpclient.HttpMethod) @bci=288, line=171 (Interpreted frame)
            - org.apache.commons.httpclient.HttpClient.executeMethod(org.apache.commons.httpclient.HostConfiguration, org.apache.commons.httpclient.HttpMethod, org.apache.commons.httpclient.HttpState) @bci=114, line=397 (Interpreted frame)
            - org.apache.commons.httpclient.HttpClient.executeMethod(org.apache.commons.httpclient.HttpMethod) @bci=14, line=323 (Interpreted frame)
            - mil.navy.fnmoc.gis.ogpsvc.execute.WpsExecuteRequest.postRequest(java.lang.String) @bci=42, line=78 (Interpreted frame)
            - mil.navy.fnmoc.gis.ogpsvc.WpsService.execute(java.lang.String) @bci=57, line=138 (Interpreted frame)
            - mil.navy.fnmoc.gis.ogpsvc.WpsService$$FastClassByCGLIB$$9544a75.invoke(int, java.lang.Object, java.lang.Object[]) @bci=94 (Interpreted frame)
            - org.springframework.cglib.proxy.MethodProxy.invoke(java.lang.Object, java.lang.Object[]) @bci=19, line=204 (Interpreted frame)
            - org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(java.lang.Object, java.lang.reflect.Method, java.lang.Object[], org.springframework.cglib.proxy.MethodProxy) @bci=86, line=627 (Interpreted frame)
            - mil.navy.fnmoc.gis.ogpsvc.WpsService$$EnhancerByCGLIB$$48a58b26.execute(java.lang.String) @bci=49 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(org.apache.cxf.message.Exchange, java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=57, line=180 (Interpreted frame)
            - org.apache.cxf.service.invoker.AbstractInvoker.invoke(org.apache.cxf.message.Exchange, java.lang.Object, java.lang.reflect.Method, java.util.List) @bci=26, line=96 (Interpreted frame)
            - org.apache.cxf.jaxrs.JAXRSInvoker.invoke(org.apache.cxf.message.Exchange, java.lang.Object, java.lang.Object) @bci=295, line=193 (Interpreted frame)
            - org.apache.cxf.jaxrs.JAXRSInvoker.invoke(org.apache.cxf.message.Exchange, java.lang.Object) @bci=112, line=102 (Interpreted frame)
            - org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run() @bci=26, line=58 (Interpreted frame)
            - org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(org.apache.cxf.message.Message) @bci=86, line=94 (Interpreted frame)
            - org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(org.apache.cxf.message.Message) @bci=137, line=271 (Interpreted frame)
            - org.apache.cxf.transport.ChainInitiationObserver.onMessage(org.apache.cxf.message.Message) @bci=416, line=121 (Interpreted frame)
            - org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(javax.servlet.ServletConfig, javax.servlet.ServletContext, javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=102, line=239 (Interpreted frame)
            - org.apache.cxf.transport.servlet.ServletController.invokeDestination(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, org.apache.cxf.transport.http.AbstractHTTPDestination) @bci=55, line=218 (Interpreted frame)
            - org.apache.cxf.transport.servlet.ServletController.invoke(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, boolean) @bci=218, line=163 (Interpreted frame)
            - org.apache.cxf.transport.servlet.ServletController.invoke(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=4, line=137 (Interpreted frame)
            - org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=42, line=158 (Interpreted frame)
            - org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=155, line=243 (Interpreted frame)
            - org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=3, line=168 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=35, line=734 (Interpreted frame)
            - org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=51, line=219 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=390, line=329 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.apache.catalina.core.StandardWrapperValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=684, line=275 (Interpreted frame)
            - org.apache.catalina.core.StandardContextValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=200, line=161 (Interpreted frame)
            - org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=9, line=50 (Interpreted frame)
            - org.jboss.as.web.security.SecurityContextAssociationValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=430, line=153 (Interpreted frame)
            - org.apache.catalina.core.StandardHostValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=233, line=155 (Interpreted frame)
            - org.apache.catalina.valves.ErrorReportValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=6, line=102 (Interpreted frame)
            - org.apache.catalina.valves.AccessLogValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=24, line=567 (Interpreted frame)
            - org.apache.catalina.core.StandardEngineValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=42, line=109 (Interpreted frame)
            - org.apache.catalina.connector.CoyoteAdapter.service(org.apache.coyote.Request, org.apache.coyote.Response) @bci=176, line=368 (Interpreted frame)
            - org.apache.coyote.http11.Http11Processor.process(java.net.Socket) @bci=379, line=877 (Interpreted frame)
            - org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(java.net.Socket) @bci=65, line=671 (Interpreted frame)
            - org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run() @bci=25, line=518 (Interpreted frame)
            - org.jboss.threads.SimpleDirectExecutor.execute(java.lang.Runnable) @bci=1, line=33 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.runTask(java.lang.Runnable) @bci=9, line=801 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.access$100(org.jboss.threads.QueueExecutor, java.lang.Runnable) @bci=2, line=45 (Interpreted frame)
            - org.jboss.threads.QueueExecutor$Worker.run() @bci=23, line=821 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20150: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt() @bci=1, line=834 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(int) @bci=72, line=994 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(int) @bci=24, line=1303 (Interpreted frame)
            - java.util.concurrent.FutureTask$Sync.innerGet() @bci=2, line=248 (Interpreted frame)
            - java.util.concurrent.FutureTask.get() @bci=4, line=111 (Interpreted frame)
            - org.geoserver.wps.executor.DefaultProcessManager.getOutput(java.lang.String, long) @bci=31, line=146 (Interpreted frame)
            - org.geoserver.wps.executor.WPSExecutionManager.getOutput(java.lang.String, long) @bci=37, line=173 (Interpreted frame)
            - org.geoserver.wps.Execute.run(net.opengis.wps10.ExecuteType) @bci=134, line=75 (Interpreted frame)
            - org.geoserver.wps.DefaultWebProcessingService.execute(net.opengis.wps10.ExecuteType) @bci=16, line=76 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=7, line=318 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint() @bci=12, line=183 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=19, line=150 (Interpreted frame)
            - org.geoserver.ows.util.RequestObjectLogger.invoke(org.aopalliance.intercept.MethodInvocation) @bci=131, line=54 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=101, line=172 (Interpreted frame)
            - org.springframework.aop.framework.JdkDynamicAopProxy.invoke(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=321, line=202 (Interpreted frame)
            - $Proxy190.execute(net.opengis.wps10.ExecuteType) @bci=16 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.geoserver.ows.Dispatcher.execute(org.geoserver.ows.Request, org.geoserver.platform.Operation) @bci=65, line=772 (Interpreted frame)
            - org.geoserver.ows.Dispatcher.handleRequestInternal(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=114, line=272 (Interpreted frame)
            - org.springframework.web.servlet.mvc.AbstractController.handleRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=58, line=153 (Interpreted frame)
            - org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, java.lang.Object) @bci=6, line=48 (Interpreted frame)
            - org.springframework.web.servlet.DispatcherServlet.doDispatch(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=279, line=923 (Interpreted frame)
            - org.springframework.web.servlet.DispatcherServlet.doService(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=292, line=852 (Interpreted frame)
            - org.springframework.web.servlet.FrameworkServlet.processRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=111, line=882 (Interpreted frame)
            - org.springframework.web.servlet.FrameworkServlet.doPost(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=3, line=789 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=131, line=754 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=30, line=847 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=390, line=329 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=3, line=23 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=62, line=74 (Interpreted frame)
            - org.geoserver.filters.SpringDelegatingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=11, line=45 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.platform.AdvancedDispatchFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=22, line=49 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=39, line=109 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=68, line=311 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(org.springframework.security.web.FilterInvocation) @bci=87, line=116 (Interpreted frame)
            - org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=15, line=83 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=17, line=113 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=30, line=53 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=54, line=150 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=16, line=82 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=165, line=87 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=142, line=173 (Interpreted frame)
            - org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=14, line=97 (Interpreted frame)
            - org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(javax.servlet.Filter, javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=5, line=346 (Interpreted frame)
            - org.springframework.web.filter.DelegatingFilterProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=71, line=259 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.LoggingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=581, line=71 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.GZIPFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=89, line=47 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.SessionDebugFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=25, line=46 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.apache.catalina.core.StandardWrapperValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=684, line=275 (Interpreted frame)
            - org.apache.catalina.core.StandardContextValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=200, line=161 (Interpreted frame)
            - org.jboss.as.web.security.SecurityContextAssociationValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=430, line=153 (Interpreted frame)
            - org.apache.catalina.core.StandardHostValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=233, line=155 (Interpreted frame)
            - org.apache.catalina.valves.ErrorReportValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=6, line=102 (Interpreted frame)
            - org.apache.catalina.valves.AccessLogValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=24, line=567 (Interpreted frame)
            - org.apache.catalina.core.StandardEngineValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=42, line=109 (Interpreted frame)
            - org.apache.catalina.connector.CoyoteAdapter.service(org.apache.coyote.Request, org.apache.coyote.Response) @bci=176, line=368 (Interpreted frame)
            - org.apache.coyote.http11.Http11Processor.process(java.net.Socket) @bci=379, line=877 (Interpreted frame)
            - org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(java.net.Socket) @bci=65, line=671 (Interpreted frame)
            - org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run() @bci=25, line=518 (Interpreted frame)
            - org.jboss.threads.SimpleDirectExecutor.execute(java.lang.Runnable) @bci=1, line=33 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.runTask(java.lang.Runnable) @bci=9, line=801 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.access$100(org.jboss.threads.QueueExecutor, java.lang.Runnable) @bci=2, line=45 (Interpreted frame)
            - org.jboss.threads.QueueExecutor$Worker.run() @bci=23, line=821 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20149: (state = IN_NATIVE)
            - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise)
            - java.net.SocketInputStream.read(byte[], int, int, int) @bci=79, line=150 (Compiled frame)
            - java.net.SocketInputStream.read(byte[], int, int) @bci=11, line=121 (Compiled frame)
            - java.io.BufferedInputStream.fill() @bci=175, line=235 (Compiled frame)
            - java.io.BufferedInputStream.read() @bci=12, line=254 (Compiled frame)
            - org.apache.commons.httpclient.HttpParser.readRawLine(java.io.InputStream) @bci=19, line=78 (Interpreted frame)
            - org.apache.commons.httpclient.HttpParser.readLine(java.io.InputStream, java.lang.String) @bci=11, line=106 (Interpreted frame)
            - org.apache.commons.httpclient.HttpConnection.readLine(java.lang.String) @bci=19, line=1116 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodBase.readStatusLine(org.apache.commons.httpclient.HttpState, org.apache.commons.httpclient.HttpConnection) @bci=36, line=1973 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodBase.readResponse(org.apache.commons.httpclient.HttpState, org.apache.commons.httpclient.HttpConnection) @bci=21, line=1735 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodBase.execute(org.apache.commons.httpclient.HttpState, org.apache.commons.httpclient.HttpConnection) @bci=68, line=1098 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(org.apache.commons.httpclient.HttpMethod) @bci=135, line=398 (Interpreted frame)
            - org.apache.commons.httpclient.HttpMethodDirector.executeMethod(org.apache.commons.httpclient.HttpMethod) @bci=288, line=171 (Interpreted frame)
            - org.apache.commons.httpclient.HttpClient.executeMethod(org.apache.commons.httpclient.HostConfiguration, org.apache.commons.httpclient.HttpMethod, org.apache.commons.httpclient.HttpState) @bci=114, line=397 (Interpreted frame)
            - org.apache.commons.httpclient.HttpClient.executeMethod(org.apache.commons.httpclient.HttpMethod) @bci=14, line=323 (Interpreted frame)
            - mil.navy.fnmoc.gis.ogpsvc.execute.WpsExecuteRequest.postRequest(java.lang.String) @bci=42, line=78 (Interpreted frame)
            - mil.navy.fnmoc.gis.ogpsvc.WpsService.execute(java.lang.String) @bci=57, line=138 (Interpreted frame)
            - mil.navy.fnmoc.gis.ogpsvc.WpsService$$FastClassByCGLIB$$9544a75.invoke(int, java.lang.Object, java.lang.Object[]) @bci=94 (Interpreted frame)
            - org.springframework.cglib.proxy.MethodProxy.invoke(java.lang.Object, java.lang.Object[]) @bci=19, line=204 (Interpreted frame)
            - org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(java.lang.Object, java.lang.reflect.Method, java.lang.Object[], org.springframework.cglib.proxy.MethodProxy) @bci=86, line=627 (Interpreted frame)
            - mil.navy.fnmoc.gis.ogpsvc.WpsService$$EnhancerByCGLIB$$48a58b26.execute(java.lang.String) @bci=49 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(org.apache.cxf.message.Exchange, java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=57, line=180 (Interpreted frame)
            - org.apache.cxf.service.invoker.AbstractInvoker.invoke(org.apache.cxf.message.Exchange, java.lang.Object, java.lang.reflect.Method, java.util.List) @bci=26, line=96 (Interpreted frame)
            - org.apache.cxf.jaxrs.JAXRSInvoker.invoke(org.apache.cxf.message.Exchange, java.lang.Object, java.lang.Object) @bci=295, line=193 (Interpreted frame)
            - org.apache.cxf.jaxrs.JAXRSInvoker.invoke(org.apache.cxf.message.Exchange, java.lang.Object) @bci=112, line=102 (Interpreted frame)
            - org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run() @bci=26, line=58 (Interpreted frame)
            - org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(org.apache.cxf.message.Message) @bci=86, line=94 (Interpreted frame)
            - org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(org.apache.cxf.message.Message) @bci=137, line=271 (Interpreted frame)
            - org.apache.cxf.transport.ChainInitiationObserver.onMessage(org.apache.cxf.message.Message) @bci=416, line=121 (Interpreted frame)
            - org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(javax.servlet.ServletConfig, javax.servlet.ServletContext, javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=102, line=239 (Interpreted frame)
            - org.apache.cxf.transport.servlet.ServletController.invokeDestination(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, org.apache.cxf.transport.http.AbstractHTTPDestination) @bci=55, line=218 (Interpreted frame)
            - org.apache.cxf.transport.servlet.ServletController.invoke(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, boolean) @bci=218, line=163 (Interpreted frame)
            - org.apache.cxf.transport.servlet.ServletController.invoke(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=4, line=137 (Interpreted frame)
            - org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=42, line=158 (Interpreted frame)
            - org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=155, line=243 (Interpreted frame)
            - org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=3, line=168 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=35, line=734 (Interpreted frame)
            - org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=51, line=219 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=390, line=329 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.apache.catalina.core.StandardWrapperValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=684, line=275 (Interpreted frame)
            - org.apache.catalina.core.StandardContextValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=200, line=161 (Interpreted frame)
            - org.jboss.as.jpa.interceptor.WebNonTxEmCloserValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=9, line=50 (Interpreted frame)
            - org.jboss.as.web.security.SecurityContextAssociationValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=430, line=153 (Interpreted frame)
            - org.apache.catalina.core.StandardHostValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=233, line=155 (Interpreted frame)
            - org.apache.catalina.valves.ErrorReportValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=6, line=102 (Interpreted frame)
            - org.apache.catalina.valves.AccessLogValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=24, line=567 (Interpreted frame)
            - org.apache.catalina.core.StandardEngineValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=42, line=109 (Interpreted frame)
            - org.apache.catalina.connector.CoyoteAdapter.service(org.apache.coyote.Request, org.apache.coyote.Response) @bci=176, line=368 (Interpreted frame)
            - org.apache.coyote.http11.Http11Processor.process(java.net.Socket) @bci=379, line=877 (Interpreted frame)
            - org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(java.net.Socket) @bci=65, line=671 (Interpreted frame)
            - org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run() @bci=25, line=518 (Interpreted frame)
            - org.jboss.threads.SimpleDirectExecutor.execute(java.lang.Runnable) @bci=1, line=33 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.runTask(java.lang.Runnable) @bci=9, line=801 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.access$100(org.jboss.threads.QueueExecutor, java.lang.Runnable) @bci=2, line=45 (Interpreted frame)
            - org.jboss.threads.QueueExecutor$Worker.run() @bci=23, line=821 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20141: (state = IN_NATIVE)
            - sun.nio.ch.FileDispatcherImpl.read0(java.io.FileDescriptor, long, int) @bci=0 (Interpreted frame)
            - sun.nio.ch.SocketDispatcher.read(java.io.FileDescriptor, long, int) @bci=4, line=39 (Interpreted frame)
            - sun.nio.ch.IOUtil.readIntoNativeBuffer(java.io.FileDescriptor, java.nio.ByteBuffer, long, sun.nio.ch.NativeDispatcher, java.lang.Object) @bci=116, line=218 (Interpreted frame)
            - sun.nio.ch.IOUtil.read(java.io.FileDescriptor, java.nio.ByteBuffer, long, sun.nio.ch.NativeDispatcher, java.lang.Object) @bci=52, line=191 (Interpreted frame)
            - sun.nio.ch.SocketChannelImpl.read(java.nio.ByteBuffer) @bci=182, line=359 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.python.core.PyReflectedFunction.__call__(org.python.core.PyObject, org.python.core.PyObject[], java.lang.String[]) @bci=217, line=186 (Interpreted frame)
            - org.python.core.PyReflectedFunction.__call__(org.python.core.PyObject[], java.lang.String[]) @bci=43, line=204 (Interpreted frame)
            - org.python.core.PyObject.__call__(org.python.core.PyObject, org.python.core.PyObject) @bci=16, line=420 (Compiled frame)
            - org.python.core.PyObject.__call__(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject) @bci=3, line=424 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=28, line=136 (Interpreted frame)
            - socket$py._do_read_nio$49(org.python.core.PyFrame, org.python.core.ThreadState) @bci=79, line=471 (Interpreted frame)
            - socket$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=1040 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=108, line=149 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject) @bci=19, line=357 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=28, line=136 (Interpreted frame)
            - socket$py.read$52(org.python.core.PyFrame, org.python.core.ThreadState) @bci=98, line=486 (Interpreted frame)
            - socket$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=1052 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=108, line=149 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject) @bci=19, line=357 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=28, line=136 (Interpreted frame)
            - socket$py.recv$153(org.python.core.PyFrame, org.python.core.ThreadState) @bci=211, line=1327 (Interpreted frame)
            - socket$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=1456 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyFunction.function___call__(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[]) @bci=19, line=406 (Interpreted frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[]) @bci=4, line=401 (Interpreted frame)
            - org.python.core.PyFunction.__call__(org.python.core.PyObject[], java.lang.String[]) @bci=6, line=396 (Interpreted frame)
            - org.python.core.PyObject._callextra(org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject) @bci=582, line=543 (Interpreted frame)
            - socket$py.map_exception$27(org.python.core.PyFrame, org.python.core.ThreadState) @bci=37, line=171 (Interpreted frame)
            - socket$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=952 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyFunction.function___call__(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[]) @bci=19, line=406 (Interpreted frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[]) @bci=4, line=401 (Interpreted frame)
            - org.python.core.PyFunction.__call__(org.python.core.PyObject[], java.lang.String[]) @bci=6, line=396 (Interpreted frame)
            - org.python.core.PyObject._callextra(org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject) @bci=582, line=543 (Interpreted frame)
            - socket$py.set_last_error$29(org.python.core.PyFrame, org.python.core.ThreadState) @bci=77, line=183 (Interpreted frame)
            - socket$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=960 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=45, line=141 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject) @bci=19, line=357 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=28, line=136 (Interpreted frame)
            - socket$py.readline$191(org.python.core.PyFrame, org.python.core.ThreadState) @bci=233, line=1771 (Interpreted frame)
            - socket$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=1608 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=40, line=127 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=18, line=347 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState) @bci=26, line=121 (Compiled frame)
            - httplib$py._read_status$7(org.python.core.PyFrame, org.python.core.ThreadState) @bci=25, line=398 (Interpreted frame)
            - httplib$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=348 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=94, line=134 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=18, line=347 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState) @bci=26, line=121 (Compiled frame)
            - httplib$py.begin$8(org.python.core.PyFrame, org.python.core.ThreadState) @bci=77, line=484 (Interpreted frame)
            - httplib$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=352 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=94, line=134 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=18, line=347 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState) @bci=26, line=121 (Compiled frame)
            - httplib$py.getresponse$35(org.python.core.PyFrame, org.python.core.ThreadState) @bci=534, line=1041 (Interpreted frame)
            - httplib$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=460 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=40, line=127 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=18, line=347 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState) @bci=26, line=121 (Compiled frame)
            - httplib$py.getreply$41(org.python.core.PyFrame, org.python.core.ThreadState) @bci=57, line=1123 (Interpreted frame)
            - httplib$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=484 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=40, line=127 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=18, line=347 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState) @bci=26, line=121 (Compiled frame)
            - urllib$py.open_http$18(org.python.core.PyFrame, org.python.core.ThreadState) @bci=1804, line=360 (Interpreted frame)
            - urllib$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=504 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=45, line=141 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject) @bci=19, line=357 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=28, line=136 (Interpreted frame)
            - urllib$py.open$14(org.python.core.PyFrame, org.python.core.ThreadState) @bci=1074, line=211 (Interpreted frame)
            - urllib$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=488 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=45, line=141 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject) @bci=19, line=357 (Compiled frame)
            - org.python.core.PyMethod.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=28, line=136 (Interpreted frame)
            - urllib$py.urlopen$3(org.python.core.PyFrame, org.python.core.ThreadState) @bci=346, line=88 (Interpreted frame)
            - urllib$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=444 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject, org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=40, line=127 (Compiled frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject) @bci=18, line=347 (Compiled frame)
            - org.python.pycode._pyx12.run$1(org.python.core.PyFrame, org.python.core.ThreadState) @bci=70, line=20 (Interpreted frame)
            - org.python.pycode._pyx12.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=32 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyFunction.function___call__(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[]) @bci=19, line=406 (Interpreted frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[]) @bci=4, line=401 (Interpreted frame)
            - org.python.core.PyFunction.__call__(org.python.core.PyObject[], java.lang.String[]) @bci=6, line=396 (Interpreted frame)
            - org.python.core.PyObject._callextra(org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject) @bci=582, line=543 (Interpreted frame)
            - geoserver.wps$py.wrapped$3(org.python.core.PyFrame, org.python.core.ThreadState) @bci=196, line=22 (Interpreted frame)
            - geoserver.wps$py.call_function(int, org.python.core.PyFrame, org.python.core.ThreadState) @bci=64 (Interpreted frame)
            - org.python.core.PyTableCode.call(org.python.core.ThreadState, org.python.core.PyFrame, org.python.core.PyObject) @bci=129, line=165 (Compiled frame)
            - org.python.core.PyBaseCode.call(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[], org.python.core.PyObject, org.python.core.PyObject[], org.python.core.PyObject) @bci=718, line=301 (Compiled frame)
            - org.python.core.PyFunction.function___call__(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[]) @bci=19, line=406 (Interpreted frame)
            - org.python.core.PyFunction.__call__(org.python.core.ThreadState, org.python.core.PyObject[], java.lang.String[]) @bci=4, line=401 (Interpreted frame)
            - org.python.core.PyFunction.__call__(org.python.core.PyObject[], java.lang.String[]) @bci=6, line=396 (Interpreted frame)
            - org.geoserver.script.py.PyWpsHook.run(java.util.Map, javax.script.ScriptEngine) @bci=136, line=106 (Interpreted frame)
            - org.geoserver.script.wps.ScriptProcess.execute(java.util.Map, org.opengis.util.ProgressListener) @bci=12, line=81 (Interpreted frame)
            - org.geoserver.wps.executor.DefaultProcessManager$ProcessCallable.call() @bci=98, line=215 (Interpreted frame)
            - org.geoserver.wps.executor.DefaultProcessManager$ProcessCallable.call() @bci=1, line=189 (Interpreted frame)
            - java.util.concurrent.FutureTask$Sync.innerRun() @bci=29, line=334 (Interpreted frame)
            - java.util.concurrent.FutureTask.run() @bci=4, line=166 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=46, line=1110 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - <0x00000000d9210f08>, (a java/util/concurrent/ThreadPoolExecutor$Worker)

            Thread 20138: (state = BLOCKED)
            - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information may be imprecise)
            - org.apache.wicket.protocol.http.pagestore.DiskPageStore$PageSavingThread.run() @bci=43, line=977 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20135: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame)
            - org.jboss.threads.QueueExecutor.takeTask() @bci=194, line=746 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.access$400(org.jboss.threads.QueueExecutor) @bci=1, line=45 (Interpreted frame)
            - org.jboss.threads.QueueExecutor$Worker.run() @bci=165, line=835 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20134: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt() @bci=1, line=834 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(int) @bci=72, line=994 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(int) @bci=24, line=1303 (Interpreted frame)
            - java.util.concurrent.FutureTask$Sync.innerGet() @bci=2, line=248 (Interpreted frame)
            - java.util.concurrent.FutureTask.get() @bci=4, line=111 (Interpreted frame)
            - org.geoserver.wps.executor.DefaultProcessManager.getOutput(java.lang.String, long) @bci=31, line=146 (Interpreted frame)
            - org.geoserver.wps.executor.WPSExecutionManager.getOutput(java.lang.String, long) @bci=37, line=173 (Interpreted frame)
            - org.geoserver.wps.Execute.run(net.opengis.wps10.ExecuteType) @bci=134, line=75 (Interpreted frame)
            - org.geoserver.wps.DefaultWebProcessingService.execute(net.opengis.wps10.ExecuteType) @bci=16, line=76 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=7, line=318 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint() @bci=12, line=183 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=19, line=150 (Interpreted frame)
            - org.geoserver.ows.util.RequestObjectLogger.invoke(org.aopalliance.intercept.MethodInvocation) @bci=131, line=54 (Interpreted frame)
            - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=101, line=172 (Interpreted frame)
            - org.springframework.aop.framework.JdkDynamicAopProxy.invoke(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=321, line=202 (Interpreted frame)
            - $Proxy190.execute(net.opengis.wps10.ExecuteType) @bci=16 (Interpreted frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke0(java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=0 (Compiled frame)
            - sun.reflect.NativeMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=87, line=57 (Compiled frame)
            - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=43 (Compiled frame)
            - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=57, line=601 (Compiled frame)
            - org.geoserver.ows.Dispatcher.execute(org.geoserver.ows.Request, org.geoserver.platform.Operation) @bci=65, line=772 (Interpreted frame)
            - org.geoserver.ows.Dispatcher.handleRequestInternal(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=114, line=272 (Interpreted frame)
            - org.springframework.web.servlet.mvc.AbstractController.handleRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=58, line=153 (Interpreted frame)
            - org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, java.lang.Object) @bci=6, line=48 (Interpreted frame)
            - org.springframework.web.servlet.DispatcherServlet.doDispatch(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=279, line=923 (Interpreted frame)
            - org.springframework.web.servlet.DispatcherServlet.doService(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=292, line=852 (Interpreted frame)
            - org.springframework.web.servlet.FrameworkServlet.processRequest(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=111, line=882 (Interpreted frame)
            - org.springframework.web.servlet.FrameworkServlet.doGet(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=3, line=778 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse) @bci=35, line=734 (Interpreted frame)
            - javax.servlet.http.HttpServlet.service(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=30, line=847 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=390, line=329 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=3, line=23 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=62, line=74 (Interpreted frame)
            - org.geoserver.filters.SpringDelegatingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=11, line=45 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.platform.AdvancedDispatchFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=22, line=49 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=39, line=109 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=68, line=311 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(org.springframework.security.web.FilterInvocation) @bci=87, line=116 (Interpreted frame)
            - org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=15, line=83 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=17, line=113 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=30, line=53 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=54, line=150 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=16, line=82 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=197, line=68 (Interpreted frame)
            - org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=165, line=87 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=241, line=72 (Interpreted frame)
            - org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=91 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=323 (Interpreted frame)
            - org.springframework.security.web.FilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=142, line=173 (Interpreted frame)
            - org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=14, line=97 (Interpreted frame)
            - org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(javax.servlet.Filter, javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=5, line=346 (Interpreted frame)
            - org.springframework.web.filter.DelegatingFilterProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=71, line=259 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.LoggingFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=581, line=71 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.GZIPFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=75, line=41 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.geoserver.filters.SessionDebugFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=25, line=46 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=141, line=280 (Interpreted frame)
            - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=101, line=248 (Interpreted frame)
            - org.apache.catalina.core.StandardWrapperValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=684, line=275 (Interpreted frame)
            - org.apache.catalina.core.StandardContextValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=200, line=161 (Interpreted frame)
            - org.jboss.as.web.security.SecurityContextAssociationValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=430, line=153 (Interpreted frame)
            - org.apache.catalina.core.StandardHostValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=233, line=155 (Interpreted frame)
            - org.apache.catalina.valves.ErrorReportValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=6, line=102 (Interpreted frame)
            - org.apache.catalina.valves.AccessLogValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=24, line=567 (Interpreted frame)
            - org.apache.catalina.core.StandardEngineValve.invoke(org.apache.catalina.connector.Request, org.apache.catalina.connector.Response) @bci=42, line=109 (Interpreted frame)
            - org.apache.catalina.connector.CoyoteAdapter.service(org.apache.coyote.Request, org.apache.coyote.Response) @bci=176, line=368 (Interpreted frame)
            - org.apache.coyote.http11.Http11Processor.process(java.net.Socket) @bci=379, line=877 (Interpreted frame)
            - org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(java.net.Socket) @bci=65, line=671 (Interpreted frame)
            - org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run() @bci=25, line=518 (Interpreted frame)
            - org.jboss.threads.SimpleDirectExecutor.execute(java.lang.Runnable) @bci=1, line=33 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.runTask(java.lang.Runnable) @bci=9, line=801 (Interpreted frame)
            - org.jboss.threads.QueueExecutor.access$100(org.jboss.threads.QueueExecutor, java.lang.Runnable) @bci=2, line=45 (Interpreted frame)
            - org.jboss.threads.QueueExecutor$Worker.run() @bci=23, line=821 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20104: (state = BLOCKED)
            - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information may be imprecise)
            - org.geoserver.security.file.FileWatcher.run() @bci=11, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20103: (state = BLOCKED)
            - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information may be imprecise)
            - org.geoserver.security.file.FileWatcher.run() @bci=11, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20102: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20100: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20099: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame)
            - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=24, line=1079 (Interpreted frame)
            - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20098: (state = BLOCKED)
            - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information may be imprecise)
            - org.geowebcache.stats.RuntimeStats$RuntimeStatsThread.run() @bci=19, line=339 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20095: (state = BLOCKED)
            - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information may be imprecise)
            - org.h2.store.WriterThread.run() @bci=180, line=153 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20094: (state = IN_NATIVE)
            - java.net.PlainSocketImpl.socketAccept(java.net.SocketImpl) @bci=0 (Interpreted frame)
            - java.net.AbstractPlainSocketImpl.accept(java.net.SocketImpl) @bci=7, line=396 (Interpreted frame)
            - java.net.ServerSocket.implAccept(java.net.Socket) @bci=60, line=522 (Interpreted frame)
            - java.net.ServerSocket.accept() @bci=48, line=490 (Interpreted frame)
            - org.h2.server.TcpServer.listen() @bci=26, line=232 (Interpreted frame)
            - org.h2.tools.Server.run() @bci=4, line=429 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20093: (state = BLOCKED)
            - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information may be imprecise)
            - org.h2.store.FileLock$1.run() @bci=74, line=341 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20091: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20089: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)
            - java.util.TimerThread.mainLoop() @bci=28, line=526 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20067: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.lang.ref.ReferenceQueue.remove(long) @bci=44, line=135 (Compiled frame)
            - java.lang.ref.ReferenceQueue.remove() @bci=2, line=151 (Compiled frame)
            - org.python.modules._weakref.GlobalRef$RefReaperThread.collect() @bci=3, line=212 (Interpreted frame)
            - org.python.modules._weakref.GlobalRef$RefReaperThread.run() @bci=1, line=221 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20048: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20044: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.lang.ref.ReferenceQueue.remove(long) @bci=44, line=135 (Compiled frame)
            - java.lang.ref.ReferenceQueue.remove() @bci=2, line=151 (Compiled frame)
            - org.geotools.util.WeakCollectionCleaner.run() @bci=10, line=77 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20022: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.lang.ref.ReferenceQueue.remove(long) @bci=44, line=135 (Compiled frame)
            - java.lang.ref.ReferenceQueue.remove() @bci=2, line=151 (Compiled frame)
            - sun.java2d.Disposer.run() @bci=3, line=145 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 20021: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19985: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.lang.ref.ReferenceQueue.remove(long) @bci=44, line=135 (Compiled frame)
            - java.lang.ref.ReferenceQueue.remove() @bci=2, line=151 (Compiled frame)
            - org.python.modules._weakref.GlobalRef$RefReaperThread.collect() @bci=3, line=212 (Interpreted frame)
            - org.python.modules._weakref.GlobalRef$RefReaperThread.run() @bci=1, line=221 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19972: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - sun.misc.GC$Daemon.run() @bci=51, line=117 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19964: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
            - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19950: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
            - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)
            - org.jboss.jca.core.connectionmanager.pool.mcp.PoolFiller.run() @bci=99, line=106 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19949: (state = IN_NATIVE)
            - sun.nio.ch.EPollArrayWrapper.epollWait(long, int, long, int) @bci=0 (Compiled frame; information may be imprecise)
            - sun.nio.ch.EPollArrayWrapper.poll(long) @bci=18, line=228 (Compiled frame)
            - sun.nio.ch.EPollSelectorImpl.doSelect(long) @bci=28, line=81 (Compiled frame)
            - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Compiled frame)
            - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Compiled frame)
            - org.jboss.sun.net.httpserver.ServerImpl$Dispatcher.run() @bci=72, line=382 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19947: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(long) @bci=68, line=2082 (Interpreted frame)
            - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=122, line=1090 (Interpreted frame)
            - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19946: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19945: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.TimerThread.mainLoop() @bci=201, line=552 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19944: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame)
            - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=98, line=1085 (Interpreted frame)
            - java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take() @bci=1, line=807 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)
            - org.jboss.threads.JBossThread.run() @bci=10, line=122 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19943: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
            - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)
            - com.arjuna.ats.arjuna.coordinator.TransactionReaper.waitForCancellations() @bci=23, line=321 (Interpreted frame)
            - com.arjuna.ats.internal.arjuna.coordinator.ReaperWorkerThread.run() @bci=62, line=65 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19942: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
            - com.arjuna.ats.internal.arjuna.coordinator.ReaperThread.run() @bci=113, line=90 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19941: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doPeriodicWait() @bci=13, line=672 (Interpreted frame)
            - com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run() @bci=372, line=392 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19939: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
            - com.arjuna.ats.internal.arjuna.recovery.ExpiredEntryMonitor.run() @bci=149, line=190 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19938: (state = IN_NATIVE)
            - java.net.PlainSocketImpl.socketAccept(java.net.SocketImpl) @bci=0 (Interpreted frame)
            - java.net.AbstractPlainSocketImpl.accept(java.net.SocketImpl) @bci=7, line=396 (Interpreted frame)
            - java.net.ServerSocket.implAccept(java.net.Socket) @bci=60, line=522 (Interpreted frame)
            - java.net.ServerSocket.accept() @bci=48, line=490 (Interpreted frame)
            - org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(java.net.ServerSocket) @bci=1, line=61 (Interpreted frame)
            - org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run() @bci=47, line=321 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19937: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - org.apache.tomcat.util.net.JIoEndpoint$Poller.run() @bci=86, line=742 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19936: (state = BLOCKED)
            - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information may be imprecise)
            - org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run() @bci=22, line=1579 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19935: (state = IN_NATIVE)
            - sun.nio.ch.EPollArrayWrapper.epollWait(long, int, long, int) @bci=0 (Interpreted frame)
            - sun.nio.ch.EPollArrayWrapper.poll(long) @bci=18, line=228 (Interpreted frame)
            - sun.nio.ch.EPollSelectorImpl.doSelect(long) @bci=28, line=81 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.select() @bci=2, line=102 (Interpreted frame)
            - org.xnio.nio.WorkerThread.run() @bci=450, line=153 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19934: (state = IN_NATIVE)
            - sun.nio.ch.EPollArrayWrapper.epollWait(long, int, long, int) @bci=0 (Interpreted frame)
            - sun.nio.ch.EPollArrayWrapper.poll(long) @bci=18, line=228 (Interpreted frame)
            - sun.nio.ch.EPollSelectorImpl.doSelect(long) @bci=28, line=81 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.select() @bci=2, line=102 (Interpreted frame)
            - org.xnio.nio.WorkerThread.run() @bci=450, line=153 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19933: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(long, java.util.concurrent.TimeUnit) @bci=106, line=2176 (Interpreted frame)
            - org.jboss.jca.core.connectionmanager.pool.idle.IdleRemover$IdleRemoverRunner.run() @bci=53, line=261 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=46, line=1110 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - <0x00000000cb04bf08>, (a java/util/concurrent/ThreadPoolExecutor$Worker)

            Thread 19917: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.parkNanos(java.lang.Object, long) @bci=20, line=226 (Interpreted frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(long, java.util.concurrent.TimeUnit) @bci=106, line=2176 (Interpreted frame)
            - org.jboss.jca.core.connectionmanager.pool.validator.ConnectionValidator$ConnectionValidatorRunner.run() @bci=53, line=263 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=46, line=1110 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - <0x00000000cb04cf30>, (a java/util/concurrent/ThreadPoolExecutor$Worker)

            Thread 19914: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
            - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame)
            - java.util.TimerThread.mainLoop() @bci=28, line=526 (Interpreted frame)
            - java.util.TimerThread.run() @bci=1, line=505 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19906: (state = IN_NATIVE)
            - sun.nio.ch.EPollArrayWrapper.epollWait(long, int, long, int) @bci=0 (Interpreted frame)
            - sun.nio.ch.EPollArrayWrapper.poll(long) @bci=18, line=228 (Interpreted frame)
            - sun.nio.ch.EPollSelectorImpl.doSelect(long) @bci=28, line=81 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.select() @bci=2, line=102 (Interpreted frame)
            - org.xnio.nio.WorkerThread.run() @bci=450, line=153 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19905: (state = IN_NATIVE)
            - sun.nio.ch.EPollArrayWrapper.epollWait(long, int, long, int) @bci=0 (Interpreted frame)
            - sun.nio.ch.EPollArrayWrapper.poll(long) @bci=18, line=228 (Interpreted frame)
            - sun.nio.ch.EPollSelectorImpl.doSelect(long) @bci=28, line=81 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.lockAndDoSelect(long) @bci=37, line=87 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.select(long) @bci=30, line=98 (Interpreted frame)
            - sun.nio.ch.SelectorImpl.select() @bci=2, line=102 (Interpreted frame)
            - org.xnio.nio.WorkerThread.run() @bci=450, line=153 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19866: (state = BLOCKED)

            Locked ownable synchronizers:
                - None

            Thread 19877: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame)
            - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19876: (state = BLOCKED)
            - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
            - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame)
            - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame)
            - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Compiled frame)
            - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame)
            - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame)
            - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19875: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
            - java.lang.ref.ReferenceQueue.remove(long) @bci=44, line=135 (Interpreted frame)
            - java.lang.ref.ReferenceQueue.remove() @bci=2, line=151 (Interpreted frame)
            - org.jboss.modules.ref.References$ReaperThread.run() @bci=3, line=68 (Interpreted frame)

            Locked ownable synchronizers:
                - None

            Thread 19870: (state = BLOCKED)

            Locked ownable synchronizers:
                - None

            Thread 19869: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.lang.ref.ReferenceQueue.remove(long) @bci=44, line=135 (Compiled frame)
            - java.lang.ref.ReferenceQueue.remove() @bci=2, line=151 (Compiled frame)
            - java.lang.ref.Finalizer$FinalizerThread.run() @bci=3, line=177 (Compiled frame)

            Locked ownable synchronizers:
                - None

            Thread 19868: (state = BLOCKED)
            - java.lang.Object.wait(long) @bci=0 (Compiled frame; information may be imprecise)
            - java.lang.Object.wait() @bci=2, line=503 (Compiled frame)
            - java.lang.ref.Reference$ReferenceHandler.run() @bci=46, line=133 (Compiled frame)

            Locked ownable synchronizers:
                - None

             

            • 3. Re: JBoss7 hangs/deadlock issue
              dominique bessette Newbie

              Any insight on this issue?  Its still not resolved and I'm trying to pinpoint if its an issue in GeoServer or JBoss.

               

              Thanks

              • 4. Re: JBoss7 hangs/deadlock issue
                Calebe Varga Newbie

                I've had the same issue.

                 

                I removed the executor and let JBoss handle it.

                No more hangs

                 

                • 5. Re: JBoss7 hangs/deadlock issue
                  dominique bessette Newbie

                  Thanks for answering back.  Can you be a little more specific in your answer?  Is the executor part of JBoss?