1 2 Previous Next 17 Replies Latest reply on May 13, 2015 12:18 PM by tabs_ls

    Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException

    humanbeing

      Hi,

       

      I seem to have run into the this exception while testing on WF  (8.1, 8.2, 9.0.0.Beta2) -full-ha. Anything I can clarify / try out?

       

      09:25:08,123 ERROR [org.infinispan.interceptors.InvocationContextInterceptor] (default task-39) ISPN000136: Execution error: org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 15 seconds for key tfMNeXuMXFoTnfaEEFbXpv7e and requestor GlobalTransaction:<master:server-three>:49:local. Lock is held by GlobalTransaction:<master:server-three>:48:local, while request came from local

      [Server:server-three]     at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198)

      [Server:server-three]     at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLock(LockManagerImpl.java:171)

      [Server:server-three]     at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.lockKeyAndCheckOwnership(AbstractTxLockingInterceptor.java:177)

      [Server:server-three]     at org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitDataReadCommand(PessimisticLockingInterceptor.java:80)

      [Server:server-three]     at org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitGetKeyValueCommand(PessimisticLockingInterceptor.java:68)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111)

      [Server:server-three]     at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:77)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.TxInterceptor.enlistReadAndInvokeNext(TxInterceptor.java:322)

      [Server:server-three]     at org.infinispan.interceptors.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:300)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111)

      [Server:server-three]     at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:77)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.statetransfer.StateTransferInterceptor.handleTopologyAffectedCommand(StateTransferInterceptor.java:233)

      [Server:server-three]     at org.infinispan.statetransfer.StateTransferInterceptor.handleDefault(StateTransferInterceptor.java:217)

      [Server:server-three]     at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:77)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.CacheMgmtInterceptor.visitDataReadCommand(CacheMgmtInterceptor.java:103)

      [Server:server-three]     at org.infinispan.interceptors.CacheMgmtInterceptor.visitGetKeyValueCommand(CacheMgmtInterceptor.java:91)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102)

      [Server:server-three]     at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71)

      [Server:server-three]     at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:77)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:333)

      [Server:server-three]     at org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:423)

      [Server:server-three]     at org.infinispan.cache.impl.DecoratedCache.get(DecoratedCache.java:427)

      [Server:server-three]     at org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:289)

      [Server:server-three]     at org.wildfly.clustering.web.infinispan.session.coarse.CoarseSessionFactory.findValue(CoarseSessionFactory.java:125)

      [Server:server-three]     at org.wildfly.clustering.web.infinispan.session.coarse.CoarseSessionFactory.findValue(CoarseSessionFactory.java:58)

      [Server:server-three]     at org.wildfly.clustering.web.infinispan.session.InfinispanSessionManager.findSession(InfinispanSessionManager.java:232)

      [Server:server-three]     at org.wildfly.clustering.web.undertow.session.DistributableSessionManager.getSession(DistributableSessionManager.java:115)

      [Server:server-three]     at io.undertow.servlet.spec.ServletContextImpl.getSession(ServletContextImpl.java:716)

      [Server:server-three]     at io.undertow.servlet.spec.HttpServletRequestImpl.getSession(HttpServletRequestImpl.java:364)

      [Server:server-three]     at org.jboss.weld.servlet.SessionHolder.requestInitialized(SessionHolder.java:47)

      [Server:server-three]     at org.jboss.weld.servlet.HttpContextLifecycle.requestInitialized(HttpContextLifecycle.java:214)

      [Server:server-three]     at org.jboss.weld.servlet.WeldInitialListener.requestInitialized(WeldInitialListener.java:160)

      [Server:server-three]     at io.undertow.servlet.core.ApplicationListeners.requestInitialized(ApplicationListeners.java:216)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:277)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:255)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:80)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:174)

      [Server:server-three]     at io.undertow.server.Connectors.executeRootHandler(Connectors.java:199)

      [Server:server-three]     at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:774)

      [Server:server-three]     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

      [Server:server-three]     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      [Server:server-three]     at java.lang.Thread.run(Thread.java:745)

      [Server:server-three]

      [Server:server-three] 09:25:08,127 ERROR [io.undertow.request] (default task-39) UT005023: Exception handling request to /local/queue.xhtml: org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 15 seconds for key tfMNeXuMXFoTnfaEEFbXpv7e and requestor GlobalTransaction:<master:server-three>:49:local. Lock is held by GlobalTransaction:<master:server-three>:48:local, while request came from local

      [Server:server-three]     at org.infinispan.util.concurrent.locks.LockManagerImpl.lock(LockManagerImpl.java:198)

      [Server:server-three]     at org.infinispan.util.concurrent.locks.LockManagerImpl.acquireLock(LockManagerImpl.java:171)

      [Server:server-three]     at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.lockKeyAndCheckOwnership(AbstractTxLockingInterceptor.java:177)

      [Server:server-three]     at org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitDataReadCommand(PessimisticLockingInterceptor.java:80)

      [Server:server-three]     at org.infinispan.interceptors.locking.PessimisticLockingInterceptor.visitGetKeyValueCommand(PessimisticLockingInterceptor.java:68)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111)

      [Server:server-three]     at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:77)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.TxInterceptor.enlistReadAndInvokeNext(TxInterceptor.java:322)

      [Server:server-three]     at org.infinispan.interceptors.TxInterceptor.visitGetKeyValueCommand(TxInterceptor.java:300)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:111)

      [Server:server-three]     at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:77)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.statetransfer.StateTransferInterceptor.handleTopologyAffectedCommand(StateTransferInterceptor.java:233)

      [Server:server-three]     at org.infinispan.statetransfer.StateTransferInterceptor.handleDefault(StateTransferInterceptor.java:217)

      [Server:server-three]     at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:77)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.CacheMgmtInterceptor.visitDataReadCommand(CacheMgmtInterceptor.java:103)

      [Server:server-three]     at org.infinispan.interceptors.CacheMgmtInterceptor.visitGetKeyValueCommand(CacheMgmtInterceptor.java:91)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:97)

      [Server:server-three]     at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:102)

      [Server:server-three]     at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:71)

      [Server:server-three]     at org.infinispan.commands.AbstractVisitor.visitGetKeyValueCommand(AbstractVisitor.java:77)

      [Server:server-three]     at org.infinispan.commands.read.GetKeyValueCommand.acceptVisitor(GetKeyValueCommand.java:40)

      [Server:server-three]     at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:333)

      [Server:server-three]     at org.infinispan.cache.impl.CacheImpl.get(CacheImpl.java:423)

      [Server:server-three]     at org.infinispan.cache.impl.DecoratedCache.get(DecoratedCache.java:427)

      [Server:server-three]     at org.infinispan.cache.impl.AbstractDelegatingCache.get(AbstractDelegatingCache.java:289)

      [Server:server-three]     at org.wildfly.clustering.web.infinispan.session.coarse.CoarseSessionFactory.findValue(CoarseSessionFactory.java:125)

      [Server:server-three]     at org.wildfly.clustering.web.infinispan.session.coarse.CoarseSessionFactory.findValue(CoarseSessionFactory.java:58)

      [Server:server-three]     at org.wildfly.clustering.web.infinispan.session.InfinispanSessionManager.findSession(InfinispanSessionManager.java:232)

      [Server:server-three]     at org.wildfly.clustering.web.undertow.session.DistributableSessionManager.getSession(DistributableSessionManager.java:115)

      [Server:server-three]     at io.undertow.servlet.spec.ServletContextImpl.getSession(ServletContextImpl.java:716)

      [Server:server-three]     at io.undertow.servlet.spec.HttpServletRequestImpl.getSession(HttpServletRequestImpl.java:364)

      [Server:server-three]     at org.jboss.weld.servlet.SessionHolder.requestInitialized(SessionHolder.java:47)

      [Server:server-three]     at org.jboss.weld.servlet.HttpContextLifecycle.requestInitialized(HttpContextLifecycle.java:214)

      [Server:server-three]     at org.jboss.weld.servlet.WeldInitialListener.requestInitialized(WeldInitialListener.java:160)

      [Server:server-three]     at io.undertow.servlet.core.ApplicationListeners.requestInitialized(ApplicationListeners.java:216)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:277)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:255)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:80)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:174)

      [Server:server-three]     at io.undertow.server.Connectors.executeRootHandler(Connectors.java:199)

      [Server:server-three]     at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:774)

      [Server:server-three]     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

      [Server:server-three]     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      [Server:server-three]     at java.lang.Thread.run(Thread.java:745)

      [Server:server-three]

      [Server:server-three] 09:25:08,135 ERROR [io.undertow.request] (default task-39) UT005022: Exception generating error page /error.xhtml: java.lang.RuntimeException: org.jboss.weld.context.ContextNotActiveException: WELD-001303: No active contexts for scope type javax.enterprise.context.SessionScoped

      [Server:server-three]     at io.undertow.servlet.spec.RequestDispatcherImpl.error(RequestDispatcherImpl.java:464)

      [Server:server-three]     at io.undertow.servlet.spec.RequestDispatcherImpl.error(RequestDispatcherImpl.java:377)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:305)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:255)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:80)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:174)

      [Server:server-three]     at io.undertow.server.Connectors.executeRootHandler(Connectors.java:199)

      [Server:server-three]     at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:774)

      [Server:server-three]     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

      [Server:server-three]     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      [Server:server-three]     at java.lang.Thread.run(Thread.java:745)

      [Server:server-three] Caused by: org.jboss.weld.context.ContextNotActiveException: WELD-001303: No active contexts for scope type javax.enterprise.context.SessionScoped

      [Server:server-three]     at org.jboss.weld.manager.BeanManagerImpl.getContext(BeanManagerImpl.java:691)

      [Server:server-three]     at org.jboss.weld.bean.proxy.ContextBeanInstance.getInstance(ContextBeanInstance.java:79)

      [Server:server-three]     at org.jboss.weld.bean.proxy.CachedBeanInstance.getInstance(CachedBeanInstance.java:66)

      [Server:server-three]     at org.jboss.weld.bean.proxy.ProxyMethodHandler.getInstance(ProxyMethodHandler.java:125)

      [Server:server-three]     at org.apache.deltaspike.jsf.spi.scope.window.DefaultClientWindowConfig$Proxy$_$$_WeldClientProxy.getClientWindowRenderMode(Unknown Source)

      [Server:server-three]     at org.apache.deltaspike.jsf.impl.scope.window.DefaultClientWindow.getWindowId(DefaultClientWindow.java:105)

      [Server:server-three]     at org.apache.deltaspike.jsf.impl.scope.window.DefaultClientWindow$Proxy$_$$_WeldClientProxy.getWindowId(Unknown Source)

      [Server:server-three]     at org.apache.deltaspike.jsf.impl.listener.request.DeltaSpikeLifecycleWrapper.execute(DeltaSpikeLifecycleWrapper.java:67)

      [Server:server-three]     at javax.faces.webapp.FacesServlet.service(FacesServlet.java:646)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:86)

      [Server:server-three]     at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)

      [Server:server-three]     at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

      [Server:server-three]     at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

      [Server:server-three]     at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:257)

      [Server:server-three]     at io.undertow.servlet.handlers.ServletInitialHandler.dispatchToPath(ServletInitialHandler.java:200)

      [Server:server-three]     at io.undertow.servlet.spec.RequestDispatcherImpl.error(RequestDispatcherImpl.java:458)

      [Server:server-three]     ... 10 more

      [Server:server-three]

        • 1. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
          humanbeing

          Added some debugging:

           

          Server:server-three] 10:51:18,014 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Auto detecting atmosphere handlers /WEB-INF/classes/

          [Server:server-three] 10:51:18,070 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Auto detecting WebSocketHandler in /WEB-INF/classes/

          [Server:server-three] 10:51:18,103 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Installed WebSocketProtocol org.atmosphere.websocket.protocol.SimpleHttpProtocol

          [Server:server-three] 10:51:18,108 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Atmosphere is using async support: org.atmosphere.container.Servlet30CometSupport running under container: WildFly 8.2.0.Final - 1.1.0.Final using javax.servlet/3.0

          [Server:server-three] 10:51:18,111 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Installed Default AtmosphereInterceptor [Android Interceptor Support, SSE Interceptor Support, JSONP Interceptor Support, Atmosphere JavaScript Protocol, Browser disconnection detection]. Set org.atmosphere.cpr.AtmosphereInterceptor.disableDefaults in your xml to disable them.

          [Server:server-three] 10:51:18,112 WARN  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) No BroadcasterCache configured. Broadcasted message between client reconnection will be LOST. It is recommended to configure the org.atmosphere.cache.UUIDBroadcasterCache

          [Server:server-three] 10:51:18,112 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Shared ExecutorService supported: true

          [Server:server-three] 10:51:18,112 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) HttpSession supported: false

          [Server:server-three] 10:51:18,112 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Using BroadcasterFactory: org.atmosphere.cpr.DefaultBroadcasterFactory

          [Server:server-three] 10:51:18,112 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Using WebSocketProcessor: org.atmosphere.websocket.DefaultWebSocketProcessor

          [Server:server-three] 10:51:18,112 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Using Broadcaster: org.atmosphere.cpr.DefaultBroadcaster

          [Server:server-three] 10:51:18,113 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Atmosphere Framework 1.0.10 started.

          [Server:server-three] 10:51:18,141 INFO  [org.atmosphere.cpr.AtmosphereFramework] (default task-75) Installed AtmosphereHandler org.atmosphere.handler.ReflectorServletProcessor mapped to context-path: /__richfaces_push

          [Server:server-three] 10:51:18,141 INFO  [org.atmosphere.handler.ReflectorServletProcessor] (default task-75) Installing Servlet null

          [Server:server-three] 10:51:18,142 INFO  [org.atmosphere.handler.ReflectorServletProcessor] (default task-75) Installing Filter PushHandlerFilter

          [Server:server-three] 10:51:18,149 DEBUG [org.atmosphere.cpr.DefaultBroadcaster] (default task-75) Changing broadcaster scope for DefaultBroadcastera3fadb05-35f5-43d9-b9a2-11f2b9f2f5bb. This broadcaster will be destroyed.

          [Server:server-three] 10:51:18,531 DEBUG [org.jboss.modcluster] (UndertowEventHandlerAdapter - 1) MODCLUSTER000009: Sending STATUS for default-server

          [Server:server-three] 10:51:18,575 DEBUG [io.undertow.request] (default I/O-9) Received CPING, sending CPONG

          [Server:server-three] 10:51:27,724 DEBUG [io.undertow.request] (default I/O-8) Received CPING, sending CPONG

          [Server:server-three] 10:51:28,577 DEBUG [org.jboss.modcluster] (UndertowEventHandlerAdapter - 1) MODCLUSTER000009: Sending STATUS for default-server

          [Server:server-three] 10:51:28,623 DEBUG [io.undertow.request] (default I/O-8) Received CPING, sending CPONG

          [Server:server-three] 10:51:32,729 DEBUG [io.undertow.request] (default I/O-8) Received CPING, sending CPONG

          [Server:server-three] 10:51:32,989 DEBUG [org.infinispan.util.concurrent.locks.LockManagerImpl] (default task-76) Failed to acquire lock vfXQjkDdf_7WJDcFYObl7Vu6, owner is GlobalTransaction:<master:server-three/web>:949:local

          [Server:server-three] 10:51:32,990 DEBUG [org.infinispan.util.concurrent.locks.LockManagerImpl] (default task-76) This transaction (GlobalTransaction:<master:server-three/web>:951:local) already owned locks []

          [Server:server-three] 10:51:32,990 ERROR [org.infinispan.interceptors.InvocationContextInterceptor] (default task-76) ISPN000136: Execution error: org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [15 seconds] on key [vfXQjkDdf_7WJDcFYObl7Vu6] for requestor [GlobalTransaction:<master:server-three/web>:951:local]! Lock held by [GlobalTransaction:<master:server-three/web>:949:local]

          • 2. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
            pferraro

            Does your application make concurrent requests for the same web session?  I'm trying to better understand your use case.

            • 3. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
              humanbeing

              Hi Paul,

               

              Thanks for getting back.  I'll explain my use case.  First, all users need to login to the application.  This is done via picketlink and their are active directory permissions are validated before they can see any links to continue.  Following this, typically users click to view data in one of the message queues. This is where the app breaks after 15 seconds and I suspect that it's because there are additional permissions checks as well as requests to retrieve message data from the database. So to answer your question, yes I believe there are concurrent requests for the same web session. I hope I explained this well enough so please let me know.

              • 4. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                humanbeing

                domain.xml (full-ha profile)

                 

                This XML file does not appear to have any style information associated with it. The document tree is shown below.

                <domain xmlns="urn:jboss:domain:2.2">

                <extensions>

                <extension module="org.jboss.as.clustering.infinispan"/>

                <extension module="org.jboss.as.clustering.jgroups"/>

                <extension module="org.jboss.as.connector"/>

                <extension module="org.jboss.as.ee"/>

                <extension module="org.jboss.as.ejb3"/>

                <extension module="org.jboss.as.jacorb"/>

                <extension module="org.jboss.as.jaxrs"/>

                <extension module="org.jboss.as.jdr"/>

                <extension module="org.jboss.as.jmx"/>

                <extension module="org.jboss.as.jpa"/>

                <extension module="org.jboss.as.jsf"/>

                <extension module="org.jboss.as.jsr77"/>

                <extension module="org.jboss.as.logging"/>

                <extension module="org.jboss.as.mail"/>

                <extension module="org.jboss.as.messaging"/>

                <extension module="org.jboss.as.modcluster"/>

                <extension module="org.jboss.as.naming"/>

                <extension module="org.jboss.as.pojo"/>

                <extension module="org.jboss.as.remoting"/>

                <extension module="org.jboss.as.sar"/>

                <extension module="org.jboss.as.security"/>

                <extension module="org.jboss.as.transactions"/>

                <extension module="org.jboss.as.webservices"/>

                <extension module="org.jboss.as.weld"/>

                <extension module="org.wildfly.extension.batch"/>

                <extension module="org.wildfly.extension.io"/>

                <extension module="org.wildfly.extension.undertow"/>

                </extensions>

                <system-properties>

                <property name="java.net.preferIPv4Stack" value="true"/>

                </system-properties>

                <management>

                <access-control provider="simple">

                <role-mapping>

                <role name="SuperUser">

                <include>

                <user name="$local"/>

                </include>

                </role>

                </role-mapping>

                </access-control>

                </management>

                <profiles>

                <profile name="default">

                <subsystem xmlns="urn:jboss:domain:logging:2.0">

                <console-handler name="CONSOLE">

                <level name="INFO"/>

                <formatter>

                <named-formatter name="COLOR-PATTERN"/>

                </formatter>

                </console-handler>

                <periodic-rotating-file-handler name="FILE" autoflush="true">

                <formatter>

                <named-formatter name="PATTERN"/>

                </formatter>

                <file relative-to="jboss.server.log.dir" path="server.log"/>

                <suffix value=".yyyy-MM-dd"/>

                <append value="true"/>

                </periodic-rotating-file-handler>

                <logger category="com.arjuna">

                <level name="WARN"/>

                </logger>

                <logger category="org.apache.tomcat.util.modeler">

                <level name="WARN"/>

                </logger>

                <logger category="org.jboss.as.config">

                <level name="DEBUG"/>

                </logger>

                <logger category="sun.rmi">

                <level name="WARN"/>

                </logger>

                <logger category="jacorb">

                <level name="WARN"/>

                </logger>

                <logger category="jacorb.config">

                <level name="ERROR"/>

                </logger>

                <root-logger>

                <level name="INFO"/>

                <handlers>

                <handler name="CONSOLE"/>

                <handler name="FILE"/>

                </handlers>

                </root-logger>

                <formatter name="PATTERN">

                <pattern-formatter pattern="%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p [%c] (%t) %s%E%n"/>

                </formatter>

                <formatter name="COLOR-PATTERN">

                <pattern-formatter pattern="%K{level}%d{HH:mm:ss,SSS} %-5p [%c] (%t) %s%E%n"/>

                </formatter>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:batch:1.0">

                <job-repository>

                <in-memory/>

                </job-repository>

                <thread-pool>

                <max-threads count="10"/>

                <keepalive-time time="30" unit="seconds"/>

                </thread-pool>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:datasources:2.0">

                <datasources>

                <datasource jndi-name="java:jboss/datasources/ExampleDS" pool-name="ExampleDS" enabled="true" use-java-context="true">

                <connection-url>

                jdbc:h2:mem:test;DB_CLOSE_DELAY=-1;DB_CLOSE_ON_EXIT=FALSE

                </connection-url>

                <driver>h2</driver>

                <security>

                <user-name>sa</user-name>

                <password>sa</password>

                </security>

                </datasource>

                <drivers>

                <driver name="h2" module="com.h2database.h2">

                <xa-datasource-class>org.h2.jdbcx.JdbcDataSource</xa-datasource-class>

                </driver>

                </drivers>

                </datasources>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:ee:2.0">

                <spec-descriptor-property-replacement>false</spec-descriptor-property-replacement>

                <concurrent>

                <context-services>

                <context-service name="default" jndi-name="java:jboss/ee/concurrency/context/default" use-transaction-setup-provider="true"/>

                </context-services>

                <managed-thread-factories>

                <managed-thread-factory name="default" jndi-name="java:jboss/ee/concurrency/factory/default" context-service="default"/>

                </managed-thread-factories>

                <managed-executor-services>

                <managed-executor-service name="default" jndi-name="java:jboss/ee/concurrency/executor/default" context-service="default" hung-task-threshold="60000" core-threads="5" max-threads="25" keepalive-time="5000"/>

                </managed-executor-services>

                <managed-scheduled-executor-services>

                <managed-scheduled-executor-service name="default" jndi-name="java:jboss/ee/concurrency/scheduler/default" context-service="default" hung-task-threshold="60000" core-threads="2" keepalive-time="3000"/>

                </managed-scheduled-executor-services>

                </concurrent>

                <default-bindings context-service="java:jboss/ee/concurrency/context/default" datasource="java:jboss/datasources/ExampleDS" jms-connection-factory="java:jboss/DefaultJMSConnectionFactory" managed-executor-service="java:jboss/ee/concurrency/executor/default" managed-scheduled-executor-service="java:jboss/ee/concurrency/scheduler/default" managed-thread-factory="java:jboss/ee/concurrency/factory/default"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:ejb3:2.0">

                <session-bean>

                <stateful default-access-timeout="5000" cache-ref="simple" passivation-disabled-cache-ref="simple"/>

                <singleton default-access-timeout="5000"/>

                </session-bean>

                <pools>

                <bean-instance-pools>

                <strict-max-pool name="slsb-strict-max-pool" max-pool-size="20" instance-acquisition-timeout="5" instance-acquisition-timeout-unit="MINUTES"/>

                <strict-max-pool name="mdb-strict-max-pool" max-pool-size="20" instance-acquisition-timeout="5" instance-acquisition-timeout-unit="MINUTES"/>

                </bean-instance-pools>

                </pools>

                <caches>

                <cache name="simple"/>

                <cache name="distributable" passivation-store-ref="infinispan" aliases="passivating clustered"/>

                </caches>

                <passivation-stores>

                <passivation-store name="infinispan" cache-container="ejb" max-size="10000"/>

                </passivation-stores>

                <async thread-pool-name="default"/>

                <timer-service thread-pool-name="default" default-data-store="default-file-store">

                <data-stores>

                <file-data-store name="default-file-store" path="timer-service-data" relative-to="jboss.server.data.dir"/>

                </data-stores>

                </timer-service>

                <remote connector-ref="http-remoting-connector" thread-pool-name="default"/>

                <thread-pools>

                <thread-pool name="default">

                <max-threads count="10"/>

                <keepalive-time time="100" unit="milliseconds"/>

                </thread-pool>

                </thread-pools>

                <default-security-domain value="other"/>

                <default-missing-method-permissions-deny-access value="true"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:io:1.1">

                <worker name="default"/>

                <buffer-pool name="default"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:infinispan:2.0">

                <cache-container name="web" default-cache="passivation" module="org.wildfly.clustering.web.infinispan">

                <local-cache name="passivation" batching="true">

                <file-store passivation="true" purge="false"/>

                </local-cache>

                <local-cache name="persistent" batching="true">

                <file-store passivation="false" purge="false"/>

                </local-cache>

                </cache-container>

                <cache-container name="ejb" default-cache="passivation" module="org.wildfly.clustering.ejb.infinispan" aliases="sfsb">

                <local-cache name="passivation" batching="true">

                <file-store passivation="true" purge="false"/>

                </local-cache>

                <local-cache name="persistent" batching="true">

                <file-store passivation="false" purge="false"/>

                </local-cache>

                </cache-container>

                <cache-container name="hibernate" default-cache="local-query" module="org.hibernate">

                <local-cache name="entity">

                <transaction mode="NON_XA"/>

                <eviction strategy="LRU" max-entries="10000"/>

                <expiration max-idle="100000"/>

                </local-cache>

                <local-cache name="local-query">

                <transaction mode="NONE"/>

                <eviction strategy="LRU" max-entries="10000"/>

                <expiration max-idle="100000"/>

                </local-cache>

                <local-cache name="timestamps">

                <transaction mode="NONE"/>

                <eviction strategy="NONE"/>

                </local-cache>

                </cache-container>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jaxrs:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jca:2.0">

                <archive-validation enabled="true" fail-on-error="true" fail-on-warn="false"/>

                <bean-validation enabled="true"/>

                <default-workmanager>

                <short-running-threads>

                <core-threads count="50"/>

                <queue-length count="50"/>

                <max-threads count="50"/>

                <keepalive-time time="10" unit="seconds"/>

                </short-running-threads>

                <long-running-threads>

                <core-threads count="50"/>

                <queue-length count="50"/>

                <max-threads count="50"/>

                <keepalive-time time="10" unit="seconds"/>

                </long-running-threads>

                </default-workmanager>

                <cached-connection-manager/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jdr:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jmx:1.3">

                <expose-resolved-model/>

                <expose-expression-model/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jpa:1.1">

                <jpa default-datasource="" default-extended-persistence-inheritance="DEEP"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jsf:1.0"/>

                <subsystem xmlns="urn:jboss:domain:mail:2.0">

                <mail-session name="default" jndi-name="java:jboss/mail/Default">

                <smtp-server outbound-socket-binding-ref="mail-smtp"/>

                </mail-session>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:naming:2.0">

                <remote-naming/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:pojo:1.0"/>

                <subsystem xmlns="urn:jboss:domain:remoting:2.0">

                <endpoint worker="default"/>

                <http-connector name="http-remoting-connector" connector-ref="default" security-realm="ApplicationRealm"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:resource-adapters:2.0"/>

                <subsystem xmlns="urn:jboss:domain:sar:1.0"/>

                <subsystem xmlns="urn:jboss:domain:security:1.2">

                <security-domains>

                <security-domain name="other" cache-type="default">

                <authentication>

                <login-module code="Remoting" flag="optional">

                <module-option name="password-stacking" value="useFirstPass"/>

                </login-module>

                <login-module code="RealmDirect" flag="required">

                <module-option name="password-stacking" value="useFirstPass"/>

                </login-module>

                </authentication>

                </security-domain>

                <security-domain name="jboss-web-policy" cache-type="default">

                <authorization>

                <policy-module code="Delegating" flag="required"/>

                </authorization>

                </security-domain>

                <security-domain name="jboss-ejb-policy" cache-type="default">

                <authorization>

                <policy-module code="Delegating" flag="required"/>

                </authorization>

                </security-domain>

                </security-domains>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:transactions:2.0">

                <core-environment>

                <process-id>

                <uuid/>

                </process-id>

                </core-environment>

                <recovery-environment socket-binding="txn-recovery-environment" status-socket-binding="txn-status-manager"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:undertow:1.2">

                <buffer-cache name="default"/>

                <server name="default-server">

                <http-listener name="default" socket-binding="http"/>

                <host name="default-host" alias="localhost">

                <location name="/" handler="welcome-content"/>

                <filter-ref name="server-header"/>

                <filter-ref name="x-powered-by-header"/>

                </host>

                </server>

                <servlet-container name="default">

                <jsp-config/>

                <websockets/>

                </servlet-container>

                <handlers>

                <file name="welcome-content" path="${jboss.home.dir}/welcome-content"/>

                </handlers>

                <filters>

                <response-header name="server-header" header-name="Server" header-value="WildFly/8"/>

                <response-header name="x-powered-by-header" header-name="X-Powered-By" header-value="Undertow/1"/>

                </filters>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:webservices:1.2">

                <wsdl-host>${jboss.bind.address:127.0.0.1}</wsdl-host>

                <endpoint-config name="Standard-Endpoint-Config"/>

                <endpoint-config name="Recording-Endpoint-Config">

                <pre-handler-chain name="recording-handlers" protocol-bindings="##SOAP11_HTTP ##SOAP11_HTTP_MTOM ##SOAP12_HTTP ##SOAP12_HTTP_MTOM">

                <handler name="RecordingHandler" class="org.jboss.ws.common.invocation.RecordingServerHandler"/>

                </pre-handler-chain>

                </endpoint-config>

                <client-config name="Standard-Client-Config"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:weld:2.0"/>

                </profile>

                <profile name="ha">

                <subsystem xmlns="urn:jboss:domain:logging:2.0">

                <console-handler name="CONSOLE">

                <level name="INFO"/>

                <formatter>

                <named-formatter name="COLOR-PATTERN"/>

                </formatter>

                </console-handler>

                <periodic-rotating-file-handler name="FILE" autoflush="true">

                <formatter>

                <named-formatter name="PATTERN"/>

                </formatter>

                <file relative-to="jboss.server.log.dir" path="server.log"/>

                <suffix value=".yyyy-MM-dd"/>

                <append value="true"/>

                </periodic-rotating-file-handler>

                <logger category="com.arjuna">

                <level name="WARN"/>

                </logger>

                <logger category="org.apache.tomcat.util.modeler">

                <level name="WARN"/>

                </logger>

                <logger category="org.jboss.as.config">

                <level name="DEBUG"/>

                </logger>

                <logger category="sun.rmi">

                <level name="WARN"/>

                </logger>

                <logger category="jacorb">

                <level name="WARN"/>

                </logger>

                <logger category="jacorb.config">

                <level name="ERROR"/>

                </logger>

                <root-logger>

                <level name="INFO"/>

                <handlers>

                <handler name="CONSOLE"/>

                <handler name="FILE"/>

                </handlers>

                </root-logger>

                <formatter name="PATTERN">

                <pattern-formatter pattern="%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p [%c] (%t) %s%E%n"/>

                </formatter>

                <formatter name="COLOR-PATTERN">

                <pattern-formatter pattern="%K{level}%d{HH:mm:ss,SSS} %-5p [%c] (%t) %s%E%n"/>

                </formatter>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:batch:1.0">

                <job-repository>

                <in-memory/>

                </job-repository>

                <thread-pool>

                <max-threads count="10"/>

                <keepalive-time time="30" unit="seconds"/>

                </thread-pool>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:datasources:2.0">

                <datasources>

                <datasource jndi-name="java:jboss/datasources/ExampleDS" pool-name="ExampleDS" enabled="true" use-java-context="true">

                <connection-url>

                jdbc:h2:mem:test;DB_CLOSE_DELAY=-1;DB_CLOSE_ON_EXIT=FALSE

                </connection-url>

                <driver>h2</driver>

                <security>

                <user-name>sa</user-name>

                <password>sa</password>

                </security>

                </datasource>

                <drivers>

                <driver name="h2" module="com.h2database.h2">

                <xa-datasource-class>org.h2.jdbcx.JdbcDataSource</xa-datasource-class>

                </driver>

                </drivers>

                </datasources>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:ee:2.0">

                <spec-descriptor-property-replacement>false</spec-descriptor-property-replacement>

                <concurrent>

                <context-services>

                <context-service name="default" jndi-name="java:jboss/ee/concurrency/context/default" use-transaction-setup-provider="true"/>

                </context-services>

                <managed-thread-factories>

                <managed-thread-factory name="default" jndi-name="java:jboss/ee/concurrency/factory/default" context-service="default"/>

                </managed-thread-factories>

                <managed-executor-services>

                <managed-executor-service name="default" jndi-name="java:jboss/ee/concurrency/executor/default" context-service="default" hung-task-threshold="60000" core-threads="5" max-threads="25" keepalive-time="5000"/>

                </managed-executor-services>

                <managed-scheduled-executor-services>

                <managed-scheduled-executor-service name="default" jndi-name="java:jboss/ee/concurrency/scheduler/default" context-service="default" hung-task-threshold="60000" core-threads="2" keepalive-time="3000"/>

                </managed-scheduled-executor-services>

                </concurrent>

                <default-bindings context-service="java:jboss/ee/concurrency/context/default" datasource="java:jboss/datasources/ExampleDS" jms-connection-factory="java:jboss/DefaultJMSConnectionFactory" managed-executor-service="java:jboss/ee/concurrency/executor/default" managed-scheduled-executor-service="java:jboss/ee/concurrency/scheduler/default" managed-thread-factory="java:jboss/ee/concurrency/factory/default"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:ejb3:2.0">

                <session-bean>

                <stateful default-access-timeout="5000" cache-ref="distributable" passivation-disabled-cache-ref="simple"/>

                <singleton default-access-timeout="5000"/>

                </session-bean>

                <pools>

                <bean-instance-pools>

                <strict-max-pool name="slsb-strict-max-pool" max-pool-size="20" instance-acquisition-timeout="5" instance-acquisition-timeout-unit="MINUTES"/>

                <strict-max-pool name="mdb-strict-max-pool" max-pool-size="20" instance-acquisition-timeout="5" instance-acquisition-timeout-unit="MINUTES"/>

                </bean-instance-pools>

                </pools>

                <caches>

                <cache name="simple"/>

                <cache name="distributable" passivation-store-ref="infinispan" aliases="passivating clustered"/>

                </caches>

                <passivation-stores>

                <passivation-store name="infinispan" cache-container="ejb" max-size="10000"/>

                </passivation-stores>

                <async thread-pool-name="default"/>

                <timer-service thread-pool-name="default" default-data-store="default-file-store">

                <data-stores>

                <file-data-store name="default-file-store" path="timer-service-data" relative-to="jboss.server.data.dir"/>

                </data-stores>

                </timer-service>

                <remote connector-ref="http-remoting-connector" thread-pool-name="default"/>

                <thread-pools>

                <thread-pool name="default">

                <max-threads count="10"/>

                <keepalive-time time="100" unit="milliseconds"/>

                </thread-pool>

                </thread-pools>

                <default-security-domain value="other"/>

                <default-missing-method-permissions-deny-access value="true"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:io:1.1">

                <worker name="default"/>

                <buffer-pool name="default"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:infinispan:2.0">

                <cache-container name="server" default-cache="default" module="org.wildfly.clustering.server" aliases="singleton cluster">

                <transport lock-timeout="60000"/>

                <replicated-cache name="default" batching="true" mode="SYNC">

                <locking isolation="REPEATABLE_READ"/>

                </replicated-cache>

                </cache-container>

                <cache-container name="web" default-cache="dist" module="org.wildfly.clustering.web.infinispan">

                <transport lock-timeout="60000"/>

                <distributed-cache name="dist" batching="true" mode="ASYNC" owners="2" l1-lifespan="0">

                <file-store/>

                </distributed-cache>

                </cache-container>

                <cache-container name="ejb" default-cache="dist" module="org.wildfly.clustering.ejb.infinispan" aliases="sfsb">

                <transport lock-timeout="60000"/>

                <distributed-cache name="dist" batching="true" mode="ASYNC" owners="2" l1-lifespan="0">

                <file-store/>

                </distributed-cache>

                </cache-container>

                <cache-container name="hibernate" default-cache="local-query" module="org.hibernate">

                <transport lock-timeout="60000"/>

                <local-cache name="local-query">

                <transaction mode="NONE"/>

                <eviction strategy="LRU" max-entries="10000"/>

                <expiration max-idle="100000"/>

                </local-cache>

                <invalidation-cache name="entity" mode="SYNC">

                <transaction mode="NON_XA"/>

                <eviction strategy="LRU" max-entries="10000"/>

                <expiration max-idle="100000"/>

                </invalidation-cache>

                <replicated-cache name="timestamps" mode="ASYNC">

                <transaction mode="NONE"/>

                <eviction strategy="NONE"/>

                </replicated-cache>

                </cache-container>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jaxrs:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jca:2.0">

                <archive-validation enabled="true" fail-on-error="true" fail-on-warn="false"/>

                <bean-validation enabled="true"/>

                <default-workmanager>

                <short-running-threads>

                <core-threads count="50"/>

                <queue-length count="50"/>

                <max-threads count="50"/>

                <keepalive-time time="10" unit="seconds"/>

                </short-running-threads>

                <long-running-threads>

                <core-threads count="50"/>

                <queue-length count="50"/>

                <max-threads count="50"/>

                <keepalive-time time="10" unit="seconds"/>

                </long-running-threads>

                </default-workmanager>

                <cached-connection-manager/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jdr:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jgroups:2.0" default-stack="udp">

                <stack name="udp">

                <transport type="UDP" socket-binding="jgroups-udp"/>

                <protocol type="PING"/>

                <protocol type="MERGE3"/>

                <protocol type="FD_SOCK" socket-binding="jgroups-udp-fd"/>

                <protocol type="FD_ALL"/>

                <protocol type="VERIFY_SUSPECT"/>

                <protocol type="pbcast.NAKACK2"/>

                <protocol type="UNICAST3"/>

                <protocol type="pbcast.STABLE"/>

                <protocol type="pbcast.GMS"/>

                <protocol type="UFC"/>

                <protocol type="MFC"/>

                <protocol type="FRAG2"/>

                <protocol type="RSVP"/>

                </stack>

                <stack name="tcp">

                <transport type="TCP" socket-binding="jgroups-tcp"/>

                <protocol type="MPING" socket-binding="jgroups-mping"/>

                <protocol type="MERGE2"/>

                <protocol type="FD_SOCK" socket-binding="jgroups-tcp-fd"/>

                <protocol type="FD"/>

                <protocol type="VERIFY_SUSPECT"/>

                <protocol type="pbcast.NAKACK2"/>

                <protocol type="UNICAST3"/>

                <protocol type="pbcast.STABLE"/>

                <protocol type="pbcast.GMS"/>

                <protocol type="MFC"/>

                <protocol type="FRAG2"/>

                <protocol type="RSVP"/>

                </stack>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jmx:1.3">

                <expose-resolved-model/>

                <expose-expression-model/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jpa:1.1">

                <jpa default-datasource="" default-extended-persistence-inheritance="DEEP"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jsf:1.0"/>

                <subsystem xmlns="urn:jboss:domain:mail:2.0">

                <mail-session name="default" jndi-name="java:jboss/mail/Default">

                <smtp-server outbound-socket-binding-ref="mail-smtp"/>

                </mail-session>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:modcluster:1.2">

                <mod-cluster-config advertise-socket="modcluster" connector="ajp">

                <dynamic-load-provider>

                <load-metric type="cpu"/>

                </dynamic-load-provider>

                </mod-cluster-config>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:naming:2.0">

                <remote-naming/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:pojo:1.0"/>

                <subsystem xmlns="urn:jboss:domain:remoting:2.0">

                <endpoint worker="default"/>

                <http-connector name="http-remoting-connector" connector-ref="default" security-realm="ApplicationRealm"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:resource-adapters:2.0"/>

                <subsystem xmlns="urn:jboss:domain:sar:1.0"/>

                <subsystem xmlns="urn:jboss:domain:security:1.2">

                <security-domains>

                <security-domain name="other" cache-type="default">

                <authentication>

                <login-module code="Remoting" flag="optional">

                <module-option name="password-stacking" value="useFirstPass"/>

                </login-module>

                <login-module code="RealmDirect" flag="required">

                <module-option name="password-stacking" value="useFirstPass"/>

                </login-module>

                </authentication>

                </security-domain>

                <security-domain name="jboss-web-policy" cache-type="default">

                <authorization>

                <policy-module code="Delegating" flag="required"/>

                </authorization>

                </security-domain>

                <security-domain name="jboss-ejb-policy" cache-type="default">

                <authorization>

                <policy-module code="Delegating" flag="required"/>

                </authorization>

                </security-domain>

                </security-domains>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:transactions:2.0">

                <core-environment>

                <process-id>

                <uuid/>

                </process-id>

                </core-environment>

                <recovery-environment socket-binding="txn-recovery-environment" status-socket-binding="txn-status-manager"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:undertow:1.2">

                <buffer-cache name="default"/>

                <server name="default-server">

                <ajp-listener name="ajp" socket-binding="ajp"/>

                <http-listener name="default" socket-binding="http"/>

                <host name="default-host" alias="localhost">

                <location name="/" handler="welcome-content"/>

                <filter-ref name="server-header"/>

                <filter-ref name="x-powered-by-header"/>

                </host>

                </server>

                <servlet-container name="default">

                <jsp-config/>

                <websockets/>

                </servlet-container>

                <handlers>

                <file name="welcome-content" path="${jboss.home.dir}/welcome-content"/>

                </handlers>

                <filters>

                <response-header name="server-header" header-name="Server" header-value="WildFly/8"/>

                <response-header name="x-powered-by-header" header-name="X-Powered-By" header-value="Undertow/1"/>

                </filters>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:webservices:1.2">

                <wsdl-host>${jboss.bind.address:127.0.0.1}</wsdl-host>

                <endpoint-config name="Standard-Endpoint-Config"/>

                <endpoint-config name="Recording-Endpoint-Config">

                <pre-handler-chain name="recording-handlers" protocol-bindings="##SOAP11_HTTP ##SOAP11_HTTP_MTOM ##SOAP12_HTTP ##SOAP12_HTTP_MTOM">

                <handler name="RecordingHandler" class="org.jboss.ws.common.invocation.RecordingServerHandler"/>

                </pre-handler-chain>

                </endpoint-config>

                <client-config name="Standard-Client-Config"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:weld:2.0"/>

                </profile>

                <profile name="full">

                <subsystem xmlns="urn:jboss:domain:logging:2.0">

                <console-handler name="CONSOLE">

                <level name="INFO"/>

                <formatter>

                <named-formatter name="COLOR-PATTERN"/>

                </formatter>

                </console-handler>

                <periodic-rotating-file-handler name="FILE" autoflush="true">

                <formatter>

                <named-formatter name="PATTERN"/>

                </formatter>

                <file relative-to="jboss.server.log.dir" path="server.log"/>

                <suffix value=".yyyy-MM-dd"/>

                <append value="true"/>

                </periodic-rotating-file-handler>

                <logger category="com.arjuna">

                <level name="WARN"/>

                </logger>

                <logger category="org.apache.tomcat.util.modeler">

                <level name="WARN"/>

                </logger>

                <logger category="org.jboss.as.config">

                <level name="DEBUG"/>

                </logger>

                <logger category="sun.rmi">

                <level name="WARN"/>

                </logger>

                <logger category="jacorb">

                <level name="WARN"/>

                </logger>

                <logger category="jacorb.config">

                <level name="ERROR"/>

                </logger>

                <root-logger>

                <level name="INFO"/>

                <handlers>

                <handler name="CONSOLE"/>

                <handler name="FILE"/>

                </handlers>

                </root-logger>

                <formatter name="PATTERN">

                <pattern-formatter pattern="%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p [%c] (%t) %s%E%n"/>

                </formatter>

                <formatter name="COLOR-PATTERN">

                <pattern-formatter pattern="%K{level}%d{HH:mm:ss,SSS} %-5p [%c] (%t) %s%E%n"/>

                </formatter>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:batch:1.0">

                <job-repository>

                <in-memory/>

                </job-repository>

                <thread-pool>

                <max-threads count="10"/>

                <keepalive-time time="30" unit="seconds"/>

                </thread-pool>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:datasources:2.0">

                <datasources>

                <datasource jndi-name="java:jboss/datasources/ExampleDS" pool-name="ExampleDS" enabled="true" use-java-context="true">

                <connection-url>

                jdbc:h2:mem:test;DB_CLOSE_DELAY=-1;DB_CLOSE_ON_EXIT=FALSE

                </connection-url>

                <driver>h2</driver>

                <security>

                <user-name>sa</user-name>

                <password>sa</password>

                </security>

                </datasource>

                <drivers>

                <driver name="h2" module="com.h2database.h2">

                <xa-datasource-class>org.h2.jdbcx.JdbcDataSource</xa-datasource-class>

                </driver>

                </drivers>

                </datasources>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:ee:2.0">

                <spec-descriptor-property-replacement>false</spec-descriptor-property-replacement>

                <concurrent>

                <context-services>

                <context-service name="default" jndi-name="java:jboss/ee/concurrency/context/default" use-transaction-setup-provider="true"/>

                </context-services>

                <managed-thread-factories>

                <managed-thread-factory name="default" jndi-name="java:jboss/ee/concurrency/factory/default" context-service="default"/>

                </managed-thread-factories>

                <managed-executor-services>

                <managed-executor-service name="default" jndi-name="java:jboss/ee/concurrency/executor/default" context-service="default" hung-task-threshold="60000" core-threads="5" max-threads="25" keepalive-time="5000"/>

                </managed-executor-services>

                <managed-scheduled-executor-services>

                <managed-scheduled-executor-service name="default" jndi-name="java:jboss/ee/concurrency/scheduler/default" context-service="default" hung-task-threshold="60000" core-threads="2" keepalive-time="3000"/>

                </managed-scheduled-executor-services>

                </concurrent>

                <default-bindings context-service="java:jboss/ee/concurrency/context/default" datasource="java:jboss/datasources/ExampleDS" jms-connection-factory="java:jboss/DefaultJMSConnectionFactory" managed-executor-service="java:jboss/ee/concurrency/executor/default" managed-scheduled-executor-service="java:jboss/ee/concurrency/scheduler/default" managed-thread-factory="java:jboss/ee/concurrency/factory/default"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:ejb3:2.0">

                <session-bean>

                <stateful default-access-timeout="5000" cache-ref="simple" passivation-disabled-cache-ref="simple"/>

                <singleton default-access-timeout="5000"/>

                </session-bean>

                <mdb>

                <resource-adapter-ref resource-adapter-name="${ejb.resource-adapter-name:hornetq-ra.rar}"/>

                <bean-instance-pool-ref pool-name="mdb-strict-max-pool"/>

                </mdb>

                <pools>

                <bean-instance-pools>

                <strict-max-pool name="slsb-strict-max-pool" max-pool-size="20" instance-acquisition-timeout="5" instance-acquisition-timeout-unit="MINUTES"/>

                <strict-max-pool name="mdb-strict-max-pool" max-pool-size="20" instance-acquisition-timeout="5" instance-acquisition-timeout-unit="MINUTES"/>

                </bean-instance-pools>

                </pools>

                <caches>

                <cache name="simple"/>

                <cache name="distributable" passivation-store-ref="infinispan" aliases="passivating clustered"/>

                </caches>

                <passivation-stores>

                <passivation-store name="infinispan" cache-container="ejb" max-size="10000"/>

                </passivation-stores>

                <async thread-pool-name="default"/>

                <timer-service thread-pool-name="default" default-data-store="default-file-store">

                <data-stores>

                <file-data-store name="default-file-store" path="timer-service-data" relative-to="jboss.server.data.dir"/>

                </data-stores>

                </timer-service>

                <remote connector-ref="http-remoting-connector" thread-pool-name="default"/>

                <thread-pools>

                <thread-pool name="default">

                <max-threads count="10"/>

                <keepalive-time time="100" unit="milliseconds"/>

                </thread-pool>

                </thread-pools>

                <iiop enable-by-default="false" use-qualified-name="false"/>

                <default-security-domain value="other"/>

                <default-missing-method-permissions-deny-access value="true"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:io:1.1">

                <worker name="default"/>

                <buffer-pool name="default"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:infinispan:2.0">

                <cache-container name="web" default-cache="passivation" module="org.wildfly.clustering.web.infinispan">

                <local-cache name="passivation" batching="true">

                <file-store passivation="true" purge="false"/>

                </local-cache>

                <local-cache name="persistent" batching="true">

                <file-store passivation="false" purge="false"/>

                </local-cache>

                </cache-container>

                <cache-container name="ejb" default-cache="passivation" module="org.wildfly.clustering.ejb.infinispan" aliases="sfsb">

                <local-cache name="passivation" batching="true">

                <file-store passivation="true" purge="false"/>

                </local-cache>

                <local-cache name="persistent" batching="true">

                <file-store passivation="false" purge="false"/>

                </local-cache>

                </cache-container>

                <cache-container name="hibernate" default-cache="local-query" module="org.hibernate">

                <local-cache name="entity">

                <transaction mode="NON_XA"/>

                <eviction strategy="LRU" max-entries="10000"/>

                <expiration max-idle="100000"/>

                </local-cache>

                <local-cache name="local-query">

                <transaction mode="NONE"/>

                <eviction strategy="LRU" max-entries="10000"/>

                <expiration max-idle="100000"/>

                </local-cache>

                <local-cache name="timestamps">

                <transaction mode="NONE"/>

                <eviction strategy="NONE"/>

                </local-cache>

                </cache-container>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jacorb:1.3">

                <orb socket-binding="jacorb" ssl-socket-binding="jacorb-ssl">

                <initializers security="identity" transactions="spec"/>

                </orb>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jaxrs:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jca:2.0">

                <archive-validation enabled="true" fail-on-error="true" fail-on-warn="false"/>

                <bean-validation enabled="true"/>

                <default-workmanager>

                <short-running-threads>

                <core-threads count="50"/>

                <queue-length count="50"/>

                <max-threads count="50"/>

                <keepalive-time time="10" unit="seconds"/>

                </short-running-threads>

                <long-running-threads>

                <core-threads count="50"/>

                <queue-length count="50"/>

                <max-threads count="50"/>

                <keepalive-time time="10" unit="seconds"/>

                </long-running-threads>

                </default-workmanager>

                <cached-connection-manager/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jdr:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jmx:1.3">

                <expose-resolved-model/>

                <expose-expression-model/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jpa:1.1">

                <jpa default-datasource="" default-extended-persistence-inheritance="DEEP"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jsf:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jsr77:1.0"/>

                <subsystem xmlns="urn:jboss:domain:mail:2.0">

                <mail-session name="default" jndi-name="java:jboss/mail/Default">

                <smtp-server outbound-socket-binding-ref="mail-smtp"/>

                </mail-session>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:messaging:2.0">

                <hornetq-server>

                <cluster-password>monarchcluster</cluster-password>

                <journal-file-size>102400</journal-file-size>

                <connectors>

                <http-connector name="http-connector" socket-binding="http">

                <param key="http-upgrade-endpoint" value="http-acceptor"/>

                </http-connector>

                <http-connector name="http-connector-throughput" socket-binding="http">

                <param key="http-upgrade-endpoint" value="http-acceptor-throughput"/>

                <param key="batch-delay" value="50"/>

                </http-connector>

                <in-vm-connector name="in-vm" server-id="0"/>

                </connectors>

                <acceptors>

                <http-acceptor http-listener="default" name="http-acceptor"/>

                <http-acceptor http-listener="default" name="http-acceptor-throughput">

                <param key="batch-delay" value="50"/>

                <param key="direct-deliver" value="false"/>

                </http-acceptor>

                <in-vm-acceptor name="in-vm" server-id="0"/>

                </acceptors>

                <security-settings>

                <security-setting match="#">

                <permission type="send" roles="guest"/>

                <permission type="consume" roles="guest"/>

                <permission type="createNonDurableQueue" roles="guest"/>

                <permission type="deleteNonDurableQueue" roles="guest"/>

                </security-setting>

                </security-settings>

                <address-settings>

                <address-setting match="#">

                <dead-letter-address>jms.queue.DLQ</dead-letter-address>

                <expiry-address>jms.queue.ExpiryQueue</expiry-address>

                <max-size-bytes>10485760</max-size-bytes>

                <page-size-bytes>2097152</page-size-bytes>

                <message-counter-history-day-limit>10</message-counter-history-day-limit>

                </address-setting>

                </address-settings>

                <jms-connection-factories>

                <connection-factory name="InVmConnectionFactory">

                <connectors>

                <connector-ref connector-name="in-vm"/>

                </connectors>

                <entries>

                <entry name="java:/ConnectionFactory"/>

                </entries>

                </connection-factory>

                <connection-factory name="RemoteConnectionFactory">

                <connectors>

                <connector-ref connector-name="http-connector"/>

                </connectors>

                <entries>

                <entry name="java:jboss/exported/jms/RemoteConnectionFactory"/>

                </entries>

                </connection-factory>

                <pooled-connection-factory name="hornetq-ra">

                <transaction mode="xa"/>

                <connectors>

                <connector-ref connector-name="in-vm"/>

                </connectors>

                <entries>

                <entry name="java:/JmsXA"/>

                <entry name="java:jboss/DefaultJMSConnectionFactory"/>

                </entries>

                </pooled-connection-factory>

                </jms-connection-factories>

                <jms-destinations>

                <jms-queue name="ExpiryQueue">

                <entry name="java:/jms/queue/ExpiryQueue"/>

                </jms-queue>

                <jms-queue name="DLQ">

                <entry name="java:/jms/queue/DLQ"/>

                </jms-queue>

                </jms-destinations>

                </hornetq-server>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:naming:2.0">

                <remote-naming/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:pojo:1.0"/>

                <subsystem xmlns="urn:jboss:domain:remoting:2.0">

                <endpoint worker="default"/>

                <http-connector name="http-remoting-connector" connector-ref="default" security-realm="ApplicationRealm"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:resource-adapters:2.0"/>

                <subsystem xmlns="urn:jboss:domain:sar:1.0"/>

                <subsystem xmlns="urn:jboss:domain:security:1.2">

                <security-domains>

                <security-domain name="other" cache-type="default">

                <authentication>

                <login-module code="Remoting" flag="optional">

                <module-option name="password-stacking" value="useFirstPass"/>

                </login-module>

                <login-module code="RealmDirect" flag="required">

                <module-option name="password-stacking" value="useFirstPass"/>

                </login-module>

                </authentication>

                </security-domain>

                <security-domain name="jboss-web-policy" cache-type="default">

                <authorization>

                <policy-module code="Delegating" flag="required"/>

                </authorization>

                </security-domain>

                <security-domain name="jboss-ejb-policy" cache-type="default">

                <authorization>

                <policy-module code="Delegating" flag="required"/>

                </authorization>

                </security-domain>

                </security-domains>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:transactions:2.0">

                <core-environment>

                <process-id>

                <uuid/>

                </process-id>

                </core-environment>

                <recovery-environment socket-binding="txn-recovery-environment" status-socket-binding="txn-status-manager"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:undertow:1.2">

                <buffer-cache name="default"/>

                <server name="default-server">

                <http-listener name="default" socket-binding="http"/>

                <host name="default-host" alias="localhost">

                <location name="/" handler="welcome-content"/>

                <filter-ref name="server-header"/>

                <filter-ref name="x-powered-by-header"/>

                </host>

                </server>

                <servlet-container name="default">

                <jsp-config/>

                <websockets/>

                </servlet-container>

                <handlers>

                <file name="welcome-content" path="${jboss.home.dir}/welcome-content"/>

                </handlers>

                <filters>

                <response-header name="server-header" header-name="Server" header-value="WildFly/8"/>

                <response-header name="x-powered-by-header" header-name="X-Powered-By" header-value="Undertow/1"/>

                </filters>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:webservices:1.2">

                <wsdl-host>${jboss.bind.address:127.0.0.1}</wsdl-host>

                <endpoint-config name="Standard-Endpoint-Config"/>

                <endpoint-config name="Recording-Endpoint-Config">

                <pre-handler-chain name="recording-handlers" protocol-bindings="##SOAP11_HTTP ##SOAP11_HTTP_MTOM ##SOAP12_HTTP ##SOAP12_HTTP_MTOM">

                <handler name="RecordingHandler" class="org.jboss.ws.common.invocation.RecordingServerHandler"/>

                </pre-handler-chain>

                </endpoint-config>

                <client-config name="Standard-Client-Config"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:weld:2.0"/>

                </profile>

                <profile name="full-ha">

                <subsystem xmlns="urn:jboss:domain:logging:2.0">

                <console-handler name="CONSOLE">

                <level name="DEBUG"/>

                <formatter>

                <named-formatter name="COLOR-PATTERN"/>

                </formatter>

                </console-handler>

                <periodic-rotating-file-handler name="FILE" autoflush="true">

                <formatter>

                <named-formatter name="PATTERN"/>

                </formatter>

                <file relative-to="jboss.server.log.dir" path="server.log"/>

                <suffix value=".yyyy-MM-dd"/>

                <append value="true"/>

                </periodic-rotating-file-handler>

                <logger category="com.arjuna">

                <level name="DEBUG"/>

                </logger>

                <logger category="org.apache.tomcat.util.modeler">

                <level name="DEBUG"/>

                </logger>

                <logger category="org.jboss.as.config">

                <level name="DEBUG"/>

                </logger>

                <logger category="sun.rmi">

                <level name="DEBUG"/>

                </logger>

                <logger category="jacorb">

                <level name="DEBUG"/>

                </logger>

                <logger category="jacorb.config">

                <level name="DEBUG"/>

                </logger>

                <root-logger>

                <level name="DEBUG"/>

                <handlers>

                <handler name="CONSOLE"/>

                <handler name="FILE"/>

                </handlers>

                </root-logger>

                <formatter name="PATTERN">

                <pattern-formatter pattern="%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p [%c] (%t) %s%E%n"/>

                </formatter>

                <formatter name="COLOR-PATTERN">

                <pattern-formatter pattern="%K{level}%d{HH:mm:ss,SSS} %-5p [%c] (%t) %s%E%n"/>

                </formatter>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:batch:1.0">

                <job-repository>

                <in-memory/>

                </job-repository>

                <thread-pool>

                <max-threads count="10"/>

                <keepalive-time time="30" unit="seconds"/>

                </thread-pool>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:datasources:2.0">

                <datasources>

                <datasource jndi-name="java:jboss/datasources/ExampleDS" pool-name="ExampleDS" enabled="true" use-java-context="true">

                <connection-url>

                jdbc:h2:mem:test;DB_CLOSE_DELAY=-1;DB_CLOSE_ON_EXIT=FALSE

                </connection-url>

                <driver>h2</driver>

                <security>

                <user-name>sa</user-name>

                <password>sa</password>

                </security>

                </datasource>

                <xa-datasource jndi-name="java:jboss/datasources/commandCenterDatasource" pool-name="commandCenterDatasource_Pool" enabled="true" use-ccm="true">

                <xa-datasource-property name="DatabaseName">mccdb</xa-datasource-property>

                <xa-datasource-property name="Password">blah</xa-datasource-property>

                <xa-datasource-property name="PortNumber">5432</xa-datasource-property>

                <xa-datasource-property name="ServerName">oasisdemo.staffaccess.net</xa-datasource-property>

                <xa-datasource-property name="User">monarch</xa-datasource-property>

                <xa-datasource-class>org.postgresql.xa.PGXADataSource</xa-datasource-class>

                <driver>postgresql</driver>

                <xa-pool>

                <is-same-rm-override>false</is-same-rm-override>

                <interleaving>false</interleaving>

                <pad-xid>false</pad-xid>

                <wrap-xa-resource>false</wrap-xa-resource>

                </xa-pool>

                <security>

                <user-name>monarch</user-name>

                <password>blah</password>

                </security>

                <validation>

                <validate-on-match>false</validate-on-match>

                <background-validation>false</background-validation>

                </validation>

                <timeout>

                <set-tx-query-timeout>false</set-tx-query-timeout>

                <blocking-timeout-millis>0</blocking-timeout-millis>

                <idle-timeout-minutes>0</idle-timeout-minutes>

                <query-timeout>0</query-timeout>

                <use-try-lock>0</use-try-lock>

                <allocation-retry>0</allocation-retry>

                <allocation-retry-wait-millis>0</allocation-retry-wait-millis>

                <xa-resource-timeout>0</xa-resource-timeout>

                </timeout>

                <statement>

                <share-prepared-statements>false</share-prepared-statements>

                </statement>

                </xa-datasource>

                <xa-datasource jndi-name="java:jboss/datasources/PicketLinkDataSource" pool-name="picketlink" enabled="true" use-ccm="false">

                <xa-datasource-property name="DatabaseName">picketlink</xa-datasource-property>

                <xa-datasource-property name="Password">blah</xa-datasource-property>

                <xa-datasource-property name="PortNumber">5432</xa-datasource-property>

                <xa-datasource-property name="ServerName">oasisdemo.staffaccess.net</xa-datasource-property>

                <xa-datasource-property name="User">monarch</xa-datasource-property>

                <xa-datasource-class>org.postgresql.xa.PGXADataSource</xa-datasource-class>

                <driver>postgresql</driver>

                <xa-pool>

                <is-same-rm-override>false</is-same-rm-override>

                <interleaving>false</interleaving>

                <pad-xid>false</pad-xid>

                <wrap-xa-resource>false</wrap-xa-resource>

                </xa-pool>

                <security>

                <user-name>monarch</user-name>

                <password>blah</password>

                </security>

                <validation>

                <validate-on-match>false</validate-on-match>

                <background-validation>false</background-validation>

                </validation>

                <timeout>

                <set-tx-query-timeout>false</set-tx-query-timeout>

                <blocking-timeout-millis>0</blocking-timeout-millis>

                <idle-timeout-minutes>0</idle-timeout-minutes>

                <query-timeout>0</query-timeout>

                <use-try-lock>0</use-try-lock>

                <allocation-retry>0</allocation-retry>

                <allocation-retry-wait-millis>0</allocation-retry-wait-millis>

                <xa-resource-timeout>0</xa-resource-timeout>

                </timeout>

                <statement>

                <share-prepared-statements>false</share-prepared-statements>

                </statement>

                </xa-datasource>

                <drivers>

                <driver name="h2" module="com.h2database.h2">

                <xa-datasource-class>org.h2.jdbcx.JdbcDataSource</xa-datasource-class>

                </driver>

                <driver name="postgresql" module="org.postgresql.jdbc">

                <driver-class>org.postgresql.Driver</driver-class>

                <xa-datasource-class>org.postgresql.xa.PGXADataSource</xa-datasource-class>

                </driver>

                </drivers>

                </datasources>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:ee:2.0">

                <spec-descriptor-property-replacement>false</spec-descriptor-property-replacement>

                <concurrent>

                <context-services>

                <context-service name="default" jndi-name="java:jboss/ee/concurrency/context/default" use-transaction-setup-provider="true"/>

                </context-services>

                <managed-thread-factories>

                <managed-thread-factory name="default" jndi-name="java:jboss/ee/concurrency/factory/default" context-service="default"/>

                </managed-thread-factories>

                <managed-executor-services>

                <managed-executor-service name="default" jndi-name="java:jboss/ee/concurrency/executor/default" context-service="default" hung-task-threshold="60000" core-threads="5" max-threads="25" keepalive-time="5000"/>

                </managed-executor-services>

                <managed-scheduled-executor-services>

                <managed-scheduled-executor-service name="default" jndi-name="java:jboss/ee/concurrency/scheduler/default" context-service="default" hung-task-threshold="60000" core-threads="2" keepalive-time="3000"/>

                </managed-scheduled-executor-services>

                </concurrent>

                <default-bindings context-service="java:jboss/ee/concurrency/context/default" datasource="java:jboss/datasources/ExampleDS" jms-connection-factory="java:jboss/DefaultJMSConnectionFactory" managed-executor-service="java:jboss/ee/concurrency/executor/default" managed-scheduled-executor-service="java:jboss/ee/concurrency/scheduler/default" managed-thread-factory="java:jboss/ee/concurrency/factory/default"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:ejb3:2.0">

                <session-bean>

                <stateful default-access-timeout="5000" cache-ref="distributable" passivation-disabled-cache-ref="simple"/>

                <singleton default-access-timeout="5000"/>

                </session-bean>

                <mdb>

                <resource-adapter-ref resource-adapter-name="${ejb.resource-adapter-name:hornetq-ra.rar}"/>

                <bean-instance-pool-ref pool-name="mdb-strict-max-pool"/>

                </mdb>

                <pools>

                <bean-instance-pools>

                <strict-max-pool name="slsb-strict-max-pool" max-pool-size="20" instance-acquisition-timeout="5" instance-acquisition-timeout-unit="MINUTES"/>

                <strict-max-pool name="mdb-strict-max-pool" max-pool-size="20" instance-acquisition-timeout="5" instance-acquisition-timeout-unit="MINUTES"/>

                </bean-instance-pools>

                </pools>

                <caches>

                <cache name="simple"/>

                <cache name="distributable" passivation-store-ref="infinispan" aliases="passivating clustered"/>

                </caches>

                <passivation-stores>

                <passivation-store name="infinispan" cache-container="ejb" max-size="10000"/>

                </passivation-stores>

                <async thread-pool-name="default"/>

                <timer-service thread-pool-name="default" default-data-store="default-file-store">

                <data-stores>

                <file-data-store name="default-file-store" path="timer-service-data" relative-to="jboss.server.data.dir"/>

                </data-stores>

                </timer-service>

                <remote connector-ref="http-remoting-connector" thread-pool-name="default"/>

                <thread-pools>

                <thread-pool name="default">

                <max-threads count="10"/>

                <keepalive-time time="100" unit="milliseconds"/>

                </thread-pool>

                </thread-pools>

                <iiop enable-by-default="false" use-qualified-name="false"/>

                <default-security-domain value="other"/>

                <default-missing-method-permissions-deny-access value="true"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:io:1.1">

                <worker name="default"/>

                <buffer-pool name="default"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:infinispan:2.0">

                <cache-container name="server" default-cache="default" module="org.wildfly.clustering.server" aliases="singleton cluster ha-partition">

                <transport lock-timeout="60000"/>

                <replicated-cache name="default" batching="true" mode="SYNC">

                <locking isolation="REPEATABLE_READ" acquire-timeout="60000"/>

                </replicated-cache>

                </cache-container>

                <cache-container name="web" default-cache="dist" module="org.wildfly.clustering.web.infinispan" aliases="standard-session-cache">

                <transport lock-timeout="60000"/>

                <replicated-cache name="sso" mode="SYNC"/>

                <distributed-cache name="dist" batching="true" mode="ASYNC" owners="2" l1-lifespan="0">

                <file-store/>

                </distributed-cache>

                </cache-container>

                <cache-container name="ejb" default-cache="repl" module="org.wildfly.clustering.ejb.infinispan" aliases="sfsb sfsb-cache">

                <transport lock-timeout="60000"/>

                <replicated-cache name="repl" batching="true" mode="ASYNC"/>

                <replicated-cache name="remote-connector-client-mappings" batching="true" mode="SYNC"/>

                <distributed-cache name="dist" batching="true" mode="ASYNC" owners="2" l1-lifespan="0">

                <file-store/>

                </distributed-cache>

                </cache-container>

                <cache-container name="hibernate" default-cache="local-query" module="org.hibernate">

                <transport lock-timeout="60000"/>

                <local-cache name="local-query">

                <transaction mode="NONE"/>

                <eviction strategy="LRU" max-entries="10000"/>

                <expiration max-idle="100000"/>

                </local-cache>

                <invalidation-cache name="entity" start="LAZY" mode="SYNC">

                <transaction mode="NON_XA"/>

                <eviction strategy="LRU" max-entries="10000"/>

                <expiration max-idle="100000"/>

                </invalidation-cache>

                <replicated-cache name="timestamps" mode="ASYNC">

                <transaction mode="NONE"/>

                <eviction strategy="NONE"/>

                </replicated-cache>

                </cache-container>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jacorb:1.3">

                <orb socket-binding="jacorb" ssl-socket-binding="jacorb-ssl">

                <initializers security="identity" transactions="spec"/>

                </orb>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jaxrs:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jca:2.0">

                <archive-validation enabled="true" fail-on-error="true" fail-on-warn="false"/>

                <bean-validation enabled="true"/>

                <default-workmanager>

                <short-running-threads>

                <core-threads count="50"/>

                <queue-length count="50"/>

                <max-threads count="50"/>

                <keepalive-time time="10" unit="seconds"/>

                </short-running-threads>

                <long-running-threads>

                <core-threads count="50"/>

                <queue-length count="50"/>

                <max-threads count="50"/>

                <keepalive-time time="10" unit="seconds"/>

                </long-running-threads>

                </default-workmanager>

                <cached-connection-manager/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jdr:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jgroups:2.0" default-stack="udp">

                <stack name="udp">

                <transport type="UDP" socket-binding="jgroups-udp"/>

                <protocol type="PING"/>

                <protocol type="MERGE3"/>

                <protocol type="FD_SOCK" socket-binding="jgroups-udp-fd"/>

                <protocol type="FD_ALL"/>

                <protocol type="VERIFY_SUSPECT"/>

                <protocol type="pbcast.NAKACK2"/>

                <protocol type="UNICAST3"/>

                <protocol type="pbcast.STABLE"/>

                <protocol type="pbcast.GMS"/>

                <protocol type="UFC"/>

                <protocol type="MFC"/>

                <protocol type="FRAG2"/>

                <protocol type="RSVP"/>

                </stack>

                <stack name="tcp">

                <transport type="TCP" socket-binding="jgroups-tcp"/>

                <protocol type="MPING" socket-binding="jgroups-mping"/>

                <protocol type="MERGE2"/>

                <protocol type="FD_SOCK" socket-binding="jgroups-tcp-fd"/>

                <protocol type="FD"/>

                <protocol type="VERIFY_SUSPECT"/>

                <protocol type="pbcast.NAKACK2"/>

                <protocol type="UNICAST3"/>

                <protocol type="pbcast.STABLE"/>

                <protocol type="pbcast.GMS"/>

                <protocol type="MFC"/>

                <protocol type="FRAG2"/>

                <protocol type="RSVP"/>

                </stack>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jmx:1.3">

                <expose-resolved-model/>

                <expose-expression-model/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jpa:1.1">

                <jpa default-datasource="" default-extended-persistence-inheritance="DEEP"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:jsf:1.0"/>

                <subsystem xmlns="urn:jboss:domain:jsr77:1.0"/>

                <subsystem xmlns="urn:jboss:domain:mail:2.0">

                <mail-session name="default" jndi-name="java:jboss/mail/Default">

                <smtp-server outbound-socket-binding-ref="mail-smtp"/>

                </mail-session>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:messaging:2.0">

                <hornetq-server>

                <persistence-enabled>true</persistence-enabled>

                <cluster-password>${jboss.messaging.cluster.password:monarchcluster}</cluster-password>

                <journal-file-size>102400</journal-file-size>

                <run-sync-speed-test>false</run-sync-speed-test>

                <replication-clustername>my-clusterDemo</replication-clustername>

                <connectors>

                <netty-connector name="netty" socket-binding="messaging"/>

                <netty-connector name="netty-throughput" socket-binding="messaging-throughput">

                <param key="batch-delay" value="50"/>

                </netty-connector>

                <in-vm-connector name="in-vm" server-id="0"/>

                </connectors>

                <acceptors>

                <netty-acceptor name="netty" socket-binding="messaging"/>

                <netty-acceptor name="netty-throughput" socket-binding="messaging-throughput">

                <param key="batch-delay" value="50"/>

                <param key="direct-deliver" value="false"/>

                </netty-acceptor>

                <in-vm-acceptor name="in-vm" server-id="0"/>

                <acceptor name="stomp-acceptor">

                <factory-class>

                org.hornetq.core.remoting.impl.netty.NettyAcceptorFactory

                </factory-class>

                <param key="protocol" value="stomp"/>

                <param key="port" value="61613"/>

                </acceptor>

                </acceptors>

                <broadcast-groups>

                <broadcast-group name="bg-group1demo">

                <socket-binding>messaging-group</socket-binding>

                <broadcast-period>5000</broadcast-period>

                <connector-ref>netty</connector-ref>

                </broadcast-group>

                </broadcast-groups>

                <discovery-groups>

                <discovery-group name="dg-group1demo">

                <socket-binding>messaging-group</socket-binding>

                </discovery-group>

                </discovery-groups>

                <cluster-connections>

                <cluster-connection name="my-clusterDemo">

                <address>jms</address>

                <connector-ref>netty</connector-ref>

                <discovery-group-ref discovery-group-name="dg-group1demo"/>

                </cluster-connection>

                </cluster-connections>

                <security-settings>

                <security-setting match="#">

                <permission type="send" roles="guest"/>

                <permission type="consume" roles="guest"/>

                <permission type="createDurableQueue" roles="monarch"/>

                <permission type="deleteDurableQueue" roles="monarch"/>

                <permission type="createNonDurableQueue" roles="guest monarch"/>

                <permission type="deleteNonDurableQueue" roles="guest monarch"/>

                </security-setting>

                </security-settings>

                <address-settings>

                <address-setting match="#">

                <dead-letter-address>jms.queue.DLQ</dead-letter-address>

                <expiry-address>jms.queue.ExpiryQueue</expiry-address>

                <max-size-bytes>10485760</max-size-bytes>

                <page-size-bytes>2097152</page-size-bytes>

                <message-counter-history-day-limit>10</message-counter-history-day-limit>

                <redistribution-delay>1000</redistribution-delay>

                </address-setting>

                </address-settings>

                <jms-connection-factories>

                <connection-factory name="InVmConnectionFactory">

                <connectors>

                <connector-ref connector-name="in-vm"/>

                </connectors>

                <entries>

                <entry name="java:/ConnectionFactory"/>

                </entries>

                </connection-factory>

                <connection-factory name="RemoteConnectionFactory">

                <connectors>

                <connector-ref connector-name="netty"/>

                </connectors>

                <entries>

                <entry name="java:jboss/exported/jms/RemoteConnectionFactory"/>

                </entries>

                <ha>true</ha>

                <block-on-acknowledge>true</block-on-acknowledge>

                <reconnect-attempts>-1</reconnect-attempts>

                </connection-factory>

                <pooled-connection-factory name="hornetq-ra">

                <transaction mode="xa"/>

                <connectors>

                <connector-ref connector-name="in-vm"/>

                </connectors>

                <entries>

                <entry name="java:/JmsXA"/>

                <entry name="java:jboss/DefaultJMSConnectionFactory"/>

                </entries>

                </pooled-connection-factory>

                </jms-connection-factories>

                <jms-destinations>

                <jms-queue name="ExpiryQueue">

                <entry name="java:/jms/queue/ExpiryQueue"/>

                </jms-queue>

                <jms-queue name="DLQ">

                <entry name="java:/jms/queue/DLQ"/>

                </jms-queue>

                <jms-topic name="pushGlobalQueue">

                <entry name="topic/pushGlobalQueue"/>

                </jms-topic>

                <jms-topic name="pushLocalQueue">

                <entry name="topic/pushLocalQueue"/>

                </jms-topic>

                <jms-topic name="pushDigmaQueue">

                <entry name="topic/pushDigmaQueue"/>

                </jms-topic>

                </jms-destinations>

                </hornetq-server>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:modcluster:1.2">

                <mod-cluster-config advertise-socket="modcluster" proxy-list="oasisdemo.staffaccess.net:443" balancer="my-clusterDemo" advertise="true" advertise-security-key="Dev_Cluster" connector="ajp">

                <dynamic-load-provider>

                <load-metric type="busyness"/>

                </dynamic-load-provider>

                <ssl key-alias="nope" password="blahblahblah" certificate-key-file="/etc/httpd/conf/certs/staffaccess.net.jboss.jks" ca-certificate-file="/etc/httpd/conf/certs/staffaccess.net.jboss.jks"/>

                </mod-cluster-config>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:naming:2.0">

                <remote-naming/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:pojo:1.0"/>

                <subsystem xmlns="urn:jboss:domain:remoting:2.0">

                <endpoint worker="default"/>

                <http-connector name="http-remoting-connector" connector-ref="default" security-realm="ApplicationRealm"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:resource-adapters:2.0"/>

                <subsystem xmlns="urn:jboss:domain:sar:1.0"/>

                <subsystem xmlns="urn:jboss:domain:security:1.2">

                <security-domains>

                <security-domain name="other" cache-type="default">

                <authentication>

                <login-module code="Remoting" flag="optional">

                <module-option name="password-stacking" value="useFirstPass"/>

                </login-module>

                <login-module code="RealmDirect" flag="required">

                <module-option name="password-stacking" value="useFirstPass"/>

                </login-module>

                </authentication>

                </security-domain>

                <security-domain name="jboss-web-policy" cache-type="default">

                <authorization>

                <policy-module code="Delegating" flag="required"/>

                </authorization>

                </security-domain>

                <security-domain name="jboss-ejb-policy" cache-type="default">

                <authorization>

                <policy-module code="Delegating" flag="required"/>

                </authorization>

                </security-domain>

                </security-domains>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:transactions:2.0">

                <core-environment>

                <process-id>

                <uuid/>

                </process-id>

                </core-environment>

                <recovery-environment socket-binding="txn-recovery-environment" status-socket-binding="txn-status-manager"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:undertow:1.2">

                <buffer-cache name="default"/>

                <server name="default-server">

                <ajp-listener name="ajp" socket-binding="ajp"/>

                <http-listener name="default" socket-binding="http"/>

                <https-listener name="https" socket-binding="https" security-realm="WebSocketRealm"/>

                <host name="oasis" alias="oasisdemo.staffaccess.net" default-web-module="OASIS.war"/>

                <host name="default-host" alias="localhost">

                <location name="/" handler="welcome-content"/>

                <filter-ref name="server-header"/>

                <filter-ref name="x-powered-by-header"/>

                </host>

                </server>

                <servlet-container name="default">

                <jsp-config/>

                <websockets/>

                </servlet-container>

                <handlers>

                <file name="welcome-content" path="${jboss.home.dir}/welcome-content"/>

                </handlers>

                <filters>

                <response-header name="server-header" header-name="Server" header-value="WildFly/8"/>

                <response-header name="x-powered-by-header" header-name="X-Powered-By" header-value="Undertow/1"/>

                </filters>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:webservices:1.2">

                <wsdl-host>${jboss.bind.address:127.0.0.1}</wsdl-host>

                <endpoint-config name="Standard-Endpoint-Config"/>

                <endpoint-config name="Recording-Endpoint-Config">

                <pre-handler-chain name="recording-handlers" protocol-bindings="##SOAP11_HTTP ##SOAP11_HTTP_MTOM ##SOAP12_HTTP ##SOAP12_HTTP_MTOM">

                <handler name="RecordingHandler" class="org.jboss.ws.common.invocation.RecordingServerHandler"/>

                </pre-handler-chain>

                </endpoint-config>

                <client-config name="Standard-Client-Config"/>

                </subsystem>

                <subsystem xmlns="urn:jboss:domain:weld:2.0"/>

                </profile>

                </profiles>

                <interfaces>

                <interface name="management"/>

                <interface name="public"/>

                <interface name="unsecure"/>

                </interfaces>

                <socket-binding-groups>

                <socket-binding-group name="standard-sockets" default-interface="public">

                <socket-binding name="ajp" port="${jboss.ajp.port:8009}"/>

                <socket-binding name="http" port="${jboss.http.port:8080}"/>

                <socket-binding name="https" port="${jboss.https.port:8443}"/>

                <socket-binding name="txn-recovery-environment" port="4712"/>

                <socket-binding name="txn-status-manager" port="4713"/>

                <outbound-socket-binding name="mail-smtp">

                <remote-destination host="localhost" port="25"/>

                </outbound-socket-binding>

                </socket-binding-group>

                <socket-binding-group name="ha-sockets" default-interface="public">

                <socket-binding name="ajp" port="${jboss.ajp.port:8009}"/>

                <socket-binding name="http" port="${jboss.http.port:8080}"/>

                <socket-binding name="https" port="${jboss.https.port:8443}"/>

                <socket-binding name="jgroups-mping" port="0" multicast-address="${jboss.default.multicast.address:230.0.0.4}" multicast-port="45700"/>

                <socket-binding name="jgroups-tcp" port="7600"/>

                <socket-binding name="jgroups-tcp-fd" port="57600"/>

                <socket-binding name="jgroups-udp" port="55200" multicast-address="${jboss.default.multicast.address:230.0.0.4}" multicast-port="45688"/>

                <socket-binding name="jgroups-udp-fd" port="54200"/>

                <socket-binding name="modcluster" port="0" multicast-address="224.0.1.105" multicast-port="23364"/>

                <socket-binding name="txn-recovery-environment" port="4712"/>

                <socket-binding name="txn-status-manager" port="4713"/>

                <outbound-socket-binding name="mail-smtp">

                <remote-destination host="localhost" port="25"/>

                </outbound-socket-binding>

                </socket-binding-group>

                <socket-binding-group name="full-sockets" default-interface="public">

                <socket-binding name="ajp" port="${jboss.ajp.port:8009}"/>

                <socket-binding name="http" port="${jboss.http.port:8080}"/>

                <socket-binding name="https" port="${jboss.https.port:8443}"/>

                <socket-binding name="jacorb" interface="unsecure" port="3528"/>

                <socket-binding name="jacorb-ssl" interface="unsecure" port="3529"/>

                <socket-binding name="messaging-group" port="0" multicast-address="${jboss.messaging.group.address:231.7.7.7}" multicast-port="${jboss.messaging.group.port:9876}"/>

                <socket-binding name="txn-recovery-environment" port="4712"/>

                <socket-binding name="txn-status-manager" port="4713"/>

                <outbound-socket-binding name="mail-smtp">

                <remote-destination host="localhost" port="25"/>

                </outbound-socket-binding>

                </socket-binding-group>

                <socket-binding-group name="full-ha-sockets" default-interface="public">

                <socket-binding name="ajp" port="${jboss.ajp.port:8009}"/>

                <socket-binding name="http" port="${jboss.http.port:8080}"/>

                <socket-binding name="https" port="${jboss.https.port:8443}"/>

                <socket-binding name="jacorb" interface="unsecure" port="3528"/>

                <socket-binding name="jacorb-ssl" interface="unsecure" port="3529"/>

                <socket-binding name="jgroups-mping" port="0" multicast-address="${jboss.default.multicast.address:230.0.0.6}" multicast-port="45700"/>

                <socket-binding name="jgroups-tcp" port="7600"/>

                <socket-binding name="jgroups-tcp-fd" port="57600"/>

                <socket-binding name="jgroups-udp" port="55200" multicast-address="${jboss.default.multicast.address:230.0.0.6}" multicast-port="45688"/>

                <socket-binding name="jgroups-udp-fd" port="54200"/>

                <socket-binding name="messaging" port="5445"/>

                <socket-binding name="messaging-group" port="0" multicast-address="${jboss.messaging.group.address:231.7.7.9}" multicast-port="${jboss.messaging.group.port:9876}"/>

                <socket-binding name="messaging-throughput" port="5455"/>

                <socket-binding name="modcluster" port="0" multicast-address="224.0.1.107" multicast-port="23364"/>

                <socket-binding name="txn-recovery-environment" port="4712"/>

                <socket-binding name="txn-status-manager" port="4713"/>

                <outbound-socket-binding name="mail-smtp">

                <remote-destination host="localhost" port="25"/>

                </outbound-socket-binding>

                </socket-binding-group>

                </socket-binding-groups>

                <deployments>

                <deployment name="OASIS.war" runtime-name="OASIS.war">

                <content sha1="9f2d8f6d7117681deff615c636d1e41aabb05471"/>

                </deployment>

                </deployments>

                <server-groups>

                <server-group name="main-server-group" profile="full-ha">

                <jvm name="default">

                <heap size="1303m" max-size="1303m"/>

                <permgen max-size="500m"/>

                </jvm>

                <socket-binding-group ref="full-ha-sockets"/>

                </server-group>

                <server-group name="other-server-group" profile="full-ha">

                <jvm name="default">

                <heap size="64m" max-size="512m"/>

                </jvm>

                <socket-binding-group ref="full-ha-sockets"/>

                <deployments>

                <deployment name="OASIS.war" runtime-name="OASIS.war"/>

                </deployments>

                </server-group>

                </server-groups>

                </domain>

                • 5. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                  humanbeing

                  Was able to increase the 15 second time out but still got the issue.  I discovered this in the log file as well.

                   

                  [Server:server-three] 10:05:57,039 DEBUG [io.undertow.servlet.request] (default task-40) Async request timed out

                  [Server:server-three] 10:05:57,041 DEBUG [org.atmosphere.container.Servlet30CometSupport] (default task-40) onTimeout(): event: d0085186-f9e1-43bd-b0d4-fd094d3c0dc6

                  [Server:server-three] 10:05:57,043 DEBUG [org.atmosphere.cpr.AsynchronousProcessor] (default task-40) Timing out the connection for request d0085186-f9e1-43bd-b0d4-fd094d3c0dc6

                  [Server:server-three] 10:05:57,044 DEBUG [org.atmosphere.cpr.DefaultBroadcasterFactory] (default task-40) Removing Broadcaster DefaultBroadcaster381614e3-dd6f-4e29-a214-57aae8273079 factory size now 1

                  [Server:server-three] 10:05:57,044 DEBUG [org.atmosphere.cpr.AtmosphereResourceImpl] (default task-40) Broadcaster's scope is set to request, destroying it DefaultBroadcaster381614e3-dd6f-4e29-a214-57aae8273079

                  [Server:server-three] 10:05:57,045 DEBUG [org.atmosphere.container.Servlet30CometSupport] (default task-40) Resumed (completed): event: d0085186-f9e1-43bd-b0d4-fd094d3c0dc6

                  [Server:server-three] 10:05:57,045 DEBUG [org.atmosphere.container.Servlet30CometSupport] (default task-40) Already resumed or cancelled: event: AtmosphereResourceImpl{

                  [Server:server-three]  uuid=d0085186-f9e1-43bd-b0d4-fd094d3c0dc6,

                  [Server:server-three]  transport=LONG_POLLING,

                  [Server:server-three]  action=Action{timeout=30000, type=RESUME},

                  [Server:server-three]  isResumed=true,

                  [Server:server-three]  isCancelled=true,

                  [Server:server-three]  isSuspended=false,

                  [Server:server-three]  broadcaster=DefaultBroadcaster381614e3-dd6f-4e29-a214-57aae8273079,

                  [Server:server-three]  isInScope=false,

                  [Server:server-three]  useWriter=true,

                  [Server:server-three]  listeners=[]}

                  [Server:server-three] 10:05:57,046 DEBUG [org.atmosphere.cpr.DefaultBroadcaster] (default task-40) This Broadcaster has been destroyed and cannot be used DefaultBroadcaster381614e3-dd6f-4e29-a214-57aae8273079 by invoking removeAtmosphereResource(AtmosphereResource r)

                  [Server:server-three] 10:05:57,047 DEBUG [org.atmosphere.cpr.DefaultBroadcaster] (default task-40) This Broadcaster has been destroyed and cannot be used DefaultBroadcaster381614e3-dd6f-4e29-a214-57aae8273079 by invoking removeAtmosphereResource(AtmosphereResource r)

                  • 6. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                    scyta1e

                    I believe I’m seeing the same problem using Wildly 8.2.0 & Atmosphere 2.2.0. The nature of the application being developed is that atmosphere is managing a “session" to the browser using either a web socket or long-polling (negotiated) - delivering async data. In parallel we have user driven REST requests from the browser using the same web session.

                     

                     

                    This works fine standalone, however switching to full-ha with the default Infinispan clustering config we start to see this lock issue intermittently. Unfortunately once it does occur it appears to prevent all REST interactions with the service (they all time-out after 15 seconds).

                     


                    I’ll be testing over the next few days to try and isolate the problem and identify a reproducible test scenario.


                     

                    Paul, thanks for your response in Re: Deploying Web Application on wildfly 8.2-final getting java.la ng.IllegalStateException: Transaction DummyTransaction{xid=DummyXid is not in a valid state to be invoking cache operations on.  - does the use of atmosphere essentially make this a variant on [WFLY-3715] Async servlets cause lock timeouts for distributable sessions?

                    • 7. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                      humanbeing

                      Thanks Chris.  Will be good to hear what you find out.

                      • 8. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                        humanbeing

                        FYI, I get the same behavior with WF 9.0.0.CR1.

                        • 9. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                          scyta1e

                          Just a quick update. We found if we set the atmosphere client to connect using long-polling instead of websockets the problem has gone from an intermittent problem to reproducible simply by launching the UI. To be clear this doesn't just kill the users session it stops all sessions from working - it effectively stops all web activity with the server.

                           

                          I've tried almost all combinations of configuring the Infinispan web/ejb caches (i.e. modes local, distributed, replicated, optimistic, pessimistic, XA, NON XA) none of them have had any impact on the problem.

                           

                          I also tried switching <async-supported>false</async-supported> in the AtmosphereServlet but it stops Atmosphere from working dead.

                           

                          Human Being ... can you confirm which version of Atmosphere you are using and how you are initialising it - is it as a servlet?

                          • 10. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                            humanbeing

                            Chris Hewitt...

                             

                            Thank you for the update. My problem happens after I login and go to the page where I begin accessing the queue. Basically, it sounds similar to your problem.  I also tried a few configurations with Infinispan we/ejb cache's and none of those helped. The app becomes unusable until I restart it.

                             

                            In my pom:

                             

                            <dependency>

                              <groupId>org.atmosphere</groupId>

                              <artifactId>atmosphere-runtime</artifactId>

                              </dependency>

                             

                            In  my log files: WEB-INF/lib/atmosphere-runtime-1.0.10.jar

                             

                            I hope this helps but if not, let me know what other info I can provide.

                            • 11. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                              pferraro

                              This sounds to me like the lock the web session cache entry is never released.  By switching to optimistic locking, concurrent reads by multiple requests should be allowed.  However, a write lock is eventually required when updating the last access time stamp - which happens during io.undertow.servlet.spec.HttpServletResponesImpl.responseDone(), after which locks on the session are released.  It sounds like this isn't happening.

                              • 12. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                                humanbeing

                                Here's what I have after modifying the configuration as you suggested. The result sounds exactly like what you explained correct?

                                 

                                [Server:server-three] 09:37:46,373 DEBUG [org.infinispan.interceptors.InvocationContextInterceptor] (default task-38) Exception executing call: org.infinispan.transaction.WriteSkewException: Write skew detected on key uKgXOSdebRyRMHXxGAH8LlYp for transaction DummyTransaction{xid=DummyXid{id=101}, status=0}

                                [Server:server-three] at org.infinispan.transaction.WriteSkewHelper.performWriteSkewCheckAndReturnNewVersions(WriteSkewHelper.java:49)

                                [Server:server-three] at org.infinispan.interceptors.locking.ClusteringDependentLogic$AbstractClusteringDependentLogic.clusteredCreateNewVersionsAndCheckForWriteSkews(ClusteringDependentLogic.java:171)

                                [Server:server-three] at org.infinispan.interceptors.locking.ClusteringDependentLogic$AbstractClusteringDependentLogic.createNewVersionsAndCheckForWriteSkews(ClusteringDependentLogic.java:97)

                                [Server:server-three] at org.infinispan.interceptors.VersionedEntryWrappingInterceptor.visitPrepareCommand(VersionedEntryWrappingInterceptor.java:49)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)

                                [Server:server-three] at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.invokeNextAndCommitIf1Pc(AbstractTxLockingInterceptor.java:78)

                                [Server:server-three] at org.infinispan.interceptors.locking.OptimisticLockingInterceptor.visitPrepareCommand(OptimisticLockingInterceptor.java:87)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)

                                [Server:server-three] at org.infinispan.interceptors.NotificationInterceptor.visitPrepareCommand(NotificationInterceptor.java:36)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)

                                [Server:server-three] at org.infinispan.interceptors.TxInterceptor.invokeNextInterceptorAndVerifyTransaction(TxInterceptor.java:114)

                                [Server:server-three] at org.infinispan.interceptors.TxInterceptor.visitPrepareCommand(TxInterceptor.java:101)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112)

                                [Server:server-three] at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:96)

                                [Server:server-three] at org.infinispan.statetransfer.TransactionSynchronizerInterceptor.visitPrepareCommand(TransactionSynchronizerInterceptor.java:42)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)

                                [Server:server-three] at org.infinispan.statetransfer.StateTransferInterceptor.handleTopologyAffectedCommand(StateTransferInterceptor.java:263)

                                [Server:server-three] at org.infinispan.statetransfer.StateTransferInterceptor.handleTxCommand(StateTransferInterceptor.java:194)

                                [Server:server-three] at org.infinispan.statetransfer.StateTransferInterceptor.visitPrepareCommand(StateTransferInterceptor.java:94)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:112)

                                [Server:server-three] at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:96)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)

                                [Server:server-three] at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:110)

                                [Server:server-three] at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:73)

                                [Server:server-three] at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:96)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:98)

                                [Server:server-three] at org.infinispan.interceptors.BatchingInterceptor.handleDefault(BatchingInterceptor.java:66)

                                [Server:server-three] at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:96)

                                [Server:server-three] at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124)

                                [Server:server-three] at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:333)

                                [Server:server-three] at org.infinispan.transaction.TransactionCoordinator.prepare(TransactionCoordinator.java:119)

                                [Server:server-three] at org.infinispan.transaction.TransactionCoordinator.prepare(TransactionCoordinator.java:101)

                                [Server:server-three] at org.infinispan.transaction.synchronization.SynchronizationAdapter.beforeCompletion(SynchronizationAdapter.java:44)

                                [Server:server-three] at org.infinispan.transaction.tm.DummyTransaction.notifyBeforeCompletion(DummyTransaction.java:208)

                                [Server:server-three] at org.infinispan.transaction.tm.DummyTransaction.runPrepare(DummyTransaction.java:220)

                                [Server:server-three] at org.infinispan.transaction.tm.DummyTransaction.commit(DummyTransaction.java:64)

                                [Server:server-three] at org.infinispan.transaction.tm.DummyBaseTransactionManager.commit(DummyBaseTransactionManager.java:80)

                                [Server:server-three] at org.infinispan.batch.BatchContainer.resolveTransaction(BatchContainer.java:101)

                                [Server:server-three] at org.infinispan.batch.BatchContainer.endBatch(BatchContainer.java:83)

                                [Server:server-three] at org.infinispan.batch.BatchContainer.endBatch(BatchContainer.java:64)

                                [Server:server-three] at org.infinispan.CacheImpl.endBatch(CacheImpl.java:777)

                                [Server:server-three] at org.infinispan.AbstractDelegatingCache.endBatch(AbstractDelegatingCache.java:53)

                                [Server:server-three] at org.wildfly.clustering.web.infinispan.InfinispanBatcher$1.end(InfinispanBatcher.java:56)

                                [Server:server-three]at org.wildfly.clustering.web.infinispan.InfinispanBatcher$1.close(InfinispanBatcher.java:46)
                                [Server:server-three]at org.wildfly.clustering.web.undertow.session.DistributableSession.requestDone(DistributableSession.java:72)
                                [Server:server-three]at io.undertow.servlet.spec.ServletContextImpl.updateSessionAccessTime(ServletContextImpl.java:730) [undertow-servlet-1.1.0.Final.jar:1.1.0.Final]
                                [Server:server-three]at io.undertow.servlet.spec.HttpServletResponseImpl.responseDone(HttpServletResponseImpl.java:578) [undertow-servlet-1.1.0.Final.jar:1.1.0.Final]
                                [Server:server-three]at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:308) [undertow-servlet-1.1.0.Final.jar:1.1.0.Final]
                                [Server:server-three]at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:247) [undertow-servlet-1.1.0.Final.jar:1.1.0.Final]
                                [Server:server-three]at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:76) [undertow-servlet-1.1.0.Final.jar:1.1.0.Final]
                                [Server:server-three]at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:166) [undertow-servlet-1.1.0.Final.jar:1.1.0.Final]
                                [Server:server-three]at io.undertow.server.Connectors.executeRootHandler(Connectors.java:197) [undertow-core-1.1.0.Final.jar:1.1.0.Final]
                                [Server:server-three]at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:759) [undertow-core-1.1.0.Final.jar:1.1.0.Final]
                                [Server:server-three]at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65]
                                [Server:server-three]at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65]
                                [Server:server-three]at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65]
                                • 13. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                                  tabs_ls

                                  Hi All,

                                   

                                  I`m seeing pretty much the same issue with a rest server(Resteasy) using <distributable/> in the web.xml and running in a wildfly cluster release 8.2 final

                                   

                                  Steps to recreate.

                                  1) rest end point using @Suspended AsyncResponse with a timeout of say 60seconds

                                  2) a "normal" rest call which will return a response.

                                   

                                  3) From the same browser, issue a call to 1) which will suspend the request, then issue another call to the normal rest 2). -Using 2 tabs-

                                   

                                  I`m guessing that the @Suspended is actually holding onto the lock.

                                   

                                  We've got 2 use case for this ranging from a simple chat client to a browser based real-time(ish) market data solution.

                                   

                                  can someone please help?.

                                   

                                  Regards,

                                  David.

                                  • 14. Re: Please help. Need to understand why I get org.infinispan.util.concurrent.TimeoutException
                                    humanbeing

                                    The struggle for me now is to figure out where to make this happen. Basically, the app I'm working on was designed so that when a message is sent to the topic, it basically triggers a db update for the connected clients (using a4j:push and h:dataTable elements).

                                    1 2 Previous Next