3 Replies Latest reply on Oct 29, 2018 7:03 AM by Miroslav Novak

    Wildfly 10.1.0.FINAL, JMS, ActiveMQ problem

    Tim Hallwachs Newbie

      Hi,

      I have a problem with the messaging subsystem.

      I'm running a Wildfly10 Server in standalone mode, the JMS messages are bridged to another JBoss-Server, everything works fine for the last 4 weeks.

      But yesterday the first error was a TimeOut and after that the bridge failed because the dispacher cannot be found anymore and the send messages are lost.

       

      Do anybody know why after the timeout the dispatcher is lost, the messages are lost or if there are any bugs in ActiveMQ?

       

      Thanks for help.

      2018-10-23 13:40:25,978 ERROR [stderr]  javax.jms.JMSRuntimeException: AMQ119014: Timed out after waiting 30.000 ms for response when sending packet 71

      2018-10-23 13:40:25,979 ERROR [stderr]      at org.apache.activemq.artemis.jms.client.JmsExceptionUtils.convertToRuntimeException(JmsExceptionUtils.java:88)

      2018-10-23 13:40:25,979 ERROR [stderr]      at org.apache.activemq.artemis.jms.client.ActiveMQJMSProducer.send(ActiveMQJMSProducer.java:103)

      2018-10-23 13:40:25,989 ERROR [stderr]      at org.apache.activemq.artemis.jms.client.ActiveMQJMSProducer.send(ActiveMQJMSProducer.java:197)

      2018-10-23 13:40:25,989 ERROR [stderr]      at lisa.logistics.core.message.MessageSender.sendMessage(MessageSender.java:57)

      2018-10-23 13:40:25,989 ERROR [stderr]      at lisa.logistics.picking.messages.TriggerILMLiquidationMessageSender.sendMessage(TriggerILMLiquidationMessageSender.java:26)

      2018-10-23 13:40:25,989 ERROR [stderr]      at sun.reflect.GeneratedMethodAccessor544.invoke(Unknown Source)

      2018-10-23 13:40:25,989 ERROR [stderr]      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

      2018-10-23 13:40:25,989 ERROR [stderr]      at java.lang.reflect.Method.invoke(Method.java:498)

      2018-10-23 13:40:25,989 ERROR [stderr]      at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52)

      2018-10-23 13:40:25,989 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,989 ERROR [stderr]      at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)

      2018-10-23 13:40:25,989 ERROR [stderr]      at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:82)

      2018-10-23 13:40:25,989 ERROR [stderr]      at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93)

      2018-10-23 13:40:25,989 ERROR [stderr]      at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:64)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,990 ERROR [stderr]      at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:254)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:329)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,991 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.as.ejb3.security.AuthorizationInterceptor.processInvocation(AuthorizationInterceptor.java:138)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67)

      2018-10-23 13:40:25,992 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80)

      2018-10-23 13:40:25,993 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,994 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:25,994 ERROR [stderr]      at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198)

      2018-10-23 13:40:25,994 ERROR [stderr]      at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185)

      2018-10-23 13:40:25,994 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,994 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:25,994 ERROR [stderr]      at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73)

      2018-10-23 13:40:25,994 ERROR [stderr]      at lisa.logistics.picking.messages.TriggerILMLiquidationMessageSender$$$view87.sendMessage(Unknown Source)

      2018-10-23 13:40:25,994 ERROR [stderr]      at lisa.logistics.picking.service.ILMLiquidationServiceBean.triggerLiquidationCheck(ILMLiquidationServiceBean.java:330)

      2018-10-23 13:40:25,994 ERROR [stderr]      at sun.reflect.GeneratedMethodAccessor269.invoke(Unknown Source)

      2018-10-23 13:40:25,994 ERROR [stderr]      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

      2018-10-23 13:40:25,994 ERROR [stderr]      at java.lang.reflect.Method.invoke(Method.java:498)

      2018-10-23 13:40:25,994 ERROR [stderr]      at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52)

      2018-10-23 13:40:25,994 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:82)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:64)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83)

      2018-10-23 13:40:25,995 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:254)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:329)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239)

      2018-10-23 13:40:25,996 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.as.ejb3.security.AuthorizationInterceptor.processInvocation(AuthorizationInterceptor.java:138)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,997 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,998 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356)

      2018-10-23 13:40:25,999 ERROR [stderr]      at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80)

      2018-10-23 13:40:25,999 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,999 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:25,999 ERROR [stderr]      at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198)

      2018-10-23 13:40:25,999 ERROR [stderr]      at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185)

      2018-10-23 13:40:25,999 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:25,999 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:25,999 ERROR [stderr]      at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73)

      2018-10-23 13:40:25,999 ERROR [stderr]      at lisa.logistics.picking.service.ILMLiquidationService$$$view70.triggerLiquidationCheck(Unknown Source)

      2018-10-23 13:40:25,999 ERROR [stderr]      at lisa.logistics.picking.service.PickingProcessServiceBean.pick(PickingProcessServiceBean.java:318)

      2018-10-23 13:40:25,999 ERROR [stderr]      at lisa.logistics.picking.service.PickingProcessServiceBean.pickFromCurrentPosition(PickingProcessServiceBean.java:194)

      2018-10-23 13:40:25,999 ERROR [stderr]      at sun.reflect.GeneratedMethodAccessor265.invoke(Unknown Source)

      2018-10-23 13:40:25,999 ERROR [stderr]      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

      2018-10-23 13:40:25,999 ERROR [stderr]      at java.lang.reflect.Method.invoke(Method.java:498)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:82)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,000 ERROR [stderr]      at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,001 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:254)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:329)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.as.ejb3.security.AuthorizationInterceptor.processInvocation(AuthorizationInterceptor.java:138)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,002 ERROR [stderr]      at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22)

      2018-10-23 13:40:26,003 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,003 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64)

      2018-10-23 13:40:26,003 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,003 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67)

      2018-10-23 13:40:26,003 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,003 ERROR [stderr]      at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)

      2018-10-23 13:40:26,003 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,006 ERROR [stderr]      at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54)

      2018-10-23 13:40:26,006 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,006 ERROR [stderr]      at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64)

      2018-10-23 13:40:26,006 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,006 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)

      2018-10-23 13:40:26,007 ERROR [stderr]      at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73)

      2018-10-23 13:40:26,007 ERROR [stderr]      at lisa.logistics.picking.service.PickingProcessService$$$view73.pickFromCurrentPosition(Unknown Source)

      2018-10-23 13:40:26,008 ERROR [stderr]      at lisa.logistics.mde.picking.MDEPickingBean.handleNoneStandardPick(MDEPickingBean.java:658)

      2018-10-23 13:40:26,008 ERROR [stderr]      at lisa.logistics.mde.picking.MDEPickingBean.handlePick(MDEPickingBean.java:605)

      2018-10-23 13:40:26,008 ERROR [stderr]      at lisa.logistics.mde.picking.PickingPickView.actionNext(PickingPickView.java:126)

      2018-10-23 13:40:26,008 ERROR [stderr]      at sun.reflect.GeneratedMethodAccessor1087.invoke(Unknown Source)

      2018-10-23 13:40:26,008 ERROR [stderr]      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

      2018-10-23 13:40:26,008 ERROR [stderr]      at java.lang.reflect.Method.invoke(Method.java:498)

      2018-10-23 13:40:26,008 ERROR [stderr]      at com.sun.el.util.ReflectionUtil.invokeMethod(ReflectionUtil.java:181)

      2018-10-23 13:40:26,008 ERROR [stderr]      at com.sun.el.parser.AstValue.invoke(AstValue.java:289)

      2018-10-23 13:40:26,008 ERROR [stderr]      at com.sun.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:304)

      2018-10-23 13:40:26,008 ERROR [stderr]      at org.jboss.weld.util.el.ForwardingMethodExpression.invoke(ForwardingMethodExpression.java:40)

      2018-10-23 13:40:26,008 ERROR [stderr]      at org.jboss.weld.el.WeldMethodExpression.invoke(WeldMethodExpression.java:50)

      2018-10-23 13:40:26,008 ERROR [stderr]      at com.sun.faces.facelets.el.TagMethodExpression.invoke(TagMethodExpression.java:105)

      2018-10-23 13:40:26,008 ERROR [stderr]      at javax.faces.component.MethodBindingMethodExpressionAdapter.invoke(MethodBindingMethodExpressionAdapter.java:87)

      2018-10-23 13:40:26,009 ERROR [stderr]      at com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:101)

      2018-10-23 13:40:26,009 ERROR [stderr]      at javax.faces.component.UICommand.broadcast(UICommand.java:315)

      2018-10-23 13:40:26,009 ERROR [stderr]      at javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:786)

      2018-10-23 13:40:26,009 ERROR [stderr]      at javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:1251)

      2018-10-23 13:40:26,009 ERROR [stderr]      at com.sun.faces.lifecycle.InvokeApplicationPhase.execute(InvokeApplicationPhase.java:81)

      2018-10-23 13:40:26,009 ERROR [stderr]      at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101)

      2018-10-23 13:40:26,009 ERROR [stderr]      at com.sun.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:118)

      2018-10-23 13:40:26,009 ERROR [stderr]      at javax.faces.webapp.FacesServlet.service(FacesServlet.java:603)

      2018-10-23 13:40:26,009 ERROR [stderr]      at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85)

      2018-10-23 13:40:26,009 ERROR [stderr]      at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129)

      2018-10-23 13:40:26,009 ERROR [stderr]      at lisa.logistics.mde.filter.TransactionFilter.doFilter(TransactionFilter.java:64)

      2018-10-23 13:40:26,009 ERROR [stderr]      at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

      2018-10-23 13:40:26,009 ERROR [stderr]      at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

      2018-10-23 13:40:26,010 ERROR [stderr]      at lisa.logistics.mde.filter.UserMessageFilter.doFilter(UserMessageFilter.java:41)

      2018-10-23 13:40:26,010 ERROR [stderr]      at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

      2018-10-23 13:40:26,010 ERROR [stderr]      at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

      2018-10-23 13:40:26,010 ERROR [stderr]      at lisa.logistics.mde.filter.MDELogFilter.doFilter(MDELogFilter.java:34)

      2018-10-23 13:40:26,010 ERROR [stderr]      at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

      2018-10-23 13:40:26,010 ERROR [stderr]      at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

      2018-10-23 13:40:26,010 ERROR [stderr]      at lisa.logistics.mde.filter.ThreadNameFilter.doFilter(ThreadNameFilter.java:43)

      2018-10-23 13:40:26,011 ERROR [stderr]      at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

      2018-10-23 13:40:26,011 ERROR [stderr]      at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

      2018-10-23 13:40:26,011 ERROR [stderr]      at lisa.logistics.mde.filter.ProxyFilter.doFilter(ProxyFilter.java:104)

      2018-10-23 13:40:26,011 ERROR [stderr]      at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

      2018-10-23 13:40:26,011 ERROR [stderr]      at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

      2018-10-23 13:40:26,011 ERROR [stderr]      at lisa.logistics.mde.filter.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:134)

      2018-10-23 13:40:26,011 ERROR [stderr]      at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)

      2018-10-23 13:40:26,011 ERROR [stderr]      at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)

      2018-10-23 13:40:26,011 ERROR [stderr]      at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)

      2018-10-23 13:40:26,012 ERROR [stderr]      at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53)

      2018-10-23 13:40:26,012 ERROR [stderr]      at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

      2018-10-23 13:40:26,013 ERROR [stderr]      at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81)

      2018-10-23 13:40:26,013 ERROR [stderr]      at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104)

      2018-10-23 13:40:26,014 ERROR [stderr]      at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202)

      2018-10-23 13:40:26,015 ERROR [stderr]      at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805)

      2018-10-23 13:40:26,015 ERROR [stderr]      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

      2018-10-23 13:40:26,015 ERROR [stderr]      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

      2018-10-23 13:40:26,015 ERROR [stderr]      at java.lang.Thread.run(Thread.java:745)

      2018-10-23 13:40:26,015 ERROR [stderr]  Caused by: javax.jms.JMSException: AMQ119014: Timed out after waiting 30.000 ms for response when sending packet 71

      2018-10-23 13:40:26,015 ERROR [stderr]      at org.apache.activemq.artemis.core.protocol.core.impl.ChannelImpl.sendBlocking(ChannelImpl.java:398)

      2018-10-23 13:40:26,015 ERROR [stderr]      at org.apache.activemq.artemis.core.protocol.core.impl.ChannelImpl.sendBlocking(ChannelImpl.java:304)

      2018-10-23 13:40:26,015 ERROR [stderr]      at org.apache.activemq.artemis.core.protocol.core.impl.ActiveMQSessionContext.sendFullMessage(ActiveMQSessionContext.java:378)

      2018-10-23 13:40:26,015 ERROR [stderr]      at org.apache.activemq.artemis.core.client.impl.ClientProducerImpl.sendRegularMessage(ClientProducerImpl.java:286)

      2018-10-23 13:40:26,015 ERROR [stderr]      at org.apache.activemq.artemis.core.client.impl.ClientProducerImpl.doSend(ClientProducerImpl.java:264)

      2018-10-23 13:40:26,015 ERROR [stderr]      at org.apache.activemq.artemis.core.client.impl.ClientProducerImpl.send(ClientProducerImpl.java:122)

      2018-10-23 13:40:26,016 ERROR [stderr]      at org.apache.activemq.artemis.jms.client.ActiveMQMessageProducer.doSendx(ActiveMQMessageProducer.java:477)

      2018-10-23 13:40:26,016 ERROR [stderr]      at org.apache.activemq.artemis.jms.client.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:197)

      2018-10-23 13:40:26,016 ERROR [stderr]      at org.apache.activemq.artemis.jms.client.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:185)

      2018-10-23 13:40:26,016 ERROR [stderr]      at org.apache.activemq.artemis.jms.client.ActiveMQJMSProducer.send(ActiveMQJMSProducer.java:99)

      2018-10-23 13:40:26,016 ERROR [stderr]      ... 283 more

      2018-10-23 13:40:26,016 ERROR [stderr]  Caused by: ActiveMQConnectionTimedOutException[errorType=CONNECTION_TIMEDOUT message=AMQ119014: Timed out after waiting 30.000 ms for response when sending packet 71]

      2018-10-23 13:40:26,016 ERROR [stderr]      ... 293 more

      2018-10-23 13:40:26,684 WARN  [org.apache.activemq.artemis.jms.bridge] (Thread-297) AMQ342009: JMS Bridge failed to send + acknowledge batch, closing JMS objects: org.jboss.jms.exception.MessagingTransactionRolledBackException: Failed to invoke

              at org.jboss.jms.tx.ResourceManager.commitLocal(ResourceManager.java:225)

              at org.jboss.jms.client.container.SessionAspect.handleCommit(SessionAspect.java:582)

              at org.jboss.aop.advice.org.jboss.jms.client.container.SessionAspect_z_handleCommit_1635262156.invoke(SessionAspect_z_handleCommit_1635262156.java)

              at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

              at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

              at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

              at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

              at org.jboss.jms.client.delegate.ClientSessionDelegate.commit(ClientSessionDelegate.java)

              at org.jboss.jms.client.JBossSession.commit(JBossSession.java:164)

              at org.apache.activemq.artemis.jms.bridge.impl.JMSBridgeImpl.sendBatchNonTransacted(JMSBridgeImpl.java:1291)

              at org.apache.activemq.artemis.jms.bridge.impl.JMSBridgeImpl.sendBatch(JMSBridgeImpl.java:1251)

              at org.apache.activemq.artemis.jms.bridge.impl.JMSBridgeImpl.access$1500(JMSBridgeImpl.java:75)

              at org.apache.activemq.artemis.jms.bridge.impl.JMSBridgeImpl$BatchTimeChecker.run(JMSBridgeImpl.java:1794)

              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

              at java.lang.Thread.run(Thread.java:745)

      Caused by: org.jboss.jms.exception.MessagingJMSException: Failed to invoke

              at org.jboss.jms.client.delegate.DelegateSupport.handleThrowable(DelegateSupport.java:271)

              at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:205)

              at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:160)

              at org.jboss.jms.client.delegate.ClientConnectionDelegate.org$jboss$jms$client$delegate$ClientConnectionDelegate$sendTransaction$aop(ClientConnectionDelegate.java:221)

              at org.jboss.jms.client.delegate.ClientConnectionDelegate$sendTransaction_N3268650789275322226.invokeTarget(ClientConnectionDelegate$sendTransaction_N3268650789275322226.java)

              at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:111)

              at org.jboss.jms.client.container.FailoverValveInterceptor.invoke(FailoverValveInterceptor.java:114)

              at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

              at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

              at org.jboss.jms.client.container.ClosedInterceptor.invoke(ClosedInterceptor.java:170)

              at org.jboss.aop.advice.PerInstanceInterceptor.invoke(PerInstanceInterceptor.java:86)

              at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:102)

              at org.jboss.jms.client.delegate.ClientConnectionDelegate.sendTransaction(ClientConnectionDelegate.java)

              at org.jboss.jms.tx.ResourceManager.commitLocal(ResourceManager.java:206)

              ... 15 more

      Caused by: java.lang.IllegalStateException: Cannot find object in dispatcher with id 2y4-675tcanj-1-f1adcanj-lthhzo-bij5a

              at org.jboss.jms.wireformat.ConnectionSendTransactionRequest.serverInvoke(ConnectionSendTransactionRequest.java:79)

              at org.jboss.jms.server.remoting.JMSServerInvocationHandler.invoke(JMSServerInvocationHandler.java:157)

              at org.jboss.remoting.ServerInvoker.invoke(ServerInvoker.java:897)

              at org.jboss.remoting.transport.socket.ServerThread.completeInvocation(ServerThread.java:768)

              at org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:721)

              at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:575)

              at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:234)

              at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:218)

              at org.jboss.remoting.Client.invoke(Client.java:2084)

              at org.jboss.remoting.Client.invoke(Client.java:879)

              at org.jboss.remoting.Client.invoke(Client.java:867)

              at org.jboss.jms.client.delegate.DelegateSupport.doInvoke(DelegateSupport.java:189)

              ... 27 more

        • 1. Re: Wildfly 10.1.0.FINAL, JMS, ActiveMQ problem
          Miroslav Novak Master

          Hi Tim,

           

          could you check server logs of target server of the JMS bridge, please? Based on the exception it seems that JMS bridge forwarded/sent message to target destination to remote server but for some reason it did not get any reply. It can happen if target server crashed.

           

          If there is quality-of-service set to ONCE_AND_ONLY_ONCE on JMS bridge then no message will be lost. In the worst case they will get to DLQ (dead letter queue). But i'm not sure what happens if other types of quality service are set.

           

          Thanks,

          Mirek

          • 2. Re: Wildfly 10.1.0.FINAL, JMS, ActiveMQ problem
            Tim Hallwachs Newbie

            Hi Mirek,

             

            quality-of-service was AT_MOST_ONCE, i will change it to ONCE_AND_ONLY_ONCE.

             

            I couldn't found any errors on the target server, target server seems to work proper.

             

            Why is the bridge broken after the timeout and why is the connection not restored?

            Only a server restart has helped.

             

            Tim

            • 3. Re: Wildfly 10.1.0.FINAL, JMS, ActiveMQ problem
              Miroslav Novak Master

              I could see those timeout exceptions only when target server crashed thus I was asking for exception from remote target server but if there are no error then it's very hard to say what happened. It might be caused by network issues or if target server got overloaded. It's very hard to say as exception above is  symptom of the failure but not it's root cause.

               

              Only thing what  can be done now is to start monitoring of both of the servers of the bridge like CPU, memory, network and disk usage + checking any WARN/ERROR messages in logs so if this happens next time then there is more information.

               

              Another thing might be mis-configuration could you share configuration of messaging subsystem of the servers?