failed deserializing retransmission list

[ojudith.ext]

Hi,

On an application recently deployed in préproduction, we have the error bellow  that appears every second in console.log

Our configuration is based on domain mode hosted on two hosts .

1 domain + host controller

1 host controller.

We've also changed the default ports of jgroup multicast 

[Server:Server1] 11:52:50,013 ERROR [org.jgroups.protocols.pbcast.NAKACK2] (thread-2,ee,slave_002:Server1) failed deserializing retransmission list: java.util.concurrent.RejectedExecutionException: Task org.jgroups.protocols.TP$3@3ecd179a rejected from java.util.concurrent.ThreadPoolExecutor@2d78d0b6[Running, pool size = 300, active threads = 1, queued tasks = 100, completed tasks = 2974188]

[Server:Server1]     at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)

[Server:Server1]     at org.jgroups.util.ShutdownRejectedExecutionHandler.rejectedExecution(ShutdownRejectedExecutionHandler.java:33)

[Server:Server1]     at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)

[Server:Server1]     at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)

[Server:Server1]     at org.jgroups.protocols.TP.loopback(TP.java:1533)

[Server:Server1]     at org.jgroups.protocols.TP.down(TP.java:1472)

[Server:Server1]     at org.jgroups.protocols.Discovery.down(Discovery.java:440)

[Server:Server1]     at org.jgroups.protocols.MERGE3.down(MERGE3.java:254)

[Server:Server1]     at org.jgroups.protocols.FD_SOCK.down(FD_SOCK.java:371)

[Server:Server1]     at org.jgroups.protocols.FD_ALL.down(FD_ALL.java:233)

[Server:Server1]     at org.jgroups.protocols.VERIFY_SUSPECT.down(VERIFY_SUSPECT.java:92)

[Server:Server1]     at org.jgroups.protocols.pbcast.NAKACK2.sendXmitRsp(NAKACK2.java:1054)

[Server:Server1]     at org.jgroups.protocols.pbcast.NAKACK2.handleXmitReq(NAKACK2.java:958)

[Server:Server1]     at org.jgroups.protocols.pbcast.NAKACK2.up(NAKACK2.java:618)

[Server:Server1]     at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:155)

[Server:Server1]     at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:200)

[Server:Server1]     at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:310)

[Server:Server1]     at org.jgroups.protocols.MERGE3.up(MERGE3.java:285)

[Server:Server1]     at org.jgroups.protocols.Discovery.up(Discovery.java:296)

[Server:Server1]     at org.jgroups.protocols.TP.passMessageUp(TP.java:1601)

[Server:Server1]     at org.jgroups.protocols.TP$SingleMessageHandler.run(TP.java:1817)

[Server:Server1]     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

[Server:Server1]     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

[Server:Server1]     at org.jboss.as.clustering.jgroups.ClassLoaderThreadFactory.lambda$newThread$4(ClassLoaderThreadFactory.java:52)

[Server:Server1]     at java.lang.Thread.run(Thread.java:745)

Does someone has an idea how i can resolve this?

[pferraro]

Which version of WildFly are you using?  The error message is misleading.  The exception happens here:

https://github.com/belaban/JGroups/blob/3.6/src/org/jgroups/protocols/pbcast/NAKACK2.java#L614

but the issue isn't with serializing the retransmission, but rather with sending the retransmission response (it throws a rejected execution exception when submitting the task to the thread pool).  It looks as if the rejected execution exception is due to the channel shutting down.

You can workaround this specific issue by making the following configuration change to the transport of the target protocol stack in your jgroups subsystem configuration:

<stack name="...">
    <transport type="...">
        <property name="loopback_separate_thread">false</property>
    </transport>
    <!-- ... -->
</stack>

[ojudith.ext]

Hi, Paul

We're using wildfly 10 .

We'll try your solution. Keep you informed

Regards

2017-04-12 16:17 GMT+02:00 pferraro <[e-mail]>:

JBoss Developer <https://developer.jboss.org/?et=watches.email.thread>

failed deserializing retransmission list

reply from Paul Ferraro

<https://developer.jboss.org/people/pferraro?et=watches.email.thread> in

WildFly - View the full discussion

<https://developer.jboss.org/message/970834?et=watches.email.thread#970834>

[danielserva]

Hi Olivier,

Are you still getting this error?

Have you found the solution for this issue?

I'm having this problem too. Same configuration as yours.

Regards