2 Replies Latest reply on Mar 1, 2019 9:28 AM by haohong

WFLYCTL0412: Required services that are not installed:" => ["jboss.datagrid-jgroups.factory.cluster"]

haohong Feb 28, 2019 2:22 AM

When I want to upgrade my infinispan from 9.1.4 to 9.3.1, I got an error message.

Our company infinispan running as a cluster in Openshift environment.

Here is the error message:

2019-02-25 16:24:39,741 DEBG 'Infinispan' stdout output:

16:24:39,740 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("add") failed - address: ([("subsystem" => "datagrid-jgroups")]) - failure description: {

"WFLYCTL0412: Required services that are not installed:" => ["jboss.datagrid-jgroups.factory.cluster"],

"WFLYCTL0180: Services with missing/unavailable dependencies" => ["jboss.datagrid-jgroups.factory.default is missing [jboss.datagrid-jgroups.factory.cluster]"]

}

2019-02-25 16:24:39,785 DEBG 'Infinispan' stdout output:

16:24:39,785 ERROR [org.jboss.as] (Controller Boot Thread) WFLYSRV0026: Infinispan Server 9.3.1.Final (WildFly Core 5.0.0.Final) started (with errors) in 2817ms - Started 141 of 256 services (17 services failed or missing dependencies, 137 services are lazy, passive or on-demand)

The following is my config file:

<?xml version='1.0' encoding='UTF-8'?>

<server xmlns="urn:jboss:domain:7.0">
<extensions>
<extension module="org.infinispan.extension"/>
<extension module="org.infinispan.server.endpoint"/>
<extension module="org.jboss.as.connector"/>
<extension module="org.jboss.as.deployment-scanner"/>
<extension module="org.jboss.as.jdr"/>
<extension module="org.jboss.as.jmx"/>
<extension module="org.jboss.as.logging"/>
<extension module="org.jboss.as.naming"/>
<extension module="org.jboss.as.remoting"/>
<extension module="org.jboss.as.security"/>
<extension module="org.jboss.as.transactions"/>
<extension module="org.jgroups.extension"/>
<extension module="org.wildfly.extension.elytron"/>
<extension module="org.wildfly.extension.io"/>
</extensions>
<management>
<security-realms>
<security-realm name="ManagementRealm">
<authentication>
<local default-user="$local" skip-group-loading="true"/>
<properties path="mgmt-users.properties" relative-to="jboss.server.config.dir"/>
</authentication>
<authorization map-groups-to-roles="false">
<properties path="mgmt-groups.properties" relative-to="jboss.server.config.dir"/>
</authorization>
</security-realm>
<security-realm name="ApplicationRealm">
<server-identities>
<ssl>
<keystore path="${env.ISPNKEYSTORE_HOTROD}" keystore-password="${env.KEYSTORE_PASSWORD}"/>
</ssl>
</server-identities>
<authentication>
<local default-user="$local" allowed-users="*" skip-group-loading="true"/>
<properties path="application-users.properties" relative-to="jboss.server.config.dir"/>
</authentication>
<authorization>
<properties path="application-roles.properties" relative-to="jboss.server.config.dir"/>
</authorization>
</security-realm>
<security-realm name="HotRodRealm">
<server-identities>
<ssl>
<keystore path="${env.ISPNKEYSTORE_HOTROD}" keystore-password="${env.KEYSTORE_PASSWORD}"/>
</ssl>
</server-identities>
</security-realm>
</security-realms>
<audit-log>
<formatters>
<json-formatter name="json-formatter"/>
</formatters>
<handlers>
<file-handler name="file" formatter="json-formatter" relative-to="jboss.server.data.dir"
   path="audit-log.log"/>
</handlers>
<logger log-boot="true" log-read-only="false" enabled="false">
<handlers>
<handler name="file"/>
</handlers>
</logger>
</audit-log>
<management-interfaces>
<http-interface security-realm="ManagementRealm">
<http-upgrade enabled="true"/>
<socket-binding http="management-http"/>
</http-interface>
</management-interfaces>
<access-control provider="rbac">
<role-mapping>
<role name="SuperUser">
<include>
<user name="$local"/>
</include>
</role>
<role name="Monitor">
<include>
<user name="%%HEALTHCHECK_USERNAME%%"/>
</include>
</role>
</role-mapping>
</access-control>
</management>
<profile>
<subsystem xmlns="urn:jboss:domain:logging:3.0">
<async-handler name="SERVER-FILE-ASYNC">
<queue-length value="1024"/>
<subhandlers>
<handler name="SERVER-FILE"/>
</subhandlers>
</async-handler>
<async-handler name="HR-ACCESS-FILE-ASYNC">
<queue-length value="1024"/>
<subhandlers>
<handler name="HR-ACCESS-FILE"/>
</subhandlers>
</async-handler>
<async-handler name="REST-ACCESS-FILE-ASYNC">
<queue-length value="1024"/>
<subhandlers>
<handler name="REST-ACCESS-FILE"/>
</subhandlers>
</async-handler>

<console-handler name="CONSOLE">
<level name="INFO"/>
<formatter>
<named-formatter name="COLOR-PATTERN"/>
</formatter>
</console-handler>
<size-rotating-file-handler name="SERVER-FILE" autoflush="true">
<formatter>
<named-formatter name="PATTERN"/>
</formatter>
<file path="/tmp/logs/server.log"/>
<suffix value=".yyyy-MM-dd"/>
<append value="true"/>
<rotate-size value="100M"/>
<max-backup-index value="10"/>
</size-rotating-file-handler>
<size-rotating-file-handler name="HR-ACCESS-FILE" autoflush="true">
<formatter>
<pattern-formatter pattern="(%t) %s%e%n"/>
</formatter>
<file path="/tmp/logs/hotrod-access.log"/>
<append value="true"/>
<rotate-size value="100M"/>
<max-backup-index value="10"/>
</size-rotating-file-handler>
<size-rotating-file-handler name="REST-ACCESS-FILE" autoflush="true">
<formatter>
<pattern-formatter pattern="(%t) %s%e%n"/>
</formatter>
<file path="/tmp/logs/rest-access.log"/>
<append value="true"/>
<rotate-size value="100M"/>
<max-backup-index value="10"/>
</size-rotating-file-handler>
<logger category="com.arjuna">
<level name="WARN"/>
</logger>
<logger category="org.jboss.as.config">
<level name="DEBUG"/>
</logger>
<logger category="sun.rmi">
<level name="WARN"/>
</logger>
<logger category="org.infinispan.server.hotrod.Decoder2x">
<level name="ERROR"/>
</logger>
<logger category="org.infinispan.server.hotrod.logging.HotRodAccessLoggingHandler">
   
   <level name="TRACE"/>
<handlers>
<handler name="HR-ACCESS-FILE-ASYNC"/>
</handlers>
</logger>
<logger category="RestAccessLoggingHandler">
   
   <level name="TRACE"/>
<handlers>
<handler name="REST-ACCESS-FILE-ASYNC"/>
</handlers>
</logger>
<root-logger>
<level name="${env.ISPN_LOGLEVEL:INFO}"/>
<handlers>
<handler name="CONSOLE"/>
<handler name="SERVER-FILE-ASYNC"/>
</handlers>
</root-logger>
<formatter name="PATTERN">
<pattern-formatter pattern="%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p [%c] (%t) %s%e%n"/>
</formatter>
<formatter name="COLOR-PATTERN">
<pattern-formatter pattern="%K{level}%d{HH:mm:ss,SSS} %-5p [%c] (%t) %s%e%n"/>
</formatter>
</subsystem>
<subsystem xmlns="urn:jboss:domain:deployment-scanner:2.0">
<deployment-scanner path="deployments" relative-to="jboss.server.base.dir" scan-interval="5000"
   runtime-failure-causes-rollback="${jboss.deployment.scanner.rollback.on.failure:false}"/>
</subsystem>
<subsystem xmlns="urn:jboss:domain:datasources:5.0">
<datasources/>
</subsystem>
<subsystem xmlns="urn:wildfly:elytron:3.0" final-providers="combined-providers" disallowed-providers="OracleUcrypto">
<providers>
<aggregate-providers name="combined-providers">
<providers name="elytron"/>
<providers name="openssl"/>
</aggregate-providers>
<provider-loader name="elytron" module="org.wildfly.security.elytron"/>
<provider-loader name="openssl" module="org.wildfly.openssl"/>
</providers>
<audit-logging>
<file-audit-log name="local-audit" path="audit.log" relative-to="jboss.server.log.dir" format="JSON"/>
</audit-logging>
<security-domains>
<security-domain name="ApplicationDomain" default-realm="ApplicationRealm"
   permission-mapper="default-permission-mapper">
<realm name="ApplicationRealm" role-decoder="groups-to-roles"/>
<realm name="local"/>
</security-domain>
<security-domain name="ManagementDomain" default-realm="ManagementRealm"
   permission-mapper="default-permission-mapper">
<realm name="ManagementRealm" role-decoder="groups-to-roles"/>
<realm name="local" role-mapper="super-user-mapper"/>
</security-domain>
</security-domains>
<security-realms>
<identity-realm name="local" identity="$local"/>
<properties-realm name="ApplicationRealm">
<users-properties path="application-users.properties" relative-to="jboss.server.config.dir"
   digest-realm-name="ApplicationRealm"/>
<groups-properties path="application-roles.properties" relative-to="jboss.server.config.dir"/>
</properties-realm>
<properties-realm name="ManagementRealm">
<users-properties path="mgmt-users.properties" relative-to="jboss.server.config.dir"
   digest-realm-name="ManagementRealm"/>
<groups-properties path="mgmt-groups.properties" relative-to="jboss.server.config.dir"/>
</properties-realm>
</security-realms>
<mappers>
<simple-permission-mapper name="default-permission-mapper" mapping-mode="first">
<permission-mapping>
<principal name="anonymous"/>
<permission-set name="default-permissions"/>
</permission-mapping>
<permission-mapping match-all="true">
<permission-set name="login-permission"/>
<permission-set name="default-permissions"/>
</permission-mapping>
</simple-permission-mapper>
<constant-realm-mapper name="local" realm-name="local"/>
<simple-role-decoder name="groups-to-roles" attribute="groups"/>
<constant-role-mapper name="super-user-mapper">
<role name="SuperUser"/>
</constant-role-mapper>
</mappers>
<permission-sets>
<permission-set name="login-permission">
<permission class-name="org.wildfly.security.auth.permission.LoginPermission"/>
</permission-set>
<permission-set name="default-permissions"/>
</permission-sets>
<http>
<http-authentication-factory name="application-http-authentication" security-domain="ApplicationDomain"
   http-server-mechanism-factory="global">
<mechanism-configuration>
<mechanism mechanism-name="BASIC">
<mechanism-realm realm-name="Application Realm"/>
</mechanism>
<mechanism mechanism-name="FORM"/>
</mechanism-configuration>
</http-authentication-factory>
<http-authentication-factory name="management-http-authentication" security-domain="ManagementDomain"
   http-server-mechanism-factory="global">
<mechanism-configuration>
<mechanism mechanism-name="DIGEST">
<mechanism-realm realm-name="ManagementRealm"/>
</mechanism>
</mechanism-configuration>
</http-authentication-factory>
<provider-http-server-mechanism-factory name="global"/>
</http>
<sasl>
<sasl-authentication-factory name="application-sasl-authentication" sasl-server-factory="configured"
   security-domain="ApplicationDomain">
<mechanism-configuration>
<mechanism mechanism-name="JBOSS-LOCAL-USER" realm-mapper="local"/>
<mechanism mechanism-name="DIGEST-MD5">
<mechanism-realm realm-name="ApplicationRealm"/>
</mechanism>
</mechanism-configuration>
</sasl-authentication-factory>
<sasl-authentication-factory name="management-sasl-authentication" sasl-server-factory="configured"
   security-domain="ManagementDomain">
<mechanism-configuration>
<mechanism mechanism-name="JBOSS-LOCAL-USER" realm-mapper="local"/>
<mechanism mechanism-name="DIGEST-MD5">
<mechanism-realm realm-name="ManagementRealm"/>
</mechanism>
</mechanism-configuration>
</sasl-authentication-factory>
<configurable-sasl-server-factory name="configured" sasl-server-factory="elytron">
<properties>
<property name="wildfly.sasl.local-user.default-user" value="$local"/>
</properties>
</configurable-sasl-server-factory>
<mechanism-provider-filtering-sasl-server-factory name="elytron" sasl-server-factory="global">
<filters>
<filter provider-name="WildFlyElytron"/>
</filters>
</mechanism-provider-filtering-sasl-server-factory>
<provider-sasl-server-factory name="global"/>
</sasl>
</subsystem>
<subsystem xmlns="urn:infinispan:server:core:9.3" default-cache-container="clustered">
<cache-container name="clustered" default-cache="default">
<transport lock-timeout="60000"/>
<global-state/>
<replicated-cache-configuration name="sessions-cfg" mode="SYNC" start="EAGER" batching="false">
<transaction mode="NON_DURABLE_XA" locking="PESSIMISTIC"/>
<locking acquire-timeout="0"/>
</replicated-cache-configuration>
<distributed-cache name="memcachedCache"/>
<distributed-cache name="default" remote-timeout="30000"/>
<replicated-cache name="work" configuration="sessions-cfg">
<backups></backups>
</replicated-cache>
<replicated-cache name="sessions" configuration="sessions-cfg">
<backups></backups>
</replicated-cache>
<replicated-cache name="authenticationSessions" configuration="sessions-cfg">
<backups></backups>
</replicated-cache>
<replicated-cache name="clientSessions" configuration="sessions-cfg">
<backups></backups>
</replicated-cache>
<replicated-cache name="offlineClientSessions" configuration="sessions-cfg">
<backups></backups>
</replicated-cache>
<replicated-cache name="offlineSessions" configuration="sessions-cfg">
<backups></backups>
</replicated-cache>
<replicated-cache name="loginFailures" configuration="sessions-cfg">
<backups></backups>
</replicated-cache>
<replicated-cache name="actionTokens" configuration="sessions-cfg">
<backups></backups>
</replicated-cache>
</cache-container>
</subsystem>
<subsystem xmlns="urn:infinispan:server:endpoint:9.3">
<hotrod-connector socket-binding="hotrod" cache-container="clustered" worker-threads="100">
   
   <topology-state-transfer external-host="${jboss.node.name}" lazy-retrieval="false" lock-timeout="1000"
   replication-timeout="5000"/>
</hotrod-connector>
</subsystem>
<subsystem xmlns="urn:infinispan:server:jgroups:9.3">
<channels default="cluster">
<channel name="cluster_v2"/>
<channel name="xsite_v2" stack="tcp"/>
</channels>
<stacks default="${jboss.default.jgroups.stack:kubernetes}">
<stack name="tcp">
<transport type="TCP" socket-binding="jgroups-tcp">
<property name="external_addr">${jgroups.tcp.external_addr:}</property>
</transport>
<protocol type="TCPPING">
<property name="initial_hosts">${jgroups.tcpping.initial_hosts:}</property>
<property name="ergonomics">false</property>
</protocol>
<protocol type="MERGE3">
<property name="min_interval">10000</property>
<property name="max_interval">30000</property>
</protocol>
<protocol type="FD_SOCK" socket-binding="jgroups-tcp-fd"/>
<protocol type="FD_ALL">
<property name="timeout">60000</property>
<property name="interval">15000</property>
<property name="timeout_check_interval">5000</property>
</protocol>
<protocol type="VERIFY_SUSPECT">
<property name="timeout">5000</property>
</protocol>
<protocol type="SYM_ENCRYPT">
<property name="keystore_type">pkcs12</property>
<property name="sym_algorithm">AES</property>
<property name="encrypt_entire_message">true</property>
<property name="keystore_name">${env.ISPNKEYSTORE_REPLICATION}</property>
<property name="store_password">${env.KEYSTORE_PASSWORD}</property>
<property name="alias">replication</property>
</protocol>
<protocol type="pbcast.NAKACK2">
<property name="use_mcast_xmit">false</property>
<property name="xmit_interval">100</property>
<property name="xmit_table_num_rows">50</property>
<property name="xmit_table_msgs_per_row">1024</property>
<property name="xmit_table_max_compaction_time">30000</property>
<property name="resend_last_seqno">true</property>
</protocol>
<protocol type="UNICAST3">
<property name="xmit_interval">100</property>
<property name="xmit_table_num_rows">50</property>
<property name="xmit_table_msgs_per_row">1024</property>
<property name="xmit_table_max_compaction_time">30000</property>
<property name="conn_expiry_timeout">0</property>
</protocol>
<protocol type="pbcast.STABLE">
<property name="stability_delay">500</property>
<property name="desired_avg_gossip">5000</property>
<property name="max_bytes">1M</property>
</protocol>
<protocol type="pbcast.GMS">
<property name="print_local_addr">true</property>
<property name="install_view_locally_first">true</property>
<property name="join_timeout">${jgroups.join_timeout:5000}</property>
</protocol>
<protocol type="MFC">
<property name="max_credits">2m</property>
<property name="min_threshold">0.40</property>
</protocol>
<protocol type="FRAG3"/>
<protocol type="RSVP"/>
</stack>
<stack name="kubernetes">
<transport type="TCP" socket-binding="jgroups-tcp">
<property name="logical_addr_cache_expiration">360000</property>
</transport>
<protocol type="kubernetes.KUBE_PING"/>
<protocol type="MERGE3">
<property name="min_interval">10000</property>
<property name="max_interval">30000</property>
</protocol>
<protocol type="FD_SOCK" socket-binding="jgroups-tcp-fd"/>
<protocol type="FD_ALL">
<property name="timeout">60000</property>
<property name="interval">15000</property>
<property name="timeout_check_interval">5000</property>
</protocol>
<protocol type="VERIFY_SUSPECT">
<property name="timeout">5000</property>
</protocol>
<protocol type="SYM_ENCRYPT">
<property name="keystore_type">pkcs12</property>
<property name="sym_algorithm">AES</property>
<property name="encrypt_entire_message">true</property>
<property name="keystore_name">${env.ISPNKEYSTORE_REPLICATION}</property>
<property name="store_password">${env.KEYSTORE_PASSWORD}</property>
<property name="alias">replication</property>
</protocol>
<protocol type="pbcast.NAKACK2">
<property name="use_mcast_xmit">false</property>
<property name="xmit_interval">100</property>
<property name="xmit_table_num_rows">50</property>
<property name="xmit_table_msgs_per_row">1024</property>
<property name="xmit_table_max_compaction_time">30000</property>
<property name="resend_last_seqno">true</property>
</protocol>
<protocol type="UNICAST3">
<property name="xmit_interval">100</property>
<property name="xmit_table_num_rows">50</property>
<property name="xmit_table_msgs_per_row">1024</property>
<property name="xmit_table_max_compaction_time">30000</property>
<property name="conn_expiry_timeout">0</property>
</protocol>
<protocol type="pbcast.STABLE">
<property name="stability_delay">500</property>
<property name="desired_avg_gossip">5000</property>
<property name="max_bytes">1M</property>
</protocol>
<protocol type="pbcast.GMS">
<property name="print_local_addr">true</property>
<property name="install_view_locally_first">true</property>
<property name="join_timeout">${jgroups.join_timeout:5000}</property>
</protocol>
<protocol type="MFC">
<property name="max_credits">2m</property>
<property name="min_threshold">0.40</property>
</protocol>
<protocol type="FRAG3"/>
<relay site="${env.LOCAL_SITE}">
<property name="relay_multicasts">false</property>
<property name="max_site_masters">3</property>
</relay>
</stack>
</stacks>
</subsystem>
<subsystem xmlns="urn:jboss:domain:io:3.0">
<worker name="default" task-max-threads="30" io-threads="30"/>
<buffer-pool name="default"/>
</subsystem>
<subsystem xmlns="urn:jboss:domain:jca:5.0">
<archive-validation enabled="true" fail-on-error="true" fail-on-warn="false"/>
<bean-validation enabled="true"/>
<default-workmanager>
<short-running-threads>
<core-threads count="50"/>
<queue-length count="50"/>
<max-threads count="50"/>
<keepalive-time time="10" unit="seconds"/>
</short-running-threads>
<long-running-threads>
<core-threads count="50"/>
<queue-length count="50"/>
<max-threads count="50"/>
<keepalive-time time="10" unit="seconds"/>
</long-running-threads>
</default-workmanager>
<cached-connection-manager/>
</subsystem>
<subsystem xmlns="urn:jboss:domain:jdr:1.0"/>
<subsystem xmlns="urn:jboss:domain:jmx:1.3">
<expose-resolved-model/>
<expose-expression-model/>
<remoting-connector/>
</subsystem>
<subsystem xmlns="urn:jboss:domain:naming:2.0">
<remote-naming/>
</subsystem>
<subsystem xmlns="urn:jboss:domain:remoting:4.0">
<endpoint/>
<http-connector name="http-remoting-connector" connector-ref="default" security-realm="ApplicationRealm"/>
</subsystem>
<subsystem xmlns="urn:jboss:domain:security:2.0">
<security-domains>
<security-domain name="other" cache-type="default">
<authentication>
<login-module code="Remoting" flag="optional">
<module-option name="password-stacking" value="useFirstPass"/>
</login-module>
<login-module code="RealmDirect" flag="required">
<module-option name="password-stacking" value="useFirstPass"/>
</login-module>
</authentication>
</security-domain>
<security-domain name="jboss-web-policy" cache-type="default">
<authorization>
<policy-module code="Delegating" flag="required"/>
</authorization>
</security-domain>
<security-domain name="jboss-ejb-policy" cache-type="default">
<authorization>
<policy-module code="Delegating" flag="required"/>
</authorization>
</security-domain>
<security-domain name="jaspitest" cache-type="default">
<authentication-jaspi>
<login-module-stack name="dummy">
<login-module code="Dummy" flag="optional"/>
</login-module-stack>
<auth-module code="Dummy"/>
</authentication-jaspi>
</security-domain>
</security-domains>
</subsystem>
<subsystem xmlns="urn:jboss:domain:transactions:4.0">
<core-environment>
<process-id>
<uuid/>
</process-id>
</core-environment>
<recovery-environment socket-binding="txn-recovery-environment" status-socket-binding="txn-status-manager"/>
<object-store path="tx-object-store" relative-to="jboss.server.data.dir"/>
</subsystem>
</profile>
<interfaces>
<interface name="management">
<inet-address value="${jboss.bind.address.management:127.0.0.1}"/>
</interface>
<interface name="public">
<inet-address value="${jboss.bind.address:127.0.0.1}"/>
</interface>
</interfaces>
<socket-binding-group name="standard-sockets" default-interface="public" port-offset="${jboss.socket.binding.port-offset:0}">
<socket-binding name="management-http" interface="management" port="${jboss.management.http.port:9990}"/>
<socket-binding name="management-https" interface="management" port="${jboss.management.https.port:9993}"/>
<socket-binding name="hotrod" port="11222"/>
<socket-binding name="hotrod-internal" port="11223"/>
<socket-binding name="hotrod-multi-tenancy" port="11224"/>
<socket-binding name="jgroups-mping" port="0" multicast-address="${jboss.default.multicast.address:234.99.54.14}" multicast-port="45700"/>
<socket-binding name="jgroups-tcp" port="7600"/>
<socket-binding name="jgroups-tcp-fd" port="57600"/>
<socket-binding name="jgroups-udp" port="55200" multicast-address="${jboss.default.multicast.address:234.99.54.14}" multicast-port="45688"/>
<socket-binding name="jgroups-udp-fd" port="54200"/>
<socket-binding name="memcached" port="11211"/>
<socket-binding name="rest" port="8080"/>
<socket-binding name="rest-multi-tenancy" port="8081"/>
<socket-binding name="rest-ssl" port="8443"/>
<socket-binding name="txn-recovery-environment" port="4712"/>
<socket-binding name="txn-status-manager" port="4713"/>
<socket-binding name="websocket" port="8181"/>
<outbound-socket-binding name="remote-store-hotrod-server">
<remote-destination host="remote-host" port="11222"/>
</outbound-socket-binding>
<outbound-socket-binding name="remote-store-rest-server">
<remote-destination host="remote-host" port="8080"/>
</outbound-socket-binding>
</socket-binding-group>
</server>

Thanks,

Haoran Hong

1. Re: WFLYCTL0412: Required services that are not installed:" => ["jboss.datagrid-jgroups.factory.cluster"]

nadirx Feb 28, 2019 3:00 AM (in response to haohong)

This error happens because the jgroups subsystem is not initializing correctly. Do you have an earlier log about jgroups initialization / discovery ?
Actions
2. Re: WFLYCTL0412: Required services that are not installed:" => ["jboss.datagrid-jgroups.factory.cluster"]

haohong Mar 1, 2019 9:28 AM (in response to nadirx)

Thanks Tristan!
I have resolved this question.
Could you please have a look another issue?
WARN [org.jgroups.protocols.TCP] JGRP000012: discarded message from different cluster xsite(our cluster is cluster).

Thanks very much!
Actions

Go to original post