Duplicate key problem reoccurs when there are two clusters in same IP block

[ovuncsezer]

Hi,

I am using WildFly 10.0.0.Final for clustering our application. There are two cluster groups running for different applications on same IP block.

We have two applications to run in domain mode. These application uses same libraries so there are EJBs with same names.

One master and slave is now running for application1.

When I try to deploy application2 to another master and slave configuration I have faced Duplicate key exception which has an issue before. Here is the issue: [WFLY-5308] Failed to start service due to IllegalStateException: Duplicate key during application deployment - JBoss …

It is said to be fixed in 10.0.0.CR1 and we are using 10.0.0.Final. I think same problem occurs when there are two different clusters on same IP block.

When we shutted down the application1 servers, application2 deploys successfully.

domain.xml and host.xml can be found in attachment for application2.

How can be overcome this issue?

[ctomc]

stacktrace?

[ovuncsezer]

Stacktrace is exactly the same as the stack trace in the issue. [WFLY-5308] Failed to start service due to IllegalStateException: Duplicate key during application deployment - JBoss …

[ctomc]

Well stacktrace cannot be exactly the same as in 10.0.0.Final line 110 in CacheRegistry doesn't match up with stracktrce in linked issue.

see wildfly/CacheRegistry.java at 10.0.0.Final · wildfly/wildfly · GitHub  for example.

[ovuncsezer]

Here is the stacktrace.

2016-11-15 13:27:43,368 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 69) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:43,368 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 69) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:43,368 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:43,368 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:43,759 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-4) WFLYJCA0005: Deploying non-JDBC-compliant driver class com.teradata.jdbc.TeraDriver (version 14.10)

2016-11-15 13:27:43,775 INFO  [org.jboss.weld.deployer] (MSC service thread 1-4) WFLYWELD0006: Starting Services for CDI deployment: turkuaz-sgrs-web.war

2016-11-15 13:27:43,821 INFO  [org.jboss.weld.Version] (MSC service thread 1-4) WELD-000900: 2.3.2 (Final)

2016-11-15 13:27:43,853 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 69) WFLYCLINF0002: Started dist cache from ejb container

2016-11-15 13:27:43,884 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 70) WFLYCLINF0002: Started client-mappings cache from ejb container

2016-11-15 13:27:43,915 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-1) MSC000001: Failed to start service jboss.ejb.remoting.connector.client-mappings.installer: org.jboss.msc.service.StartException in service jboss.ejb.remoting.connector.client-mappings.installer: Failed to start service

                at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1904)

                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

                at java.lang.Thread.run(Thread.java:745)

Caused by: java.lang.IllegalStateException: Duplicate key [org.jboss.as.network.ClientMapping@1ffd20fb]

                at java.util.stream.Collectors.lambda$throwingMerger$0(Collectors.java:133)

                at java.util.HashMap.merge(HashMap.java:1253)

                at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1320)

                at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)

                at java.util.Iterator.forEachRemaining(Iterator.java:116)

                at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)

                at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)

                at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)

                at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)

                at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)

                at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)

                at org.wildfly.clustering.server.registry.CacheRegistry.getEntries(CacheRegistry.java:123)

                at org.jboss.as.ejb3.remote.LocalEjbReceiver.registryAdded(LocalEjbReceiver.java:447)

                at org.jboss.as.ejb3.remote.RegistryCollectorService.add(RegistryCollectorService.java:54)

                at org.jboss.as.ejb3.remote.RegistryInstallerService.start(RegistryInstallerService.java:65)

                at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1948)

                at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1881)

                ... 3 more

2016-11-15 13:27:46,572 INFO  [org.jboss.ws.cxf.deployment] (MSC service thread 1-4) JBWS024074: WSDL published to: file:/D:/Programs/wildfly-10.0.0.Final/domain/servers/server-three/data/wsdl/turkuaz-sgrs-web.war/KsyaSoapServiceService.wsdl

2016-11-15 13:27:46,619 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:46,619 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:46,619 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:46,619 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:46,650 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-6) WFLYJCA0018: Started Driver service with driver-name = turkuaz-sgrs-web.war_com.teradata.jdbc.TeraDriver_14_10

2016-11-15 13:27:46,650 INFO  [org.jboss.as.webservices] (MSC service thread 1-1) WFLYWS0003: Starting service jboss.ws.endpoint."turkuaz-sgrs-web.war"."tr.com.havelsan.sgrs.ksya.service.soap.KsyaSoapService"

2016-11-15 13:27:46,650 INFO  [org.jboss.as.webservices] (MSC service thread 1-4) WFLYWS0003: Starting service jboss.ws.endpoint."turkuaz-sgrs-web.war"."tr.com.havelsan.sgrs.ksya.service.soap.SicilSoapService"

2016-11-15 13:27:46,650 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 69) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:46,650 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 69) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-15 13:27:46,665 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 70) WFLYCLINF0002: Started routing cache from web container

2016-11-15 13:27:46,712 INFO  [org.jboss.weld.deployer] (MSC service thread 1-4) WFLYWELD0009: Starting weld service for deployment turkuaz-sgrs-web.war

2016-11-15 13:27:46,728 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 70) WFLYCLINF0002: Started turkuaz-sgrs-web.war cache from web container

2016-11-15 13:27:46,962 INFO  [org.jboss.as.jpa] (ServerService Thread Pool -- 70) WFLYJPA0010: Starting Persistence Unit (phase 2 of 2) Service 'turkuaz-sgrs-web.war#sgrs'

2016-11-15 13:27:47,213 WARN  [org.jboss.jca.core.connectionmanager.pool.strategy.OnePool] (ServerService Thread Pool -- 70) IJ000407: No lazy enlistment available for turkuaz_db_srv_12c

2016-11-15 13:27:47,229 INFO  [org.hibernate.dialect.Dialect] (ServerService Thread Pool -- 70) HHH000400: Using dialect: org.hibernate.spatial.dialect.oracle.OracleSpatial10gDialect

2016-11-15 13:27:47,229 INFO  [org.hibernate.dialect.Dialect] (ServerService Thread Pool -- 70) HHH000400: Using dialect: org.hibernate.spatial.dialect.oracle.OracleSpatial10gDialect

2016-11-15 13:27:47,370 INFO  [org.hibernate.envers.boot.internal.EnversServiceImpl] (ServerService Thread Pool -- 70) Envers integration enabled? : true

2016-11-15 13:27:48,557 INFO  [org.hibernate.hql.internal.QueryTranslatorFactoryInitiator] (ServerService Thread Pool -- 70) HHH000397: Using ASTQueryTranslatorFactory

2016-11-15 13:27:48,713 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("add") failed - address: ([

    ("subsystem" => "ejb3"),

    ("service" => "remote")

]) - failure description: {"WFLYCTL0080: Failed services" => {"jboss.ejb.remoting.connector.client-mappings.installer" => "org.jboss.msc.service.StartException in service jboss.ejb.remoting.connector.client-mappings.installer: Failed to start service

    Caused by: java.lang.IllegalStateException: Duplicate key [org.jboss.as.network.ClientMapping@1ffd20fb]"}}

2016-11-15 13:27:48,760 INFO  [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0010: Deployed "turkuaz-sgrs-web.war" (runtime-name : "turkuaz-sgrs-web.war")

2016-11-15 13:27:48,792 INFO  [org.jboss.as.controller] (Controller Boot Thread) WFLYCTL0183: Service status report

WFLYCTL0186:   Services which failed to start:      service jboss.ejb.remoting.connector.client-mappings.installer: org.jboss.msc.service.StartException in service jboss.ejb.remoting.connector.client-mappings.installer: Failed to start service

[pferraro]

Can you paste the portion of your log that reports the cluster membership?  Does this look correct to you?  My suspicion is that your clusters are not isolated properly.

[ovuncsezer]

Here is the full stacktrace...

2016-11-16 09:06:29,330 INFO  [org.jboss.modules] (main) JBoss Modules version 1.5.1.Final

2016-11-16 09:06:29,502 INFO  [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final

2016-11-16 09:06:29,565 INFO  [org.jboss.as] (MSC service thread 1-6) WFLYSRV0049: WildFly Full 10.0.0.Final (WildFly Core 2.0.10.Final) starting

2016-11-16 09:06:29,565 DEBUG [org.jboss.as.config] (MSC service thread 1-6) Configured system properties:

  [Server:server-three] =

  awt.toolkit = sun.awt.windows.WToolkit

  file.encoding = Cp1254

  file.encoding.pkg = sun.io

  file.separator = \

  java.awt.graphicsenv = sun.awt.Win32GraphicsEnvironment

  java.awt.printerjob = sun.awt.windows.WPrinterJob

  java.class.path = D:\Programs\wildfly-10.0.0.Final\jboss-modules.jar

  java.class.version = 52.0

  java.endorsed.dirs = C:\Program Files\Java\jdk1.8.0_92\jre\lib\endorsed

  java.ext.dirs = C:\Program Files\Java\jdk1.8.0_92\jre\lib\ext;C:\Windows\Sun\Java\lib\ext

  java.home = C:\Program Files\Java\jdk1.8.0_92\jre

  java.io.tmpdir = C:\Users\fisik\AppData\Local\Temp\

  java.library.path = C:\Program Files\Java\jdk1.8.0_92\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;D:\programs\app\product\12.1.0\dbhome_1\bin;D:\Programs\app\oracle\product\12.1.0\dbhome_1\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\; C:\Program Files\TortoiseSVN\bin;D:\Programs\apache-maven-3.0.4\bin;C:\Program Files\TortoiseSVN\bin; ;.

  java.net.preferIPv4Stack = true

  java.runtime.name = Java(TM) SE Runtime Environment

  java.runtime.version = 1.8.0_92-b14

  java.specification.name = Java Platform API Specification

  java.specification.vendor = Oracle Corporation

  java.specification.version = 1.8

  java.util.logging.manager = org.jboss.logmanager.LogManager

  java.vendor = Oracle Corporation

  java.vendor.url = http://java.oracle.com/

  java.vendor.url.bug = http://bugreport.sun.com/bugreport/

  java.version = 1.8.0_92

  java.vm.info = mixed mode

  java.vm.name = Java HotSpot(TM) 64-Bit Server VM

  java.vm.specification.name = Java Virtual Machine Specification

  java.vm.specification.vendor = Oracle Corporation

  java.vm.specification.version = 1.8

  java.vm.vendor = Oracle Corporation

  java.vm.version = 25.92-b14

  javax.management.builder.initial = org.jboss.as.jmx.PluggableMBeanServerBuilder

  javax.xml.datatype.DatatypeFactory = __redirected.__DatatypeFactory

  javax.xml.parsers.DocumentBuilderFactory = __redirected.__DocumentBuilderFactory

  javax.xml.parsers.SAXParserFactory = __redirected.__SAXParserFactory

  javax.xml.stream.XMLEventFactory = __redirected.__XMLEventFactory

  javax.xml.stream.XMLInputFactory = __redirected.__XMLInputFactory

  javax.xml.stream.XMLOutputFactory = __redirected.__XMLOutputFactory

  javax.xml.transform.TransformerFactory = __redirected.__TransformerFactory

  javax.xml.validation.SchemaFactory:http://www.w3.org/2001/XMLSchema = __redirected.__SchemaFactory

  javax.xml.xpath.XPathFactory:http://java.sun.com/jaxp/xpath/dom = __redirected.__XPathFactory

  jboss.domain.base.dir = D:\Programs\wildfly-10.0.0.Final\domain

  jboss.domain.config.dir = D:\Programs\wildfly-10.0.0.Final\domain\configuration

  jboss.home.dir = D:\Programs\wildfly-10.0.0.Final

  jboss.host.name = fisik

  jboss.modules.dir = D:\Programs\wildfly-10.0.0.Final\modules

  jboss.modules.system.pkgs = org.jboss.byteman

  jboss.node.name = master:server-three

  jboss.qualified.host.name = fisik

  jboss.server.base.dir = D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three

  jboss.server.config.dir = D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\configuration

  jboss.server.data.dir = D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data

  jboss.server.deploy.dir = D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data\content

  jboss.server.log.dir = D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\log

  jboss.server.name = server-three

  jboss.server.persist.config = true

  jboss.server.temp.dir = D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\tmp

  line.separator =

  logging.configuration = file:D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data\logging.properties

  module.path = D:\Programs\wildfly-10.0.0.Final\modules

  org.jboss.resolver.warning = true

  org.xml.sax.driver = __redirected.__XMLReaderFactory

  os.arch = amd64

  os.name = Windows 8

  os.version = 6.2

  path.separator = ;

  sun.arch.data.model = 64

  sun.boot.class.path = C:\Program Files\Java\jdk1.8.0_92\jre\lib\resources.jar;C:\Program Files\Java\jdk1.8.0_92\jre\lib\rt.jar;C:\Program Files\Java\jdk1.8.0_92\jre\lib\sunrsasign.jar;C:\Program Files\Java\jdk1.8.0_92\jre\lib\jsse.jar;C:\Program Files\Java\jdk1.8.0_92\jre\lib\jce.jar;C:\Program Files\Java\jdk1.8.0_92\jre\lib\charsets.jar;C:\Program Files\Java\jdk1.8.0_92\jre\lib\jfr.jar;C:\Program Files\Java\jdk1.8.0_92\jre\classes

  sun.boot.library.path = C:\Program Files\Java\jdk1.8.0_92\jre\bin

  sun.cpu.endian = little

  sun.cpu.isalist = amd64

  sun.desktop = windows

  sun.io.unicode.encoding = UnicodeLittle

  sun.java.command = D:\Programs\wildfly-10.0.0.Final\jboss-modules.jar -mp D:\Programs\wildfly-10.0.0.Final\modules org.jboss.as.server

  sun.java.launcher = SUN_STANDARD

  sun.jnu.encoding = Cp1254

  sun.management.compiler = HotSpot 64-Bit Tiered Compilers

  sun.os.patch.level =

  user.country = US

  user.country.format = TR

  user.dir = D:\Programs\wildfly-10.0.0.Final

  user.home = C:\Users\fisik

  user.language = en

  user.language.format = tr

  user.name = fisik

  user.script =

  user.timezone = Europe/Moscow

  user.variant =

2016-11-16 09:06:29,565 DEBUG [org.jboss.as.config] (MSC service thread 1-6) VM Arguments: -D[Server:server-three] -Xms64m -Xmx512m -XX:MetaspaceSize=96m -XX:MaxMetaspaceSize=256m -Djava.net.preferIPv4Stack=true -Djboss.home.dir=D:\Programs\wildfly-10.0.0.Final -Djboss.modules.system.pkgs=org.jboss.byteman -Djboss.server.log.dir=D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\log -Djboss.server.temp.dir=D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\tmp -Djboss.server.data.dir=D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data -Dlogging.configuration=file:D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data\logging.properties

2016-11-16 09:06:29,627 INFO  [org.xnio] (MSC service thread 1-1) XNIO version 3.3.4.Final

2016-11-16 09:06:29,643 INFO  [org.xnio.nio] (MSC service thread 1-1) XNIO NIO Implementation Version 3.3.4.Final

2016-11-16 09:06:29,674 INFO  [org.jboss.remoting] (MSC service thread 1-4) JBoss Remoting version 4.0.18.Final

2016-11-16 09:06:31,034 WARN  [org.jboss.as.txn] (ServerService Thread Pool -- 39) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique.

2016-11-16 09:06:31,049 INFO  [org.jboss.as.webservices] (ServerService Thread Pool -- 37) WFLYWS0002: Activating WebServices Extension

2016-11-16 09:06:31,049 INFO  [org.jboss.as.clustering.jgroups] (ServerService Thread Pool -- 56) WFLYCLJG0001: Activating JGroups subsystem.

2016-11-16 09:06:31,049 INFO  [org.jboss.as.security] (ServerService Thread Pool -- 42) WFLYSEC0002: Activating Security Subsystem

2016-11-16 09:06:31,049 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 61) WFLYCLINF0001: Activating Infinispan subsystem.

2016-11-16 09:06:31,065 INFO  [org.jboss.as.naming] (ServerService Thread Pool -- 48) WFLYNAM0001: Activating Naming Subsystem

2016-11-16 09:06:31,065 INFO  [org.jboss.as.security] (MSC service thread 1-3) WFLYSEC0001: Current PicketBox version=4.9.4.Final

2016-11-16 09:06:31,081 INFO  [org.wildfly.iiop.openjdk] (ServerService Thread Pool -- 60) WFLYIIOP0001: Activating IIOP Subsystem

2016-11-16 09:06:31,081 INFO  [org.jboss.as.jsf] (ServerService Thread Pool -- 53) WFLYJSF0007: Activated the following JSF Implementations: [main]

2016-11-16 09:06:31,081 INFO  [org.jboss.as.connector] (MSC service thread 1-4) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.3.2.Final)

2016-11-16 09:06:31,081 INFO  [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 65) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3)

2016-11-16 09:06:31,096 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-6) WFLYJCA0018: Started Driver service with driver-name = h2

2016-11-16 09:06:31,096 INFO  [org.wildfly.extension.io] (ServerService Thread Pool -- 62) WFLYIO001: Worker 'default' has auto-configured to 16 core threads with 128 task threads based on your 8 available processors

2016-11-16 09:06:31,127 INFO  [org.wildfly.extension.undertow] (ServerService Thread Pool -- 38) WFLYUT0003: Undertow 1.3.15.Final starting

2016-11-16 09:06:31,127 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-1) WFLYUT0003: Undertow 1.3.15.Final starting

2016-11-16 09:06:31,174 INFO  [org.jboss.as.naming] (MSC service thread 1-7) WFLYNAM0003: Starting Naming Service

2016-11-16 09:06:31,174 INFO  [org.jboss.as.mail.extension] (MSC service thread 1-3) WFLYMAIL0001: Bound mail session [java:jboss/mail/Default]

2016-11-16 09:06:31,190 INFO  [org.wildfly.extension.undertow] (ServerService Thread Pool -- 38) WFLYUT0014: Creating file handler for path 'D:\Programs\wildfly-10.0.0.Final/welcome-content' with options [directory-listing: 'false', follow-symlink: 'false', case-sensitive: 'true', safe-symlink-paths: '[]']

2016-11-16 09:06:31,206 INFO  [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 65) WFLYJCA0004: Deploying JDBC-compliant driver class oracle.jdbc.OracleDriver (version 12.1)

2016-11-16 09:06:31,221 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-4) WFLYJCA0018: Started Driver service with driver-name = oraclesql

2016-11-16 09:06:31,409 INFO  [org.jboss.as.ejb3] (MSC service thread 1-5) WFLYEJB0481: Strict pool slsb-strict-max-pool is using a max instance size of 128 (per class), which is derived from thread worker pool sizing.

2016-11-16 09:06:31,409 INFO  [org.jboss.as.ejb3] (MSC service thread 1-8) WFLYEJB0482: Strict pool mdb-strict-max-pool is using a max instance size of 32 (per class), which is derived from the number of CPUs on this host.

2016-11-16 09:06:31,409 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-1) WFLYUT0012: Started server default-server.

2016-11-16 09:06:31,424 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-1) WFLYUT0018: Host default-host starting

2016-11-16 09:06:31,471 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-4) WFLYUT0006: Undertow AJP listener ajp listening on 10.0.15.132:8009

2016-11-16 09:06:31,487 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-8) WFLYUT0006: Undertow HTTP listener default listening on 10.0.15.132:8330

2016-11-16 09:06:31,502 INFO  [org.jboss.modcluster] (ServerService Thread Pool -- 69) MODCLUSTER000001: Initializing mod_cluster version 1.3.1.Final

2016-11-16 09:06:31,518 INFO  [org.jboss.modcluster] (ServerService Thread Pool -- 69) MODCLUSTER000032: Listening to proxy advertisements on /224.0.1.105:23364

2016-11-16 09:06:31,659 INFO  [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-3) WFLYJCA0001: Bound data source [java:/MyProjectDBSrv12c]

2016-11-16 09:06:31,659 INFO  [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-8) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS]

2016-11-16 09:06:31,721 INFO  [org.jboss.as.server.deployment] (MSC service thread 1-1) WFLYSRV0027: Starting deployment of "test-app.war" (runtime-name: "test-app.war")

2016-11-16 09:06:31,737 INFO  [org.wildfly.iiop.openjdk] (MSC service thread 1-6) WFLYIIOP0009: CORBA ORB Service started

2016-11-16 09:06:31,784 INFO  [org.jboss.ws.common.management] (MSC service thread 1-4) JBWS022052: Starting JBossWS 5.1.3.Final (Apache CXF 3.1.4)

2016-11-16 09:06:34,253 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-7) WFLYMSGAMQ0001: AIO wasn't located on this platform, it will fall back to using pure Java NIO.

2016-11-16 09:06:34,362 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221000: live Message Broker is starting with configuration Broker Configuration (clustered=true,journalDirectory=D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data\activemq\journal,bindingsDirectory=D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data\activemq\bindings,largeMessagesDirectory=D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data\activemq\largemessages,pagingDirectory=D:\Programs\wildfly-10.0.0.Final\domain\servers\server-three\data\activemq\paging)

2016-11-16 09:06:34,409 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221013: Using NIO Journal

2016-11-16 09:06:34,565 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221043: Protocol module found: [artemis-server]. Adding protocol support for: CORE

2016-11-16 09:06:34,565 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221043: Protocol module found: [artemis-amqp-protocol]. Adding protocol support for: AMQP

2016-11-16 09:06:34,581 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221043: Protocol module found: [artemis-hornetq-protocol]. Adding protocol support for: HORNETQ

2016-11-16 09:06:34,581 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221043: Protocol module found: [artemis-stomp-protocol]. Adding protocol support for: STOMP

2016-11-16 09:06:34,644 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-4) ISPN000078: Starting JGroups channel hibernate

2016-11-16 09:06:34,644 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7) ISPN000078: Starting JGroups channel web

2016-11-16 09:06:34,644 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-3) ISPN000078: Starting JGroups channel server

2016-11-16 09:06:34,644 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-8) ISPN000078: Starting JGroups channel ejb

2016-11-16 09:06:34,660 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-3) ISPN000094: Received new cluster view for channel server: [master:server-three|5] (2) [master:server-three, master:server-three]

2016-11-16 09:06:34,660 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7) ISPN000094: Received new cluster view for channel web: [master:server-three|5] (2) [master:server-three, master:server-three]

2016-11-16 09:06:34,660 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-8) ISPN000094: Received new cluster view for channel ejb: [master:server-three|5] (2) [master:server-three, master:server-three]

2016-11-16 09:06:34,660 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-4) ISPN000094: Received new cluster view for channel hibernate: [master:server-three|5] (2) [master:server-three, master:server-three]

2016-11-16 09:06:34,676 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-4) ISPN000079: Channel hibernate local address is master:server-three, physical addresses are [10.0.15.132:55450]

2016-11-16 09:06:34,676 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-8) ISPN000079: Channel ejb local address is master:server-three, physical addresses are [10.0.15.132:55450]

2016-11-16 09:06:34,676 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-3) ISPN000079: Channel server local address is master:server-three, physical addresses are [10.0.15.132:55450]

2016-11-16 09:06:34,676 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7) ISPN000079: Channel web local address is master:server-three, physical addresses are [10.0.15.132:55450]

2016-11-16 09:06:34,707 INFO  [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-8) ISPN000128: Infinispan version: Infinispan 'Mahou' 8.1.0.Final

2016-11-16 09:06:34,707 INFO  [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-3) ISPN000128: Infinispan version: Infinispan 'Mahou' 8.1.0.Final

2016-11-16 09:06:34,707 INFO  [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-4) ISPN000128: Infinispan version: Infinispan 'Mahou' 8.1.0.Final

2016-11-16 09:06:34,707 INFO  [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-7) ISPN000128: Infinispan version: Infinispan 'Mahou' 8.1.0.Final

2016-11-16 09:06:38,629 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-8) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor acceptor

2016-11-16 09:06:38,629 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-5) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor-throughput acceptor

2016-11-16 09:06:38,629 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-7) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor acceptor

2016-11-16 09:06:38,629 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-6) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor-throughput acceptor

2016-11-16 09:06:38,676 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221007: Server is now live

2016-11-16 09:06:38,676 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221001: Apache ActiveMQ Artemis Message Broker version 1.1.0.wildfly-011 [nodeID=a37b6dfd-aa36-11e6-8564-81e8959e645b]

2016-11-16 09:06:38,676 INFO  [org.wildfly.extension.messaging-activemq] (ServerService Thread Pool -- 68) WFLYMSGAMQ0002: Bound messaging object to jndi name java:jboss/exported/jms/RemoteConnectionFactory

2016-11-16 09:06:38,738 INFO  [org.jboss.as.connector.deployment] (MSC service thread 1-6) WFLYJCA0007: Registered connection factory java:/JmsXA

2016-11-16 09:06:38,754 INFO  [org.apache.activemq.artemis.ra] (MSC service thread 1-6) Resource adaptor started

2016-11-16 09:06:38,754 INFO  [org.jboss.as.connector.services.resourceadapters.ResourceAdapterActivatorService$ResourceAdapterActivator] (MSC service thread 1-6) IJ020002: Deployed: file://RaActivatoractivemq-ra

2016-11-16 09:06:38,770 INFO  [org.jboss.as.connector.deployment] (MSC service thread 1-8) WFLYJCA0002: Bound JCA ConnectionFactory [java:/JmsXA]

2016-11-16 09:06:38,770 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-3) WFLYMSGAMQ0002: Bound messaging object to jndi name java:jboss/DefaultJMSConnectionFactory

2016-11-16 09:06:39,801 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 71) AMQ221003: trying to deploy queue jms.queue.ExpiryQueue

2016-11-16 09:06:39,801 INFO  [org.wildfly.extension.messaging-activemq] (ServerService Thread Pool -- 70) WFLYMSGAMQ0002: Bound messaging object to jndi name java:/ConnectionFactory

2016-11-16 09:06:39,801 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 69) AMQ221003: trying to deploy queue jms.queue.DLQ

2016-11-16 09:06:40,082 INFO  [org.apache.activemq.artemis.core.server] (Thread-9 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@6786e692-1234953772)) AMQ221027: Bridge ClusterConnectionBridge@d02e23 [name=sf.my-cluster.ca48258a-a037-11e6-9f49-c3950db54c3b, queue=QueueImpl[name=sf.my-cluster.ca48258a-a037-11e6-9f49-c3950db54c3b, postOffice=PostOfficeImpl [server=ActiveMQServerImpl::serverUUID=a37b6dfd-aa36-11e6-8564-81e8959e645b]]@ae3f1e0 targetConnector=ServerLocatorImpl (identity=(Cluster-connection-bridge::ClusterConnectionBridge@d02e23 [name=sf.my-cluster.ca48258a-a037-11e6-9f49-c3950db54c3b, queue=QueueImpl[name=sf.my-cluster.ca48258a-a037-11e6-9f49-c3950db54c3b, postOffice=PostOfficeImpl [server=ActiveMQServerImpl::serverUUID=a37b6dfd-aa36-11e6-8564-81e8959e645b]]@ae3f1e0 targetConnector=ServerLocatorImpl [initialConnectors=[TransportConfiguration(name=http-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?httpUpgradeEnabled=true&httpPpgradeEndpoint=http-acceptor&port=8330&host=10-0-15-151], discoveryGroupConfiguration=null]]::ClusterConnectionImpl@325398467[nodeUUID=a37b6dfd-aa36-11e6-8564-81e8959e645b, connector=TransportConfiguration(name=http-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?httpUpgradeEnabled=true&httpPpgradeEndpoint=http-acceptor&port=8330&host=10-0-15-132, address=jms, server=ActiveMQServerImpl::serverUUID=a37b6dfd-aa36-11e6-8564-81e8959e645b])) [initialConnectors=[TransportConfiguration(name=http-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?httpUpgradeEnabled=true&httpPpgradeEndpoint=http-acceptor&port=8330&host=10-0-15-151], discoveryGroupConfiguration=null]] is connected

2016-11-16 09:06:41,535 ERROR [org.jboss.modcluster] (UndertowEventHandlerAdapter - 1) MODCLUSTER000042: Error MEM sending CONFIG command to ezsetupsystema0d3c1f091b4.milsoft.com.tr/10.0.15.143:10003, configuration will be reset: MEM: Old node still exist

2016-11-16 09:06:41,535 ERROR [org.jboss.modcluster] (UndertowEventHandlerAdapter - 1) MODCLUSTER000042: Error MEM sending CONFIG command to fisik.milsoft.com.tr/10.0.15.132:10001, configuration will be reset: MEM: Old node still exist

2016-11-16 09:06:41,535 WARN  [org.jboss.modcluster] (UndertowEventHandlerAdapter - 1) MODCLUSTER000045: AverageSystemLoadMetric is not supported on this system and will be disabled.

2016-11-16 09:06:42,801 WARN  [org.jboss.as.server.deployment] (MSC service thread 1-1) WFLYSRV0059: Class Path entry xml-apis.jar in /D:/Programs/wildfly-10.0.0.Final/content/test-app.war/WEB-INF/lib/serializer-2.7.1.jar  does not point to a valid jar for a Class-Path reference.

2016-11-16 09:06:42,801 WARN  [org.jboss.as.server.deployment] (MSC service thread 1-1) WFLYSRV0059: Class Path entry smack.jar in /D:/Programs/wildfly-10.0.0.Final/content/test-app.war/WEB-INF/lib/smackx-3.2.2.jar  does not point to a valid jar for a Class-Path reference.

2016-11-16 09:06:42,817 WARN  [org.jboss.as.server.deployment] (MSC service thread 1-1) WFLYSRV0059: Class Path entry xercesImpl.jar in /D:/Programs/wildfly-10.0.0.Final/content/test-app.war/WEB-INF/lib/xalan-2.7.1.jar  does not point to a valid jar for a Class-Path reference.

2016-11-16 09:06:42,817 WARN  [org.jboss.as.server.deployment] (MSC service thread 1-1) WFLYSRV0059: Class Path entry xml-apis.jar in /D:/Programs/wildfly-10.0.0.Final/content/test-app.war/WEB-INF/lib/xalan-2.7.1.jar  does not point to a valid jar for a Class-Path reference.

2016-11-16 09:06:42,817 WARN  [org.jboss.as.server.deployment] (MSC service thread 1-1) WFLYSRV0059: Class Path entry serializer.jar in /D:/Programs/wildfly-10.0.0.Final/content/test-app.war/WEB-INF/lib/xalan-2.7.1.jar  does not point to a valid jar for a Class-Path reference.

2016-11-16 09:06:43,270 INFO  [org.jboss.as.jpa] (MSC service thread 1-1) WFLYJPA0002: Read persistence.xml for test

2016-11-16 09:06:43,676 INFO  [org.jboss.as.jpa] (ServerService Thread Pool -- 69) WFLYJPA0010: Starting Persistence Unit (phase 1 of 2) Service 'test-app.war#test'

2016-11-16 09:06:43,707 INFO  [org.hibernate.jpa.internal.util.LogHelper] (ServerService Thread Pool -- 69) HHH000204: Processing PersistenceUnitInfo [

  name: test

  ...]

2016-11-16 09:06:43,770 INFO  [org.hibernate.Version] (ServerService Thread Pool -- 69) HHH000412: Hibernate Core {5.0.7.Final}

2016-11-16 09:06:43,770 INFO  [org.hibernate.cfg.Environment] (ServerService Thread Pool -- 69) HHH000206: hibernate.properties not found

2016-11-16 09:06:43,770 INFO  [org.hibernate.cfg.Environment] (ServerService Thread Pool -- 69) HHH000021: Bytecode provider name : javassist

2016-11-16 09:06:43,785 INFO  [org.hibernate.spatial.integration.SpatialService] (ServerService Thread Pool -- 69) HHH80000001: hibernate-spatial integration enabled : true

2016-11-16 09:06:43,801 INFO  [org.hibernate.orm.deprecation] (ServerService Thread Pool -- 69) HHH90000001: Found usage of deprecated setting for specifying Scanner [hibernate.ejb.resource_scanner]; use [hibernate.archive.scanner] instead

2016-11-16 09:06:43,801 INFO  [org.hibernate.annotations.common.Version] (ServerService Thread Pool -- 69) HCANN000001: Hibernate Commons Annotations {5.0.1.Final}

2016-11-16 09:06:44,379 INFO  [org.jboss.weld.deployer] (MSC service thread 1-1) WFLYWELD0003: Processing weld deployment test-app.war

2016-11-16 09:06:44,457 INFO  [org.hibernate.validator.internal.util.Version] (MSC service thread 1-1) HV000001: Hibernate Validator 5.2.3.Final

2016-11-16 09:06:44,520 INFO  [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'MyProjecttestLDAPChangeManager' in deployment unit 'deployment "test-app.war"' are as follows:

2016-11-16 09:06:51,020 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 69) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:51,020 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 69) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:51,020 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:51,020 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:51,348 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 69) WFLYCLINF0002: Started dist cache from ejb container

2016-11-16 09:06:51,364 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 70) WFLYCLINF0002: Started client-mappings cache from ejb container

2016-11-16 09:06:51,380 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-7) MSC000001: Failed to start service jboss.ejb.remoting.connector.client-mappings.installer: org.jboss.msc.service.StartException in service jboss.ejb.remoting.connector.client-mappings.installer: Failed to start service

  at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1904)

  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

  at java.lang.Thread.run(Thread.java:745)

Caused by: java.lang.IllegalStateException: Duplicate key [org.jboss.as.network.ClientMapping@6f7806fe]

  at java.util.stream.Collectors.lambda$throwingMerger$0(Collectors.java:133)

  at java.util.HashMap.merge(HashMap.java:1253)

  at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1320)

  at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)

  at java.util.Iterator.forEachRemaining(Iterator.java:116)

  at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)

  at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)

  at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)

  at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)

  at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)

  at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)

  at org.wildfly.clustering.server.registry.CacheRegistry.getEntries(CacheRegistry.java:123)

  at org.jboss.as.ejb3.remote.LocalEjbReceiver.registryAdded(LocalEjbReceiver.java:447)

  at org.jboss.as.ejb3.remote.RegistryCollectorService.add(RegistryCollectorService.java:54)

  at org.jboss.as.ejb3.remote.RegistryInstallerService.start(RegistryInstallerService.java:65)

  at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1948)

  at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1881)

  ... 3 more

2016-11-16 09:06:51,442 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-8) WFLYJCA0005: Deploying non-JDBC-compliant driver class com.teradata.jdbc.TeraDriver (version 14.10)

2016-11-16 09:06:51,442 INFO  [org.jboss.weld.deployer] (MSC service thread 1-8) WFLYWELD0006: Starting Services for CDI deployment: test-app.war

2016-11-16 09:06:51,473 INFO  [org.jboss.weld.Version] (MSC service thread 1-8) WELD-000900: 2.3.2 (Final)

2016-11-16 09:06:53,208 INFO  [org.jboss.ws.cxf.deployment] (MSC service thread 1-8) JBWS024074: WSDL published to: file:/D:/Programs/wildfly-10.0.0.Final/domain/servers/server-three/data/wsdl/test-app.war/KsyaSoapServiceService.wsdl

2016-11-16 09:06:53,239 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:53,239 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:53,239 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:53,239 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:53,270 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-3) WFLYJCA0018: Started Driver service with driver-name = test-app.war_com.teradata.jdbc.TeraDriver_14_10

2016-11-16 09:06:53,286 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 69) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:53,286 INFO  [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 69) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated.

2016-11-16 09:06:53,302 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 70) WFLYCLINF0002: Started routing cache from web container

2016-11-16 09:06:53,302 INFO  [org.jboss.weld.deployer] (MSC service thread 1-4) WFLYWELD0009: Starting weld service for deployment test-app.war

2016-11-16 09:06:53,348 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 70) WFLYCLINF0002: Started test-app.war cache from web container

2016-11-16 09:06:53,630 INFO  [org.jboss.as.jpa] (ServerService Thread Pool -- 69) WFLYJPA0010: Starting Persistence Unit (phase 2 of 2) Service 'test-app.war#test'

2016-11-16 09:06:53,880 WARN  [org.jboss.jca.core.connectionmanager.pool.strategy.OnePool] (ServerService Thread Pool -- 69) IJ000407: No lazy enlistment available for MyProject_db_srv_12c

2016-11-16 09:06:53,880 INFO  [org.hibernate.dialect.Dialect] (ServerService Thread Pool -- 69) HHH000400: Using dialect: org.hibernate.spatial.dialect.oracle.OracleSpatial10gDialect

2016-11-16 09:06:53,895 INFO  [org.hibernate.dialect.Dialect] (ServerService Thread Pool -- 69) HHH000400: Using dialect: org.hibernate.spatial.dialect.oracle.OracleSpatial10gDialect

2016-11-16 09:06:54,020 INFO  [org.hibernate.envers.boot.internal.EnversServiceImpl] (ServerService Thread Pool -- 69) Envers integration enabled? : true

2016-11-16 09:06:55,145 INFO  [org.hibernate.hql.internal.QueryTranslatorFactoryInitiator] (ServerService Thread Pool -- 69) HHH000397: Using ASTQueryTranslatorFactory

2016-11-16 09:06:55,193 WARN  [org.hibernate.hql.internal.ast.HqlSqlWalker] (ServerService Thread Pool -- 69) [DEPRECATION] Encountered positional parameter near line 1, column 101 in HQL: [select alert From com.milsoft.MyProject.core.alert.application.db.MyProjectAlert alert Where alert.id = ? ].  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.

2016-11-16 09:06:55,209 WARN  [org.hibernate.hql.internal.ast.HqlSqlWalker] (ServerService Thread Pool -- 69) [DEPRECATION] Encountered positional parameter near line 1, column 108 in HQL: [select user From com.milsoft.MyProject.core.alert.application.db.MyProjectAlertUser user Where user.alert.id = ? and user.userId = ?].  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.

2016-11-16 09:06:55,209 WARN  [org.hibernate.hql.internal.ast.HqlSqlWalker] (ServerService Thread Pool -- 69) [DEPRECATION] Encountered positional parameter near line 1, column 128 in HQL: [select user From com.milsoft.MyProject.core.alert.application.db.MyProjectAlertUser user Where user.alert.id = ? and user.userId = ?].  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.

2016-11-16 09:06:55,209 WARN  [org.hibernate.hql.internal.ast.HqlSqlWalker] (ServerService Thread Pool -- 69) [DEPRECATION] Encountered positional parameter near line 1, column 103 in HQL: [select user From com.milsoft.MyProject.core.alert.application.db.MyProjectAlertUser user Where alert.id = ? ].  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.

2016-11-16 09:06:55,271 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("add") failed - address: ([

    ("subsystem" => "ejb3"),

    ("service" => "remote")

]) - failure description: {"WFLYCTL0080: Failed services" => {"jboss.ejb.remoting.connector.client-mappings.installer" => "org.jboss.msc.service.StartException in service jboss.ejb.remoting.connector.client-mappings.installer: Failed to start service

    Caused by: java.lang.IllegalStateException: Duplicate key [org.jboss.as.network.ClientMapping@6f7806fe]"}}

2016-11-16 09:06:55,303 INFO  [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0010: Deployed "test-app.war" (runtime-name : "test-app.war")

2016-11-16 09:06:55,303 INFO  [org.jboss.as.controller] (Controller Boot Thread) WFLYCTL0183: Service status report

WFLYCTL0186:   Services which failed to start:      service jboss.ejb.remoting.connector.client-mappings.installer: org.jboss.msc.service.StartException in service jboss.ejb.remoting.connector.client-mappings.installer: Failed to start service

2016-11-16 09:06:55,725 ERROR [org.jboss.as] (Controller Boot Thread) WFLYSRV0026: WildFly Full 10.0.0.Final (WildFly Core 2.0.10.Final) started (with errors) in 26848ms - Started 2494 of 5035 services (2294 services failed or missing dependencies, 458 services are lazy, passive or on-demand)

2016-11-16 09:07:01,306 INFO  [org.jboss.as.server] (Thread-2) WFLYSRV0220: Server shutdown has been requested.

2016-11-16 09:07:01,337 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-5) WFLYJCA0019: Stopped Driver service with driver-name = test-app.war_com.teradata.jdbc.TeraDriver_14_10

2016-11-16 09:07:01,353 INFO  [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-1) WFLYJCA0010: Unbound data source [java:jboss/datasources/ExampleDS]

2016-11-16 09:07:01,369 INFO  [org.jboss.modcluster] (ServerService Thread Pool -- 33) MODCLUSTER000002: Initiating mod_cluster shutdown

2016-11-16 09:07:01,369 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-8) WFLYMSGAMQ0006: Unbound messaging object to jndi name java:jboss/DefaultJMSConnectionFactory

2016-11-16 09:07:01,369 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-3) WFLYUT0019: Host default-host stopping

2016-11-16 09:07:01,369 INFO  [org.infinispan.eviction.impl.PassivationManagerImpl] (ServerService Thread Pool -- 32) ISPN000029: Passivating all entries to disk

2016-11-16 09:07:01,369 INFO  [org.infinispan.eviction.impl.PassivationManagerImpl] (ServerService Thread Pool -- 32) ISPN000030: Passivated 0 entries in 2 milliseconds

2016-11-16 09:07:01,384 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-2) ISPN000080: Disconnecting JGroups channel server

2016-11-16 09:07:01,384 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-2) ISPN000082: Stopping the RpcDispatcher for channel server

2016-11-16 09:07:01,384 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-6) ISPN000080: Disconnecting JGroups channel hibernate

2016-11-16 09:07:01,384 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-6) ISPN000082: Stopping the RpcDispatcher for channel hibernate

2016-11-16 09:07:01,384 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 32) WFLYCLINF0003: Stopped test-app.war cache from web container

2016-11-16 09:07:01,384 INFO  [org.jboss.as.jpa] (ServerService Thread Pool -- 32) WFLYJPA0011: Stopping Persistence Unit (phase 2 of 2) Service 'test-app.war#test'

2016-11-16 09:07:01,400 INFO  [org.wildfly.extension.messaging-activemq] (ServerService Thread Pool -- 31) WFLYMSGAMQ0006: Unbound messaging object to jndi name java:/ConnectionFactory

2016-11-16 09:07:01,400 INFO  [org.jboss.as.connector.deployment] (MSC service thread 1-8) WFLYJCA0011: Unbound JCA ConnectionFactory [java:/JmsXA]

2016-11-16 09:07:01,400 INFO  [org.infinispan.eviction.impl.PassivationManagerImpl] (ServerService Thread Pool -- 10) ISPN000029: Passivating all entries to disk

2016-11-16 09:07:01,416 INFO  [org.infinispan.eviction.impl.PassivationManagerImpl] (ServerService Thread Pool -- 10) ISPN000030: Passivated 0 entries in 0 milliseconds

2016-11-16 09:07:01,416 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 10) WFLYCLINF0003: Stopped dist cache from ejb container

2016-11-16 09:07:01,416 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-1) WFLYJCA0019: Stopped Driver service with driver-name = h2

2016-11-16 09:07:01,416 WARN  [org.jboss.msc.service.fail] (MSC service thread 1-4) MSC000004: Failure during stop of service jboss.ejb3.localEjbReceiver.value: java.lang.NullPointerException

  at org.infinispan.cache.impl.CacheImpl.getAll(CacheImpl.java:436)

  at org.infinispan.cache.impl.CacheImpl.getAll(CacheImpl.java:429)

  at org.infinispan.cache.impl.AbstractDelegatingAdvancedCache.getAll(AbstractDelegatingAdvancedCache.java:207)

  at org.wildfly.clustering.server.registry.CacheRegistry.getEntries(CacheRegistry.java:123)

  at org.jboss.as.ejb3.remote.LocalEjbReceiver.disassociate(LocalEjbReceiver.java:683)

  at org.jboss.ejb.client.EJBClientContext.unregisterEJBReceiver(EJBClientContext.java:446)

  at org.jboss.ejb.client.EJBReceiverContext.close(EJBReceiverContext.java:57)

  at org.jboss.as.ejb3.remote.LocalEjbReceiver.stop(LocalEjbReceiver.java:412)

  at org.jboss.msc.service.ServiceControllerImpl$StopTask.stopService(ServiceControllerImpl.java:2056)

  at org.jboss.msc.service.ServiceControllerImpl$StopTask.run(ServiceControllerImpl.java:2017)

  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

  at java.lang.Thread.run(Thread.java:745)

2016-11-16 09:07:01,431 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 10) WFLYCLINF0003: Stopped client-mappings cache from ejb container

2016-11-16 09:07:01,431 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 69) WFLYCLINF0003: Stopped routing cache from web container

2016-11-16 09:07:01,431 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-3) ISPN000080: Disconnecting JGroups channel ejb

2016-11-16 09:07:01,431 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-3) ISPN000082: Stopping the RpcDispatcher for channel ejb

2016-11-16 09:07:01,431 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7) ISPN000080: Disconnecting JGroups channel web

2016-11-16 09:07:01,431 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (MSC service thread 1-7) ISPN000082: Stopping the RpcDispatcher for channel web

2016-11-16 09:07:01,447 INFO  [org.apache.activemq.artemis.ra] (ServerService Thread Pool -- 31) AMQ151003: resource adaptor stopped

2016-11-16 09:07:01,494 INFO  [org.jboss.as.jpa] (ServerService Thread Pool -- 32) WFLYJPA0011: Stopping Persistence Unit (phase 1 of 2) Service 'test-app.war#test'

2016-11-16 09:07:01,494 INFO  [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-7) WFLYJCA0010: Unbound data source [java:/MyProjectDBSrv12c]

2016-11-16 09:07:01,494 INFO  [org.apache.activemq.artemis.core.server] (Thread-13 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@6786e692-1234953772)) AMQ221029: stopped bridge sf.my-cluster.ca48258a-a037-11e6-9f49-c3950db54c3b

2016-11-16 09:07:01,494 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-5) WFLYJCA0019: Stopped Driver service with driver-name = oraclesql

2016-11-16 09:07:01,509 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-5) WFLYUT0008: Undertow AJP listener ajp suspending

2016-11-16 09:07:01,509 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-5) WFLYUT0007: Undertow AJP listener ajp stopped, was bound to 10.0.15.132:8009

2016-11-16 09:07:01,541 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 31) AMQ221002: Apache ActiveMQ Artemis Message Broker version 1.1.0.wildfly-011 [a37b6dfd-aa36-11e6-8564-81e8959e645b] stopped

2016-11-16 09:07:01,541 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-2) WFLYUT0008: Undertow HTTP listener default suspending

2016-11-16 09:07:01,541 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-2) WFLYUT0007: Undertow HTTP listener default stopped, was bound to 10.0.15.132:8080

2016-11-16 09:07:01,541 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-1) WFLYUT0004: Undertow 1.3.15.Final stopping

2016-11-16 09:07:02,041 INFO  [org.jboss.as.server.deployment] (MSC service thread 1-4) WFLYSRV0028: Stopped deployment test-app.war (runtime-name: test-app.war) in 731ms

2016-11-16 09:07:02,056 INFO  [org.jboss.as] (MSC service thread 1-2) WFLYSRV0050: WildFly Full 10.0.0.Final (WildFly Core 2.0.10.Final) stopped in 694ms

[rhusar]

Looking at the log, each server needs to have an unique name.

ISPN000094: Received new cluster view for channel server: [master:server-three|5] (2) [master:server-three, master:server-three]

You have 2 nodes with the same name.

[hans.christian.goranson]

I had a similar issue for an application in standalone mode were I had two Wildfly instances on the same server and I used one for Arquillian testing.

After setting this up I ended up in the same problem since my nodes shared the same name.

I solved by setting the parameter jboss.node.name=JavaDevArquillian in JBOSS_OPTS for one of the Wildfly instances

It might be possible to set this in a similar way in domain mode