11 Replies Latest reply on Sep 10, 2012 8:13 PM by dmlloyd

    where are the sources of jboss-client.jar:7.1.1.Final ? java.lang.IllegalStateException: The LogManager was not properly installed

      I am hit by a "java.lang.IllegalStateException: The LogManager was not properly installed" for which the stack trace shows the offending line to be in Logger.java:

       

      jboss.logmanager.LogManager"): java.lang.IllegalStateException: The LogManager was not properly installed (you must set the "java.util.logging.manager" system property to "org.jboss.logmanager.LogManager")
      at org.jboss.logmanager.Logger.getLogger(Logger.java:60) [jboss-client.jar:7.1.1.Final]

       

      BTW I' ve also logged a JIRA for this (https://issues.jboss.org/browse/AS7-5488)

       

      I've forked and cloned JBoss AS github project (from https://github.com/jbossas/jboss-as) but I couldn't find Logger.java anywhere in the sources.

       

      Where can I find the sources of jboss-client.jar:7.1.1.Final so that I may inspect the offending line and possibly modify it and create my own jboss-client.jar ?

        • 1. Re: where are the sources of jboss-client.jar:7.1.1.Final ?
          jaikiran

          mperdikeas wrote:

           

          I am hit by a "java.lang.IllegalStateException: The LogManager was not properly installed" for which the stack trace shows the offending line to be in Logger.java:

           

          Can you please post the entire exception stacktrace including the echo statements (which point to Java installation)? Which operating system are you on and what exact command do you use to start the server?

          • 2. Re: where are the sources of jboss-client.jar:7.1.1.Final ?

            Thank you for your reply. I provide all the information you requested below. In the mean time perhaps you could also let me know how to modify Logger.java / jboss-client.jar as perhaps I may be able to circumvent the issue there.

             

            Please note that this is a deterministically triggered failure, it happens every time. My environment is Ubuntu precise.

            I launch JBoss with:

             

            jboss-as-7.1.1.Final/bin/standalone.sh -Djboss.bind.address=172.31.129.29 -bmanagement=127.0.0.1

             

            The scenario that triggers it is the following:

             

            [1] JBoss 7.1.1.Final Brontes launches normally in standalone mode and wihtout failure or any complaints.

            [2] I deploy an EAR which, in its WAR component, contains and uses some EhCache jars for its caching functionality

            [3] The EAR deploys without failure or complaints and I can visit the application from a browser.

            [4] At some point as I interact with the application with a browser (any browser), and as EhCache operations take place in the deployed EAR/WAR, the exception shown below is thrown.

             

            Below I append:

            [A] echo statements (like I said, JBoss AS launches normally)

            [B] full stack trace thrown.

             

            With respect to [A] please note that I did some googling and found some suggestions for a similar (purportedly solved) problem (   https://community.jboss.org/thread/174428   ) so I 've modified my CLASSPATH and JAVA_OPTS accordingly (in the standalone.conf) and also added the line: " -logmodule "org.jboss.logmanager" \  " at the invocation of JBoss in my standalone.sh (line 186). Finally I added some more echo statements (with my name to tell them apart from the others) to help me diagnose the issue. Needless to say, none of the above "fixes" worked.

             

            [A echo statements at startup]


            $ ./jboss-start
            *** MPERDIKEAS *** JAVA_OPTS is now: -Xms64m -Xmx512m -XX:MaxPermSize=256m -Djava.net.preferIPv4Stack=true -Dorg.jboss.resolver.warning=true -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djboss.modules.system.pkgs=org.jboss.byteman -Djava.awt.headless=true -Djboss.server.default.config=standalone.xml -Djava.util.logging.manager=org.jboss.logmanager.LogManager -Dorg.jboss.logging.Logger.pluginClass=org.jboss.logging.logmanager.LoggerPluginImpl
            =========================================================================

             

              JBoss Bootstrap Environment

             

              JBOSS_HOME: /home/mperdikeas/git-jboss/jboss-as-7.1.1.Final

             

              JAVA: /usr/lib/jvm/java-1.7.0-openjdk-i386/bin/java

             

              JAVA_OPTS:  -server -XX:+TieredCompilation -Xms64m -Xmx512m -XX:MaxPermSize=256m -Djava.net.preferIPv4Stack=true -Dorg.jboss.resolver.warning=true -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djboss.modules.system.pkgs=org.jboss.byteman -Djava.awt.headless=true -Djboss.server.default.config=standalone.xml -Djava.util.logging.manager=org.jboss.logmanager.LogManager -Dorg.jboss.logging.Logger.pluginClass=org.jboss.logging.logmanager.LoggerPluginImpl

             

              CLASSPATH: /usr/lib/jvm/java-1.7.0-openjdk-i386/jre/lib/rt.jar:.:/modules/org/jboss/logmanager/main/jboss-logmanager-1.2.2.GA.jar                   (mperdikeas)

             

            =========================================================================

             

            WARNING: -logmodule is deprecated. Please use the system property 'java.util.logging.manager' or the 'java.util.logging.LogManager' service loader.
            10:43:29,800 INFO  [org.jboss.modules] JBoss Modules version 1.1.1.GA
            10:43:29,987 INFO  [org.jboss.msc] JBoss MSC version 1.0.2.GA
            10:43:30,048 INFO  [org.jboss.as] JBAS015899: JBoss AS 7.1.1.Final "Brontes" starting
            10:43:30,896 INFO  [org.xnio] XNIO Version 3.0.3.GA
            10:43:30,905 INFO  [org.xnio.nio] XNIO NIO Implementation Version 3.0.3.GA
            10:43:30,913 INFO  [org.jboss.remoting] JBoss Remoting version 3.2.3.GA
            10:43:30,915 INFO  [org.jboss.as.server] JBAS015888: Creating http management service using socket-binding (management-http)
            10:43:30,961 INFO  [org.jboss.as.logging] JBAS011502: Removing bootstrap log handlers
            10:43:30,964 INFO  [org.jboss.as.configadmin] (ServerService Thread Pool -- 26) JBAS016200: Activating ConfigAdmin Subsystem
            10:43:31,003 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 31) JBAS010280: Activating Infinispan subsystem.
            10:43:31,022 INFO  [org.jboss.as.connector] (MSC service thread 1-8) JBAS010408: Starting JCA Subsystem (JBoss IronJacamar 1.0.9.Final)
            10:43:31,028 INFO  [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 27) JBAS010403: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3)
            10:43:31,050 INFO  [org.jboss.as.naming] (ServerService Thread Pool -- 38) JBAS011800: Activating Naming Subsystem
            10:43:31,056 INFO  [org.jboss.as.security] (ServerService Thread Pool -- 44) JBAS013101: Activating Security Subsystem
            10:43:31,062 INFO  [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 27) JBAS010404: Deploying non-JDBC-compliant driver class org.postgresql.Driver (version 9.1)
            10:43:31,075 INFO  [org.jboss.as.osgi] (ServerService Thread Pool -- 39) JBAS011940: Activating OSGi Subsystem
            10:43:31,075 INFO  [org.jboss.as.security] (MSC service thread 1-5) JBAS013100: Current PicketBox version=4.0.7.Final
            10:43:31,079 INFO  [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 27) JBAS010403: Deploying JDBC-compliant driver class org.hsqldb.jdbc.JDBCDriver (version 2.2)
            10:43:31,090 INFO  [org.jboss.as.naming] (MSC service thread 1-8) JBAS011802: Starting Naming Service
            10:43:31,117 INFO  [org.jboss.as.mail.extension] (MSC service thread 1-3) JBAS015400: Bound mail session [java:jboss/mail/Default]
            10:43:31,151 INFO  [org.jboss.as.webservices] (ServerService Thread Pool -- 48) JBAS015537: Activating WebServices Extension
            10:43:31,340 INFO  [org.jboss.ws.common.management.AbstractServerConfig] (MSC service thread 1-1) JBoss Web Services - Stack CXF Server 4.0.2.GA
            10:43:31,378 INFO  [org.apache.coyote.http11.Http11Protocol] (MSC service thread 1-2) Starting Coyote HTTP/1.1 on http--172.31.129.29-8888
            10:43:31,577 INFO  [org.jboss.as.remoting] (MSC service thread 1-5) JBAS017100: Listening on /127.0.0.1:9999
            10:43:31,582 INFO  [org.jboss.as.server.deployment.scanner] (MSC service thread 1-3) JBAS015012: Started FileSystemDeploymentService for directory /home/mperdikeas/git-jboss/jboss-as-7.1.1.Final/standalone/deployments
            10:43:31,577 INFO  [org.jboss.as.remoting] (MSC service thread 1-4) JBAS017100: Listening on /172.31.129.29:4447
            10:43:31,713 INFO  [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-8) JBAS010400: Bound data source [java:jboss/datasources/ExampleDS]
            10:43:31,889 INFO  [org.jboss.as] (Controller Boot Thread) JBAS015951: Admin console listening on http://127.0.0.1:9990
            10:43:31,891 INFO  [org.jboss.as] (Controller Boot Thread) JBAS015874: JBoss AS 7.1.1.Final "Brontes" started in 2342ms - Started 135 of 210 services (74 services are passive or on-demand)

             

            [B full stack trace thrown]

             

            09:51:36,193 INFO  [stdout] (http--172.31.129.29-8888-1) returning: goToEhCacheTest
            09:51:36,194 INFO  [mutil.jsf.LifeCycleListener] (http--172.31.129.29-8888-1) END PHASE: INVOKE_APPLICATION 5
            09:51:36,209 INFO  [mutil.jsf.LifeCycleListener] (http--172.31.129.29-8888-1) START PHASE: RESTORE_VIEW 1
            09:51:36,212 INFO  [mutil.jsf.LifeCycleListener] (http--172.31.129.29-8888-1) END PHASE: RESTORE_VIEW 1
            09:51:36,213 INFO  [mutil.jsf.LifeCycleListener] (http--172.31.129.29-8888-1) START PHASE: RENDER_RESPONSE 6
            09:51:36,219 INFO  [mutil.jsf.LifeCycleListener] (http--172.31.129.29-8888-1) END PHASE: RENDER_RESPONSE 6
            09:51:36,932 WARN  [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] (Replication Thread) Unable to send message to remote peer.  Message was: The LogManager was not properly installed (you must set the "java.util.logging.manager" system property to "org.jboss.logmanager.LogManager"): java.lang.IllegalStateException: The LogManager was not properly installed (you must set the "java.util.logging.manager" system property to "org.jboss.logmanager.LogManager")
            at org.jboss.logmanager.Logger.getLogger(Logger.java:60) [jboss-client.jar:7.1.1.Final]
            at org.jboss.logmanager.SerializedLogger.readResolve(SerializedLogger.java:54) [jboss-client.jar:7.1.1.Final]
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03]
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadResolve(ObjectStreamClass.java:1091) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1780) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
            at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
            at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readArray(ObjectInputStream.java:1685) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1341) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
            at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
            at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readArray(ObjectInputStream.java:1685) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1341) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
            at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
            at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
            at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
            at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
            at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
            at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
            at org.apache.shiro.session.mgt.SimpleSession.readObject(SimpleSession.java:500) [shiro-all-1.2.1.jar:1.2.1]
            at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) [:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:498) [rt.jar:1.7.0_03]
            at net.sf.ehcache.Element.readObject(Element.java:844) [ehcache-core-ee-2.6.0.jar:]
            at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) [:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
            at java.util.ArrayList.readObject(ArrayList.java:733) [rt.jar:1.7.0_03]
            at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) [:1.7.0_03]
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
            at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
            at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
            at sun.rmi.server.UnicastRef.unmarshalValue(UnicastRef.java:324) [rt.jar:1.7.0_03]
            at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:307) [rt.jar:1.7.0_03]
            at sun.rmi.transport.Transport$1.run(Transport.java:177) [rt.jar:1.7.0_03]
            at sun.rmi.transport.Transport$1.run(Transport.java:174) [rt.jar:1.7.0_03]
            at java.security.AccessController.doPrivileged(Native Method) [rt.jar:1.7.0_03]
            at sun.rmi.transport.Transport.serviceCall(Transport.java:173) [rt.jar:1.7.0_03]
            at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:553) [rt.jar:1.7.0_03]
            at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:808) [rt.jar:1.7.0_03]
            at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:667) [rt.jar:1.7.0_03]
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03]
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03]
            at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03]
            at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:273) [rt.jar:1.7.0_03]
            at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:251) [rt.jar:1.7.0_03]
            at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:160) [rt.jar:1.7.0_03]
            at net.sf.ehcache.distribution.RMICachePeer_Stub.send(Unknown Source) [ehcache-core-ee-2.6.0.jar:]
            at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:314) [ehcache-core-ee-2.6.0.jar:]
            at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) [ehcache-core-ee-2.6.0.jar:]
            at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) [ehcache-core-ee-2.6.0.jar:]
            at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) [ehcache-core-ee-2.6.0.jar:]

            • 3. Re: where are the sources of jboss-client.jar:7.1.1.Final ?
              jaikiran

              Okay so this really isn't an issue with JBoss AS startup but appears to be related to deserialization that seems to be happening while using EHCache. I'll take a more detailed look at that stacktrace later to see if I can understand what's going on.

               

               

              mperdikeas wrote:

               

              Thank you for your reply. I provide all the information you requested below. In the mean time perhaps you could also let me know how to modify Logger.java / jboss-client.jar as perhaps I may be able to circumvent the issue there.

               

              The jboss-client.jar is just a meta jar (or whatever better name that can be used for it). The classes in that jar are pulled together from various other project jars. In this case the JBoss Logging Logger class comes from the JBoss Logging project which is hosted here https://github.com/jboss-logging/jboss-logging/tree/3.1

              • 4. Re: where are the sources of jboss-client.jar:7.1.1.Final ?

                Thanks, I was looking at the EhCache sources in the meantime. EhCache logging seems to be working (after all the WARN message at the beginning of the trace comes from EhCache). My guess is that some logging in the sun.reflect or java.lang.reflect fails to grab a Logger.

                • 5. Re: where are the sources of jboss-client.jar:7.1.1.Final ?

                  I did some further investigation and threw away EhCache replacing it with a Java client for memcached. The problem persists so it is UNRELATED to ehcache or memcached and's got to do with some kind of reflection / serialization code. Here's a second trace. This is now becoming really critical as I was hoping that using memcached instead of EhCache would allow me to circumvent the problem. Apparently, it runs deeper.

                   

                  18:41:41,735 ERROR [org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/terracotta-web-1].[GetAllUsers]] (http--172.31.129.29-8888-2) Servlet.service() for servlet GetAllUsers threw exception: java.lang.IllegalStateException: The LogManager was not properly installed (you must set the "java.util.logging.manager" system property to "org.jboss.logmanager.LogManager")
                  at org.jboss.logmanager.Logger.getLogger(Logger.java:60) [jboss-client.jar:7.1.1.Final]
                  at org.jboss.logmanager.SerializedLogger.readResolve(SerializedLogger.java:54) [jboss-client.jar:7.1.1.Final]
                  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03]
                  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03]
                  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
                  at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
                  at java.io.ObjectStreamClass.invokeReadResolve(ObjectStreamClass.java:1091) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1780) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
                  at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
                  at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
                  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
                  at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
                  at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readArray(ObjectInputStream.java:1685) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1341) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
                  at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
                  at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
                  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
                  at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
                  at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readArray(ObjectInputStream.java:1685) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1341) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
                  at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
                  at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
                  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
                  at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
                  at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
                  at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
                  at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
                  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
                  at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
                  at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
                  at java.util.HashMap.readObject(HashMap.java:1043) [rt.jar:1.7.0_03]
                  at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) [:1.7.0_03]
                  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
                  at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
                  at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
                  at org.apache.shiro.session.mgt.SimpleSession.readObject(SimpleSession.java:500) [shiro-all-1.2.1.jar:1.2.1]
                  at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) [:1.7.0_03]
                  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03]
                  at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03]
                  at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1866) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) [rt.jar:1.7.0_03]
                  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) [rt.jar:1.7.0_03]
                  at net.spy.memcached.transcoders.BaseSerializingTranscoder.deserialize(BaseSerializingTranscoder.java:129) [spymemcached-2.8.4.jar:2.8.4]
                  at net.spy.memcached.transcoders.SerializingTranscoder.decode(SerializingTranscoder.java:88) [spymemcached-2.8.4.jar:2.8.4]
                  at net.spy.memcached.transcoders.TranscodeService$1.call(TranscodeService.java:63) [spymemcached-2.8.4.jar:2.8.4]
                  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03]
                  at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03]
                  at net.spy.memcached.transcoders.TranscodeService$Task.run(TranscodeService.java:110) [spymemcached-2.8.4.jar:2.8.4]
                  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03]
                  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03]
                  at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03]

                  • 6. Re: where are the sources of jboss-client.jar:7.1.1.Final ?
                    jaikiran

                    Do any of your classes have non-static Logger members?

                    • 7. Re: where are the sources of jboss-client.jar:7.1.1.Final ?

                      YES, I had View-scoped and Request-scoped JSF backing-beans with non-static Loggers (java.util.logging.Logger).

                      Upon changing them to static I think I notice different behavior and that this exception does not arise, but please allow me some more time to verify it more thoroughly. Is there a requirement in JBoss AS to deploy static Loggers only? I am trying to understand what was happenning.

                      • 8. Re: where are the sources of jboss-client.jar:7.1.1.Final ?

                        I can confirm that by changing the JSF backing-beans' non-static java.util.logging.Logger members to static the exception reported above no longer arises regardless of whether I use memcached or ehcache. Could you please shed some light as to whether:

                         

                        [1] it is a JBoss 7.1.1 requirement to use static java.util.logging.Logger members for JSF-managed backing beans

                        [2] it is a JBoss 7.1.1 requirement to use static java.util.logging.Logger members on all deployed code

                        [3] it is a JBoss 7.1.1 requirement to use static Logger members, not just from the java.util.logging package but any kind of logging, on all deployed code or JSF-managed backing beans

                        [4] this practice is a work-around to bypass a JBoss 7.1.1 issue that may be addressed in future versions or not?

                         

                        Thank you for you support.

                        • 9. Re: where are the sources of jboss-client.jar:7.1.1.Final ?
                          jaikiran

                          Well, the reason why I asked about static Logger member was because the stacktrace showed that the exception was happening when a Logger instance was being deserialized. It looks like there might be some problem with deserialization of the logger, might even be a bug, but I'm not sure yet. Anyway, typically applications use a static Logger member in their classes so changing it to static shouldn't really be a problem.

                          • 10. Re: where are the sources of jboss-client.jar:7.1.1.Final ?
                            jaikiran

                            jaikiran pai wrote:

                             

                            Well, the reason why I asked about static Logger member was because the stacktrace showed that the exception was happening when a Logger instance was being deserialized. It looks like there might be some problem with deserialization of the logger, might even be a bug, but I'm not sure yet.

                            Someone from the JBoss Logging team might know more about this.

                            • 11. Re: where are the sources of jboss-client.jar:7.1.1.Final ?
                              dmlloyd

                              Filed and fixed LOGMGR-49.