4 Replies Latest reply on Nov 3, 2005 2:32 PM by Ben Wang

    Clustering Jboss4.0.1 with sp1 in windows 2000 in production

    Muhamed Rafi Newbie

      Hi,
      I'm implementing the cluster in JBoss4.0.1 with sp1 in windows 2000, i'm getting problem. Before getting deep in to the problem, i just brief intro about the setting up of env, were we have setup 2 nodes (machines) with the default parition name in the cluster.

      I'm using Apache with Modjk2.0, tomcat in node1. The following are the steps i used to implement the jboss clustering, with the information what i have got in the jboss,

      ---------------------------------------------
      1.1. Using mod_jk 1.2.x with JBoss/Tomcat bundle and Apache2
      1.1.1. Quick Overview
      1.Download Apache2
      2. Download modjk 1.2.x
      3. Change the main Apache config to include modjk config
      4. Create the modjk config
      5. Configure the modjk workers (which JBoss/Tomcat nodes Apache uses)
      6. Configure the Apache URIs served by modjk (the applications served by JBoss/Tomcat)
      7. Restart Apache
      8. Configure Tomcat (Give each JBoss/Tomcat a jvmRoute for session stickness)
      9. Restart JBoss
      10. Test it
      1.1.1.1. More Details
      This wiki outlines the various steps required to install a basic load-balancing solution based on JBoss/Tomcat and mod_jk 1.2.
      Step #1: Download Apache2 Web Server
      Get the latest Apache2 package from Apache.org and install it. We require no special configuration, just use the default settings. In the following steps, APACHE_HOME will represent the Apache install directory.

      Step #2: Download mod_jk 1.2.x
      Download the latest package available from Jakarta's 'Tomcat connector section' page . Always download the latest release if possible.
      Rename the lib mod_jk.so and drop it in APACHE_HOME/modules directory.

      Step #3: Setup Apache to use modjk
      Add this line at the very bottom in APACHE_HOME/conf/httpd.conf :
      # Include mod_jk configuration file
      Include conf/mod-jk.conf

      Step #4: Create the modjk config
      Under APACHE_HOME/conf, create mod-jk.conf and populate it as follows:
      # Load mod_jk module
      # Specify the filename of the mod_jk lib
      LoadModule jk_module modules/mod_jk.so

      # Where to find workers.properties
      JkWorkersFile conf/workers.properties

      # Where to put jk logs
      JkLogFile logs/mod_jk.log

      # Set the jk log level [debug/error/info]
      JkLogLevel info

      # Select the log format
      JkLogStampFormat "[%a %b %d %H:%M:%S %Y]"

      # JkOptions indicates to send SSK KEY SIZE
      JkOptions +ForwardKeySize +ForwardURICompat -ForwardDirectories

      # JkRequestLogFormat
      JkRequestLogFormat "%w %V %T"

      # Mount your applications
      JkMount /application/* loadbalancer

      # You can use external file for mount points.
      # It will be checked for updates each 60 seconds.
      # The format of the file is: /url=worker
      # /examples/*=loadbalancer
      JkMountFile conf/uriworkermap.properties

      # Add shared memory.
      # This directive is present with 1.2.10 and
      # later versions of mod_jk, and is needed for
      # for load balancing to work properly
      JkShmFile logs/jk.shm

      # Add jkstatus for managing runtime data
      <Location /jkstatus/>
      JkMount status
      Order deny,allow
      Deny from all
      Allow from 127.0.0.1

      mod_jk is ready to forward requests to JBoss instances. We need now to setup the workers

      Step #5: Configuring workers
      Under APACHE_HOME/conf, create workers.properties and populate it as follows:
      # Define list of workers that will be used
      # for mapping requests
      worker.list=loadbalancer,status

      # Define Node1
      # modify the host as your host IP or DNS name.
      worker.node1.port=8009
      worker.node1.host=node1.mydomain.com
      worker.node1.type=ajp13
      worker.node1.lbfactor=1
      #worker.node1.local_worker=1 (1)
      worker.node1.cachesize=10

      # Define Node2
      # modify the host as your host IP or DNS name.
      worker.node2.port=8009
      worker.node2.host= node2.mydomain.com
      worker.node2.type=ajp13
      worker.node2.lbfactor=1
      #worker.node2.local_worker=1 (1)
      worker.node2.cachesize=10

      # Load-balancing behaviour
      worker.loadbalancer.type=lb
      worker.loadbalancer.balance_workers=node1,node2
      worker.loadbalancer.sticky_session=1
      #worker.loadbalancer.local_worker_only=1
      #worker.list=loadbalancer

      # Status worker for managing load balancer
      worker.status.type=status

      Step #6: Create the URI to worker map file
      Create a uriworkermap.properties file in the APACHE_HOME/conf directory. This file should contain the URL mappings you want Apache to forward to Tomcat. The format of the file is /url=worker_name. To get things started, paste this example into the file you created:
      # Simple worker configuration file
      #

      # Mount the Servlet context to the ajp13 worker
      /jmx-console=loadbalancer
      /jmx-console/*=loadbalancer
      /web-console=loadbalancer
      /web-console/*=loadbalancer

      This will configure mod_jk to forward requests to /jmx-console and /web-console to Tomcat.

      Step #7: Restart Apache

      Step #8: Configure Tomcat
      To complete the configuration, we also need to name each node accordingly to the names specified in workers.properties.

      Edit JBOSS_HOME/server/all/deploy/jbossweb-tomcat50.sar/server.xml (replace /all with your own server name)

      Locate the <Engine?.> element and add an attribute jvmRoute:

      .


      The jvmRoute attribute must match the name specified in workers.properties.

      Finally, we need to tell Tomcat to add the jvmRoute value to its session cookies so that mod_jk can route incoming requests.

      Edit JBOSS_HOME/server/all/deploy/jbossweb-tomcat50.sar/META-INF/jboss-service.xml (replace /all with your own server name)

      Locate the element with a name of UseJK?, and set its value to "true":
      true

      Step #9: Restart JBoss AS.

      Step #10: Access the JBoss AS web-console through Apache by browsing to http://localhost/web-console and you should see the JBoss web console page.

      1.1.2. Configure cluster-service.xml


      <!-- UDP: if you have a multihomed machine,
      set the bind_addr attribute to the appropriate NIC IP address -->
      <!-- UDP: On Windows machines, because of the media sense feature
      being broken with multicast (even after disabling media sense)
      set the loopback attribute to true -->

      <UDP mcast_addr="228.1.2.3" mcast_port="45566" bind_addr="xxx.xxx.xxx.xxx"
      ip_ttl="32" ip_mcast="true"
      mcast_send_buf_size="800000" mcast_recv_buf_size="150000"
      ucast_send_buf_size="800000" ucast_recv_buf_size="150000"
      loopback="false" />
      <PING timeout="2000" num_initial_members="3"
      up_thread="true" down_thread="true" />
      <MERGE2 min_interval="10000" max_interval="20000" />
      <FD shun="true" up_thread="true" down_thread="true"
      timeout="2500" max_tries="5" />
      <VERIFY_SUSPECT timeout="3000" num_msgs="3"
      up_thread="true" down_thread="true" />
      <pbcast.NAKACK gc_lag="50" retransmit_timeout="300,600,1200,2400,4800"
      max_xmit_size="8192"
      up_thread="true" down_thread="true" />
      <UNICAST timeout="300,600,1200,2400,4800" window_size="100" min_threshold="10"
      down_thread="true" />
      <pbcast.STABLE desired_avg_gossip="20000"
      up_thread="true" down_thread="true" />
      <FRAG frag_size="8192"
      down_thread="true" up_thread="true" />
      <pbcast.GMS join_timeout="5000" join_retry_timeout="2000"
      shun="true" print_local_addr="true" />
      <pbcast.STATE_TRANSFER up_thread="true" down_thread="true" />


      1.1.3. Modify tc5-cluster-service.xml

      Add a bind address and change loopback to false, if doing this on windows, you have to modify the loopback to true
      ------------------------------



      <!-- UDP: if you have a multihomed machine,
      set the bind_addr attribute to the appropriate NIC IP address, e.g bind_addr="192.168.0.2"
      -->
      <!-- UDP: On Windows machines, because of the media sense feature
      being broken with multicast (even after disabling media sense)
      set the loopback attribute to true -->
      <UDP mcast_addr="230.1.2.3" mcast_port="45577" bind_addr="xxx.xxx.xxx.xxx"
      ip_ttl="64" ip_mcast="true"
      mcast_send_buf_size="150000" mcast_recv_buf_size="80000"
      ucast_send_buf_size="150000" ucast_recv_buf_size="80000"
      loopback="false"/>
      <PING timeout="2000" num_initial_members="3"
      up_thread="false" down_thread="false"/>
      <MERGE2 min_interval="10000" max_interval="20000"/>
      <FD_SOCK/>
      <VERIFY_SUSPECT timeout="1500"
      up_thread="false" down_thread="false"/>
      <pbcast.NAKACK gc_lag="50" retransmit_timeout="600,1200,2400,4800"
      max_xmit_size="8192" up_thread="false" down_thread="false"/>
      <UNICAST timeout="600,1200,2400" window_size="100" min_threshold="10"
      down_thread="false"/>
      <pbcast.STABLE desired_avg_gossip="20000"
      up_thread="false" down_thread="false"/>
      <FRAG frag_size="8192"
      down_thread="false" up_thread="false"/>
      <pbcast.GMS join_timeout="5000" join_retry_timeout="2000"
      shun="true" print_local_addr="true"/>
      <pbcast.STATE_TRANSFER up_thread="true" down_thread="true"/>


      ----------------------------------------------

      but i'm getting execption in the both nodes (node1 and node2). In node 2 i'm getting exception as follows
      -------------------------------------------
      20:45:57,940 ERROR [RpcDispatcher] failed invoking method
      javax.transaction.NotSupportedException: Transaction already active, cannot nest transactions.
      at org.jboss.tm.TxManager.begin(TxManager.java:169)
      at org.jboss.cache.interceptors.ReplicationInterceptor.createNewLocalTransaction(ReplicationInterceptor.java:248)
      at org.jboss.cache.interceptors.ReplicationInterceptor.handlePrepare(ReplicationInterceptor.java:283)
      at org.jboss.cache.interceptors.ReplicationInterceptor.replicate(ReplicationInterceptor.java:168)
      at org.jboss.cache.TreeCache._replicate(TreeCache.java:2733)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:324)
      at org.jgroups.blocks.MethodCall.invoke(MethodCall.java:236)
      at org.jgroups.blocks.RpcDispatcher.handle(RpcDispatcher.java:220)
      at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:615)
      at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:512)
      at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:326)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.handleUp(MessageDispatcher.java:722)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.access$300(MessageDispatcher.java:554)
      at org.jgroups.blocks.MessageDispatcher$1.run(MessageDispatcher.java:691)
      at java.lang.Thread.run(Thread.java:534)
      20:45:58,421 ERROR [RpcDispatcher] failed invoking method
      javax.transaction.NotSupportedException: Transaction already active, cannot nest transactions.
      at org.jboss.tm.TxManager.begin(TxManager.java:169)
      at org.jboss.cache.interceptors.ReplicationInterceptor.createNewLocalTransaction(ReplicationInterceptor.java:248)
      at org.jboss.cache.interceptors.ReplicationInterceptor.handlePrepare(ReplicationInterceptor.java:283)
      at org.jboss.cache.interceptors.ReplicationInterceptor.replicate(ReplicationInterceptor.java:168)
      at org.jboss.cache.TreeCache._replicate(TreeCache.java:2733)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:324)
      at org.jgroups.blocks.MethodCall.invoke(MethodCall.java:236)
      at org.jgroups.blocks.RpcDispatcher.handle(RpcDispatcher.java:220)
      at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:615)
      at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:512)
      at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:326)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.handleUp(MessageDispatcher.java:722)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.access$300(MessageDispatcher.java:554)
      at org.jgroups.blocks.MessageDispatcher$1.run(MessageDispatcher.java:691)
      at java.lang.Thread.run(Thread.java:534)
      20:45:58,872 ERROR [RpcDispatcher] failed invoking method
      javax.transaction.NotSupportedException: Transaction already active, cannot nest transactions.
      at org.jboss.tm.TxManager.begin(TxManager.java:169)
      at org.jboss.cache.interceptors.ReplicationInterceptor.createNewLocalTransaction(ReplicationInterceptor.java:248)
      at org.jboss.cache.interceptors.ReplicationInterceptor.handlePrepare(ReplicationInterceptor.java:283)
      at org.jboss.cache.interceptors.ReplicationInterceptor.replicate(ReplicationInterceptor.java:168)
      at org.jboss.cache.TreeCache._replicate(TreeCache.java:2733)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:324)
      at org.jgroups.blocks.MethodCall.invoke(MethodCall.java:236)
      at org.jgroups.blocks.RpcDispatcher.handle(RpcDispatcher.java:220)
      at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:615)
      at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:512)
      at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:326)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.handleUp(MessageDispatcher.java:722)
      at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.access$300(MessageDispatcher.java:554)
      at org.jgroups.blocks.MessageDispatcher$1.run(MessageDispatcher.java:691)
      at java.lang.Thread.run(Thread.java:534)

      -------------------------------------------
      and IN node2 i'm getting exception as
      ---------------------------------------------
      19:37:36,453 INFO [STDOUT] Caused by: org.jboss.tm.JBossRollbackException: Unable to commit, tx=TransactionImpl:XidImpl[FormatId=257, GlobalId=m-rafi/885, BranchQual=, localId=885] status=STATUS_NO_TRANSACTION; - nested throwable: (org.jboss.util.NestedRuntimeException: ; - nested throwable: (org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false))
      19:37:36,453 INFO [STDOUT] at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:344)
      19:37:36,453 INFO [STDOUT] at org.jboss.tm.TxManager.commit(TxManager.java:200)
      19:37:36,453 INFO [STDOUT] at org.jboss.tm.usertx.client.ServerVMClientUserTransaction.commit(ServerVMClientUserTransaction.java:126)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:364)
      19:37:36,453 INFO [STDOUT] ... 46 more
      19:37:36,453 INFO [STDOUT] Caused by: org.jboss.util.NestedRuntimeException: ; - nested throwable: (org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false)
      19:37:36,453 INFO [STDOUT] at org.jboss.cache.interceptors.ReplicationInterceptor$SynchronizationHandler.beforeCompletion(ReplicationInterceptor.java:441)
      19:37:36,453 INFO [STDOUT] at org.jboss.cache.interceptors.OrderedSynchronizationHandler.beforeCompletion(OrderedSynchronizationHandler.java:71)
      19:37:36,453 INFO [STDOUT] at org.jboss.tm.TransactionImpl.doBeforeCompletion(TransactionImpl.java:1383)
      19:37:36,453 INFO [STDOUT] at org.jboss.tm.TransactionImpl.beforePrepare(TransactionImpl.java:1075)
      19:37:36,453 INFO [STDOUT] at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:296)
      19:37:36,453 INFO [STDOUT] ... 49 more
      19:37:36,453 INFO [STDOUT] Caused by: org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false
      19:37:36,453 INFO [STDOUT] at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2235)
      19:37:36,453 INFO [STDOUT] at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2257)
      19:37:36,453 INFO [STDOUT] at org.jboss.cache.interceptors.ReplicationInterceptor.runPreparePhase(ReplicationInterceptor.java:520)
      19:37:36,453 INFO [STDOUT] at org.jboss.cache.interceptors.ReplicationInterceptor$SynchronizationHandler.beforeCompletion(ReplicationInterceptor.java:424)
      19:37:36,453 INFO [STDOUT] ... 53 more
      19:37:36,453 INFO [STDOUT] java.lang.RuntimeException: JBossCacheManager.processSessionRepl(): failed to replicate session.
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:378)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.storeSession(JBossCacheManager.java:213)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.add(JBossCacheManager.java:245)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.session.StandardSession.setId(StandardSession.java:354)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.createSession(JBossCacheManager.java:171)
      19:37:36,453 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequest.doGetSession(CoyoteRequest.java:2274)
      19:37:36,453 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequest.getSession(CoyoteRequest.java:2116)
      19:37:36,453 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequestFacade.getSession(CoyoteRequestFacade.java:526)
      19:37:36,453 INFO [STDOUT] at com.eurodyn.epps.authorization.presentation.SecurityFilter.doFilter(SecurityFilter.java:143)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:36,453 INFO [STDOUT] at com.eurodyn.epps.common.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:103)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:75)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:214)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:198)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:152)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.security.CustomPrincipalValve.invoke(CustomPrincipalValve.java:66)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:153)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:54)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:36,453 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:80)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:118)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:36,453 INFO [STDOUT] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929)
      19:37:36,453 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160)
      19:37:36,453 INFO [STDOUT] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:799)
      19:37:36,453 INFO [STDOUT] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:705)
      19:37:36,453 INFO [STDOUT] at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:577)
      19:37:36,453 INFO [STDOUT] at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:683)
      19:37:36,453 INFO [STDOUT] at java.lang.Thread.run(Thread.java:534)
      19:37:36,468 INFO [STDOUT] Caused by: org.jboss.tm.JBossRollbackException: Unable to commit, tx=TransactionImpl:XidImpl[FormatId=257, GlobalId=m-rafi/886, BranchQual=, localId=886] status=STATUS_NO_TRANSACTION; - nested throwable: (org.jboss.util.NestedRuntimeException: ; - nested throwable: (org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false))
      19:37:36,468 INFO [STDOUT] at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:344)
      19:37:36,468 INFO [STDOUT] at org.jboss.tm.TxManager.commit(TxManager.java:200)
      19:37:36,468 INFO [STDOUT] at org.jboss.tm.usertx.client.ServerVMClientUserTransaction.commit(ServerVMClientUserTransaction.java:126)
      19:37:36,468 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:364)
      19:37:36,468 INFO [STDOUT] ... 46 more
      19:37:36,468 INFO [STDOUT] Caused by: org.jboss.util.NestedRuntimeException: ; - nested throwable: (org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false)
      19:37:36,468 INFO [STDOUT] at org.jboss.cache.interceptors.ReplicationInterceptor$SynchronizationHandler.beforeCompletion(ReplicationInterceptor.java:441)
      19:37:36,468 INFO [STDOUT] at org.jboss.cache.interceptors.OrderedSynchronizationHandler.beforeCompletion(OrderedSynchronizationHandler.java:71)
      19:37:36,468 INFO [STDOUT] at org.jboss.tm.TransactionImpl.doBeforeCompletion(TransactionImpl.java:1383)
      19:37:36,468 INFO [STDOUT] at org.jboss.tm.TransactionImpl.beforePrepare(TransactionImpl.java:1075)
      19:37:36,468 INFO [STDOUT] at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:296)
      19:37:36,468 INFO [STDOUT] ... 49 more
      19:37:36,468 INFO [STDOUT] Caused by: org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false
      19:37:36,468 INFO [STDOUT] at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2235)
      19:37:36,468 INFO [STDOUT] at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2257)
      19:37:36,468 INFO [STDOUT] at org.jboss.cache.interceptors.ReplicationInterceptor.runPreparePhase(ReplicationInterceptor.java:520)
      19:37:36,468 INFO [STDOUT] at org.jboss.cache.interceptors.ReplicationInterceptor$SynchronizationHandler.beforeCompletion(ReplicationInterceptor.java:424)
      19:37:36,468 INFO [STDOUT] ... 53 more
      19:37:41,578 WARN [ReplicationInterceptor] runPreparePhase() failed. Transaction is now rolled back
      org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false
      at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2235)
      at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2257)
      at org.jboss.cache.interceptors.ReplicationInterceptor.runPreparePhase(ReplicationInterceptor.java:520)
      at org.jboss.cache.interceptors.ReplicationInterceptor$SynchronizationHandler.beforeCompletion(ReplicationInterceptor.java:424)
      at org.jboss.cache.interceptors.OrderedSynchronizationHandler.beforeCompletion(OrderedSynchronizationHandler.java:71)
      at org.jboss.tm.TransactionImpl.doBeforeCompletion(TransactionImpl.java:1383)
      at org.jboss.tm.TransactionImpl.beforePrepare(TransactionImpl.java:1075)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:296)
      at org.jboss.tm.TxManager.commit(TxManager.java:200)
      at org.jboss.tm.usertx.client.ServerVMClientUserTransaction.commit(ServerVMClientUserTransaction.java:126)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:364)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.storeSession(JBossCacheManager.java:213)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.add(JBossCacheManager.java:245)
      at org.apache.catalina.session.StandardSession.setId(StandardSession.java:354)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.createSession(JBossCacheManager.java:171)
      at org.apache.coyote.tomcat5.CoyoteRequest.doGetSession(CoyoteRequest.java:2274)
      at org.apache.coyote.tomcat5.CoyoteRequest.getSession(CoyoteRequest.java:2116)
      at org.apache.coyote.tomcat5.CoyoteRequestFacade.getSession(CoyoteRequestFacade.java:526)
      at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:215)
      at org.apache.catalina.core.ApplicationHttpRequest.getSession(ApplicationHttpRequest.java:518)
      at org.apache.catalina.core.ApplicationHttpRequest.getSession(ApplicationHttpRequest.java:465)
      at org.apache.jasper.runtime.PageContextImpl._initialize(PageContextImpl.java:147)
      at org.apache.jasper.runtime.PageContextImpl.initialize(PageContextImpl.java:122)
      at org.apache.jasper.runtime.JspFactoryImpl.internalGetPageContext(JspFactoryImpl.java:104)
      at org.apache.jasper.runtime.JspFactoryImpl.getPageContext(JspFactoryImpl.java:61)
      at org.apache.jsp.jsp.error.custom_005ferror_jsp._jspService(custom_005ferror_jsp.java:62)
      at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:324)
      at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:292)
      at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:236)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:704)
      at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:474)
      at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:409)
      at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:312)
      at org.apache.struts.action.RequestProcessor.doForward(RequestProcessor.java:1056)
      at org.apache.struts.action.RequestProcessor.processForwardConfig(RequestProcessor.java:388)
      at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:231)
      at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1164)
      at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:415)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at com.eurodyn.epps.common.filters.MonitoringFilter.doFilter(MonitoringFilter.java:175)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.jboss.web.tomcat.tc5.JvmRouteFilter.doFilter(JvmRouteFilter.java:112)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at com.eurodyn.epps.authorization.presentation.SecurityFilter.doFilter(SecurityFilter.java:162)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at com.eurodyn.epps.common.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:103)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:75)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:214)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:198)
      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:152)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.jboss.web.tomcat.security.CustomPrincipalValve.invoke(CustomPrincipalValve.java:66)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:153)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:54)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.tc5.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:80)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:118)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929)
      at org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160)
      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:799)
      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:705)
      at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:577)
      at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:683)
      at java.lang.Thread.run(Thread.java:534)
      19:37:41,593 ERROR [JBossCacheManager] processSessionRepl: failed with exception: org.jboss.tm.JBossRollbackException: Unable to commit, tx=TransactionImpl:XidImpl[FormatId=257, GlobalId=m-rafi/887, BranchQual=, localId=887] status=STATUS_NO_TRANSACTION; - nested throwable: (org.jboss.util.NestedRuntimeException: ; - nested throwable: (org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, ret
      19:37:41,593 INFO [STDOUT] java.lang.IllegalStateException: No transaction.
      19:37:41,593 INFO [STDOUT] at org.jboss.tm.TxManager.rollback(TxManager.java:331)
      19:37:41,593 INFO [STDOUT] at org.jboss.tm.usertx.client.ServerVMClientUserTransaction.rollback(ServerVMClientUserTransaction.java:134)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:371)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.storeSession(JBossCacheManager.java:213)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.add(JBossCacheManager.java:245)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.session.StandardSession.setId(StandardSession.java:354)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.createSession(JBossCacheManager.java:171)
      19:37:41,593 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequest.doGetSession(CoyoteRequest.java:2274)
      19:37:41,593 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequest.getSession(CoyoteRequest.java:2116)
      19:37:41,593 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequestFacade.getSession(CoyoteRequestFacade.java:526)
      19:37:41,593 INFO [STDOUT] at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:215)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationHttpRequest.getSession(ApplicationHttpRequest.java:518)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationHttpRequest.getSession(ApplicationHttpRequest.java:465)
      19:37:41,593 INFO [STDOUT] at org.apache.jasper.runtime.PageContextImpl._initialize(PageContextImpl.java:147)
      19:37:41,593 INFO [STDOUT] at org.apache.jasper.runtime.PageContextImpl.initialize(PageContextImpl.java:122)
      19:37:41,593 INFO [STDOUT] at org.apache.jasper.runtime.JspFactoryImpl.internalGetPageContext(JspFactoryImpl.java:104)
      19:37:41,593 INFO [STDOUT] at org.apache.jasper.runtime.JspFactoryImpl.getPageContext(JspFactoryImpl.java:61)
      19:37:41,593 INFO [STDOUT] at org.apache.jsp.jsp.error.custom_005ferror_jsp._jspService(custom_005ferror_jsp.java:62)
      19:37:41,593 INFO [STDOUT] at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
      19:37:41,593 INFO [STDOUT] at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      19:37:41,593 INFO [STDOUT] at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:324)
      19:37:41,593 INFO [STDOUT] at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:292)
      19:37:41,593 INFO [STDOUT] at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:236)
      19:37:41,593 INFO [STDOUT] at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:704)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:474)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:409)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:312)
      19:37:41,593 INFO [STDOUT] at org.apache.struts.action.RequestProcessor.doForward(RequestProcessor.java:1056)
      19:37:41,593 INFO [STDOUT] at org.apache.struts.action.RequestProcessor.processForwardConfig(RequestProcessor.java:388)
      19:37:41,593 INFO [STDOUT] at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:231)
      19:37:41,593 INFO [STDOUT] at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1164)
      19:37:41,593 INFO [STDOUT] at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:415)
      19:37:41,593 INFO [STDOUT] at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
      19:37:41,593 INFO [STDOUT] at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:41,593 INFO [STDOUT] at com.eurodyn.epps.common.filters.MonitoringFilter.doFilter(MonitoringFilter.java:175)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.tc5.JvmRouteFilter.doFilter(JvmRouteFilter.java:112)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:41,593 INFO [STDOUT] at com.eurodyn.epps.authorization.presentation.SecurityFilter.doFilter(SecurityFilter.java:162)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:41,593 INFO [STDOUT] at com.eurodyn.epps.common.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:103)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:75)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:214)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:198)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:152)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.security.CustomPrincipalValve.invoke(CustomPrincipalValve.java:66)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:153)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:54)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:41,593 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:80)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:118)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:41,593 INFO [STDOUT] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929)
      19:37:41,593 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160)
      19:37:41,593 INFO [STDOUT] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:799)
      19:37:41,593 INFO [STDOUT] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:705)
      19:37:41,593 INFO [STDOUT] at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:577)
      19:37:41,593 INFO [STDOUT] at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:683)
      19:37:41,593 INFO [STDOUT] at java.lang.Thread.run(Thread.java:534)
      19:37:41,593 FATAL [JspFactoryImpl] Exception initializing page context
      java.lang.RuntimeException: JBossCacheManager.processSessionRepl(): failed to replicate session.
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:378)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.storeSession(JBossCacheManager.java:213)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.add(JBossCacheManager.java:245)
      at org.apache.catalina.session.StandardSession.setId(StandardSession.java:354)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.createSession(JBossCacheManager.java:171)
      at org.apache.coyote.tomcat5.CoyoteRequest.doGetSession(CoyoteRequest.java:2274)
      at org.apache.coyote.tomcat5.CoyoteRequest.getSession(CoyoteRequest.java:2116)
      at org.apache.coyote.tomcat5.CoyoteRequestFacade.getSession(CoyoteRequestFacade.java:526)
      at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:215)
      at org.apache.catalina.core.ApplicationHttpRequest.getSession(ApplicationHttpRequest.java:518)
      at org.apache.catalina.core.ApplicationHttpRequest.getSession(ApplicationHttpRequest.java:465)
      at org.apache.jasper.runtime.PageContextImpl._initialize(PageContextImpl.java:147)
      at org.apache.jasper.runtime.PageContextImpl.initialize(PageContextImpl.java:122)
      at org.apache.jasper.runtime.JspFactoryImpl.internalGetPageContext(JspFactoryImpl.java:104)
      at org.apache.jasper.runtime.JspFactoryImpl.getPageContext(JspFactoryImpl.java:61)
      at org.apache.jsp.jsp.error.custom_005ferror_jsp._jspService(custom_005ferror_jsp.java:62)
      at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:324)
      at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:292)
      at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:236)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:704)
      at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:474)
      at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:409)
      at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:312)
      at org.apache.struts.action.RequestProcessor.doForward(RequestProcessor.java:1056)
      at org.apache.struts.action.RequestProcessor.processForwardConfig(RequestProcessor.java:388)
      at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:231)
      at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1164)
      at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:415)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at com.eurodyn.epps.common.filters.MonitoringFilter.doFilter(MonitoringFilter.java:175)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.jboss.web.tomcat.tc5.JvmRouteFilter.doFilter(JvmRouteFilter.java:112)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at com.eurodyn.epps.authorization.presentation.SecurityFilter.doFilter(SecurityFilter.java:162)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at com.eurodyn.epps.common.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:103)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:75)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:214)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:198)
      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:152)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.jboss.web.tomcat.security.CustomPrincipalValve.invoke(CustomPrincipalValve.java:66)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:153)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:54)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.tc5.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:80)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:118)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929)
      at org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160)
      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:799)
      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:705)
      at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:577)
      at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:683)
      at java.lang.Thread.run(Thread.java:534)
      Caused by: org.jboss.tm.JBossRollbackException: Unable to commit, tx=TransactionImpl:XidImpl[FormatId=257, GlobalId=m-rafi/887, BranchQual=, localId=887] status=STATUS_NO_TRANSACTION; - nested throwable: (org.jboss.util.NestedRuntimeException: ; - nested throwable: (org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false))
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:344)
      at org.jboss.tm.TxManager.commit(TxManager.java:200)
      at org.jboss.tm.usertx.client.ServerVMClientUserTransaction.commit(ServerVMClientUserTransaction.java:126)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:364)
      ... 81 more
      Caused by: org.jboss.util.NestedRuntimeException: ; - nested throwable: (org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false)
      at org.jboss.cache.interceptors.ReplicationInterceptor$SynchronizationHandler.beforeCompletion(ReplicationInterceptor.java:441)
      at org.jboss.cache.interceptors.OrderedSynchronizationHandler.beforeCompletion(OrderedSynchronizationHandler.java:71)
      at org.jboss.tm.TransactionImpl.doBeforeCompletion(TransactionImpl.java:1383)
      at org.jboss.tm.TransactionImpl.beforePrepare(TransactionImpl.java:1075)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:296)
      ... 84 more
      Caused by: org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false
      at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2235)
      at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2257)
      at org.jboss.cache.interceptors.ReplicationInterceptor.runPreparePhase(ReplicationInterceptor.java:520)
      at org.jboss.cache.interceptors.ReplicationInterceptor$SynchronizationHandler.beforeCompletion(ReplicationInterceptor.java:424)
      ... 88 more
      19:37:41,593 INFO [STDOUT] eproc> 17) 127.0.0.1 Null 19/10/2005 19:37:05_17 19:37:41.593 DEBUG MonitoringFilter - removing NDC for http://localhost:8080/epps/jsp/login.do?lgSelect=en&password=123456&username=CMooney& user-agent=Java/1.4.1_01
      19:37:41,609 INFO [STDOUT] eproc> 19:37:41.609 DEBUG etCharacterEncodingFilter - Changed encoding to UTF-8
      19:37:56,609 WARN [ReplicationInterceptor] runPreparePhase() failed. Transaction is now rolled back
      org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, retval=null, received=false, suspected=false
      at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2235)
      at org.jboss.cache.TreeCache.callRemoteMethods(TreeCache.java:2257)
      at org.jboss.cache.interceptors.ReplicationInterceptor.runPreparePhase(ReplicationInterceptor.java:520)
      at org.jboss.cache.interceptors.ReplicationInterceptor$SynchronizationHandler.beforeCompletion(ReplicationInterceptor.java:424)
      at org.jboss.cache.interceptors.OrderedSynchronizationHandler.beforeCompletion(OrderedSynchronizationHandler.java:71)
      at org.jboss.tm.TransactionImpl.doBeforeCompletion(TransactionImpl.java:1383)
      at org.jboss.tm.TransactionImpl.beforePrepare(TransactionImpl.java:1075)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:296)
      at org.jboss.tm.TxManager.commit(TxManager.java:200)
      at org.jboss.tm.usertx.client.ServerVMClientUserTransaction.commit(ServerVMClientUserTransaction.java:126)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:364)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.storeSession(JBossCacheManager.java:213)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.add(JBossCacheManager.java:245)
      at org.apache.catalina.session.StandardSession.setId(StandardSession.java:354)
      at org.jboss.web.tomcat.tc5.session.JBossCacheManager.createSession(JBossCacheManager.java:171)
      at org.apache.coyote.tomcat5.CoyoteRequest.doGetSession(CoyoteRequest.java:2274)
      at org.apache.coyote.tomcat5.CoyoteRequest.getSession(CoyoteRequest.java:2116)
      at org.apache.coyote.tomcat5.CoyoteRequestFacade.getSession(CoyoteRequestFacade.java:526)
      at com.eurodyn.epps.authorization.presentation.SecurityFilter.doFilter(SecurityFilter.java:143)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at com.eurodyn.epps.common.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:103)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:75)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:214)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:198)
      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:152)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.jboss.web.tomcat.security.CustomPrincipalValve.invoke(CustomPrincipalValve.java:66)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:153)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:54)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.jboss.web.tomcat.tc5.session.ClusteredSessionValve.invoke(ClusteredSessionValve.java:80)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:118)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929)
      at org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160)
      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:799)
      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:705)
      at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:577)
      at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:683)
      at java.lang.Thread.run(Thread.java:534)
      19:37:56,609 ERROR [JBossCacheManager] processSessionRepl: failed with exception: org.jboss.tm.JBossRollbackException: Unable to commit, tx=TransactionImpl:XidImpl[FormatId=257, GlobalId=m-rafi/888, BranchQual=, localId=888] status=STATUS_NO_TRANSACTION; - nested throwable: (org.jboss.util.NestedRuntimeException: ; - nested throwable: (org.jboss.cache.lock.TimeoutException: rsp=sender=cc229:3744, ret
      19:37:56,609 INFO [STDOUT] java.lang.IllegalStateException: No transaction.
      19:37:56,609 INFO [STDOUT] at org.jboss.tm.TxManager.rollback(TxManager.java:331)
      19:37:56,609 INFO [STDOUT] at org.jboss.tm.usertx.client.ServerVMClientUserTransaction.rollback(ServerVMClientUserTransaction.java:134)
      19:37:56,609 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:371)
      19:37:56,609 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.storeSession(JBossCacheManager.java:213)
      19:37:56,609 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.add(JBossCacheManager.java:245)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.session.StandardSession.setId(StandardSession.java:354)
      19:37:56,609 INFO [STDOUT] at org.jboss.web.tomcat.tc5.session.JBossCacheManager.createSession(JBossCacheManager.java:171)
      19:37:56,609 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequest.doGetSession(CoyoteRequest.java:2274)
      19:37:56,609 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequest.getSession(CoyoteRequest.java:2116)
      19:37:56,609 INFO [STDOUT] at org.apache.coyote.tomcat5.CoyoteRequestFacade.getSession(CoyoteRequestFacade.java:526)
      19:37:56,609 INFO [STDOUT] at com.eurodyn.epps.authorization.presentation.SecurityFilter.doFilter(SecurityFilter.java:143)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:56,609 INFO [STDOUT] at com.eurodyn.epps.common.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:103)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:56,609 INFO [STDOUT] at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:75)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:214)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:198)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:152)
      19:37:56,609 INFO [STDOUT] at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.j