4 Replies Latest reply on Jun 4, 2004 4:50 PM by hbaxmann

    SQL exception with large number of JMS messages

    fboss
    fboss Jun 2, 2004 8:40 PM

      Hi all,

      We are using,

      JBOSS/Tomcat 3.2.2
      Oracle 8.1.7
      JDBC Driver (thin): Oracle8i Release 2 (8.1.7)

      We are using JMS with XA. When there's a payment that pays for one item, the payment bean would write two messages to two JMS queue and two message bean would wake up to do post payment processing. Everything works fine until we have a payment that pays for (relatively) large number of items, say 15. In this case, the system would try to write 30 messages to the JMS queue (under one global transaction) and we would get the error as listed in the stack trace below. Nothing get saved to the jms table and none of the message bean wake up to process any of the messages.

      I searched the forum and it seems we would get the sqlException, "No more data to read from socket" when the message is too large and Oracle thin dirver was used. In our case however, we are writing one message for each item so that is not the problem. I did try using latest version of OCI and thin driver (10g) and the problem seem to go away. Anyone ever encoutered this problem before? I would prefer to solve this problem without having to change the JDBC driver as our database is older verion 8.1.7.

      thanks


      the following is the stacktrace
      -------------------------------------------------------------------
      10:37:57,750 WARN [TxConnectionManager] Prepare called on a local tx. Use of lo
      cal transactions on a jta transaction with more than one branch may result in in
      consistent data in some cases of failure.
      10:38:08,531 WARN [JBossManagedConnectionPool] Exception destroying ManagedConn
      ection
      org.jboss.resource.JBossResourceException: SQLException; - nested throwable: (ja
      va.sql.SQLException: No more data to read from socket)
      at org.jboss.resource.adapter.jdbc.BaseWrapperManagedConnection.checkExc
      eption(BaseWrapperManagedConnection.java:541)
      at org.jboss.resource.adapter.jdbc.xa.XAManagedConnection.destroy(XAMana
      gedConnection.java:119)
      at org.jboss.resource.connectionmanager.InternalManagedConnectionPool.do
      Destroy(InternalManagedConnectionPool.java:476)
      at org.jboss.resource.connectionmanager.InternalManagedConnectionPool.re
      turnConnection(InternalManagedConnectionPool.java:323)
      at org.jboss.resource.connectionmanager.JBossManagedConnectionPool$BaseP
      ool.returnConnection(JBossManagedConnectionPool.java:508)
      at org.jboss.resource.connectionmanager.BaseConnectionManager2.returnMan
      agedConnection(BaseConnectionManager2.java:436)
      at org.jboss.resource.connectionmanager.BaseConnectionManager2$BaseConne
      ctionEventListener.connectionErrorOccurred(BaseConnectionManager2.java:778)
      at org.jboss.resource.connectionmanager.TxConnectionManager$TxConnection
      EventListener.connectionErrorOccurred(TxConnectionManager.java:603)
      at org.jboss.resource.adapter.jdbc.BaseWrapperManagedConnection.broadcas
      tConnectionError(BaseWrapperManagedConnection.java:318)
      at org.jboss.resource.adapter.jdbc.xa.XAManagedConnection.broadcastConne
      ctionError(XAManagedConnection.java:78)
      at org.jboss.resource.adapter.jdbc.BaseWrapperManagedConnection.connecti
      onError(BaseWrapperManagedConnection.java:303)
      at org.jboss.resource.adapter.jdbc.WrappedConnection.checkException(Wrap
      pedConnection.java:791)
      at org.jboss.resource.adapter.jdbc.WrappedStatement.checkException(Wrapp
      edStatement.java:767)
      at org.jboss.resource.adapter.jdbc.WrappedStatement.close(WrappedStateme
      nt.java:56)
      at org.jboss.mq.pm.jdbc2.PersistenceManager.add(PersistenceManager.java:
      790)
      at org.jboss.mq.pm.jdbc2.PersistenceManager.add(PersistenceManager.java:
      730)
      at org.jboss.mq.server.PersistentQueue.addMessage(PersistentQueue.java:4
      4)
      at org.jboss.mq.server.JMSQueue.addMessage(JMSQueue.java:145)
      at org.jboss.mq.server.JMSDestinationManager.addMessage(JMSDestinationMa
      nager.java:407)
      at org.jboss.mq.server.JMSDestinationManager.transact(JMSDestinationMana
      ger.java:466)
      at org.jboss.mq.server.JMSServerInterceptorSupport.transact(JMSServerInt
      erceptorSupport.java:186)
      at org.jboss.mq.server.TracingInterceptor.transact(TracingInterceptor.ja
      va:438)
      at org.jboss.mq.server.JMSServerInvoker.transact(JMSServerInvoker.java:1
      86)
      at org.jboss.mq.il.jvm.JVMServerIL.transact(JVMServerIL.java:328)
      at org.jboss.mq.Connection.send(Connection.java:928)
      at org.jboss.mq.SpyXAResourceManager.prepare(SpyXAResourceManager.java:1
      91)
      at org.jboss.mq.SpyXAResource.prepare(SpyXAResource.java:172)
      at org.jboss.tm.TransactionImpl.prepareResources(TransactionImpl.java:14
      92)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:380)
      at org.jboss.ejb.plugins.TxInterceptorCMT.endTransaction(TxInterceptorCM
      T.java:398)
      at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxIntercep
      torCMT.java:277)
      at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:1
      28)
      at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.
      java:118)
      at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:191)
      at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFacto
      ryFinderInterceptor.java:122)
      at org.jboss.ejb.StatelessSessionContainer.internalInvoke(StatelessSessi
      onContainer.java:331)
      at org.jboss.ejb.Container.invoke(Container.java:700)
      at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalPro
      xyFactory.java:375)
      at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSes
      sionProxy.java:83)
      at $Proxy135.processPayment(Unknown Source)
      at ubc.ems.functions.makepayment.FCMakePayment.processPayment(FCMakePaym
      ent.java:214)
      at ubc.ems.functions.makepayment.FCMakePayment.handleBusinessEvent(FCMak
      ePayment.java:98)
      at ubc.ems.framework.frontend.FunctionLoader_Web.handleOutput(FunctionLo
      ader_Web.java:139)
      at ubc.ems.framework.frontend.FunctionLoader_Web.processRequest(Function
      Loader_Web.java:115)
      at ubc.ems.framework.frontend.SRVFunctionGateway.doPost(SRVFunctionGatew
      ay.java:88)
      at ubc.ems.framework.frontend.SRVFunctionGateway.doGet(SRVFunctionGatewa
      y.java:75)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl
      icationFilterChain.java:247)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF
      ilterChain.java:193)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperV
      alve.java:256)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextV
      alve.java:191)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.jboss.web.tomcat.security.JBossSecurityMgrRealm.invoke(JBossSecur
      ityMgrRealm.java:220)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authentica
      torBase.java:494)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.CertificatesValve.invoke(CertificatesValve
      .java:246)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.jboss.web.tomcat.tc4.statistics.ContainerStatsValve.invoke(Contai
      nerStatsValve.java:76)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardContext.invoke(StandardContext.java:
      2416)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.j
      ava:180)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDispatche
      rValve.java:171)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.j
      ava:172)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(Securit
      yAssociationValve.java:65)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:
      577)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineVal
      ve.java:174)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:22
      3)
      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java
      :601)
      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.proce
      ssConnection(Http11Protocol.java:392)
      at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java
      :565)
      at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
      ool.java:619)
      at java.lang.Thread.run(Thread.java:534)
      Caused by: java.sql.SQLException: No more data to read from socket
      at oracle.jdbc.dbaccess.DBError.throwSqlException(DBError.java:169)
      at oracle.jdbc.dbaccess.DBError.throwSqlException(DBError.java:211)
      at oracle.jdbc.dbaccess.DBError.check_error(DBError.java:933)
      at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:739)
      at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
      at oracle.jdbc.ttc7.Ocommoncall.receive(Ocommoncall.java:108)
      at oracle.jdbc.ttc7.TTC7Protocol.logoff(TTC7Protocol.java:320)
      at oracle.jdbc.driver.OracleConnection.close(OracleConnection.java:934)
      at oracle.jdbc.pool.OraclePooledConnection.close(OraclePooledConnection.
      java:144)
      at org.jboss.resource.adapter.jdbc.xa.XAManagedConnection.destroy(XAMana
      gedConnection.java:115)
      ... 87 more
      10:38:08,562 ERROR [STDERR] java.sql.SQLException: Closed Connection
      10:38:08,562 ERROR [STDERR] at oracle.jdbc.dbaccess.DBError.throwSqlExceptio
      n(DBError.java:169)
      10:38:08,578 ERROR [STDERR] at oracle.jdbc.dbaccess.DBError.throwSqlExceptio
      n(DBError.java:211)
      10:38:08,578 ERROR [STDERR] at oracle.jdbc.dbaccess.DBError.throwSqlExceptio
      n(DBError.java:274)
      10:38:08,578 ERROR [STDERR] at oracle.jdbc.driver.OracleConnection.privatePr
      epareCall(OracleConnection.java:704)
      10:38:08,578 ERROR [STDERR] at oracle.jdbc.driver.OracleConnection.prepareCa
      ll(OracleConnection.java:632)
      10:38:08,578 ERROR [STDERR] at oracle.jdbc.xa.client.OracleXAResource.end(Or
      acleXAResource.java:258)
      10:38:08,578 ERROR [STDERR] at org.jboss.resource.adapter.jdbc.xa.XAManagedC
      onnection.end(XAManagedConnection.java:155)
      10:38:08,578 ERROR [STDERR] at org.jboss.tm.TransactionImpl.endResource(Tran
      sactionImpl.java:1201)
      10:38:08,578 ERROR [STDERR] at org.jboss.tm.TransactionImpl.endResources(Tra
      nsactionImpl.java:1274)
      10:38:08,578 ERROR [STDERR] at org.jboss.tm.TransactionImpl.commit(Transacti
      onImpl.java:351)
      10:38:08,578 ERROR [STDERR] at org.jboss.tm.TxManager.commit(TxManager.java:
      141)
      10:38:08,578 ERROR [STDERR] at org.jboss.mq.pm.jdbc2.PersistenceManager$Tran
      sactionManagerStrategy.endTX(PersistenceManager.java:178)
      10:38:08,578 ERROR [STDERR] at org.jboss.mq.pm.jdbc2.PersistenceManager.add(
      PersistenceManager.java:756)
      10:38:08,578 ERROR [STDERR] at org.jboss.mq.server.PersistentQueue.addMessag
      e(PersistentQueue.java:44)
      10:38:08,609 ERROR [STDERR] at org.jboss.mq.server.JMSQueue.addMessage(JMSQu
      eue.java:145)
      10:38:08,843 ERROR [STDERR] at org.jboss.mq.server.JMSDestinationManager.add
      Message(JMSDestinationManager.java:407)
      10:38:08,859 ERROR [STDERR] at org.jboss.mq.server.JMSDestinationManager.tra
      nsact(JMSDestinationManager.java:466)
      10:38:08,859 ERROR [STDERR] at org.jboss.mq.server.JMSServerInterceptorSuppo
      rt.transact(JMSServerInterceptorSupport.java:186)
      10:38:08,859 ERROR [STDERR] at org.jboss.mq.server.TracingInterceptor.transa
      ct(TracingInterceptor.java:438)
      10:38:08,859 ERROR [STDERR] at org.jboss.mq.server.JMSServerInvoker.transact
      (JMSServerInvoker.java:186)
      10:38:08,859 ERROR [STDERR] at org.jboss.mq.il.jvm.JVMServerIL.transact(JVMS
      erverIL.java:328)
      10:38:08,859 ERROR [STDERR] at org.jboss.mq.Connection.send(Connection.java:
      928)
      10:38:08,859 ERROR [STDERR] at org.jboss.mq.SpyXAResourceManager.prepare(Spy
      XAResourceManager.java:191)
      10:38:08,859 ERROR [STDERR] at org.jboss.mq.SpyXAResource.prepare(SpyXAResou
      rce.java:172)
      10:38:08,859 ERROR [STDERR] at org.jboss.tm.TransactionImpl.prepareResources
      (TransactionImpl.java:1492)
      10:38:08,859 ERROR [STDERR] at org.jboss.tm.TransactionImpl.commit(Transacti
      onImpl.java:380)
      10:38:08,859 ERROR [STDERR] at org.jboss.ejb.plugins.TxInterceptorCMT.endTra
      nsaction(TxInterceptorCMT.java:398)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.plugins.TxInterceptorCMT.runWit
      hTransactions(TxInterceptorCMT.java:277)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.plugins.TxInterceptorCMT.invoke
      (TxInterceptorCMT.java:128)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.plugins.SecurityInterceptor.inv
      oke(SecurityInterceptor.java:118)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.plugins.LogInterceptor.invoke(L
      ogInterceptor.java:191)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.plugins.ProxyFactoryFinderInter
      ceptor.invoke(ProxyFactoryFinderInterceptor.java:122)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.StatelessSessionContainer.inter
      nalInvoke(StatelessSessionContainer.java:331)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.Container.invoke(Container.java
      :700)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.plugins.local.BaseLocalProxyFac
      tory.invoke(BaseLocalProxyFactory.java:375)
      10:38:08,890 ERROR [STDERR] at org.jboss.ejb.plugins.local.StatelessSessionP
      roxy.invoke(StatelessSessionProxy.java:83)
      10:38:08,890 ERROR [STDERR] at $Proxy135.processPayment(Unknown Source)
      10:38:08,890 ERROR [STDERR] at ubc.ems.functions.makepayment.FCMakePayment.p
      rocessPayment(FCMakePayment.java:214)
      10:38:08,890 ERROR [STDERR] at ubc.ems.functions.makepayment.FCMakePayment.h
      andleBusinessEvent(FCMakePayment.java:98)
      10:38:08,890 ERROR [STDERR] at ubc.ems.framework.frontend.FunctionLoader_Web
      .handleOutput(FunctionLoader_Web.java:139)
      10:38:08,890 ERROR [STDERR] at ubc.ems.framework.frontend.FunctionLoader_Web
      .processRequest(FunctionLoader_Web.java:115)
      10:38:08,890 ERROR [STDERR] at ubc.ems.framework.frontend.SRVFunctionGateway
      .doPost(SRVFunctionGateway.java:88)
      10:38:08,890 ERROR [STDERR] at ubc.ems.framework.frontend.SRVFunctionGateway
      .doGet(SRVFunctionGateway.java:75)
      10:38:08,890 ERROR [STDERR] at javax.servlet.http.HttpServlet.service(HttpSe
      rvlet.java:740)
      10:38:08,890 ERROR [STDERR] at javax.servlet.http.HttpServlet.service(HttpSe
      rvlet.java:853)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterCha
      in.internalDoFilter(ApplicationFilterChain.java:247)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterCha
      in.doFilter(ApplicationFilterChain.java:193)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardWrapperValve
      .invoke(StandardWrapperValve.java:256)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:643)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.inv
      oke(StandardPipeline.java:480)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke
      (ContainerBase.java:995)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardContextValve
      .invoke(StandardContextValve.java:191)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:643)
      10:38:08,906 ERROR [STDERR] at org.jboss.web.tomcat.security.JBossSecurityMg
      rRealm.invoke(JBossSecurityMgrRealm.java:220)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.authenticator.Authenticat
      orBase.invoke(AuthenticatorBase.java:494)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.valves.CertificatesValve.
      invoke(CertificatesValve.java:246)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:08,906 ERROR [STDERR] at org.jboss.web.tomcat.tc4.statistics.Container
      StatsValve.invoke(ContainerStatsValve.java:76)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.inv
      oke(StandardPipeline.java:480)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke
      (ContainerBase.java:995)
      10:38:08,906 ERROR [STDERR] at org.apache.catalina.core.StandardContext.invo
      ke(StandardContext.java:2416)
      10:38:08,937 ERROR [STDERR] at org.apache.catalina.core.StandardHostValve.in
      voke(StandardHostValve.java:180)
      10:38:08,937 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:643)
      10:38:08,937 ERROR [STDERR] at org.apache.catalina.valves.ErrorDispatcherVal
      ve.invoke(ErrorDispatcherValve.java:171)
      10:38:08,937 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:08,953 ERROR [STDERR] at org.apache.catalina.valves.ErrorReportValve.i
      nvoke(ErrorReportValve.java:172)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,000 ERROR [STDERR] at org.jboss.web.tomcat.security.SecurityAssocia
      tionValve.invoke(SecurityAssociationValve.java:65)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.valves.AccessLogValve.inv
      oke(AccessLogValve.java:577)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.inv
      oke(StandardPipeline.java:480)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke
      (ContainerBase.java:995)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.StandardEngineValve.
      invoke(StandardEngineValve.java:174)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:643)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.inv
      oke(StandardPipeline.java:480)
      10:38:09,000 ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke
      (ContainerBase.java:995)
      10:38:09,000 ERROR [STDERR] at org.apache.coyote.tomcat4.CoyoteAdapter.servi
      ce(CoyoteAdapter.java:223)
      10:38:09,000 ERROR [STDERR] at org.apache.coyote.http11.Http11Processor.proc
      ess(Http11Processor.java:601)
      10:38:09,000 ERROR [STDERR] at org.apache.coyote.http11.Http11Protocol$Http1
      1ConnectionHandler.processConnection(Http11Protocol.java:392)
      10:38:09,015 ERROR [STDERR] at org.apache.tomcat.util.net.TcpWorkerThread.ru
      nIt(PoolTcpEndpoint.java:565)
      10:38:09,015 ERROR [STDERR] at org.apache.tomcat.util.threads.ThreadPool$Con
      trolRunnable.run(ThreadPool.java:619)
      10:38:09,015 ERROR [STDERR] at java.lang.Thread.run(Thread.java:534)
      10:38:09,015 WARN [TransactionImpl] XAException: tx=TransactionImpl:XidImpl [Fo
      rmatId=257, GlobalId=bhh147//33, BranchQual=] errorCode=XAER_RMERR
      oracle.jdbc.xa.OracleXAException
      at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:498)

      at oracle.jdbc.xa.client.OracleXAResource.end(OracleXAResource.java:285)

      at org.jboss.resource.adapter.jdbc.xa.XAManagedConnection.end(XAManagedC
      onnection.java:155)
      at org.jboss.tm.TransactionImpl.endResource(TransactionImpl.java:1201)
      at org.jboss.tm.TransactionImpl.endResources(TransactionImpl.java:1274)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:351)
      at org.jboss.tm.TxManager.commit(TxManager.java:141)
      at org.jboss.mq.pm.jdbc2.PersistenceManager$TransactionManagerStrategy.e
      ndTX(PersistenceManager.java:178)
      at org.jboss.mq.pm.jdbc2.PersistenceManager.add(PersistenceManager.java:
      756)
      at org.jboss.mq.server.PersistentQueue.addMessage(PersistentQueue.java:4
      4)
      at org.jboss.mq.server.JMSQueue.addMessage(JMSQueue.java:145)
      at org.jboss.mq.server.JMSDestinationManager.addMessage(JMSDestinationMa
      nager.java:407)
      at org.jboss.mq.server.JMSDestinationManager.transact(JMSDestinationMana
      ger.java:466)
      at org.jboss.mq.server.JMSServerInterceptorSupport.transact(JMSServerInt
      erceptorSupport.java:186)
      at org.jboss.mq.server.TracingInterceptor.transact(TracingInterceptor.ja
      va:438)
      at org.jboss.mq.server.JMSServerInvoker.transact(JMSServerInvoker.java:1
      86)
      at org.jboss.mq.il.jvm.JVMServerIL.transact(JVMServerIL.java:328)
      at org.jboss.mq.Connection.send(Connection.java:928)
      at org.jboss.mq.SpyXAResourceManager.prepare(SpyXAResourceManager.java:1
      91)
      at org.jboss.mq.SpyXAResource.prepare(SpyXAResource.java:172)
      at org.jboss.tm.TransactionImpl.prepareResources(TransactionImpl.java:14
      92)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:380)
      at org.jboss.ejb.plugins.TxInterceptorCMT.endTransaction(TxInterceptorCM
      T.java:398)
      at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxIntercep
      torCMT.java:277)
      at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:1
      28)
      at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.
      java:118)
      at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:191)
      at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFacto
      ryFinderInterceptor.java:122)
      at org.jboss.ejb.StatelessSessionContainer.internalInvoke(StatelessSessi
      onContainer.java:331)
      at org.jboss.ejb.Container.invoke(Container.java:700)
      at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalPro
      xyFactory.java:375)
      at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSes
      sionProxy.java:83)
      at $Proxy135.processPayment(Unknown Source)
      at ubc.ems.functions.makepayment.FCMakePayment.processPayment(FCMakePaym
      ent.java:214)
      at ubc.ems.functions.makepayment.FCMakePayment.handleBusinessEvent(FCMak
      ePayment.java:98)
      at ubc.ems.framework.frontend.FunctionLoader_Web.handleOutput(FunctionLo
      ader_Web.java:139)
      at ubc.ems.framework.frontend.FunctionLoader_Web.processRequest(Function
      Loader_Web.java:115)
      at ubc.ems.framework.frontend.SRVFunctionGateway.doPost(SRVFunctionGatew
      ay.java:88)
      at ubc.ems.framework.frontend.SRVFunctionGateway.doGet(SRVFunctionGatewa
      y.java:75)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl
      icationFilterChain.java:247)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF
      ilterChain.java:193)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperV
      alve.java:256)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextV
      alve.java:191)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.jboss.web.tomcat.security.JBossSecurityMgrRealm.invoke(JBossSecur
      ityMgrRealm.java:220)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authentica
      torBase.java:494)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.CertificatesValve.invoke(CertificatesValve
      .java:246)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.jboss.web.tomcat.tc4.statistics.ContainerStatsValve.invoke(Contai
      nerStatsValve.java:76)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardContext.invoke(StandardContext.java:
      2416)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.j
      ava:180)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDispatche
      rValve.java:171)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.j
      ava:172)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(Securit
      yAssociationValve.java:65)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:
      577)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineVal
      ve.java:174)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:22
      3)
      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java
      :601)
      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.proce
      ssConnection(Http11Protocol.java:392)
      at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java
      :565)
      at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
      ool.java:619)
      at java.lang.Thread.run(Thread.java:534)
      10:38:09,015 WARN [TransactionImpl] xa error: -3 (A resource manager error has
      occured in the transaction branch.); oracle error: 65535; oracle sql error: -1;
      oracle.jdbc.xa.OracleXAException
      at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:498)

      at oracle.jdbc.xa.client.OracleXAResource.end(OracleXAResource.java:285)

      at org.jboss.resource.adapter.jdbc.xa.XAManagedConnection.end(XAManagedC
      onnection.java:155)
      at org.jboss.tm.TransactionImpl.endResource(TransactionImpl.java:1201)
      at org.jboss.tm.TransactionImpl.endResources(TransactionImpl.java:1274)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:351)
      at org.jboss.tm.TxManager.commit(TxManager.java:141)
      at org.jboss.mq.pm.jdbc2.PersistenceManager$TransactionManagerStrategy.e
      ndTX(PersistenceManager.java:178)
      at org.jboss.mq.pm.jdbc2.PersistenceManager.add(PersistenceManager.java:
      756)
      at org.jboss.mq.server.PersistentQueue.addMessage(PersistentQueue.java:4
      4)
      at org.jboss.mq.server.JMSQueue.addMessage(JMSQueue.java:145)
      at org.jboss.mq.server.JMSDestinationManager.addMessage(JMSDestinationMa
      nager.java:407)
      at org.jboss.mq.server.JMSDestinationManager.transact(JMSDestinationMana
      ger.java:466)
      at org.jboss.mq.server.JMSServerInterceptorSupport.transact(JMSServerInt
      erceptorSupport.java:186)
      at org.jboss.mq.server.TracingInterceptor.transact(TracingInterceptor.ja
      va:438)
      at org.jboss.mq.server.JMSServerInvoker.transact(JMSServerInvoker.java:1
      86)
      at org.jboss.mq.il.jvm.JVMServerIL.transact(JVMServerIL.java:328)
      at org.jboss.mq.Connection.send(Connection.java:928)
      at org.jboss.mq.SpyXAResourceManager.prepare(SpyXAResourceManager.java:1
      91)
      at org.jboss.mq.SpyXAResource.prepare(SpyXAResource.java:172)
      at org.jboss.tm.TransactionImpl.prepareResources(TransactionImpl.java:14
      92)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:380)
      at org.jboss.ejb.plugins.TxInterceptorCMT.endTransaction(TxInterceptorCM
      T.java:398)
      at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxIntercep
      torCMT.java:277)
      at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:1
      28)
      at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.
      java:118)
      at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:191)
      at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFacto
      ryFinderInterceptor.java:122)
      at org.jboss.ejb.StatelessSessionContainer.internalInvoke(StatelessSessi
      onContainer.java:331)
      at org.jboss.ejb.Container.invoke(Container.java:700)
      at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalPro
      xyFactory.java:375)
      at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSes
      sionProxy.java:83)
      at $Proxy135.processPayment(Unknown Source)
      at ubc.ems.functions.makepayment.FCMakePayment.processPayment(FCMakePaym
      ent.java:214)
      at ubc.ems.functions.makepayment.FCMakePayment.handleBusinessEvent(FCMak
      ePayment.java:98)
      at ubc.ems.framework.frontend.FunctionLoader_Web.handleOutput(FunctionLo
      ader_Web.java:139)
      at ubc.ems.framework.frontend.FunctionLoader_Web.processRequest(Function
      Loader_Web.java:115)
      at ubc.ems.framework.frontend.SRVFunctionGateway.doPost(SRVFunctionGatew
      ay.java:88)
      at ubc.ems.framework.frontend.SRVFunctionGateway.doGet(SRVFunctionGatewa
      y.java:75)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl
      icationFilterChain.java:247)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF
      ilterChain.java:193)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperV
      alve.java:256)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextV
      alve.java:191)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.jboss.web.tomcat.security.JBossSecurityMgrRealm.invoke(JBossSecur
      ityMgrRealm.java:220)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authentica
      torBase.java:494)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.CertificatesValve.invoke(CertificatesValve
      .java:246)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.jboss.web.tomcat.tc4.statistics.ContainerStatsValve.invoke(Contai
      nerStatsValve.java:76)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardContext.invoke(StandardContext.java:
      2416)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.j
      ava:180)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDispatche
      rValve.java:171)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.j
      ava:172)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(Securit
      yAssociationValve.java:65)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:
      577)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineVal
      ve.java:174)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:22
      3)
      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java
      :601)
      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.proce
      ssConnection(Http11Protocol.java:392)
      at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java
      :565)
      at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
      ool.java:619)
      at java.lang.Thread.run(Thread.java:534)
      10:38:09,109 ERROR [STDERR] java.sql.SQLException: Closed Connection
      10:38:09,109 ERROR [STDERR] at oracle.jdbc.dbaccess.DBError.throwSqlExceptio
      n(DBError.java:169)
      10:38:09,109 ERROR [STDERR] at oracle.jdbc.dbaccess.DBError.throwSqlExceptio
      n(DBError.java:211)
      10:38:09,109 ERROR [STDERR] at oracle.jdbc.dbaccess.DBError.throwSqlExceptio
      n(DBError.java:274)
      10:38:09,109 ERROR [STDERR] at oracle.jdbc.driver.OracleConnection.privatePr
      epareCall(OracleConnection.java:704)
      10:38:09,109 ERROR [STDERR] at oracle.jdbc.driver.OracleConnection.prepareCa
      ll(OracleConnection.java:632)
      10:38:09,109 ERROR [STDERR] at oracle.jdbc.xa.client.OracleXAResource.rollba
      ck(OracleXAResource.java:592)
      10:38:09,125 ERROR [STDERR] at org.jboss.resource.adapter.jdbc.xa.XAManagedC
      onnection.rollback(XAManagedConnection.java:194)
      10:38:09,125 ERROR [STDERR] at org.jboss.tm.TransactionImpl.rollbackResource
      s(TransactionImpl.java:1660)
      10:38:09,125 ERROR [STDERR] at org.jboss.tm.TransactionImpl.commit(Transacti
      onImpl.java:399)
      10:38:09,125 ERROR [STDERR] at org.jboss.tm.TxManager.commit(TxManager.java:
      141)
      10:38:09,140 ERROR [STDERR] at org.jboss.mq.pm.jdbc2.PersistenceManager$Tran
      sactionManagerStrategy.endTX(PersistenceManager.java:178)
      10:38:09,140 ERROR [STDERR] at org.jboss.mq.pm.jdbc2.PersistenceManager.add(
      PersistenceManager.java:756)
      10:38:09,140 ERROR [STDERR] at org.jboss.mq.server.PersistentQueue.addMessag
      e(PersistentQueue.java:44)
      10:38:09,140 ERROR [STDERR] at org.jboss.mq.server.JMSQueue.addMessage(JMSQu
      eue.java:145)
      10:38:09,140 ERROR [STDERR] at org.jboss.mq.server.JMSDestinationManager.add
      Message(JMSDestinationManager.java:407)
      10:38:09,140 ERROR [STDERR] at org.jboss.mq.server.JMSDestinationManager.tra
      nsact(JMSDestinationManager.java:466)
      10:38:09,140 ERROR [STDERR] at org.jboss.mq.server.JMSServerInterceptorSuppo
      rt.transact(JMSServerInterceptorSupport.java:186)
      10:38:09,156 ERROR [STDERR] at org.jboss.mq.server.TracingInterceptor.transa
      ct(TracingInterceptor.java:438)
      10:38:09,156 ERROR [STDERR] at org.jboss.mq.server.JMSServerInvoker.transact
      (JMSServerInvoker.java:186)
      10:38:09,156 ERROR [STDERR] at org.jboss.mq.il.jvm.JVMServerIL.transact(JVMS
      erverIL.java:328)
      10:38:09,156 ERROR [STDERR] at org.jboss.mq.Connection.send(Connection.java:
      928)
      10:38:09,171 ERROR [STDERR] at org.jboss.mq.SpyXAResourceManager.prepare(Spy
      XAResourceManager.java:191)
      10:38:09,171 ERROR [STDERR] at org.jboss.mq.SpyXAResource.prepare(SpyXAResou
      rce.java:172)
      10:38:09,171 ERROR [STDERR] at org.jboss.tm.TransactionImpl.prepareResources
      (TransactionImpl.java:1492)
      10:38:09,171 ERROR [STDERR] at org.jboss.tm.TransactionImpl.commit(Transacti
      onImpl.java:380)
      10:38:09,171 ERROR [STDERR] at org.jboss.ejb.plugins.TxInterceptorCMT.endTra
      nsaction(TxInterceptorCMT.java:398)
      10:38:09,171 ERROR [STDERR] at org.jboss.ejb.plugins.TxInterceptorCMT.runWit
      hTransactions(TxInterceptorCMT.java:277)
      10:38:09,171 ERROR [STDERR] at org.jboss.ejb.plugins.TxInterceptorCMT.invoke
      (TxInterceptorCMT.java:128)
      10:38:09,187 ERROR [STDERR] at org.jboss.ejb.plugins.SecurityInterceptor.inv
      oke(SecurityInterceptor.java:118)
      10:38:09,187 ERROR [STDERR] at org.jboss.ejb.plugins.LogInterceptor.invoke(L
      ogInterceptor.java:191)
      10:38:09,187 ERROR [STDERR] at org.jboss.ejb.plugins.ProxyFactoryFinderInter
      ceptor.invoke(ProxyFactoryFinderInterceptor.java:122)
      10:38:09,187 ERROR [STDERR] at org.jboss.ejb.StatelessSessionContainer.inter
      nalInvoke(StatelessSessionContainer.java:331)
      10:38:09,203 ERROR [STDERR] at org.jboss.ejb.Container.invoke(Container.java
      :700)
      10:38:09,203 ERROR [STDERR] at org.jboss.ejb.plugins.local.BaseLocalProxyFac
      tory.invoke(BaseLocalProxyFactory.java:375)
      10:38:09,203 ERROR [STDERR] at org.jboss.ejb.plugins.local.StatelessSessionP
      roxy.invoke(StatelessSessionProxy.java:83)
      10:38:09,203 ERROR [STDERR] at $Proxy135.processPayment(Unknown Source)
      10:38:09,203 ERROR [STDERR] at ubc.ems.functions.makepayment.FCMakePayment.p
      rocessPayment(FCMakePayment.java:214)
      10:38:09,203 ERROR [STDERR] at ubc.ems.functions.makepayment.FCMakePayment.h
      andleBusinessEvent(FCMakePayment.java:98)
      10:38:09,218 ERROR [STDERR] at ubc.ems.framework.frontend.FunctionLoader_Web
      .handleOutput(FunctionLoader_Web.java:139)
      10:38:09,234 ERROR [STDERR] at ubc.ems.framework.frontend.FunctionLoader_Web
      .processRequest(FunctionLoader_Web.java:115)
      10:38:09,234 ERROR [STDERR] at ubc.ems.framework.frontend.SRVFunctionGateway
      .doPost(SRVFunctionGateway.java:88)
      10:38:09,234 ERROR [STDERR] at ubc.ems.framework.frontend.SRVFunctionGateway
      .doGet(SRVFunctionGateway.java:75)
      10:38:09,234 ERROR [STDERR] at javax.servlet.http.HttpServlet.service(HttpSe
      rvlet.java:740)
      10:38:09,234 ERROR [STDERR] at javax.servlet.http.HttpServlet.service(HttpSe
      rvlet.java:853)
      10:38:09,234 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterCha
      in.internalDoFilter(ApplicationFilterChain.java:247)
      10:38:09,234 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterCha
      in.doFilter(ApplicationFilterChain.java:193)
      10:38:09,250 ERROR [STDERR] at org.apache.catalina.core.StandardWrapperValve
      .invoke(StandardWrapperValve.java:256)
      10:38:09,250 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:643)
      10:38:09,250 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.inv
      oke(StandardPipeline.java:480)
      10:38:09,250 ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke
      (ContainerBase.java:995)
      10:38:09,250 ERROR [STDERR] at org.apache.catalina.core.StandardContextValve
      .invoke(StandardContextValve.java:191)
      10:38:09,265 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:643)
      10:38:09,265 ERROR [STDERR] at org.jboss.web.tomcat.security.JBossSecurityMg
      rRealm.invoke(JBossSecurityMgrRealm.java:220)
      10:38:09,265 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,265 ERROR [STDERR] at org.apache.catalina.authenticator.Authenticat
      orBase.invoke(AuthenticatorBase.java:494)
      10:38:09,265 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,281 ERROR [STDERR] at org.apache.catalina.valves.CertificatesValve.
      invoke(CertificatesValve.java:246)
      10:38:09,312 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,625 ERROR [STDERR] at org.jboss.web.tomcat.tc4.statistics.Container
      StatsValve.invoke(ContainerStatsValve.java:76)
      10:38:09,625 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,625 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.inv
      oke(StandardPipeline.java:480)
      10:38:09,625 ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke
      (ContainerBase.java:995)
      10:38:09,625 ERROR [STDERR] at org.apache.catalina.core.StandardContext.invo
      ke(StandardContext.java:2416)
      10:38:09,625 ERROR [STDERR] at org.apache.catalina.core.StandardHostValve.in
      voke(StandardHostValve.java:180)
      10:38:09,625 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:643)
      10:38:09,625 ERROR [STDERR] at org.apache.catalina.valves.ErrorDispatcherVal
      ve.invoke(ErrorDispatcherValve.java:171)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.valves.ErrorReportValve.i
      nvoke(ErrorReportValve.java:172)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,640 ERROR [STDERR] at org.jboss.web.tomcat.security.SecurityAssocia
      tionValve.invoke(SecurityAssociationValve.java:65)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.valves.AccessLogValve.inv
      oke(AccessLogValve.java:577)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:641)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.inv
      oke(StandardPipeline.java:480)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke
      (ContainerBase.java:995)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.StandardEngineValve.
      invoke(StandardEngineValve.java:174)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$Sta
      ndardPipelineValveContext.invokeNext(StandardPipeline.java:643)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.inv
      oke(StandardPipeline.java:480)
      10:38:09,640 ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke
      (ContainerBase.java:995)
      10:38:09,640 ERROR [STDERR] at org.apache.coyote.tomcat4.CoyoteAdapter.servi
      ce(CoyoteAdapter.java:223)
      10:38:09,640 ERROR [STDERR] at org.apache.coyote.http11.Http11Processor.proc
      ess(Http11Processor.java:601)
      10:38:09,640 ERROR [STDERR] at org.apache.coyote.http11.Http11Protocol$Http1
      1ConnectionHandler.processConnection(Http11Protocol.java:392)
      10:38:09,640 ERROR [STDERR] at org.apache.tomcat.util.net.TcpWorkerThread.ru
      nIt(PoolTcpEndpoint.java:565)
      10:38:09,640 ERROR [STDERR] at org.apache.tomcat.util.threads.ThreadPool$Con
      trolRunnable.run(ThreadPool.java:619)
      10:38:09,640 ERROR [STDERR] at java.lang.Thread.run(Thread.java:534)
      10:38:09,718 WARN [TransactionImpl] XAException: tx=TransactionImpl:XidImpl [Fo
      rmatId=257, GlobalId=bhh147//25, BranchQual=] errorCode=XAER_RMERR
      org.jboss.mq.SpyXAException: - nested throwable: (org.jboss.mq.SpyJMSException:
      Cannot process a transaction; - nested throwable: (org.jboss.mq.SpyTransactionRo
      lledBackException: Transaction was rolled back.; - nested throwable: (org.jboss.
      mq.SpyJMSException: Could not start a transaction with the transaction manager.;
      - nested throwable: (org.jboss.tm.JBossRollbackException: Unable to commit, tx=
      TransactionImpl:XidImpl [FormatId=257, GlobalId=bhh147//33, BranchQual=] status=
      STATUS_NO_TRANSACTION; - nested throwable: (oracle.jdbc.xa.OracleXAException))))
      )
      at org.jboss.mq.SpyXAResource.prepare(SpyXAResource.java:174)
      at org.jboss.tm.TransactionImpl.prepareResources(TransactionImpl.java:14
      92)
      at org.jboss.tm.TransactionImpl.commit(TransactionImpl.java:380)
      at org.jboss.ejb.plugins.TxInterceptorCMT.endTransaction(TxInterceptorCM
      T.java:398)
      at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxIntercep
      torCMT.java:277)
      at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:1
      28)
      at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.
      java:118)
      at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:191)
      at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFacto
      ryFinderInterceptor.java:122)
      at org.jboss.ejb.StatelessSessionContainer.internalInvoke(StatelessSessi
      onContainer.java:331)
      at org.jboss.ejb.Container.invoke(Container.java:700)
      at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalPro
      xyFactory.java:375)
      at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSes
      sionProxy.java:83)
      at $Proxy135.processPayment(Unknown Source)
      at ubc.ems.functions.makepayment.FCMakePayment.processPayment(FCMakePaym
      ent.java:214)
      at ubc.ems.functions.makepayment.FCMakePayment.handleBusinessEvent(FCMak
      ePayment.java:98)
      at ubc.ems.framework.frontend.FunctionLoader_Web.handleOutput(FunctionLo
      ader_Web.java:139)
      at ubc.ems.framework.frontend.FunctionLoader_Web.processRequest(Function
      Loader_Web.java:115)
      at ubc.ems.framework.frontend.SRVFunctionGateway.doPost(SRVFunctionGatew
      ay.java:88)
      at ubc.ems.framework.frontend.SRVFunctionGateway.doGet(SRVFunctionGatewa
      y.java:75)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl
      icationFilterChain.java:247)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF
      ilterChain.java:193)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperV
      alve.java:256)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextV
      alve.java:191)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.jboss.web.tomcat.security.JBossSecurityMgrRealm.invoke(JBossSecur
      ityMgrRealm.java:220)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authentica
      torBase.java:494)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.CertificatesValve.invoke(CertificatesValve
      .java:246)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.jboss.web.tomcat.tc4.statistics.ContainerStatsValve.invoke(Contai
      nerStatsValve.java:76)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardContext.invoke(StandardContext.java:
      2416)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.j
      ava:180)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDispatche
      rValve.java:171)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.j
      ava:172)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(Securit
      yAssociationValve.java:65)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:
      577)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:641)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineVal
      ve.java:174)
      at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContex
      t.invokeNext(StandardPipeline.java:643)
      at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.jav
      a:480)
      at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)

      at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:22
      3)
      at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java
      :601)
      at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.proce
      ssConnection(Http11Protocol.java:392)
      at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java
      :565)
      at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadP
      ool.java:619)
      at java.lang.Thread.run(Thread.java:534)
      Caused by: org.jboss.mq.SpyJMSException: Cannot process a transaction; - nested
      throwable: (org.jboss.mq.SpyTransactionRolledBackException: Transaction was roll
      ed back.; - nested throwable: (org.jboss.mq.SpyJMSException: Could not start a t
      ransaction with the transaction manager.; - nested throwable: (org.jboss.tm.JBos
      sRollbackException: Unable to commit, tx=TransactionImpl:XidImpl [FormatId=257,
      GlobalId=bhh147//33, BranchQual=] status=STATUS_NO_TRANSACTION; - nested throwab
      le: (oracle.jdbc.xa.OracleXAException))))
      at org.jboss.mq.Connection.send(Connection.java:932)
      at org.jboss.mq.SpyXAResourceManager.prepare(SpyXAResourceManager.java:1
      91)
      at org.jboss.mq.SpyXAResource.prepare(SpyXAResource.java:172)
      ... 62 more

      • 4121 Views
      • Tags:
        • 1. Re: SQL exception with large number of JMS messages
          adrian.brock Jun 3, 2004 7:25 AM (in response to fboss)

          The first message is in the FAQ (but looks irrelevent?)

          The error says the db connection is broken. In fact, the part you posted is where
          it is trying to close the connection because it encountered a problem.

          P.S. As I've said many times, you don't need an XA connection for JBossMQ persistence,
          there is only ever one branch to the JBossMQ internal transaction.
          If you want JMS XA, use the JMS Resource Adapter (FAQ again).

            • Actions
          • 2. Re: SQL exception with large number of JMS messages
            fboss
            fboss Jun 3, 2004 2:21 PM (in response to fboss)

            The reason we switched to use XA with JMS is because we want the transaction of sending of JMS message to join with caller's transaction so they commit together as the message bean that does the post payment processing needs some data from the payment EJB commited to the database.

            I'll look at JMS Resource Adapter more and see if that helps.

            thanks.

              • Actions
            • 3. Re: SQL exception with large number of JMS messages
              genman
              genman Jun 4, 2004 4:03 PM (in response to fboss)

              Oracle's thin driver is a broken Piece Of Shit which can cause broken connections, especially with BLOBs or CLOBs larger than 4k, so I suggest you use either the OCI driver or some other third party driver for JMS persistence.

                • Actions
              • 4. Re: SQL exception with large number of JMS messages
                hbaxmann
                hbaxmann Jun 4, 2004 4:50 PM (in response to fboss)

                There is no problem to use 10g drivers for 8i, they are backward compatible with 8i.

                bax

                  • Actions