13 Replies Latest reply on Jan 2, 2007 10:34 AM by Bob Walker

    LeasePinger error

    Bob Walker Newbie

      Hi,

      I've got what I think is a really basic JBoss Messaging setup, with JBossAS 4.0.5GA, and JBoss Messaging 1.0.1GA running on a SLES Linux server with JDK 1.5.0_09. Messages persist to a PostgreSQL database.

      I use JBoss as purely a JMS provider, there are no other AppServer/EJB/MDB components. My JMS client is down the other end of a VPN, which I believe to be stable/reliable. The client is just a couple of classes implementing MessageListener and a couple of classes using MessageProducers to send messages. These classes are hosted in a Jetty servlet container.

      This runs fine whilst I am developing during the day; but when I leave overnight and return, I come into a set of large stack traces on the client, and a few smaller stack traces on the server. It appears to be coming from, or manifesting itself in the LeasePinger.sendClientPing. I wondered if it was an issue with the VPN link going down, but if I disable the VPN manually, I do not get these stack traces, just a brief message telling me there was an "Error sending lease ping to server for client invoker (session id a011o-9oetow-eve0b98y-1-eve0baiy-6.", which is absolutely fine and understandable.

      I'll post the stack traces in a following post.

        • 1. Re: LeasePinger error
          Bob Walker Newbie

          Client Stack Trace:
          - error
          java.lang.reflect.InvocationTargetException
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:1000)
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithFields(RegularObjectPersister.java:182)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:90)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.io.JBossObjectOutputStream.writeObjectOverride(JBossObjectOutputStream.java:181)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at org.jboss.remoting.serialization.impl.java.JavaSerializationManager.sendObject(JavaSerializationManager.java:85)
          at org.jboss.remoting.marshal.serializable.SerializableMarshaller.write(SerializableMarshaller.java:84)
          at org.jboss.jms.server.remoting.JMSWireFormat.write(JMSWireFormat.java:310)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.versionedWrite(MicroSocketClientInvoker.java:502)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.transport(MicroSocketClientInvoker.java:340)
          at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:125)
          at org.jboss.remoting.LeasePinger.sendClientPing(LeasePinger.java:97)
          at org.jboss.remoting.LeasePinger$LeaseTimerTask.run(LeasePinger.java:216)
          at java.util.TimerThread.mainLoop(Timer.java:512)
          at java.util.TimerThread.run(Timer.java:462)
          Caused by: java.net.SocketException: Connection reset by peer: socket write error
          at java.net.SocketOutputStream.socketWrite0(Native Method)
          at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
          at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
          at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
          at java.io.BufferedOutputStream.write(BufferedOutputStream.java:78)
          at java.io.DataOutputStream.writeInt(DataOutputStream.java:183)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeInt(DataContainer.java:241)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.addObjectReference(DataContainer.java:174)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.saveImmutable(DataContainer.java:285)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:149)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:999)
          ... 36 more
          java.lang.reflect.InvocationTargetException
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:1000)
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithFields(RegularObjectPersister.java:182)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:90)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.io.JBossObjectOutputStream.writeObjectOverride(JBossObjectOutputStream.java:181)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at org.jboss.remoting.serialization.impl.java.JavaSerializationManager.sendObject(JavaSerializationManager.java:85)
          at org.jboss.remoting.marshal.serializable.SerializableMarshaller.write(SerializableMarshaller.java:84)
          at org.jboss.jms.server.remoting.JMSWireFormat.write(JMSWireFormat.java:310)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.versionedWrite(MicroSocketClientInvoker.java:502)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.transport(MicroSocketClientInvoker.java:340)
          at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:125)
          at org.jboss.remoting.LeasePinger.sendClientPing(LeasePinger.java:97)
          at org.jboss.remoting.LeasePinger$LeaseTimerTask.run(LeasePinger.java:216)
          at java.util.TimerThread.mainLoop(Timer.java:512)
          at java.util.TimerThread.run(Timer.java:462)
          Caused by: java.net.SocketException: Connection reset by peer: socket write error
          at java.net.SocketOutputStream.socketWrite0(Native Method)
          at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
          at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
          at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
          at java.io.BufferedOutputStream.write(BufferedOutputStream.java:78)
          at java.io.DataOutputStream.writeInt(DataOutputStream.java:183)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeInt(DataContainer.java:241)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.addObjectReference(DataContainer.java:174)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.saveImmutable(DataContainer.java:285)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:149)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:999)
          ... 36 more
          - error
          java.lang.reflect.InvocationTargetException
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithFields(RegularObjectPersister.java:182)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:90)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.io.JBossObjectOutputStream.writeObjectOverride(JBossObjectOutputStream.java:181)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at org.jboss.remoting.serialization.impl.java.JavaSerializationManager.sendObject(JavaSerializationManager.java:85)
          at org.jboss.remoting.marshal.serializable.SerializableMarshaller.write(SerializableMarshaller.java:84)
          at org.jboss.jms.server.remoting.JMSWireFormat.write(JMSWireFormat.java:310)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.versionedWrite(MicroSocketClientInvoker.java:502)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.transport(MicroSocketClientInvoker.java:340)
          at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:125)
          at org.jboss.remoting.LeasePinger.sendClientPing(LeasePinger.java:97)
          at org.jboss.remoting.LeasePinger$LeaseTimerTask.run(LeasePinger.java:216)
          at java.util.TimerThread.mainLoop(Timer.java:512)
          at java.util.TimerThread.run(Timer.java:462)
          Caused by: java.io.IOException
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:129)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:1000)
          ... 25 more
          Caused by: java.lang.reflect.InvocationTargetException
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          ... 32 more
          Caused by: java.net.SocketException: Connection reset by peer: socket write error
          at java.net.SocketOutputStream.socketWrite0(Native Method)
          at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
          at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
          at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
          at java.io.BufferedOutputStream.write(BufferedOutputStream.java:78)
          at java.io.DataOutputStream.writeInt(DataOutputStream.java:183)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeInt(DataContainer.java:241)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.addObjectReference(DataContainer.java:174)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.saveImmutable(DataContainer.java:285)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:149)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:999)
          ... 36 more
          java.lang.reflect.InvocationTargetException
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithFields(RegularObjectPersister.java:182)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:90)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.io.JBossObjectOutputStream.writeObjectOverride(JBossObjectOutputStream.java:181)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at org.jboss.remoting.serialization.impl.java.JavaSerializationManager.sendObject(JavaSerializationManager.java:85)
          at org.jboss.remoting.marshal.serializable.SerializableMarshaller.write(SerializableMarshaller.java:84)
          at org.jboss.jms.server.remoting.JMSWireFormat.write(JMSWireFormat.java:310)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.versionedWrite(MicroSocketClientInvoker.java:502)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.transport(MicroSocketClientInvoker.java:340)
          at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:125)
          at org.jboss.remoting.LeasePinger.sendClientPing(LeasePinger.java:97)
          at org.jboss.remoting.LeasePinger$LeaseTimerTask.run(LeasePinger.java:216)
          at java.util.TimerThread.mainLoop(Timer.java:512)
          at java.util.TimerThread.run(Timer.java:462)
          Caused by: java.io.IOException
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:129)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:1000)
          ... 25 more
          Caused by: java.lang.reflect.InvocationTargetException
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          ... 32 more
          Caused by: java.net.SocketException: Connection reset by peer: socket write error
          at java.net.SocketOutputStream.socketWrite0(Native Method)
          at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
          at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
          at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
          at java.io.BufferedOutputStream.write(BufferedOutputStream.java:78)
          at java.io.DataOutputStream.writeInt(DataOutputStream.java:183)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeInt(DataContainer.java:241)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.addObjectReference(DataContainer.java:174)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.saveImmutable(DataContainer.java:285)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:149)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:999)
          ... 36 more
          - Got marshalling exception, exiting
          java.io.IOException
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:129)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithFields(RegularObjectPersister.java:182)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:90)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.io.JBossObjectOutputStream.writeObjectOverride(JBossObjectOutputStream.java:181)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at org.jboss.remoting.serialization.impl.java.JavaSerializationManager.sendObject(JavaSerializationManager.java:85)
          at org.jboss.remoting.marshal.serializable.SerializableMarshaller.write(SerializableMarshaller.java:84)
          at org.jboss.jms.server.remoting.JMSWireFormat.write(JMSWireFormat.java:310)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.versionedWrite(MicroSocketClientInvoker.java:502)
          at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.transport(MicroSocketClientInvoker.java:340)
          at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:125)
          at org.jboss.remoting.LeasePinger.sendClientPing(LeasePinger.java:97)
          at org.jboss.remoting.LeasePinger$LeaseTimerTask.run(LeasePinger.java:216)
          at java.util.TimerThread.mainLoop(Timer.java:512)
          at java.util.TimerThread.run(Timer.java:462)
          Caused by: java.lang.reflect.InvocationTargetException
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          ... 21 more
          Caused by: java.io.IOException
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:129)
          at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
          at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:1000)
          ... 25 more
          Caused by: java.lang.reflect.InvocationTargetException
          at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
          ... 32 more
          Caused by: java.net.SocketException: Connection reset by peer: socket write error
          at java.net.SocketOutputStream.socketWrite0(Native Method)
          at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
          at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
          at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
          at java.io.BufferedOutputStream.write(BufferedOutputStream.java:78)
          at java.io.DataOutputStream.writeInt(DataOutputStream.java:183)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeInt(DataContainer.java:241)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.addObjectReference(DataContainer.java:174)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.saveImmutable(DataContainer.java:285)
          at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:149)
          at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:197)
          at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
          at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:322)
          at java.util.HashMap.writeObject(HashMap.java:999)
          ... 36 more


          • 2. Re: LeasePinger error
            Bob Walker Newbie

            Server Stack Trace:
            2006-12-06 22:56:54,508 ERROR [org.jboss.remoting.transport.socket.ServerThread] failed
            java.io.IOException
            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithMethod(RegularObjectPersister.java:107)
            at org.jboss.serial.persister.RegularObjectPersister.defaultRead(RegularObjectPersister.java:269)
            at org.jboss.serial.persister.RegularObjectPersister.readData(RegularObjectPersister.java:241)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.readObjectDescriptionFromStreaming(ObjectDescriptorFactory.java:412)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.objectFromDescription(ObjectDescriptorFactory.java:82)
            at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectInput.readObject(DataContainer.java:643)
            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithFields(RegularObjectPersister.java:353)
            at org.jboss.serial.persister.RegularObjectPersister.defaultRead(RegularObjectPersister.java:273)
            at org.jboss.serial.persister.RegularObjectPersister.readData(RegularObjectPersister.java:241)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.readObjectDescriptionFromStreaming(ObjectDescriptorFactory.java:412)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.objectFromDescription(ObjectDescriptorFactory.java:82)
            at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectInput.readObject(DataContainer.java:643)
            at org.jboss.serial.io.JBossObjectInputStream.readObjectOverride(JBossObjectInputStream.java:163)
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:342)
            at org.jboss.remoting.serialization.impl.java.JavaSerializationManager.receiveObject(JavaSerializationManager.java:132)
            at org.jboss.remoting.marshal.serializable.SerializableUnMarshaller.read(SerializableUnMarshaller.java:66)
            at org.jboss.jms.server.remoting.JMSWireFormat.read(JMSWireFormat.java:422)
            at org.jboss.remoting.transport.socket.ServerThread.versionedRead(ServerThread.java:390)
            at org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:446)
            at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:541)
            at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:261)
            Caused by: java.lang.reflect.InvocationTargetException
            at sun.reflect.GeneratedMethodAccessor112.invoke(Unknown Source)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            at java.lang.reflect.Method.invoke(Method.java:585)
            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithMethod(RegularObjectPersister.java:103)
            ... 20 more
            Caused by: java.io.IOException
            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithMethod(RegularObjectPersister.java:107)
            at org.jboss.serial.persister.RegularObjectPersister.defaultRead(RegularObjectPersister.java:269)
            at org.jboss.serial.persister.RegularObjectPersister.readData(RegularObjectPersister.java:241)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.readObjectDescriptionFromStreaming(ObjectDescriptorFactory.java:412)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.objectFromDescription(ObjectDescriptorFactory.java:82)
            at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectInput.readObject(DataContainer.java:643)
            at org.jboss.serial.persister.ObjectInputStreamProxy.readObjectOverride(ObjectInputStreamProxy.java:68)
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:342)
            at java.util.HashMap.readObject(HashMap.java:1067)
            ... 24 more
            Caused by: java.lang.reflect.InvocationTargetException
            at sun.reflect.GeneratedMethodAccessor112.invoke(Unknown Source)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            at java.lang.reflect.Method.invoke(Method.java:585)
            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithMethod(RegularObjectPersister.java:103)
            ... 32 more
            Caused by: java.io.IOException
            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithMethod(RegularObjectPersister.java:107)
            at org.jboss.serial.persister.RegularObjectPersister.defaultRead(RegularObjectPersister.java:269)
            at org.jboss.serial.persister.RegularObjectPersister.readData(RegularObjectPersister.java:241)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.readObjectDescriptionFromStreaming(ObjectDescriptorFactory.java:412)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.objectFromDescription(ObjectDescriptorFactory.java:82)
            at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectInput.readObject(DataContainer.java:643)
            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithFields(RegularObjectPersister.java:353)
            at org.jboss.serial.persister.RegularObjectPersister.defaultRead(RegularObjectPersister.java:273)
            at org.jboss.serial.persister.RegularObjectPersister.readData(RegularObjectPersister.java:241)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.readObjectDescriptionFromStreaming(ObjectDescriptorFactory.java:412)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.objectFromDescription(ObjectDescriptorFactory.java:82)
            at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectInput.readObject(DataContainer.java:643)
            at org.jboss.serial.persister.ObjectInputStreamProxy.readObjectOverride(ObjectInputStreamProxy.java:68)
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:342)
            at java.util.HashMap.readObject(HashMap.java:1067)
            ... 36 more
            Caused by: java.lang.reflect.InvocationTargetException
            at sun.reflect.GeneratedMethodAccessor112.invoke(Unknown Source)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            at java.lang.reflect.Method.invoke(Method.java:585)
            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithMethod(RegularObjectPersister.java:103)
            ... 50 more
            Caused by: java.io.EOFException
            at java.io.DataInputStream.readByte(DataInputStream.java:243)
            at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectInput.readByte(DataContainer.java:716)
            at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.objectFromDescription(ObjectDescriptorFactory.java:64)
            at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectInput.readObject(DataContainer.java:643)
            at org.jboss.serial.persister.ObjectInputStreamProxy.readObjectOverride(ObjectInputStreamProxy.java:68)
            at java.io.ObjectInputStream.readObject(ObjectInputStream.java:342)
            at java.util.HashMap.readObject(HashMap.java:1067)
            ... 54 more

            • 3. Re: LeasePinger error
              Bob Walker Newbie

              P.S. I can't swear that the timing of the server and client errors correspond, just that they occur when I am not here :-(.
              I can't glean anything useful from the stack traces, can you at least tell me if this could be caused by something in my environment?
              Also, I haven't an ExceptionListener in place - should I have?

              • 4. Re: LeasePinger error
                Bob Walker Newbie

                Hi - just to make sure this hasn't been fixed already, I applied the SP2 upgrade - I'm still geting this error.

                I've also deployed the code to a non-VPN environment, so all the communication is between local servers.

                I've also added ExceptionListeners on my connections to tell my client to re-query JNDI for the ConectionFactory and Destinations, and re-initialise my connections. This works fine for connectivity problems, but does not resolve the issue described above.

                Can anyone shed any light? If it's something I'm doing wrongly, that's fine, but I'd appreciate any pointers as to where to look/what to check etc.

                Anyone?

                TIA, in desperation,

                Bob

                • 5. Re: LeasePinger error
                  Tim Fox Master

                  Hello Bob-

                  We 're looking into this.

                  A few questions: Do you open and close lot of connections? How many connections? How much traffic? etc

                  Yes, please post your stack traces or send me them directly at my jboss address.

                  Cheers

                  • 6. Re: LeasePinger error
                    Bob Walker Newbie

                    Hi Tim,

                    Thanks for getting back to me, much appreciated.

                    I try to keep my connections to a minimum - I have a MessageListener implementation per queue, and 6 queues. I also have a couple of Dispatcher objects in my client that post messages back to a different server.

                    The listeners each have a private connection object that is started in an init() method and remains open and active until either my listener service is stopped, or the ExceptionListener informs my code of a problem - in both events a dispose() method is called and all objects are cleared up.

                    The Dispatchers also have a single private connection object, this is created once, and then start()ed and stop()ped for each message send, unless something goes wrong, then it is stop()ped, close()d and nulled prior to re-initialisation.

                    There is also a servlet I also have that takes http posts and distributes them to to some of the queues that my listeners listen on - this does open and close a new connection per post, and in fact does a fresh JNDI lookup per http post. This probably receives about 10-20 messages per hour.

                    But, at any one time, there aren't a great many connections open, probably < 20.

                    In all, traffic isn't huge at the moment, I manually send messages in bursts of maybe 50-100 at a time, on a sporadic basis at the moment, but I'm working towards automating this so that it's potentially frequent automated task. If I can get over this hurdle, the idea is to send quite a large volume of traffic via this infrastructure.

                    It may be of note that the messages can be large: they tend to be base64 representations of binaries.
                    I did see a problem with a specific large message that was around 4Mb - I gzipped the binary prior to encoding and the problem went away. Is there a size limit on messages?

                    As I mentioned, I seem to see the stack traces when I'm not actually sending anything through manually - the servlet does remain active 24/7 so, it may be that the errors originate from that traffic.

                    Thanks for your attention with this, it really is appreciated. If there's more info I can provide, do let me know.

                    Best regards,
                    Bob

                    • 7. Re: LeasePinger error
                      Bob Walker Newbie

                      Hi Tim,

                      Before you go off on a wild goos chase on my behalf - I had overlooked the servlet code I mentioned until I posted the last reply - I've just revisited the code and it looks like it wasn't cleaning up connections correctly, so it is entirely possible that there were a number of connections open. I've amended and redeployed the code to create a single connection/factory/session per servlet instance and just start/stop the connection per post - I'll let you know if I see different behaviour.

                      Do you think the problem is related to large numbers of unclosed connections? If so, is there an easy way to make this more obvious in the stack trace?

                      Thanks again and best regards,

                      Bob

                      • 8. Re: LeasePinger error
                        Clebert Suconic Master

                        Have you seen this issue?

                        http://jira.jboss.com/jira/browse/JBREM-649

                        You think it might be related?

                        • 9. Re: LeasePinger error
                          Clebert Suconic Master

                          I meant to ask if you have seen the exception listed on JBREM-649.

                          On my tests I got some other exceptions.. and the main one was this:

                          ava.lang.reflect.InvocationTargetException
                           at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
                           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
                           at java.lang.reflect.Method.invoke(Method.java:324)
                           at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
                           at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
                           at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
                           at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
                           at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:206)
                           at org.jboss.serial.persister.ObjectOutputStreamProxy.writeObjectOverride(ObjectOutputStreamProxy.java:60)
                           at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:274)
                           at java.util.HashMap.writeObject(HashMap.java:986)
                           at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
                           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
                           at java.lang.reflect.Method.invoke(Method.java:324)
                           at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)
                           at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:86)
                           at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
                           at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
                           at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:206)
                           at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithFields(RegularObjectPersister.java:182)
                           at org.jboss.serial.persister.RegularObjectPersister.defaultWrite(RegularObjectPersister.java:90)
                           at org.jboss.serial.persister.RegularObjectPersister.writeData(RegularObjectPersister.java:62)
                           at org.jboss.serial.objectmetamodel.ObjectDescriptorFactory.describeObject(ObjectDescriptorFactory.java:276)
                           at org.jboss.serial.objectmetamodel.DataContainer$DataContainerDirectOutput.writeObject(DataContainer.java:206)
                           at org.jboss.serial.io.JBossObjectOutputStream.writeObjectOverride(JBossObjectOutputStream.java:181)
                           at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:274)
                           at org.jboss.remoting.serialization.impl.java.JavaSerializationManager.sendObject(JavaSerializationManager.java:86)
                           at org.jboss.remoting.marshal.serializable.SerializableMarshaller.write(SerializableMarshaller.java:84)
                           at org.jboss.jms.server.remoting.JMSWireFormat.write(JMSWireFormat.java:310)
                           at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.versionedWrite(MicroSocketClientInvoker.java:518)
                           at org.jboss.remoting.transport.socket.MicroSocketClientInvoker.transport(MicroSocketClientInvoker.java:340)
                           at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:125)
                           at org.jboss.remoting.LeasePinger.sendClientPing(LeasePinger.java:97)
                           at org.jboss.remoting.LeasePinger$LeaseTimerTask.run(LeasePinger.java:216)
                           at java.util.TimerThread.mainLoop(Timer.java:432)
                           at java.util.TimerThread.run(Timer.java:382)
                          Caused by: java.util.ConcurrentModificationException
                           at java.util.HashMap$HashIterator.nextEntry(HashMap.java:782)
                           at java.util.HashMap$EntryIterator.next(HashMap.java:824)
                           at java.util.HashMap.writeObject(HashMap.java:984)
                           ... 36 more


                          • 10. Re: LeasePinger error
                            Bob Walker Newbie

                            Hi Clebert, thanks for responding so quickly. I hadn't seen JBREM-649 previously, but it does /appear/ to be the same error.

                            My clients and server stack traces seem to bear this out - the server is trying to do something with an object read out of a HashMap, the client seems like it's trying to write to (what I assume to be) the same HashMap.

                            server:
                            at org.jboss.serial.persister.RegularObjectPersister.readSlotWithMethod(RegularObjectPersister.java:107)

                            client:
                            at org.jboss.serial.persister.RegularObjectPersister.writeSlotWithMethod(RegularObjectPersister.java:120)

                            Is it an easy fix?

                            • 11. Re: LeasePinger error
                              Bob Walker Newbie

                              Hi Clebert - I'm also seeing the "Mismatch version of JBossSerialization signature" mentioned elsewhere:

                              http://www.jboss.com/index.html?module=bb&op=viewtopic&t=84745&postdays=0&postorder=asc&start=10
                              but I've double-checked all my jboss-messaging client jars, all my jboss-serialization jars and my jboss-remoting jars, they're all in synch versions from jboss-messaging 1.0.1.SP2. would you prefer me to post this on the other/a different thread?

                              • 12. Re: LeasePinger error
                                Clebert Suconic Master

                                The fix is easy...

                                You could replace jboss-remoting.jar by the one produced from Branch_2 from jboss-remoting CVS.

                                If you want to I can send the jar to you by e-mail. Just send me a private e-mail and I will answer you with a newer JAR. This way you will be able to test if the error is gone.

                                • 13. Re: LeasePinger error
                                  Bob Walker Newbie

                                  This seems to have fixed it, the server has been running almost uninterrupted for nearly a couple of weeks now with the CVS-built jars, and I haven't seen a reoccurrence.

                                  The mismatched serialization jars error was a classpath error on my part, which I have now resolved.

                                  Thanks, much appreciated!