2010-07-01 22:19:18,777 | INFO | ActiveMQ 5.3.1-fuse-01-00 JMS Message Broker (10.194.178.191) is starting | org.apache.activemq.broker.BrokerService | WrapperSimpleAppMain 2010-07-01 22:19:18,777 | INFO | For help or more information please see: http://activemq.apache.org/ | org.apache.activemq.broker.BrokerService | WrapperSimpleAppMain 2010-07-01 22:19:18,945 | INFO | Listening for connections at: nio://basheer-amq-s:61616 | org.apache.activemq.transport.TransportServerThreadSupport | WrapperSimpleAppMain 2010-07-01 22:19:18,945 | INFO | Connector openwire Started | org.apache.activemq.broker.TransportConnector | WrapperSimpleAppMain 2010-07-01 22:19:18,947 | INFO | ActiveMQ JMS Message Broker (10.194.178.191, ID:basheer-amq-s-49510-1278022758794-0:0) started | org.apache.activemq.broker.BrokerService | WrapperSimpleAppMain 2010-07-01 22:19:18,982 | INFO | Logging to org.slf4j.impl.JCLLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog | org.mortbay.log | WrapperSimpleAppMain 2010-07-01 22:19:18,996 | INFO | jetty-6.1.14 | org.mortbay.log | WrapperSimpleAppMain 2010-07-01 22:19:19,610 | INFO | ActiveMQ WebConsole initialized. | org.apache.activemq.web.WebConsoleStarter | WrapperSimpleAppMain 2010-07-01 22:19:19,692 | INFO | Initializing Spring FrameworkServlet 'dispatcher' | /admin | WrapperSimpleAppMain 2010-07-01 22:19:19,756 | INFO | ActiveMQ Console at http://0.0.0.0:8161/admin | org.mortbay.log | WrapperSimpleAppMain 2010-07-01 22:19:19,761 | INFO | Started SelectChannelConnector@0.0.0.0:8161 | org.mortbay.log | WrapperSimpleAppMain 2010-07-02 03:20:14,368 | WARN | KahaDB PageFile flush: 7 queued writes, latch wait took 164 | org.apache.kahadb.page.PageFile | ActiveMQ Journal Checkpoint Worker 2010-07-02 04:03:36,897 | INFO | Slow KahaDB access: Journal append took: 735 ms, Index update took 3 ms | org.apache.activemq.store.kahadb.MessageDatabase | ActiveMQ NIO Worker 2010-07-02 06:23:01,228 | ERROR | KahaDB failed to store to Journal | org.apache.activemq.store.kahadb.MessageDatabase | ActiveMQ Scheduler java.io.IOException: Input/output error at java.io.RandomAccessFile.readBytes(Native Method) at java.io.RandomAccessFile.read(Unknown Source) at java.io.RandomAccessFile.readFully(Unknown Source) at java.io.RandomAccessFile.readFully(Unknown Source) at org.apache.kahadb.page.PageFile.readPage(PageFile.java:792) at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:440) at org.apache.kahadb.page.Transaction$2.(Transaction.java:431) at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:428) at org.apache.kahadb.page.Transaction.load(Transaction.java:404) at org.apache.kahadb.page.Transaction.load(Transaction.java:361) at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262) at org.apache.kahadb.index.BTreeNode.getChild(BTreeNode.java:224) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:236) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:240) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:240) at org.apache.kahadb.index.BTreeIndex.remove(BTreeIndex.java:194) at org.apache.activemq.store.kahadb.MessageDatabase.updateIndex(MessageDatabase.java:873) at org.apache.activemq.store.kahadb.MessageDatabase.access$700(MessageDatabase.java:82) at org.apache.activemq.store.kahadb.MessageDatabase$13.execute(MessageDatabase.java:757) at org.apache.kahadb.page.Transaction.execute(Transaction.java:728) at org.apache.activemq.store.kahadb.MessageDatabase.process(MessageDatabase.java:755) at org.apache.activemq.store.kahadb.MessageDatabase$11.visit(MessageDatabase.java:700) at org.apache.activemq.store.kahadb.data.KahaRemoveMessageCommand.visit(KahaRemoveMessageCommand.java:220) at org.apache.activemq.store.kahadb.MessageDatabase.process(MessageDatabase.java:692) at org.apache.activemq.store.kahadb.MessageDatabase.store(MessageDatabase.java:644) at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.removeMessage(KahaDBStore.java:154) at org.apache.activemq.broker.region.Queue.acknowledge(Queue.java:654) at org.apache.activemq.broker.region.Queue.removeMessage(Queue.java:1317) at org.apache.activemq.broker.region.Queue.removeMessage(Queue.java:1310) at org.apache.activemq.broker.region.Queue.messageExpired(Queue.java:1366) at org.apache.activemq.broker.region.Queue.messageExpired(Queue.java:1356) at org.apache.activemq.broker.region.Queue.doBrowse(Queue.java:853) at org.apache.activemq.broker.region.Queue.expireMessages(Queue.java:632) at org.apache.activemq.broker.region.Queue.access$100(Queue.java:89) at org.apache.activemq.broker.region.Queue$2.run(Queue.java:123) at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33) at java.util.TimerThread.mainLoop(Unknown Source) at java.util.TimerThread.run(Unknown Source) 2010-07-02 06:23:01,230 | INFO | Stopping the broker due to IO exception, java.io.IOException: Input/output error | org.apache.activemq.util.DefaultIOExceptionHandler | ActiveMQ Scheduler java.io.IOException: Input/output error at java.io.RandomAccessFile.readBytes(Native Method) at java.io.RandomAccessFile.read(Unknown Source) at java.io.RandomAccessFile.readFully(Unknown Source) at java.io.RandomAccessFile.readFully(Unknown Source) at org.apache.kahadb.page.PageFile.readPage(PageFile.java:792) at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:440) at org.apache.kahadb.page.Transaction$2.(Transaction.java:431) at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:428) at org.apache.kahadb.page.Transaction.load(Transaction.java:404) at org.apache.kahadb.page.Transaction.load(Transaction.java:361) at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262) at org.apache.kahadb.index.BTreeNode.getChild(BTreeNode.java:224) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:236) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:240) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:240) at org.apache.kahadb.index.BTreeIndex.remove(BTreeIndex.java:194) at org.apache.activemq.store.kahadb.MessageDatabase.updateIndex(MessageDatabase.java:873) at org.apache.activemq.store.kahadb.MessageDatabase.access$700(MessageDatabase.java:82) at org.apache.activemq.store.kahadb.MessageDatabase$13.execute(MessageDatabase.java:757) at org.apache.kahadb.page.Transaction.execute(Transaction.java:728) at org.apache.activemq.store.kahadb.MessageDatabase.process(MessageDatabase.java:755) at org.apache.activemq.store.kahadb.MessageDatabase$11.visit(MessageDatabase.java:700) at org.apache.activemq.store.kahadb.data.KahaRemoveMessageCommand.visit(KahaRemoveMessageCommand.java:220) at org.apache.activemq.store.kahadb.MessageDatabase.process(MessageDatabase.java:692) at org.apache.activemq.store.kahadb.MessageDatabase.store(MessageDatabase.java:644) at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.removeMessage(KahaDBStore.java:154) at org.apache.activemq.broker.region.Queue.acknowledge(Queue.java:654) at org.apache.activemq.broker.region.Queue.removeMessage(Queue.java:1317) at org.apache.activemq.broker.region.Queue.removeMessage(Queue.java:1310) at org.apache.activemq.broker.region.Queue.messageExpired(Queue.java:1366) at org.apache.activemq.broker.region.Queue.messageExpired(Queue.java:1356) at org.apache.activemq.broker.region.Queue.doBrowse(Queue.java:853) at org.apache.activemq.broker.region.Queue.expireMessages(Queue.java:632) at org.apache.activemq.broker.region.Queue.access$100(Queue.java:89) at org.apache.activemq.broker.region.Queue$2.run(Queue.java:123) at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33) at java.util.TimerThread.mainLoop(Unknown Source) at java.util.TimerThread.run(Unknown Source) 2010-07-02 06:23:01,233 | ERROR | Failed to remove expired Message from the store | org.apache.activemq.broker.region.Queue | ActiveMQ Scheduler java.io.IOException: Input/output error at java.io.RandomAccessFile.readBytes(Native Method) at java.io.RandomAccessFile.read(Unknown Source) at java.io.RandomAccessFile.readFully(Unknown Source) at java.io.RandomAccessFile.readFully(Unknown Source) at org.apache.kahadb.page.PageFile.readPage(PageFile.java:792) at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:440) at org.apache.kahadb.page.Transaction$2.(Transaction.java:431) at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:428) at org.apache.kahadb.page.Transaction.load(Transaction.java:404) at org.apache.kahadb.page.Transaction.load(Transaction.java:361) at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262) at org.apache.kahadb.index.BTreeNode.getChild(BTreeNode.java:224) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:236) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:240) at org.apache.kahadb.index.BTreeNode.remove(BTreeNode.java:240) at org.apache.kahadb.index.BTreeIndex.remove(BTreeIndex.java:194) at org.apache.activemq.store.kahadb.MessageDatabase.updateIndex(MessageDatabase.java:873) at org.apache.activemq.store.kahadb.MessageDatabase.access$700(MessageDatabase.java:82) at org.apache.activemq.store.kahadb.MessageDatabase$13.execute(MessageDatabase.java:757) at org.apache.kahadb.page.Transaction.execute(Transaction.java:728) at org.apache.activemq.store.kahadb.MessageDatabase.process(MessageDatabase.java:755) at org.apache.activemq.store.kahadb.MessageDatabase$11.visit(MessageDatabase.java:700) at org.apache.activemq.store.kahadb.data.KahaRemoveMessageCommand.visit(KahaRemoveMessageCommand.java:220) at org.apache.activemq.store.kahadb.MessageDatabase.process(MessageDatabase.java:692) at org.apache.activemq.store.kahadb.MessageDatabase.store(MessageDatabase.java:644) at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.removeMessage(KahaDBStore.java:154) at org.apache.activemq.broker.region.Queue.acknowledge(Queue.java:654) at org.apache.activemq.broker.region.Queue.removeMessage(Queue.java:1317) at org.apache.activemq.broker.region.Queue.removeMessage(Queue.java:1310) at org.apache.activemq.broker.region.Queue.messageExpired(Queue.java:1366) at org.apache.activemq.broker.region.Queue.messageExpired(Queue.java:1356) at org.apache.activemq.broker.region.Queue.doBrowse(Queue.java:853) at org.apache.activemq.broker.region.Queue.expireMessages(Queue.java:632) at org.apache.activemq.broker.region.Queue.access$100(Queue.java:89) at org.apache.activemq.broker.region.Queue$2.run(Queue.java:123) at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33) at java.util.TimerThread.mainLoop(Unknown Source) at java.util.TimerThread.run(Unknown Source) 2010-07-02 06:23:01,243 | INFO | ActiveMQ Message Broker (10.194.178.191, ID:basheer-amq-s-49510-1278022758794-0:0) is shutting down | org.apache.activemq.broker.BrokerService | Thread-25 2010-07-02 06:23:02,366 | INFO | Connector openwire Stopped | org.apache.activemq.broker.TransportConnector | Thread-25 2010-07-02 06:23:02,872 | INFO | ActiveMQ JMS Message Broker (10.194.178.191, ID:basheer-amq-s-49510-1278022758794-0:0) stopped | org.apache.activemq.broker.BrokerService | Thread-25