HornetQ persistence internals
Hello,
I need to acquire deep knowledge about HornetQ persistence system and possible impact on system latency. I looking at source code and FINEST logs but still cannot make a general view about the process to create new journal files. I am confused by freeFiles, openedFiles, dataFiles classification and new journal file creation (create, rename, push ... ¿?). Could someone give me clues about the lifecycle of the journal files?
Thanks in advance!
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,453 FINEST [JournalFilesRepository] Returning file JournalFileImpl: (hornetq-data-2.hq id = 2, recordID = 2)
* [JournalImpl::FilesExecutor] 26-Jul 9:50:4,453 FINEST [JournalFilesRepository] Creating file hornetq-data-3.hq
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,453 FINEST [JournalImpl] moveNextFile: JournalFileImpl: (hornetq-data-2.hq id = 2, recordID = 2)
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,453 FINEST [JournalImpl] appendAddRecord::id=1669, userRecordType=31, usedFile = JournalFileImpl: (hornetq-data-2.hq id = 2, recordID = 2)
* [JournalImpl::CompactorExecutor] 26-Jul 9:50:4,453 FINEST [Reclaimer] posCount on JournalFileImpl: (hornetq-data-1.hq id = 1, recordID = 1) = 1660
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,453 FINEST [JournalImpl] appendUpdateRecord::id=1669, userRecordType=32, usedFile = JournalFileImpl: (hornetq-data-2.hq id = 2, recordID = 2)
* [Thread-17 (HornetQ-server-HornetQServerImpl::serverUUID=5b1b250a-d6f6-11e1-80c9-15c404bbb2e8-382567384)] 26-Jul 9:50:4,455 FINEST [StompProtocolManager] sent StompFrame[command=RECEIPT, headers={receipt-id=1739421607&1343289004451}, content-length=0]
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,455 FINEST [ServerSessionImpl] send(message=ServerMessage[messageID=1671,priority=4, bodySize=1024,expiration=0, durable=true, address=jms.queue.TestQueue,properties=TypedProperties[{JMSCorrelationID=null, receipt=1739421607&1343289004455, JMSType=null}]]@848516929, direct=true) being called
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,455 FINEST [SecurityStoreImpl] checking access permissions to jms.queue.TestQueue
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,456 FINEST [BindingsImpl] Routing message ServerMessage[messageID=1671,priority=4, bodySize=1024,expiration=0, durable=true, address=jms.queue.TestQueue,properties=TypedProperties[{JMSCorrelationID=null, receipt=1739421607&1343289004455, JMSType=null}]]@848516929 on binding=BindingsImpl [name=jms.queue.TestQueue]
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,456 FINEST [PostOfficeImpl] Message after routed=ServerMessage[messageID=1671,priority=4, bodySize=1024,expiration=0, durable=true, address=jms.queue.TestQueue,properties=TypedProperties[{JMSCorrelationID=null, receipt=1739421607&1343289004455, JMSType=null}]]@848516929
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,456 FINEST [JournalImpl] appendAddRecord::id=1671, userRecordType=31, usedFile = JournalFileImpl: (hornetq-data-2.hq id = 2, recordID = 2)
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,456 FINEST [JournalImpl] appendUpdateRecord::id=1671, userRecordType=32, usedFile = JournalFileImpl: (hornetq-data-2.hq id = 2, recordID = 2)
* [Thread-19 (HornetQ-server-HornetQServerImpl::serverUUID=5b1b250a-d6f6-11e1-80c9-15c404bbb2e8-382567384)] 26-Jul 9:50:4,465 FINEST [StompProtocolManager] sent StompFrame[command=RECEIPT, headers={receipt-id=1739421607&1343289004455}, content-length=0]
* [JournalImpl::FilesExecutor] 26-Jul 9:50:4,465 FINEST [JournalFilesRepository] Renaming file hornetq-data-3.hq.tmp as hornetq-data-3.hq
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,465 FINEST [ServerSessionImpl] send(message=ServerMessage[messageID=1673,priority=4, bodySize=1024,expiration=0, durable=true, address=jms.queue.TestQueue,properties=TypedProperties[{JMSCorrelationID=null, receipt=1739421607&1343289004465, JMSType=null}]]@1732609623, direct=true) being called
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,465 FINEST [SecurityStoreImpl] checking access permissions to jms.queue.TestQueue
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,465 FINEST [BindingsImpl] Routing message ServerMessage[messageID=1673,priority=4, bodySize=1024,expiration=0, durable=true, address=jms.queue.TestQueue,properties=TypedProperties[{JMSCorrelationID=null, receipt=1739421607&1343289004465, JMSType=null}]]@1732609623 on binding=BindingsImpl [name=jms.queue.TestQueue]
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,466 FINEST [PostOfficeImpl] Message after routed=ServerMessage[messageID=1673,priority=4, bodySize=1024,expiration=0, durable=true, address=jms.queue.TestQueue,properties=TypedProperties[{JMSCorrelationID=null, receipt=1739421607&1343289004465, JMSType=null}]]@1732609623
* [Old I/O server worker (parentId: 2046274478, [id: 0x79f7abae, /0.0.0.0:61613])] 26-Jul 9:50:4,466 FINEST [JournalImpl] appendAddRecord::id=1673, userRecordType=31, usedFile = JournalFileImpl: (hornetq-data-2.hq id = 2, recordID = 2)
* [JournalImpl::FilesExecutor] 26-Jul 9:50:4,466 FINEST [JournalFilesRepository] pushing openFile JournalFileImpl: (hornetq-data-3.hq id = 3, recordID = 3)