-
1. Re: Receiving warning about journal files
clebert.suconic Feb 11, 2010 2:57 PM (in response to briannelson2222)Can you post a complete thread dump for when this is happening.
It shouldn't lead to data loss. There is a loop that is getting a file from the queue:
while (nextFile == null) { nextFile = openedFiles.poll(60, TimeUnit.SECONDS); if (nextFile == null) { JournalImpl.log.warn("Couldn't open a file in 60 Seconds", new Exception("Warning: Couldn't open a file in 60 Seconds")); } }
And there's another file that feeds the file openedFiles internal queue.
Perhaps you have a slow disk and it is being over-used. If you post a thread dump (from a kill -3) for when this is happening I would be able to tell you exactly why it is happening.
-
2. Re: Receiving warning about journal files
clebert.suconic Feb 11, 2010 3:01 PM (in response to clebert.suconic)Also, try increasing journal-min-files on the main configuration.
there is a note about that on the performance considerations chapter (46.1):
http://hornetq.sourceforge.net/docs/hornetq-2.0.0.GA/user-manual/en/html/perf-tuning.html#d0e10552
-
3. Re: Receiving warning about journal files
clebert.suconic Feb 11, 2010 3:05 PM (in response to clebert.suconic)Just remembered another thing... You are pointing the journal file to a real disk, right?
(No Network File Systems please.. unless it's a RAID using that proprietary protocol to access RAIDS or net disks over fast networking. There is a name that differentiate slow NFS to RAID disks.. which I obviously forgot now)
-
4. Re: Receiving warning about journal files
briannelson2222 Feb 11, 2010 3:18 PM (in response to clebert.suconic)I've attached the stack trace in a file.-
hornetqtrace.txt.zip 4.2 KB
-
-
5. Re: Receiving warning about journal files
clebert.suconic Feb 11, 2010 3:13 PM (in response to briannelson2222)Can you attach a file instead please? It's kind of hard to read it
-
6. Re: Receiving warning about journal files
briannelson2222 Feb 11, 2010 3:19 PM (in response to clebert.suconic)I updated the posting to have an attachment instead of inline. Sorry about that. -
7. Re: Receiving warning about journal files
briannelson2222 Feb 11, 2010 3:27 PM (in response to clebert.suconic)Yes this is to a real disk using Reiserfs. -
8. Re: Receiving warning about journal files
timfox Feb 11, 2010 4:09 PM (in response to briannelson2222)AIO isn't supported with ReiserFS.
I think this is in the docs (if not, it should be).
-
9. Re: Receiving warning about journal files
briannelson2222 Feb 11, 2010 4:14 PM (in response to timfox)I don't see it in the docs anywhere. The docs only talk about libaio and the linux kernel version.
So can I switch to NIO without losing the journal? Or will that cause a completely new journal to be created.
-
10. Re: Receiving warning about journal files
clebert.suconic Feb 11, 2010 4:14 PM (in response to briannelson2222)We haven't tested it against ReiserFS, so I would say this is not supported.
We tested it against ext system (ext2, 3 and 4).
I'm creating a JIRA to make a mention on the manual for supported file systems.
https://jira.jboss.org/jira/browse/HORNETQ-293
I'm not sure if libaio would work on ReiserFS.
Looking at your thread dump, the only thing I see is the file being initialized. Maybe you would be able to use it through if you increased the min-files on the journal.
You could also use pure java NIO. (or maybe you could use another file format)
-
11. Re: Receiving warning about journal files
clebert.suconic Feb 11, 2010 5:48 PM (in response to briannelson2222)I was writing the post at the same time Tim was.
I opened a JIRA to change docs.
You should be able to switch journals without losing the data.
-
12. Re: Receiving warning about journal files
timfox Feb 11, 2010 4:15 PM (in response to clebert.suconic)AFAIK Aio only works with ext2 and ext3 -
13. Re: Receiving warning about journal files
timfox Feb 11, 2010 4:18 PM (in response to briannelson2222)briannelson2222 wrote:
I don't see it in the docs anywhere. The docs only talk about libaio and the linux kernel version.
So can I switch to NIO without losing the journal? Or will that cause a completely new journal to be created.
Yes, you should be able to switch to NIO without losing the journal.
Back it up first, just in case!
-
14. Re: Receiving warning about journal files
clebert.suconic Feb 11, 2010 4:18 PM (in response to timfox)It "should" work on ext4 and xfs (accordingly to Kernel guys). We have one of our users using XFS without any problems also.