-
15. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
clebert.suconic Jul 1, 2011 11:31 AM (in response to jeremystone)ConsumerWindowSize.
The consumer will have the cache on until TTL is gone.
-
16. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
jeremystone Jul 1, 2011 11:35 AM (in response to clebert.suconic)OK.
This is set to zero (no client buffer) in our tests.
-
17. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
clebert.suconic Jul 1, 2011 11:40 AM (in response to jeremystone)Ok, lets backup a bit... Can you simplify and summarize what's happening?
I understand that:
- Your client died.. that means you will have paging until TTL killed that consumer.
- You had paging because of slow consumers, right?
you have to consume faster than you can produce at some point in time otherwise you will page forever. (Same way as you would OME the server if you didn't have paging).
-
18. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
jeremystone Jul 1, 2011 12:07 PM (in response to clebert.suconic)Steps to reproduce:
- Start up a slow consumer and producer in order for paging to start to happen
- When this happens, stop the consumer. [It doesnt matter whether we do this forcibly (in which case, and quite understandably, we need to wait for TTL for the server to realize that it's gone away) or we close it cleanly (which can do in the test consumer by hitting the Enter key in the console).]
- We also stop the producer. (So both the consumer and producer VMs are stopped. HornetQ server still running.)
- Repeat 1-3 [For some reason the first time the producer and consumer are stopped, all page files (bar one) are deleted, but on the second time no page files are deleted.]
- Then restart the producer and a fast consumer which should easily be able to (and indeed does) keep up with the producer.
At this point I would not expect it to add new page files but it does. The page files that get created are never (or so it appears) deleted.
-
19. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
clebert.suconic Jul 1, 2011 12:13 PM (in response to jeremystone)Can you write a test?
-
20. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
jeremystone Jul 1, 2011 12:21 PM (in response to clebert.suconic)You should be able to reproduce it with the code attached to a previous comment in this thread.
-
21. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
miyasama Jul 5, 2011 1:21 AM (in response to clebert.suconic)@Clebert.
I made a test on HornetQ 2.2.5.
Please run this test.
Thanks.
-
22. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
jeremystone Jul 11, 2011 4:17 AM (in response to miyasama)Do you need any more info to reproduce this? Is it the same issue as http://community.jboss.org/thread/163371 and hence https://issues.jboss.org/browse/HORNETQ-734, do you think??
-
23. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
clebert.suconic Jul 11, 2011 11:14 AM (in response to jeremystone)734 is not an issue, it's a feature request, which is different to this case. Paging was written with the caveat that the consumers would catch up at some point beyond produced level.
734 is a feature request to do some cleanup before that is achieved.
I will work on this issue later this week.
-
24. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
jeremystone Jul 11, 2011 11:16 AM (in response to clebert.suconic)That's good news. Thanks, Clebert
-
25. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
jeremystone Jul 19, 2011 4:22 AM (in response to jeremystone)Any progress on this? Please let us know if you need us to try anything out.
-
26. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
clebert.suconic Jul 19, 2011 11:23 AM (in response to jeremystone)I will get there...I'm a little behind but I'm scheduled to work on it.
-
27. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
clebert.suconic Jul 20, 2011 3:22 PM (in response to clebert.suconic)I am fixing it today. Replicated it and fixed on my local copy already.
Give me a few hours and I will have it committed.
-
28. Re: Paging file of topic messages is not removed after subscribe to the corresponding message.
jeremystone Jul 27, 2011 10:51 AM (in response to clebert.suconic)Let us know which branch to try once you've done this and we'll try it out here.