-
1. Re: locking timeout: Unable to aquire a lock on key
darrellburgan Jun 12, 2012 12:28 PM (in response to dex80526)Also an issue for us using 5.0.1.FINAL. Our lock timeout is more like 25 seconds though.
Our response is to retry the cache action after a short sleep period. We're finding that the system can handle a low volume of TimeoutExceptions but the cache performance degrades quickly as more and more of them occur. Eventually a critical mass is reached and the entire cache becomes dysfunctional.
Interestingly, sometimes when this snowball effect occurs on a particular cache, it picks on only one node in the cluster. Other times the whole cluster starts having trouble for that cache. It's very mysterious to me why it would not always be a cluster-wide problem.
-
2. Re: locking timeout: Unable to aquire a lock on key
dex80526 Jun 13, 2012 12:23 PM (in response to darrellburgan)try to increase the concurrencyLevel in the locking element.
It seems to make difference in my case.
-
3. Re: locking timeout: Unable to aquire a lock on key
darrellburgan Jun 13, 2012 1:33 PM (in response to dex80526)dex chen wrote:
try to increase the concurrencyLevel in the locking element.
It seems to make difference in my case.
We're currently at concurrencyLevel 256. Is this 'low'? Seems like it's already pretty high. I can certainly push it higher ....
-
4. Re: locking timeout: Unable to aquire a lock on key
dex80526 Jun 13, 2012 2:39 PM (in response to darrellburgan)It is low for us. I have half million entries, and the concurrencyLevel is 10 times bigger than what you have here. I also bump up lockAcquisitionTimeout.
I assume you set useLockStriping="false" already,
-
5. Re: locking timeout: Unable to aquire a lock on key
darrellburgan Jun 13, 2012 2:43 PM (in response to dex80526)dex chen wrote:
It is low for us. I have half million entries, and the concurrencyLevel is 10 times bigger than what you have here. I also bump up lockAcquisitionTimeout.
I assume you set useLockStriping="false" already,
Yeah I have lock striping turned off already. I will kick our concurrencyLevel up to 2048 and see if that makes an appreciable difference. Our lockAcquisitionTimeout is already 25000 millis, which seems pretty long. What is yours?
-
6. Re: locking timeout: Unable to aquire a lock on key
dex80526 Jun 13, 2012 2:59 PM (in response to darrellburgan)yea, your number is similar to mine. Let me know if the concurrncylevel makes difference for you or not.