Cache performance with millions of nodes

jivesociety Feb 6, 2007 10:30 AM

I would like some advice as to the best way to setup JBossCache with a FileCacheLoader in a clustered topology with synchronous replication. I would like to improve concurrency contention as much as possible. So, i was planning on having a key/value pair entry basically be its own node. The issue is that my project plans to have around 10 million entries in the cache eventually. We will be deploying to a Solaris environment and I've been running some tests putting large amounts of nodes in the file system and the read times are getting pretty bad when there are this many files in a directory.

Any advice on the best way to set this up?

thanks,
ray

1. Re: Cache performance with millions of nodes

genman Feb 6, 2007 12:53 PM (in response to jivesociety)

You might want to use the Berkeley DB instead of the FileCacheLoader. There's also a JDBM implementation (I wrote :-) ) that might be adequate.

Or, create a "deeper" tree where there are fewer children per node. E.g. if you were to create a phone book, instead of just dividing the entries by "A, B, C" etc., further divide them into "AB" "AC" etc.
Actions
2. Re: Cache performance with millions of nodes

jivesociety Feb 8, 2007 7:04 PM (in response to jivesociety)

Does the JDBM implementation support multiple processes writing to a file?

thanks in advance,
ray
Actions
3. Re: Cache performance with millions of nodes

genman Feb 9, 2007 2:15 PM (in response to jivesociety)

It does, but there is heavy thread locking done. It's not as fast as this:

http://sleepycat2.inetu.net/products/bdbje.html

You might get decent performance from the JDBM using the async cache loader.
Actions
4. Re: Cache performance with millions of nodes

genman Feb 9, 2007 9:15 PM (in response to jivesociety)

I might have misunderstood you. If you have multiple _processes_ (not threads) doing writes to a file, you need some sort of central coordinator, and that would require you to use a traditional RDB. JBCache does support JDBC databases.
Actions

Go to original post