Hi,
We are indexing a table with approx 125000 rows in using hibernate search. The loop over the objects works fine but when it hits flushToIndexes() it takes approx 10 mins to start the next batch. This is causing our index to be ridiculously slow and, as this is one table of about 30, causes our index to not complete!
@SuppressWarnings("unchecked")
public void indexEntity(Class entityClass) {
LOG.debug("Indexing " + entityClass.getName());
fullTextSession.setFlushMode(FlushMode.MANUAL);
fullTextSession.setCacheMode(CacheMode.IGNORE);
// Scrollable results will avoid loading too many objects in memory
ScrollableResults results = fullTextSession.createCriteria(entityClass)
.setFetchSize(BATCH_SIZE).scroll(ScrollMode.FORWARD_ONLY);
int index = 0;
while (results.next()) {
index++;
fullTextSession.index(results.get(0)); // index each element
if (index % BATCH_SIZE == 0) {
fullTextSession.flushToIndexes(); // apply changes to indexes
fullTextSession.clear(); // clear since the queue is processed
}
}
results.close();
fullTextSession.setFlushMode(FlushMode.AUTO);
}
Anyone any ideas?
If you need the class file let me know...
Cheers
Martin