1 Reply Latest reply on Jul 22, 2009 6:26 PM by sannegrinovero

    Hibernate Search - fluchtoindexes slooooowww!

      Hi,

      We are indexing a table with approx 125000 rows in using hibernate search. The loop over the objects works fine but when it hits flushToIndexes() it takes approx 10 mins to start the next batch. This is causing our index to be ridiculously slow and, as this is one table of about 30, causes our index to not complete!

      @SuppressWarnings("unchecked")
       public void indexEntity(Class entityClass) {
       LOG.debug("Indexing " + entityClass.getName());
      
       fullTextSession.setFlushMode(FlushMode.MANUAL);
       fullTextSession.setCacheMode(CacheMode.IGNORE);
      
       // Scrollable results will avoid loading too many objects in memory
       ScrollableResults results = fullTextSession.createCriteria(entityClass)
       .setFetchSize(BATCH_SIZE).scroll(ScrollMode.FORWARD_ONLY);
      
       int index = 0;
      
       while (results.next()) {
       index++;
       fullTextSession.index(results.get(0)); // index each element
       if (index % BATCH_SIZE == 0) {
       fullTextSession.flushToIndexes(); // apply changes to indexes
       fullTextSession.clear(); // clear since the queue is processed
       }
       }
       results.close();
       fullTextSession.setFlushMode(FlushMode.AUTO);
       }
      


      Anyone any ideas?

      If you need the class file let me know...

      Cheers
      Martin