0 Replies Latest reply on Aug 18, 2015 4:51 AM by Brian Wallis

    Version 2.8.4 - Indexing after delete node

    Brian Wallis Master

      We have a system using an old version of Modeshape (2.8.4) and we have a problem with the indexing.

       

      We have a reasonably simple structure holding document nodes that have about 3 levels of child nodes with between 5-20 node child nodes under each document node. The document nodes are stored in one of 256 nt:folder nodes that are under the root node, the distribution is reasonably random across these folder nodes. We do not use SNS nodes (we used to but got rid of them).

       

      Performance with 2200 documents and indexing disabled is quite good. If I enable indexing then it takes about 9 minutes to index all the existing nodes on startup. That is OK. When I add a new node it is indexed as appropriate and that seems OK as well. When I delete one of the document nodes then it does a complete re-index of all the remaining document nodes taking about 9 minutes again. We are aiming to support up to 40000 document nodes.

       

      Fortunately we can turn off indexing, it is not essential for our application but I am concerned that we have something configured wrong. It shouldn't need to re-index every document node every time we delete one.

       

      our current configuration (with indexing enabled) is below. Is there something I can do to prevent it re-indexing every time a node is deleted?

       

      <?xml version="1.0" encoding="UTF-8"?>
      <configuration xmlns:mode="http://www.modeshape.org/1.0"
        xmlns:jcr="http://www.jcp.org/jcr/1.0">
      
      
        <!-- Define the JCR repositories -->
        <mode:repositories>
      
      
        <mode:repository jcr:name="DocumentStore" mode:source="JPA Store">
        <mode:options jcr:primaryType="options">
        <mode:option jcr:name="projectNodeTypes" mode:value="true" />
        <mode:option jcr:name="systemSourceName" mode:value="system@JPA Store" />
        <mode:option jcr:name="jaasLoginConfigName" mode:value="modeshape" />
        <mode:option jcr:name="queryIndexDirectory" mode:value="/Users/bwallis/InfoMedix/JBoss/UDR/udr_data/harvey/harvey_jcr_data/store/indexes" />
        <mode:option jcr:name="queryExecutionEnabled" mode:value="true" />
        <mode:option jcr:name="performReferentialIntegrityChecks" mode:value="false" />
        <mode:option jcr:name="queryIndexesUpdatedSynchronously" mode:value="false" />
        <mode:option jcr:name="queryIndexesRebuiltSynchronously" mode:value="false" />
        <!-- specifies the strategy (always or ifMissing) used to determine which
        query indexes need to be rebuilt when the repository restarts -->
        <mode:option jcr:name="rebuildQueryIndexOnStartup" mode:value="ifMissing" />
      
      
        </mode:options>
        </mode:repository>
        </mode:repositories>
      
      
        <!-- Define the sources used by the repository (or repositories) to store
        and access the content -->
        <mode:sources jcr:primaryType="nt:unstructured">
        <mode:source jcr:name="JPA Store"
        mode:classname="org.modeshape.connector.store.jpa.JpaSource"
        mode:isolationLevel="TRANSACTION_SERIALIZABLE"
        mode:dataSourceJndiName="java:jdbc/DocumentStoreDS"
        mode:model="Simple"
        mode:dialect="org.hibernate.dialect.PostgreSQLDialect"
        mode:referentialIntegrityEnforced="false"
        mode:largeValueSizeInBytes="10000"
        mode:retryLimit="3"
        mode:compressData="false"
        mode:predefinedWorkspaceNames="default,system"
        mode:showSql="false"
        mode:autoGenerateSchema="validate"
        mode:creatingWorkspacesAllowed="true"
        mode:defaultWorkspaceName="default">
        </mode:source>
        </mode:sources>
      
      
        <mode:sequencers>
        </mode:sequencers>
      
      
      </configuration>
      
      

       

       

      The logging I see when I delete the node from the JCR is as follows:

       

      
      2015-08-18 18:26:05,944 1145156 INFO  [pool-1-thread-13] au.com.infomedix.harvey.bpm.itemhandler.RemoveJcrNodeHandler - Processing Remove JCR Node WorkItem for documentID: 04afc71b-074f-4c93-9f3e-d839b0436bb1
      2015-08-18 18:26:05,946 1145158 INFO  [pool-1-thread-13] au.com.infomedix.harvey.documentstore.jcr.DocumentStoreJcrBean - Deleting document group node: 04afc71b-074f-4c93-9f3e-d839b0436bb1
      2015-08-18 18:26:06,133 1145345 INFO  [pool-1-thread-13] au.com.infomedix.harvey.documentstore.jcr.DocumentStoreJcrBean - Deleted document group node: 04afc71b-074f-4c93-9f3e-d839b0436bb1
      2015-08-18 18:26:06,135 1145347 INFO  [pool-1-thread-13] au.com.infomedix.harvey.bpm.itemhandler.RemoveJcrNodeHandler - documentGroup node 04afc71b-074f-4c93-9f3e-d839b0436bb1 has been deleted from the JCR.
      2015-08-18 18:26:06,151 1145363 DEBUG [pool-1-thread-13] org.modeshape.graph.query.optimize.RuleBasedOptimizer - Running query optimizer rule org.modeshape.jcr.query.RewritePseudoColumns@757f660
      2015-08-18 18:26:06,154 1145366 DEBUG [pool-1-thread-13] org.modeshape.graph.query.optimize.RuleBasedOptimizer - Running query optimizer rule ReplaceViews
      2015-08-18 18:26:06,156 1145368 DEBUG [pool-1-thread-13] org.modeshape.graph.query.optimize.RuleBasedOptimizer - Running query optimizer rule CopyCriteria
      2015-08-18 18:26:06,158 1145370 DEBUG [pool-1-thread-13] org.modeshape.graph.query.optimize.RuleBasedOptimizer - Running query optimizer rule RightOuterToLeftOuterJoins
      2015-08-18 18:26:06,159 1145371 DEBUG [pool-1-thread-13] org.modeshape.graph.query.optimize.RuleBasedOptimizer - Running query optimizer rule AddAccessNodes
      2015-08-18 18:26:06,161 1145373 DEBUG [pool-1-thread-13] org.modeshape.graph.query.optimize.RuleBasedOptimizer - Running query optimizer rule PushSelectCriteria
      2015-08-18 18:26:06,163 1145375 DEBUG [pool-1-thread-13] org.modeshape.graph.query.optimize.RuleBasedOptimizer - Running query optimizer rule PushProjects
      2015-08-18 18:26:06,164 1145376 DEBUG [pool-1-thread-13] org.modeshape.graph.query.optimize.RuleBasedOptimizer - Running query optimizer rule RewriteAsRangeCriteria
      2015-08-18 18:26:06,169 1145381 TRACE [pool-1-thread-13] org.modeshape.search.lucene.LuceneSearchProcessor - query "default" workspace: +jcr:uuid:04afc71b-074f-4c93-9f3e-d839b0436bb1 +((jcr:primaryType:inf:documentContainer jcr:primaryType:inf:document jcr:primaryType:nt:configuration jcr:primaryType:inf:comment jcr:primaryType:mode:share jcr:primaryType:nt:versionHistory jcr:primaryType:type:workflowInfo jcr:primaryType:mode:root jcr:primaryType:inf:documentGroup jcr:primaryType:nt:version jcr:primaryType:nt:frozenNode jcr:primaryType:nt:activity) (jcr:mixinTypes:mix:managedRetention jcr:mixinTypes:mix:versionable jcr:mixinTypes:mix:referenceable jcr:mixinTypes:er:eReferral jcr:mixinTypes:mix:shareable))
      2015-08-18 18:26:06,305 1145517 INFO  [pool-1-thread-13] au.com.infomedix.harvey.bpm.itemhandler.RemoveJcrNodeHandler - Completed Remove JCR Node WorkItem
      2015-08-18 18:26:16,107 1155319 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchProcessor - index for "default" workspace: DEL '/' branch
      2015-08-18 18:26:16,109 1155321 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - Text extractors did not manage to extract any text
      2015-08-18 18:26:16,110 1155322 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace: ADD / Document<stored,indexed<::pth:/> stored,indexed<::nam:> stored,indexed<::loc:> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::sns:1> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::dep:0> stored,indexed<::idp:mode:uuid=1497b6fe-8c7e-4bbb-aaa2-24f3d4942668> stored,indexed<mode:uuid:1497b6fe-8c7e-4bbb-aaa2-24f3d4942668> stored,indexed<jcr:primaryType:mode:root>>
      2015-08-18 18:26:16,110 1155322 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - Extracted text: 77
      2015-08-18 18:26:16,111 1155323 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace: ADD /77[1] Document<stored,indexed<::pth:/77[1]> stored,indexed<::nam:77> stored,indexed<::loc:77> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::sns:1> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::dep:1> stored,indexed<::idp:mode:uuid=ed1a81df-2453-4913-ba74-9130647eb2fe> stored,indexed<mode:uuid:ed1a81df-2453-4913-ba74-9130647eb2fe> stored,indexed<jcr:primaryType:inf:documentContainer> stored,indexed<modeint:nodeDefinition:{http???www.modeshape.org?1.0}root/?/{http???www.jcp.org?jcr?nt?1.0}base> indexed,tokenized<::fts:77>>
      2015-08-18 18:26:16,111 1155323 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace:     /77[1] fts terms: 77
      2015-08-18 18:26:16,112 1155324 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - Extracted text: 7716514b-c2c2-49d3-b83b-3ac04d9768bb false afda Smith 1979-12-16T00:00:00+11:00 Urgent  true Berwick 2015-12-31T00:00:00+11:00 4 Kangan Drive  Polly Anna 28/08/2015 0312345678 Lutwyche IHN 919191  Jones 543 Lutwyche Road Suite 2 3806 ok  0417031731 Box Hill Hospital Jenny  Waitlisted VIC Maternity   F 3030  MATERNITY_MATERNITY 0387654322 Maternity Repository error during Delete DocumentGroupNode: c18c9730-dba8-4e00-b580-12dbf070fb33 VIC
      2015-08-18 18:26:16,112 1155324 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace: ADD /77[1]/7716514b-c2c2-49d3-b83b-3ac04d9768bb[1] Document<stored,indexed<::pth:/77[1]/7716514b-c2c2-49d3-b83b-3ac04d9768bb[1]> stored,indexed<::nam:7716514b-c2c2-49d3-b83b-3ac04d9768bb> stored,indexed<::loc:7716514b-c2c2-49d3-b83b-3ac04d9768bb> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::sns:1> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::dep:2> stored,indexed<::idp:mode:uuid=c18c9730-dba8-4e00-b580-12dbf070fb33> stored,indexed<er:redirect:false> indexed,tokenized<:ft:er:redirect:false> stored,indexed<er:clinicName:afda> indexed,tokenized<:ft:er:clinicName:afda> stored,indexed<er:gpLastName:Smith> indexed,tokenized<:ft:er:gpLastName:Smith> stored,indexed<er:patientDob:1979-12-16T00:00:00+11:00> indexed,tokenized<:ft:er:patientDob:1979-12-16T00:00:00+11:00> stored,indexed<modeint:nodeDefinition:{http???infomedix.com.au?inf}documentContainer/?/{http???infomedix.com.au?inf}documentGroup> stored,indexed<er:priority:Urgent> indexed,tokenized<:ft:er:priority:Urgent> stored,indexed<er:patientAddrCountry:> indexed,tokenized<:ft:er:patientAddrCountry:> stored,indexed<er:referralApproved:true> indexed,tokenized<:ft:er:referralApproved:true> stored,indexed<modeint:multiValuedProperties:jcr:mixinTypes> stored,indexed<er:patientAddrCity:Berwick> indexed,tokenized<:ft:er:patientAddrCity:Berwick> stored,indexed<er:scheduledDate:2015-12-31T00:00:00+11:00> indexed,tokenized<:ft:er:scheduledDate:2015-12-31T00:00:00+11:00> stored,indexed<jcr:mixinTypes:er:eReferral> stored,indexed<er:patientAddrLine1:4 Kangan Drive> indexed,tokenized<:ft:er:patientAddrLine1:4 Kangan Drive> stored,indexed<er:patientAddrLine2:> indexed,tokenized<:ft:er:patientAddrLine2:> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<inf:receivedDate:1439787492000> stored,indexed<er:patientFirstName:Polly Anna> indexed,tokenized<:ft:er:patientFirstName:Polly Anna> stored,indexed<er:appointmentDate:28/08/2015> indexed,tokenized<:ft:er:appointmentDate:28/08/2015> stored,indexed<er:gpWorkPhone:0312345678> indexed,tokenized<:ft:er:gpWorkPhone:0312345678> stored,indexed<jcr:primaryType:inf:documentGroup> stored,indexed<er:gpAddrCity:Lutwyche> indexed,tokenized<:ft:er:gpAddrCity:Lutwyche> stored,indexed<er:patientDomain:IHN> indexed,tokenized<:ft:er:patientDomain:IHN> stored,indexed<er:patientUrno:919191> indexed,tokenized<:ft:er:patientUrno:919191> stored,indexed<er:episodeDomain:> indexed,tokenized<:ft:er:episodeDomain:> stored,indexed<er:patientLastName:Jones> indexed,tokenized<:ft:er:patientLastName:Jones> stored,indexed<er:gpAddrLine2:543 Lutwyche Road> indexed,tokenized<:ft:er:gpAddrLine2:543 Lutwyche Road> stored,indexed<er:gpAddrLine1:Suite 2> indexed,tokenized<:ft:er:gpAddrLine1:Suite 2> stored,indexed<er:patientAddrPostCode:3806> indexed,tokenized<:ft:er:patientAddrPostCode:3806> stored,indexed<er:exportStatus:ok> indexed,tokenized<:ft:er:exportStatus:ok> stored,indexed<er:gpAddrCountry:> indexed,tokenized<:ft:er:gpAddrCountry:> stored,indexed<mode:uuid:c18c9730-dba8-4e00-b580-12dbf070fb33> stored,indexed<er:patientHomePhone:0417031731> indexed,tokenized<:ft:er:patientHomePhone:0417031731> stored,indexed<er:site:Box Hill Hospital> indexed,tokenized<:ft:er:site:Box Hill Hospital> stored,indexed<er:gpFirstName:Jenny> indexed,tokenized<:ft:er:gpFirstName:Jenny> stored,indexed<er:episodeCareType:> indexed,tokenized<:ft:er:episodeCareType:> stored,indexed<er:referralStatus:Waitlisted> indexed,tokenized<:ft:er:referralStatus:Waitlisted> stored,indexed<er:gpAddrState:VIC> indexed,tokenized<:ft:er:gpAddrState:VIC> stored,indexed<er:specialty:Maternity> indexed,tokenized<:ft:er:specialty:Maternity> stored,indexed<er:episodeService:> indexed,tokenized<:ft:er:episodeService:> stored,indexed<er:episodeNumber:> indexed,tokenized<:ft:er:episodeNumber:> stored,indexed<er:patientSex:F> indexed,tokenized<:ft:er:patientSex:F> stored,indexed<jcr:uuid:c18c9730-dba8-4e00-b580-12dbf070fb33> stored,indexed<er:gpAddrPostCode:3030> indexed,tokenized<:ft:er:gpAddrPostCode:3030> stored,indexed<er:episodeCampus:> indexed,tokenized<:ft:er:episodeCampus:> stored,indexed<er:servicePoint:MATERNITY_MATERNITY> indexed,tokenized<:ft:er:servicePoint:MATERNITY_MATERNITY> stored,indexed<er:gpFax:0387654322> indexed,tokenized<:ft:er:gpFax:0387654322> stored,indexed<er:referralType:Maternity> indexed,tokenized<:ft:er:referralType:Maternity> stored,indexed<er:removeMsg:Repository error during Delete DocumentGroupNode: c18c9730-dba8-4e00-b580-12dbf070fb33> indexed,tokenized<:ft:er:removeMsg:Repository error during Delete DocumentGroupNode: c18c9730-dba8-4e00-b580-12dbf070fb33> stored,indexed<er:patientAddrState:VIC> indexed,tokenized<:ft:er:patientAddrState:VIC> stored,indexed<er:episodeDate:> indexed,tokenized<:ft:er:episodeDate:> indexed,tokenized<::fts:7716514b-c2c2-49d3-b83b-3ac04d9768bb false afda Smith 1979-12-16T00:00:00+11:00 Urgent  true Berwick 2015-12-31T00:00:00+11:00 4 Kangan Drive  Polly Anna 28/08/2015 0312345678 Lutwyche IHN 919191  Jones 543 Lutwyche Road Suite 2 3806 ok  0417031731 Box Hill Hospital Jenny  Waitlisted VIC Maternity   F 3030  MATERNITY_MATERNITY 0387654322 Maternity Repository error during Delete DocumentGroupNode: c18c9730-dba8-4e00-b580-12dbf070fb33 VIC >>
      2015-08-18 18:26:16,112 1155324 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace:     /77[1]/7716514b-c2c2-49d3-b83b-3ac04d9768bb[1] fts terms: 7716514b-c2c2-49d3-b83b-3ac04d9768bb fals afda smith 1979-12-16t00 00 00 11 00 urgent true berwick 2015-12-31t00 00 00 11 00 4 kangan drive polli anna 28/08/2015 0312345678 lutwych ihn 919191 jone 543 lutwych road suit 2 3806 ok 0417031731 box hill hospit jenni waitlist vic matern f 3030 matern matern 0387654322 matern repositori error dure delet documentgroupnod c18c9730-dba8-4e00-b580-12dbf070fb33 vic
      2015-08-18 18:26:16,113 1155325 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - Extracted text: documents CDA
      2015-08-18 18:26:16,113 1155325 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace: ADD /77[1]/7716514b-c2c2-49d3-b83b-3ac04d9768bb[1]/inf:documents[1] Document<stored,indexed<::pth:/77[1]/7716514b-c2c2-49d3-b83b-3ac04d9768bb[1]/inf:documents[1]> stored,indexed<::nam:inf:documents> stored,indexed<::loc:documents> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::sns:1> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::dep:3> stored,indexed<::idp:mode:uuid=e871c378-b5b6-4f8d-bcfd-e71388c599e7> stored,indexed<mode:uuid:e871c378-b5b6-4f8d-bcfd-e71388c599e7> stored,indexed<jcr:primaryType:inf:document> stored,indexed<inf:type:CDA> indexed,tokenized<:ft:inf:type:CDA> stored,indexed<modeint:nodeDefinition:{http???infomedix.com.au?inf}documentGroup/{http???infomedix.com.au?inf}documents/{http???infomedix.com.au?inf}document> indexed,tokenized<::fts:documents CDA>>
      2015-08-18 18:26:16,114 1155326 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace:     /77[1]/7716514b-c2c2-49d3-b83b-3ac04d9768bb[1]/inf:documents[1] fts terms: document cda
      2015-08-18 18:26:16,114 1155326 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - Extracted text: 77f6e2f3-3e05-49cf-a11d-afb59f40bc53 Smith 1979-12-16T00:00:00+11:00 3806 Urgent   0417031731 Box Hill Hospital Jenny 2015-12-31T23:59:59+11:00 Berwick Received VIC 4 Kangan Drive  Maternity F Polly Anna 3030 0312345678 0387654322 Lutwyche Maternity  VIC Jones 543 Lutwyche Road Suite 2
      2015-08-18 18:26:16,114 1155326 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace: ADD /77[1]/77f6e2f3-3e05-49cf-a11d-afb59f40bc53[1] Document<stored,indexed<::pth:/77[1]/77f6e2f3-3e05-49cf-a11d-afb59f40bc53[1]> stored,indexed<::nam:77f6e2f3-3e05-49cf-a11d-afb59f40bc53> stored,indexed<::loc:77f6e2f3-3e05-49cf-a11d-afb59f40bc53> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::sns:1> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<::dep:2> stored,indexed<::idp:mode:uuid=3e178c50-0599-415e-84ac-310fc23674aa> stored,indexed<er:gpLastName:Smith> indexed,tokenized<:ft:er:gpLastName:Smith> stored,indexed<er:patientDob:1979-12-16T00:00:00+11:00> indexed,tokenized<:ft:er:patientDob:1979-12-16T00:00:00+11:00> stored,indexed<er:patientAddrPostCode:3806> indexed,tokenized<:ft:er:patientAddrPostCode:3806> stored,indexed<modeint:nodeDefinition:{http???infomedix.com.au?inf}documentContainer/?/{http???infomedix.com.au?inf}documentGroup> stored,indexed<er:priority:Urgent> indexed,tokenized<:ft:er:priority:Urgent> stored,indexed<er:patientAddrCountry:> indexed,tokenized<:ft:er:patientAddrCountry:> stored,indexed<er:gpAddrCountry:> indexed,tokenized<:ft:er:gpAddrCountry:> stored,indexed<mode:uuid:3e178c50-0599-415e-84ac-310fc23674aa> stored,indexed<modeint:multiValuedProperties:jcr:mixinTypes> stored,indexed<er:patientHomePhone:0417031731> indexed,tokenized<:ft:er:patientHomePhone:0417031731> stored,indexed<er:site:Box Hill Hospital> indexed,tokenized<:ft:er:site:Box Hill Hospital> stored,indexed<er:gpFirstName:Jenny> indexed,tokenized<:ft:er:gpFirstName:Jenny> stored,indexed<er:scheduledDate:2015-12-31T23:59:59+11:00> indexed,tokenized<:ft:er:scheduledDate:2015-12-31T23:59:59+11:00> stored,indexed<er:patientAddrCity:Berwick> indexed,tokenized<:ft:er:patientAddrCity:Berwick> stored,indexed<er:referralStatus:Received> indexed,tokenized<:ft:er:referralStatus:Received> stored,indexed<jcr:mixinTypes:er:eReferral> stored,indexed<er:gpAddrState:VIC> indexed,tokenized<:ft:er:gpAddrState:VIC> stored,indexed<er:patientAddrLine1:4 Kangan Drive> indexed,tokenized<:ft:er:patientAddrLine1:4 Kangan Drive> stored,indexed<er:patientAddrLine2:> indexed,tokenized<:ft:er:patientAddrLine2:> stored,indexed<er:specialty:Maternity> indexed,tokenized<:ft:er:specialty:Maternity> stored,indexed<er:patientSex:F> indexed,tokenized<:ft:er:patientSex:F> stored,indexed,tokenized,omitNorms,indexOptions=DOCS_ONLY<inf:receivedDate:1439788478000> stored,indexed<er:patientFirstName:Polly Anna> indexed,tokenized<:ft:er:patientFirstName:Polly Anna> stored,indexed<jcr:uuid:3e178c50-0599-415e-84ac-310fc23674aa> stored,indexed<er:gpAddrPostCode:3030> indexed,tokenized<:ft:er:gpAddrPostCode:3030> stored,indexed<er:gpWorkPhone:0312345678> indexed,tokenized<:ft:er:gpWorkPhone:0312345678> stored,indexed<jcr:primaryType:inf:documentGroup> stored,indexed<er:gpFax:0387654322> indexed,tokenized<:ft:er:gpFax:0387654322> stored,indexed<er:gpAddrCity:Lutwyche> indexed,tokenized<:ft:er:gpAddrCity:Lutwyche> stored,indexed<er:referralType:Maternity> indexed,tokenized<:ft:er:referralType:Maternity> stored,indexed<er:patientUrno:> indexed,tokenized<:ft:er:patientUrno:> stored,indexed<er:patientAddrState:VIC> indexed,tokenized<:ft:er:patientAddrState:VIC> stored,indexed<er:patientLastName:Jones> indexed,tokenized<:ft:er:patientLastName:Jones> stored,indexed<er:gpAddrLine2:543 Lutwyche Road> indexed,tokenized<:ft:er:gpAddrLine2:543 Lutwyche Road> stored,indexed<er:gpAddrLine1:Suite 2> indexed,tokenized<:ft:er:gpAddrLine1:Suite 2> indexed,tokenized<::fts:77f6e2f3-3e05-49cf-a11d-afb59f40bc53 Smith 1979-12-16T00:00:00+11:00 3806 Urgent   0417031731 Box Hill Hospital Jenny 2015-12-31T23:59:59+11:00 Berwick Received VIC 4 Kangan Drive  Maternity F Polly Anna 3030 0312345678 0387654322 Lutwyche Maternity  VIC Jones 543 Lutwyche Road Suite 2>>
      2015-08-18 18:26:16,115 1155327 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - index for "default" workspace:     /77[1]/77f6e2f3-3e05-49cf-a11d-afb59f40bc53[1] fts terms: 77f6e2f3-3e05-49cf-a11d-afb59f40bc53 smith 1979-12-16t00 00 00 11 00 3806 urgent 0417031731 box hill hospit jenni 2015-12-31t23 59 59 11 00 berwick receiv vic 4 kangan drive matern f polli anna 3030 0312345678 0387654322 lutwych matern vic jone 543 lutwych road suit 2
      2015-08-18 18:26:16,115 1155327 TRACE [modeshape-indexing] org.modeshape.search.lucene.LuceneSearchSession - Extracted text: documents CDA
      
      

       

      The logging of the indexing by LuceneSearchSession goes on for a long time (9 minutes at about 4 nodes/second).

       

      And the code we use for delete is

       

      
                  session = repository.login(new SimpleCredentials("username", "password".toCharArray()), "default");
      
                  Node documentNode = session.getNodeByIdentifier(documentGroupUID);
                  documentNode.remove();
                  session.save();