Teiid embedded with Solr (exception max boolean clauses)

[hend.amin]

Hello

I am using Teiid embedded with sorl.

i have a query like:

select field1 from solrCore where field2 in (v1,v2,v3 ..... v2000).

I get an expcetion

Caused by: org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount is set to 1024

at org.apache.lucene.search.BooleanQuery$Builder.add(BooleanQuery.java:127)

at org.apache.lucene.search.BooleanQuery$Builder.add(BooleanQuery.java:117)

at org.apache.solr.parser.SolrQueryParserBase.getBooleanQuery(SolrQueryParserBase.java:514)

at org.apache.solr.parser.SolrQueryParserBase.getBooleanQuery(SolrQueryParserBase.java:490)

If i am querying solr directly, i can work around the restriction of 1024 Boolean queries by using

field2:(v1 v2 v3 ... v1000) OR field2:(v1001 v1002 v1003 ... v2000) but with Teiid i can not do this and i get the exception.

if i split the query field2 in (v1,v2,v3 ..... v1000) OR field2 in (v1001,v1002,v1003 ..... v2000) teiid groups this in one statement.

Any solution for this ?? given that i do not want to change the value 1024 in solr itself

thanks

Hend

[shawkins]

You can set the translator property MaxInCriteriaSize to 1024.  Since that looks like the general default for solr, the executionfactory should set that by default as well.  Can you open an issue for that?

[hend.amin]

I have tried this but it is not working:

<model name="solr"> 

        <source name="solr" translator-name="solr" connection-jndi-name="java:/solr-ds"/> 

    </model>

<translator name="solr" type="solr">

      <property name="MaxInCriteriaSize" value="1024"/>

</translator>

i get cvc-complex-type.2.4.a: Invalid content was found starting with element 'model'. One of '{translator, data-role, entry}' is expected.

i refered to the example at: https://docs.jboss.org/author/display/TEIID/Translators

[shawkins]

I can't say what you are seeing from just this snippet.  Can you post the whole vdb.xml or check it against the xsd - https://raw.githubusercontent.com/teiid/teiid/master/client/src/main/resources/vdb-deployer.xsd

Also you'll want to use an override name that is different from the translator name.

[hend.amin]

Hi Stevens

I have corrected the syntax but now i get: an exception

org.teiid.deployers.VirtualDatabaseException: TEIID40106 VDB solr deployment failed.  Override translators are not allowed in embedded mode.

i can not use the override value with teiid embedded , why ?

Thanks

Hend

[rareddy]

Embedded mode the translators "instances" are actually defined in the code, thus if you are doing an override, there is no way to inject these properties into *your* instance of the translator, thus they are not supported. The easy fix, in the code where you are doing

ec = new SolrExecutionfactory();

embeddedTeiid.addTranslator("solr", ec);

add

ec.setMaxInCriteriaSize(1024);

That should be same as overriding in the VDB.xml

Ramesh..