Integrate Teiid/Data Virtualization with Data Grid Cache

[ranjith123]

Hi Team,

I am trying to integrate Data Grid with Data Virtualization, so that i use Data Grid as a data source in my DV requirement. Is there a way to configure and connect Data Grid from DV / Teiid ??

Thank you

Ranjith

[tejones]

Hi Ranjith,

Please see: JBoss Data Grid (JDG) Remote Cache as a Data Source Example - Teiid Examples - Project Documentation Editor

Thanks,

Ted

[van.halbert]

Hi Ranjith,

Unfortunately, it appears the example documentation has been removed (not sure how that happened).  But you can go to the git repo:  teiid/teiid-quickstarts · GitHub to find the jdg-local-cache and jdg-remote-cache quoickstarts.

We'll see what we can do to restore those example documents.

Van

[ranjith123]

Hi Team,

Thank you for the pointers. I have been trying as explained in the example. But currently running into trouble When i set up the adapter configuration in the standalone-ha.xml configuration file and start the server i am getting ERROR line in the log as follows.

11:07:09,326 ERROR [org.jboss.as.controller.management-operation] (ServerService Thread Pool -- 46) JBAS014613: Operation ("add") failed - address: ([

    ("subsystem" => "resource-adapters"),

    ("resource-adapter" => "infinispan")

]) - failure description: "JBAS010473: Failed to load module for RA [org.jboss.teiid.resource-adapter.infinispan]"

and few line below i see similar error for activate also

11:07:09,372 ERROR [org.jboss.as.controller.management-operation] (ServerService Thread Pool -- 46) JBAS014613: Operation ("activate") failed - address: ([

    ("subsystem" => "resource-adapters"),

    ("resource-adapter" => "infinispan")

]) - failure description: "rar not yet deployed"

I am attaching the my configuration file for reference.

Also i set-up the translator under org/jboss/teiid/translatior/infinispan and i am getting the following error

11:07:09,840 ERROR [org.jboss.as.controller.management-operation] (ServerService Thread Pool -- 55) JBAS014613: Operation ("add") failed - address: ([

    ("subsystem" => "teiid"),

    ("translator" => "infinispan")

]) - failure description: "TEIID50007 Failed to load module org.jboss.teiid.translator.infinispan.dsl for translator infinispan"

I am attaching the my start configuration file, Infinispan Adapter install configuration and Translator install. Is there a place where i need to sort of register the adapter in server so that the jars get recognized. Error looks like the Server cant understand the pointers define in the standalone-ha.xml

Thank you

Ranjith

[van.halbert]

The infinispan resource adapters should only be configured with 1 of the following options:

-  Use JNDI to find the cache

-  Use server:host to obtain the cache

-  Use an infinispan config file

-  Use hot-rod properties file

In your case, it appears 2 of the options are being specified at the same time:

                            <config-property name="CacheJndiName">

                                java:jboss/eis/infinispan/lht/cache/container/ApplicationCache

                            </config-property>

                            <config-property name="RemoteServerList">

                                localhost:11096

                            </config-property>

remove 1 and lets see what happens.

[van.halbert]

And the next error that you will run into will be related to the translator you installed.   The one you installed (not sure where you obtained the cli script from), doesn't match one of the 2 that are available:

            <translator name="infinispan-cache" module="org.jboss.teiid.translator.object"/>

            <translator name="infinispan-cache-dsl" module="org.jboss.teiid.translator.infinispan.dsl"/>

And based on the resource-adapter, you should be using the 1st one, which will be using hot-rod client to access a remote cache.   However, you plan on using hot-rod client with DSL querying, you need the 2nd, and you will also need to  install the DSL supported resource adapter.   Look for the resource-adapter in the docs/teiid/datasources/infinispan/infinispan-remote-query-dsl-ds.xml

I need to ask, are you following how the jdg-remote-cache quickstart is instructing?   Because I would like to correct any mis-information that it maybe stating.

[ranjith123]

Hi Van,

Thank you for the pointers. Here is where i made some mistakes and got offtrack when going through the Git Example

The point number 6) Install the infinispan-cache-dsl translator.

     In my DV install i dont have the dsl translator under /doc/teiid/... So i downloaded from the teiid site obtained via google. But you were saying that this is not required. So i am using <translator name="infinispan-cache" module="org.jboss.teiid.translator.object"/> instead.

     Could you tell me when i need to use DSL, and from where i can get the right install for the translator.

     Also in my /doc/teiid/infinispan/.....  i dont have infinispan-remote-query-dsl-ds.xm file. So not sure where i can get this from.

     My version of DV is 6.0. Does 6.1 have these file for install ???

Secondly in the translator the name i gave was <translator name="infinispan" module="org.jboss.teiid.translator.object"/>. SO for some reason the translator was not loading. When i changed the name to infinispan-cache

Third in the remote-adapter /module.xml dependency section i had some dependencies that were not part of the hot rod install. i removed the unwanted ones and then the Adapter got loaded...

These are the things that i did to get it working

Thank you

Ranjith

[ranjith123]

Hi Team,

Also i am currently getting the error when i DV is trying to connect to JDG

00:21:18,898 DEBUG [org.teiid.COMMAND_LOG] (Worker0_QueryProcessorQueue2)    ERROR USER COMMAND:    endTime=2015-02-19 00:21:18.898    requestID=Cf8aR5l230OG.0    txID=null    sessionID=Cf8aR5l230OG    principal=teiidUser@teiid-security    vdbName=POCVHL_BrandModel_v2_0_VDB    vdbVersion=1    finalRowCount=null

00:21:18,898 WARN  [org.teiid.PROCESSOR] (Worker0_QueryProcessorQueue2) TEIID30020 Processing exception for request Cf8aR5l230OG.0 'TEIID30504 CACHE_BRANDMODEL: TEIID60000 javax.resource.ResourceException: IJ000453: Unable to get managed connection for java:jboss/eis/infinispan/lht/cache/connection/JBDGD640Nn'. Originally TeiidProcessingException 'loader constraint violation: loader (instance of org/jboss/modules/ModuleClassLoader) previously initiated loading for a different type with name "org/jboss/marshalling/MarshallingConfiguration"' PojoMarshaller.java:32.: org.teiid.core.TeiidProcessingException: TEIID30504 CACHE_BRANDMODEL: TEIID60000 javax.resource.ResourceException: IJ000453: Unable to get managed connection for java:jboss/eis/infinispan/lht/cache/connection/JBDGD640Nn

    at org.teiid.dqp.internal.process.DataTierTupleSource.exceptionOccurred(DataTierTupleSource.java:384) [teiid-engine-8.4.1-redhat-7.jar:8.4.1-redhat-7]

    at org.teiid.dqp.internal.process.DataTierTupleSource.nextTuple(DataTierTupleSource.java:157) [teiid-engine-8.4.1-redhat-7.jar:8.4.1-redhat-7]

    at org.teiid.query.processor.relational.AccessNode.nextBatchDirect(AccessNode.java:306) [teiid-engine-8.4.1-redhat-7.jar:8.4.1-redhat-7]

    at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:278) [teiid-engine-8.4.1-redhat-7.jar:8.4.1-redhat-7]

    at org.teiid.query.processor.relational.RelationalPlan.nextBatch(RelationalPlan.java:149) [teiid-engine-8.4.1-redhat-7.jar:8.4.1-redhat-7]

Following is my adapter setting in my DV standalone-ha.xml, Am i missing somthing like Credentials etc.

Any help os greatly appreciated.

	<resource-adapter id="infinispan">
	<module slot="main" id="org.jboss.teiid.resource-adapter.infinispan"/>
	<transaction-support>NoTransaction</transaction-support>
	<connection-definitions>
	<connection-definition class-name="org.teiid.resource.adapter.infinispan.InfinispanManagedConnectionFactory" jndi-name="java:jboss/eis/infinispan/lht/cache/connection/JBDGD640Nn" enabled="true" use-java-context="true" pool-name="LHTINFSPNCACHE">
	<config-property name="CacheTypeMap">
	LHTDVMCache:java.lang.Object;brandModelId
	</config-property>
	<config-property name="RemoteServerList">
	localhost:11096
	</config-property>
	<pool>
	<min-pool-size>0</min-pool-size>
	<max-pool-size>5</max-pool-size>
	</pool>
	</connection-definition>
	</connection-definitions>
	</resource-adapter>

Thank you

Ranjith

[van.halbert]

I assumed you were using the project.  If you are using the product, then the "DSL" support isn't available until DV 6.1.  You need to use the quickstarts that are provided in the DV 6.0 kit.  Also, the available translator is installed OOTB.   

However, at this point, since you are using the DV product version, I'm going to need to have you contact Red Hat support to further assist you so that you can take advantage of the subscription you've purchased (I assume this because you are using DV).   If you are working on a POC to demonstrate DV, Red Hat will be glad to work with you in that endeavor as well.