5 Replies Latest reply on Jan 15, 2013 8:44 AM by rareddy

    How Teiid behaves in distributed system ?

    capoorhimanshu

      Hi,

       

      I am new to Teiid and looking some of the experienced folks with teiid wo can answer my queries. I would like to know that how teiid behaves in distributed system. If i configure the teiid in such a way that it caches the result set , than how does that cached data gets distributed over the distributed system. Say i have four instances of teiid (data nodes) , than how would i define the data replication strategy. Does there is a 100% data replication at each data node ?

       

      What about failovers , how its reacts to that , are there any controller nodes over data nodes and how to configure them ?

       

      It will be great if some one can explain the brief architecture of teiid in Distributed system.

       

      Also if i like to use the teiid in embedded mode than, is clustering supported in teiid in embedded mode ?

       

       

      Thanks

      Himanshu Kapoor

        • 1. Re: How Teiid behaves in distributed system ?
          rareddy

          Himanshu,

           

          Teiid uses the JBoss AS7 clustering mechanism to be in the multi-node configuration. Read the Caching Guide for various caching options available. You need configure "domain" mode.

           

          I am new to Teiid and looking some of the experienced folks with teiid wo can answer my queries. I would like to know that how teiid behaves in distributed system. If i configure the teiid in such a way that it caches the result set , than how does that cached data gets distributed over the distributed system. Say i have four instances of teiid (data nodes) , than how would i define the data replication strategy. Does there is a 100% data replication at each data node ?

          Infinispan is used for replication. Replication strategy is already set, which is REPL_ASYNC. Data is replicated at the nodes depending upon the requests at the node and scope of cache.

           

           

          What about failovers , how its reacts to that , are there any controller nodes over data nodes and how to configure them ?

          If the data is only populated at one node, and if that node goes down then data is fetched again. However once the data is replicated to another node, then there will be more than single node that contain the data in case of failure. AS7 has host controllers in domain mode.

           

           

          It will be great if some one can explain the brief architecture of teiid in Distributed system.

          All user documentation should be in the Caching Guide. If you have specific questions you can ask here.

           

          Also if i like to use the teiid in embedded mode than, is clustering supported in teiid in embedded mode ?

          The embedded mode is configured with Infinispan, by configuring the Infinispan with JGroups you make them cache distribution capable.

           

          Ramesh..

          • 2. Re: How Teiid behaves in distributed system ?
            capoorhimanshu

            Hi ,

             

            Thanks for the explanation.

             

            I was in process of settng up the teiid in embedded mode in distributed enviornment . I ran two teeid instances running in embedded mode in separate servers and fired some of the commands like creating models, vdbs

            and than querying the vdb and it worked fine . Since they are running in embedded mode so i believe there was no chance of them failing , the ony thing which i had to check is , like if creating models and vdbs commad has gone to server 1(hosting teiid 1) , but querying the vdb on server 2 (which do not have the information about model and vdbs created in server 1) i need to create them in server 2 (hosting teiid 2) and it works .

             

            Is there is any way with which these embedded teiid run time can talk to each other in distributed system , so that server 2 gets aware of VDB's and models created in server 1 (instead of i manualy creating them in server 2) ?

             

            I am also in process of configuring infinispan with jgroup to make the cache available in distributed enviornment. In this case i understand that infinispan will be configured in clustered enviornment and will be shared across

            various teiid runtime depending on how its been configured i.e. in replication , distributed or in invalidation mode. Please let me know if my understanding is wrong.

             

            Thanks

            Himanshu Kapoor

            • 3. Re: How Teiid behaves in distributed system ?
              rareddy

              Himanshu,

              I was in process of settng up the teiid in embedded mode in distributed enviornment .

              Is there a reason you choose embedded version? like you are trying to run in tomcat or your own app etc.

               

              I ran two teeid instances running in embedded mode in separate servers and fired some of the commands like creating models, vdbs

              and than querying the vdb and it worked fine . Since they are running in embedded mode so i believe there was no chance of them failing , the ony thing which i had to check is , like if creating models and vdbs commad has gone to server 1(hosting teiid 1) , but querying the vdb on server 2 (which do not have the information about model and vdbs created in server 1) i need to create them in server 2 (hosting teiid 2) and it works .

              It will not. Embedded mode does not support propagation of metadata (VDB, models etc), you would have to have mechanics in place to deploy the models in both places simultaneously. It is only capable of distributed caching when properly configured through a infinispan/jgroups channel.

               

              Is there is any way with which these embedded teiid run time can talk to each other in distributed system , so that server 2 gets aware of VDB's and models created in server 1 (instead of i manualy creating them in server 2) ?

              Yes, AS7 based Teiid. By the time you implement all the features required by embedded to be full featured, it will look about what Teiid on AS7 deployed looks like.

               

              I am also in process of configuring infinispan with jgroup to make the cache available in distributed enviornment. In this case i understand that infinispan will be configured in clustered enviornment and will be shared across

              various teiid runtime depending on how its been configured i.e. in replication , distributed or in invalidation mode. Please let me know if my understanding is wrong.

              You are going in right direction based on above comment.

               

              Ramesh..

              • 4. Re: How Teiid behaves in distributed system ?
                capoorhimanshu

                Hi,

                 

                Thanks for the reply.

                 

                Yes your are right , i am trying to run teiid in own app.

                 

                Is there any plan to implement the feature like below in embedded mode in near future 

                 

                teiid run times talking to each other in distributed environment ?

                propogation of metadata in in distributed environment ?

                 

                Thanks

                Himanshu Kapoor

                • 5. Re: How Teiid behaves in distributed system ?
                  rareddy
                  Is there any plan to implement the feature like below in embedded mode in near future 

                  No, it would be a different for each environment based on services the environment it provides. What Teiid provides you is framework and hooks into Teiid, such that inclined individuals like you can fill in those services to make it work for your needs.

                   

                  teiid run times talking to each other in distributed environment ?

                  propogation of metadata in in distributed environment ?

                  I do not know what u mean by talking, Yes, as I mentioned in my previous post, if you use the Teiid deployed in the AS7 environment in the domain mode, caching services are distributed. The deployment of metadata (deploying of VDBs, translators, data sources) are done across the cluster. Pls read the Caching Guide for more information.

                   

                  Ramesh..