4 Replies Latest reply on Mar 15, 2013 11:17 AM by rareddy

    Trying connect to Hive

    lockdog

      Hello.

      I'm Using Teiid 8.1

       

      And Clouderra VM

      https://ccp.cloudera.com/display/SUPPORT/Demo+VMs

       

      I installed driver

      hive-jdbc-0.10.0-cdh4.2.0.jar

       

      When i'm trying to connect to Hive i have exception
      21:58:03,483 WARN  [org.jboss.jca.core.connectionmanager.pool.strategy.OnePool] (Worker0_QueryProcessorQueue125) IJ000604: Throwable while attempting to get a new connection: null: javax.resource.ResourceException: Could not create con
      nection
              at org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.getLocalManagedConnection(LocalManagedConnectionFactory.java:277)
              at org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.createManagedConnection(LocalManagedConnectionFactory.java:235)
              at org.jboss.jca.core.connectionmanager.pool.mcp.SemaphoreArrayListManagedConnectionPool.createConnectionEventListener(SemaphoreArrayListManagedConnectionPool.java:761) [ironjacamar-core-impl-1.0.9.Final.jar:1.0.9.Final]
              at org.jboss.jca.core.connectionmanager.pool.mcp.SemaphoreArrayListManagedConnectionPool.getConnection(SemaphoreArrayListManagedConnectionPool.java:343) [ironjacamar-core-impl-1.0.9.Final.jar:1.0.9.Final]
              at org.jboss.jca.core.connectionmanager.pool.AbstractPool.getSimpleConnection(AbstractPool.java:397) [ironjacamar-core-impl-1.0.9.Final.jar:1.0.9.Final]
              at org.jboss.jca.core.connectionmanager.pool.AbstractPool.getConnection(AbstractPool.java:365) [ironjacamar-core-impl-1.0.9.Final.jar:1.0.9.Final]
              at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.getManagedConnection(AbstractConnectionManager.java:329) [ironjacamar-core-impl-1.0.9.Final.jar:1.0.9.Final]
              at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:368) [ironjacamar-core-impl-1.0.9.Final.jar:1.0.9.Final]
              at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:464) [ironjacamar-core-impl-1.0.9.Final.jar:1.0.9.Final]
              at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:129)
              at org.teiid.translator.jdbc.JDBCExecutionFactory.getConnection(JDBCExecutionFactory.java:229)
              at org.teiid.translator.jdbc.JDBCExecutionFactory.getConnection(JDBCExecutionFactory.java:57)
              at org.teiid.translator.ExecutionFactory.getConnection(ExecutionFactory.java:188) [teiid-api-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.metadata.NativeMetadataRepository.loadMetadata(NativeMetadataRepository.java:50) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at com.datavirtuality.dv.core.controller.DVController.createModel(DVController.java:1228) [controller-1.0.0.jar:1.0.0]
              at com.datavirtuality.dv.core.controller.DVController.createModel(DVController.java:1083) [controller-1.0.0.jar:1.0.0]
              at com.datavirtuality.dv.core.controller.DVController.callProc(DVController.java:635) [controller-1.0.0.jar:1.0.0]
              at com.datavirtuality.dv.core.teiid.TeiidSystemExtension.run2(TeiidSystemExtension.java:99) [teiid-impl-1.0.0.jar:1.0.0]
              at org.teiid.dqp.internal.process.DataTierManagerImpl.processSystemQuery(DataTierManagerImpl.java:304) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.dqp.internal.process.DataTierManagerImpl.registerRequest(DataTierManagerImpl.java:199) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.tempdata.TempTableDataManager.registerRequest(TempTableDataManager.java:160) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.processor.relational.AccessNode.registerRequest(AccessNode.java:377) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.processor.relational.AccessNode.open(AccessNode.java:164) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.processor.relational.RelationalNode.open(RelationalNode.java:255) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.processor.relational.RelationalPlan.open(RelationalPlan.java:139) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.processor.QueryProcessor.init(QueryProcessor.java:200) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.processor.QueryProcessor.nextBatchDirect(QueryProcessor.java:130) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.processor.QueryProcessor.nextBatch(QueryProcessor.java:109) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:153) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.dqp.internal.process.RequestWorkItem.processMore(RequestWorkItem.java:383) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.dqp.internal.process.RequestWorkItem.process(RequestWorkItem.java:292) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.dqp.internal.process.AbstractWorkItem.run(AbstractWorkItem.java:49) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.dqp.internal.process.RequestWorkItem.run(RequestWorkItem.java:220) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:249) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:123) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:298) [teiid-engine-8.1.0.Final.jar:8.1.0.Final]
              at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) [rt.jar:1.6.0_33]
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) [rt.jar:1.6.0_33]
              at java.lang.Thread.run(Thread.java:662) [rt.jar:1.6.0_33]
      Caused by: java.sql.SQLException: org.apache.thrift.TApplicationException: Invalid method name: 'execute'
              at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:191)
              at org.apache.hadoop.hive.jdbc.HiveStatement.execute(HiveStatement.java:127)
              at org.apache.hadoop.hive.jdbc.HiveConnection.configureConnection(HiveConnection.java:126)
              at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:121)
              at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:104)
              at org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.getLocalManagedConnection(LocalManagedConnectionFactory.java:249)
              ... 38 more
      

       

      I copied drivers from VM server.

      Please help me with this exception.

        • 1. Re: Trying connect to Hive
          rareddy

          Eugene,

           

          The exception looks like it is coming below Teiid layer, in Hive driver itself. I have never tried on the ClouderraVM. See if you can roll back the driver to 0.7 or 0.8 and see if problem still exists?

           

          Ramesh..

          • 2. Re: Trying connect to Hive
            rareddy

            Similar issue was found, and Van (one of colleague) passed this on https://jira.talendforge.org/browse/TDI-24288

             

            This kind of says, the way Teiid accessing the metadata may be wrong in the embedded case.  You can enter JIRA, or update the code and give us the patch.

             

            Thanks.

             

            Ramesh..

            • 3. Re: Trying connect to Hive
              lockdog

              Thanks, maybe you know quick way to test hive connection on my windows machine?

              Some open hive servers, or maybe other hive-hadoop virtual machines on windows?

              • 4. Re: Trying connect to Hive
                rareddy

                Thanks, maybe you know quick way to test hive connection on my windows machine?

                It is JDBC driver, you can write jdbc client app.

                 

                Some open hive servers, or maybe other hive-hadoop virtual machines on windows?

                you can install locally, see the hive website for instructions.