RHQ web interface: 503 service not available after ORA-00904 for storagenode VERSION
ymartin Oct 9, 2015 10:36 AMHello,
I have upgraded a RHQ 4.4 instance to 4.13.1 running on Oracle XE. The upgrade process has finished with success and data migration was succesful too.
But after server start up, there is no way to enter the web interface. The POST request to "/portal/sessionAccess" fails with 503 Service Unavailable. To confirm, the JBoss welcome page at "localhost:7080" also says the service not ready yet.
RHQ runs Java 7u79 64 bits. The "server.log" contains:
15:07:58,648 WARN [org.hibernate.engine.jdbc.spi.SqlExceptionHelper] (pool-6-thread-1) SQL Error: 904, SQLState: 42000
15:07:58,649 ERROR [org.hibernate.engine.jdbc.spi.SqlExceptionHelper] (pool-6-thread-1) ORA-00904: "STORAGENOD0_"."VERSION": invalid identifier
15:07:58,654 ERROR [org.jboss.as.ejb3.invocation] (pool-6-thread-1) JBAS014134: EJB Invocation failed on component StorageNodeManagerBean for method public abstract org.rhq.core.domain.util.PageList org.rhq.enterprise.server.cloud.StorageNodeManagerRemote.findStorageNodesByCriteria(org.rhq.core.domain.auth.Subject,org.rhq.core.domain.criteria.StorageNodeCriteria): javax.ejb.EJBException: javax.persistence.PersistenceException: org.hibernate.exception.SQLGrammarException: could not extract ResultSet
[...]
Caused by: javax.persistence.PersistenceException: org.hibernate.exception.SQLGrammarException: could not extract ResultSet
at org.hibernate.ejb.AbstractEntityManagerImpl.convert(AbstractEntityManagerImpl.java:1387) [hibernate-entitymanager-4.2.10.Final.jar:4.2.10.Final]
[...]
Caused by: java.sql.SQLSyntaxErrorException: ORA-00904: "STORAGENOD0_"."VERSION": invalid identifier
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:440) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:837) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:445) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:523) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:863) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1153) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1275) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3576) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3620) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1491) [ojdbc6-11.2.0.2.0.jar:11.2.0.2.0]
at org.jboss.jca.adapters.jdbc.CachedPreparedStatement.executeQuery(CachedPreparedStatement.java:107)
at org.jboss.jca.adapters.jdbc.WrappedPreparedStatement.executeQuery(WrappedPreparedStatement.java:462)
at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:79) [hibernate-core-4.2.10.Final.jar:4.2.10.Final]
Is there any Oracle backend issue with RHQ 4.13.1 or is the upgrade process failed at some step ?
How should I diagnose to get it fixed ?