Hi all,

I am Hoping someone can shed some light on what is going on in my server.

When I start the jboss service, named workflow in my app, the service shows as starting, then when I check the status it shows started, ( running) and provides the pid. However I'm not sure it is actually running, properly as my web UI fails to come up. So I try and stop the service and I see errors and an illegal state exception, that says: not started... checking the status again shows that the service is not stopped, I have to forcefully kill the process with: kill -9 <pid> 

tomcat  ( apache-tomcat-5.5.26) and workflow ( jboss, version very old, but unfortunately I can not upgrade as the legacy app depends on it...)  JDBC driver version 10.2.0.1.0

Manifest-Version: 1.0

Specification-Title:    Oracle JDBC driver classes for use with JDK14

Sealed: true

Created-By: 1.4.2_08 (Sun Microsystems Inc.)

Implementation-Title:   ojdbc14.jar

Specification-Vendor:   Oracle Corporation

Specification-Version:  Oracle JDBC Driver version - "10.2.0.1.0"

Implementation-Version: Oracle JDBC Driver version - "10.2.0.1.0"

Implementation-Vendor:  Oracle Corporation

Implementation-Time:    Wed Jun 22 18:55:48 2005

here is the full error stack:

[root@watchpoint-app /]# service workflow status

workflow (pid  7846) is running...

[root@watchpoint-app /]# service workflow stop

Stopping WatchPoint Workflow Server

Exception in thread "main" javax.management.RuntimeMBeanException

        at org.jboss.mx.interceptor.ReflectedDispatcher.handleInvocationExceptions(ReflectedDispatcher.java:162)

        at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:149)

        at org.jboss.mx.server.Invocation.dispatch(Invocation.java:80)

        at org.jboss.mx.server.Invocation.invoke(Invocation.java:72)

        at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:245)

        at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:644)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:585)

        at org.jboss.jmx.connector.invoker.InvokerAdaptorService.invoke(InvokerAdaptorService.java:251)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:585)

        at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:141)

        at org.jboss.mx.server.Invocation.dispatch(Invocation.java:80)

        at org.jboss.mx.interceptor.AbstractInterceptor.invoke(AbstractInterceptor.java:118)

        at org.jboss.mx.server.Invocation.invoke(Invocation.java:74)

        at org.jboss.mx.interceptor.ModelMBeanOperationInterceptor.invoke(ModelMBeanOperationInterceptor.java:127)

        at org.jboss.mx.server.Invocation.invoke(Invocation.java:74)

        at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:245)

        at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:644)

        at org.jboss.invocation.jrmp.server.JRMPProxyFactory.invoke(JRMPProxyFactory.java:164)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:585)

        at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:141)

        at org.jboss.mx.server.Invocation.dispatch(Invocation.java:80)

        at org.jboss.mx.server.Invocation.invoke(Invocation.java:72)

        at org.jboss.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:245)

        at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:644)

        at org.jboss.invocation.jrmp.server.JRMPInvoker$MBeanServerAction.invoke(JRMPInvoker.java:805)

        at org.jboss.invocation.jrmp.server.JRMPInvoker.invoke(JRMPInvoker.java:406)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:585)

        at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:294)

        at sun.rmi.transport.Transport$1.run(Transport.java:153)

        at java.security.AccessController.doPrivileged(Native Method)

        at sun.rmi.transport.Transport.serviceCall(Transport.java:149)

        at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:466)

        at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:707)

        at java.lang.Thread.run(Thread.java:595)

Caused by: java.lang.IllegalStateException: not started

        at org.jboss.system.server.ServerImpl.shutdown(ServerImpl.java:617)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:585)

        at org.jboss.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java:141)

        ... 44 more

[root@watchpoint-app /]# service workflow status

workflow (pid  7846) is running...

[root@watchpoint-app /]# kill -9 7846

[root@watchpoint-app /]# service workflow status

workflow is stopped

[root@watchpoint-app /]#

I need it to run and run properly. digging around I found this as well:  ..../jboss/server/default/log/server.log  

--- MBEANS THAT ARE THE ROOT CAUSE OF THE PROBLEM ---

ObjectName: jboss:service=Hypersonic,database=localDB

  State: FAILED

  Reason: java.sql.SQLException: The database is already in use by another process: org.hsqldb.persist.NIOLockFile@8216305d[file =/opt/tandbergtv/watchpoint/workflow/jboss/server/default/data/hypersonic/localDB.lck, exists=true, locke

d=false, valid=false, fl =null]: java.lang.Exception: checkHeartbeat(): lock file [/opt/tandbergtv/watchpoint/workflow/jboss/server/default/data/hypersonic/localDB.lck] is presumably locked by another process.

  Depends On Me:

    jboss.jca:service=ManagedConnectionFactory,name=DefaultDS

ObjectName: jboss.jca:service=RARDeployment,name='jboss-local-jdbc.rar'

  State: NOTYETINSTALLED

  Depends On Me:

    jboss.jca:service=ManagedConnectionFactory,name=DefaultDS

    jboss.jca:service=ManagedConnectionFactory,name=uiDataSource

ObjectName: jboss:service=Naming

  State: FAILED

  Reason: java.rmi.server.ExportException: Port already in use: 1098; nested exception is:

        java.net.BindException: Address already in use

  I Depend On:

    jboss.system:service=ThreadPool

  Depends On Me:

    jboss:service=KeyGeneratorFactory,type=UUID

    jboss.jmx:type=adaptor,name=Invoker,protocol=jrmp,service=proxyFactory

    jboss.jmx:alias=jmx/rmi/RMIAdaptor

    jboss:service=TransactionManager

ObjectName: jboss:service=Naming

  State: FAILED

  Reason: java.rmi.server.ExportException: Port already in use: 1098; nested exception is:

        java.net.BindException: Address already in use

01 Aug 2014 10:44:36,000  INFO  JbpmConfiguration.getInstance() - using jbpm configuration resource 'jbpm.cfg.xml'

01 Aug 2014 10:44:36,854  WARN  EhCacheProvider.buildCache() - Could not find configuration [org.jbpm.taskmgmt.def.Swimlane.tasks]; using defaults.

01 Aug 2014 10:44:37,415  INFO  SessionFactoryObjectFactory.addInstance() - Not binding factory to JNDI, no JNDI name configured

01 Aug 2014 10:44:37,555  WARN  QuerySplitter.concreteQueries() - no persistent classes found for query class:

      update org.jbpm.msg.Message

      set isSuspended = false

      where token = :token

01 Aug 2014 10:44:37,563  WARN  QuerySplitter.concreteQueries() - no persistent classes found for query class:

      select message

      from org.jbpm.msg.Message as message

      where message.destination = :destination

        and message.isSuspended != true

        and message.exception is null

01 Aug 2014 10:44:37,570  WARN  QuerySplitter.concreteQueries() - no persistent classes found for query class:

      update org.jbpm.msg.Message

      set isSuspended = true

      where token = :token

01 Aug 2014 10:44:37,598  WARN  QuerySplitter.concreteQueries() - no persistent classes found for query class:

      select message

      from org.jbpm.msg.Message as message

      where message.destination = :destination

        and message.isSuspended != true

        and message.exception is not null

01 Aug 2014 10:44:37,620  WARN  QuerySplitter.concreteQueries() - no persistent classes found for query class:

      delete

      from org.jbpm.msg.Message m

      where m.token = :token

01 Aug 2014 10:44:37,634  INFO  DefaultApplicationInitializer.configure() - logging system initialized

01 Aug 2014 10:44:37,635  INFO  DefaultApplicationInitializer.configure() - application root is /opt/tandbergtv/watchpoint/workflow/jboss/bin

01 Aug 2014 10:44:37,634  INFO  DefaultApplicationInitializer.configure() - logging system initialized

01 Aug 2014 10:44:37,635  INFO  DefaultApplicationInitializer.configure() - application root is /opt/tandbergtv/watchpoint/workflow/jboss/bin

01 Aug 2014 10:44:37,920  INFO  ManifestParser.<init>() - got SAX parser factory - org.apache.xerces.jaxp.SAXParserFactoryImpl@5561bfa3

01 Aug 2014 10:44:37,921  INFO  PluginRegistryImpl.configure() - configured, stopOnError=false, isValidating=true

01 Aug 2014 10:44:38,143  INFO  PluginRegistryImpl.register() - plug-in and fragment descriptors registered - 32

01 Aug 2014 10:44:38,198  INFO  DefaultApplicationInitializer.initApplication() - integrity check done: errors - 0, warnings - 0

01 Aug 2014 10:44:38,198  INFO  DefaultApplicationInitializer.initApplication() - application plug-in is com.tandbergtv.workflow

01 Aug 2014 10:44:38,205  INFO  StandardPluginManager.activatePlugin() - plug-in started - com.tandbergtv.workflow@1.0.0

01 Aug 2014 10:44:38,395  WARN  Cache.<init>() - An API change between ehcache-1.1 and ehcache-1.2 results in the persistence path being set to java.io.tmpdir when the ehcache-1.1 constructor is used. Please change to the 1.2 constructor

01 Aug 2014 10:44:38,447  WARN  Cache.<init>() - An API change between ehcache-1.1 and ehcache-1.2 results in the persistence path being set to java.io.tmpdir when the ehcache-1.1 constructor is used. Please change to the 1.2 constructor

Thanks to anyone who may be able to help me out here. Let me know if I can provide any more specifics that may help.

~Forcedtouseoldversions