HAJNDI should work out of the box. in the default configuration for the "all" server.
There's no cross-dependency between DefaultPartition and HAJNDI as the latter depends on the former, not vice-versa.
You can try relocating HAJNDI to a different port to see if the problem persists on the new port. The HAJNDI port is specified by the Port attribute in the HAJNDI configuration, located in ../deploy/cluster-service.xml.