Joins are sequential. I.e., if you start 10 caches, they will join 1 at a time. Perhaps watch the logs and see if anything nasty happens that breaks the join process?
Thanks for the hints. It seems the second one tried to join before the first one fully started up. I can avoid that now.
Thanks again for the reponse.