11 Replies Latest reply on Aug 27, 2013 2:44 PM by rhauch

    Clustered Modeshape on Inifinispan and JBoss AS7

    durante

      Hello,

       

      I've been looking for a way to implement Modeshape in a clustered environment over JBoss 7 and embedded Infinispan.

      Followed steps described here [1] and could set up Modeshape, which is working for file upload and update (my main use case).

      However, I can't satisfy the replication case, in which changes made to a master node would be replicated to all other nodes.

       

      I'm running JBoss 7 configured on standalone-ha. For now all nodes stand on the same network, but this might change, as they would probably be executed on different networks when in production.

       

      The error message I get when all nodes (2 for development purposes) are running is this:

       

      08:33:47,257 WARNING [org.jgroups.protocols.pbcast.NAKACK] (OOB-19,null) srv01/cluster: dropped message 1 from srv02/cluster (sender not in table srv01/cluster]), view=[srv02/cluster|0] [srv02/cluster]

       

      Both nodes output the same message (one complaining about the other).

       

       

      Note that I get this when JBoss is started with -b 0.0.0.0. If I change it to the local interface (each node's IP) then the message is not shown anymore, however, replication just doesn't work, as nodes were not communicating.

       

      In order to test replication I have a simple web application which exposes a servlet that writes to a modeshape folder structure. Once one node writes to the folder, I try to read it from the other node, but data is not there.

      (If I write and read from the same node, data can be retrieved).

       

       

      Any clue?

       

      [1] https://docs.jboss.org/author/display/MODE/Installing+ModeShape+into+AS7#InstallingModeShapeintoAS7-DownloadandinstallModeShape

       

       

      Thanks in advance,

      durante.

        • 1. Re: Clustered Modeshape on Inifinispan and JBoss AS7
          hchiorean

          Hi,

           

          We do have an EAP6.1-based clustering example you can look at here: https://github.com/ModeShape/quickstart/tree/master/modeshape-clustering.

           

          Among other things, it has a couple of standalone-master & standalone-slave xml configuration files which you can look at for the JGroups/Infinispan/ModeShape configuration.

          1 of 1 people found this helpful
          • 2. Re: Clustered Modeshape on Inifinispan and JBoss AS7
            durante

            Hi Horia,

             

            I'll bookmark that, however I have to stick to AS7 for now.

             

            Is there any similar content for this older version?

             

             

            BR

            • 3. Re: Clustered Modeshape on Inifinispan and JBoss AS7
              hchiorean

              The quickstart was built & tested against ModeShape 3.3.0.Final & EAP 6.1.0.

               

              We don't have a similar set of configs for the previous versions of AS7, but afaik the configuration part (XML syntax) shouldn't be that different. The only noticeable difference may be around various bugs & fixes in AS around the Infinispan & JGroups subsystems.

              • 4. Re: Clustered Modeshape on Inifinispan and JBoss AS7
                durante

                Ok, I'll try to adapt my configuration based on the sample XML files and post some progress later..

                • 5. Re: Clustered Modeshape on Inifinispan and JBoss AS7
                  durante

                  Could not make it work on AS 7, it works fine on EAP 6 though.

                   

                  I appreciate your support, however, that would be good to have some AS 7 how-to available sometime..

                  • 6. Re: Clustered Modeshape on Inifinispan and JBoss AS7
                    durante

                    Hey Horia,

                     

                    even having modeshape running on EAP 6, as you suggested, I got some other problems related to Infinispan on EAP 6.

                    Browsing the web, seems like Infinispan is not supported by EAP anymore, being replaced by Data Grid, which is a paid enterprise solution.

                     

                    How can I workaround that?

                     

                    I created an entry on Infinispan forum. Please check it out:

                    WELD-001305 on EAP6.1

                     

                    Any advice is welcome!

                    BR.

                    • 7. Re: Clustered Modeshape on Inifinispan and JBoss AS7
                      rhauch

                      even having modeshape running on EAP 6, as you suggested, I got some other problems related to Infinispan on EAP 6.

                      Browsing the web, seems like Infinispan is not supported by EAP anymore, being replaced by Data Grid, which is a paid enterprise solution.

                      There is no support for clients using Infinispan in EAP 6 other than for caching (e.g., supporting web applications), and if you want a true supported data grid you should indeed look at JBoss Data Grid. However, community ModeShape can use Infinispan within EAP for storage functionality, and this kind of functionality will be delivered as part of Data Virtualization 6.

                      • 8. Re: Clustered Modeshape on Inifinispan and JBoss AS7
                        durante

                        Ok Randall, thank you for the explanation.

                         

                        I just want to summarise all I got so far..

                         

                        My initial plan was to cluster Modeshape over AS 7 (different network nodes). As later advised, I moved forward to EAP 6.1 and now I see it's not the best choice - no support for Infinispan as you mentioned and as I found around, it's not free for production environments - moreover, JBoss Data Grid is out of reach for me.

                         

                        I'm then moving back to AS 7 and, as I see Modeshape is not clusterable in AS 7, I gave up using JCR and am going for a custom document control/replication using Infinispan.

                         

                        The problem now is that I cannot find a way to cluster (replicate) Infinispan on nodes in different networks (found domain mode only), but that's exactly what I need: replicate from master to slaves upon cache changes.

                         

                        What would you advise in this case? How to have such scenario applied?

                         

                         

                        Thanks

                        • 9. Re: Clustered Modeshape on Inifinispan and JBoss AS7
                          rhauch

                          My initial plan was to cluster Modeshape over AS 7 (different network nodes). As later advised, I moved forward to EAP 6.1 and now I see it's not the best choice - no support for Infinispan as you mentioned and as I found around.

                           

                          I'm not sure I follow: you don't want to buy a subscription for EAP or JBoss Data Grid, but then you worry about not having support. All of the communities (Infinispan, ModeShape, AS7/WildFly, etc.) are community-based, meaning that the community members will try to help out if they can. There's no notion of true commercial 24x7 support in our communities. Building and supporting stable platforms is how Red Hat makes its money, so if that's the kind of support you're referring to, you should look at the platforms.

                           

                          [EAP 6.1 is] not free for production environments

                           

                          That may be, but its pretty inexpensive. Seriously - if you want support, then price it out. But if you need support for Infinispan, the only option is JBoss Data Grid.

                           

                          I'm then moving back to AS 7 and, as I see Modeshape is not clusterable in AS 7, I gave up using JCR and am going for a custom document control/replication using Infinispan.

                           

                          The problem now is that I cannot find a way to cluster (replicate) Infinispan on nodes in different networks (found domain mode only), but that's exactly what I need: replicate from master to slaves upon cache changes.

                           

                           

                          If you're not going to use ModeShape and instead are going to use Infinispan directly, then I suggest that you work with the Infinispan community.

                           

                          But as a fellow user of Infinispan, I really don't think you're going to get clustering to work on AS7 because the Infinispan version embedded in AS7 is simply old and has clustering issues. Period. (BTW, this is why clustering ModeShape doesn't work on AS7.) Clustering was fixed in subsequent versions of Infinispan, but no AS7 version was released with them; instead, they were bundled into EAP 6.0 and 6.1.

                           

                          Good luck.

                          • 10. Re: Clustered Modeshape on Inifinispan and JBoss AS7
                            durante

                            The point is that I cannot buy it, it's not up to me to decide that, unfortunately.

                            There is no support for clients using Infinispan in EAP 6 other than for caching

                            By support, I mean EAP6 code fully supporting Infinispan cluster (what I understood from your text..), not 24/7 enterprise support. I know that's something I'll have access only if I pay for. I'm good to go with community support..

                             

                            If you're not going to use ModeShape and instead are going to use Infinispan directly, then I suggest that you work with the Infinispan community.

                            Ok, gonna get more involved with them.

                             

                            I really don't think you're going to get clustering to work on AS7 because the Infinispan version embedded in AS7 is simply old and has clustering issues. Period. (BTW, this is why clustering ModeShape doesn't work on AS7.)

                            Good to know!

                             

                            Would that be possible with AS7 + standalone (and new version of) Infinispan?

                             

                             

                            BR

                            • 11. Re: Clustered Modeshape on Inifinispan and JBoss AS7
                              rhauch

                              Would that be possible with AS7 + standalone (and new version of) Infinispan?

                              That's something to ask the Infinispan folks.