1 2 Previous Next 16 Replies Latest reply on Jul 3, 2013 4:22 AM by pathduck

    4.7 new graphs system - graphs not showing at all

    pathduck

      Hi,

      when testing out the new system for historical graphs in 4.7 there are now several places they do not show at all. There are no errors given, just a blank chart.

       

      The time range buttons show, but when I click Set the background just refreshes.

       

      Seems to be related to groups - when I try the same metrics for an individual resource, it shows fine.

       

      Tried in Firefox 19 and Chrome 25

       

      Anyone else having the same problem?

       

       

      -Stian

        • 1. Re: 4.7 new graphs system - graphs not showing at all
          mithomps

          Hi Stian,

           

          I was just looking at a RHQ 4.7.0 build and was unable to see what you are referrng to. I'm probably have not spotted this in the correct place yet. Can you help me narrow this down a little bit more? What kind of groups and where are the charts invoked from?

           

          Thanks,

          Mike

          • 2. Re: 4.7 new graphs system - graphs not showing at all
            pathduck

            Hello Mike,

            thanks for having a look at this.

             

            I have a hard time nailing it down exactly - it seems to groups-related, in that I can go to each resource and get the individual charts, but not the same metric for the groups.

             

            These are groups of Tomcat or JBoss AS7 servers running on RHEL6/5, as well as groups for Linux OS.

             

            One thing I do notice; I can click the main Group "header" on the left (the group name) and get stuff like Commands/min etc. Then a graph shows, but only for *one* instance, the first it appears. For a group of two only the first graph is drawn. But for child resources the usual result is a blank chart.

             

            But for instance, looking at User Load for a group of Linux servers, it seems the chart is drawn with all the members.

             

            Attaching a few shots of the various stuff I see.

            Graph-bug1: Tomcat VM, groups of six Tomcats.

            Graph-bug1.png

             

            Graph-bug2: Two JBoss servers, selecting the groups name and choosing management requests/min.

            Graph-bug2.png

             

            Graph-bug3: Group of RHQ Agents

            Graph-bug3.png

             

            Graph-bug4: User Load for a group of Linux servers.

            Graph-bug4.png

             

            regards,

            Stian

            • 3. Re: 4.7 new graphs system - graphs not showing at all
              mithomps

              Hi Stian,

               

              The above helps and I have started investigating this issue. Another diagnostic tool helpful in determining the root cause is the browser console. We log the GWT 'FINE' (Debug) level events to the browser console. If there any exceptions occuring in the UI they will be logged here and any pertinent messages leading up to the issue will also be logged giving us a better understanding of the system state when the issue occurred. For example, all of the raw graph data from the metrics service is logged.

               

              To show the javascript console use Chrome (right click and select 'inspect element' then select 'Console' from the set of tabs on the bottom of the screen. For FireFox the default browser console doesn't seem to work for displaying the logs but installation of the FireBug addon works great. Once Firebug is addon is installed into FireFox just right click in the page and select 'Inspect Element with Firebug' and make sure the 'Console' tab is selected below. [IE also has a console feature] See Firebug console below:

              FireBug.jpg

               

              These browser console logs can then be pasted here or better, put in a pastebin and linked.

               

              In the meantime, I'm looking into this and will have some sort of answers in a day or two.

               

              -- Mike

              • 4. Re: 4.7 new graphs system - graphs not showing at all
                mithomps

                Hi Stian,

                 

                All four issues you are describing above sure sound like: https://bugzilla.redhat.com/show_bug.cgi?id=951266 which was fixed with:

                commit - d180a87f10798f616c744130383560e26f1780ad

                date - April 15, 2013

                 

                However, git reports that commit in the RHQ_4_7_0 tag [git tag --contains d180a87f10798f616c744130383560e26f1780ad]  so it should in the 4.7.0 final release.

                 

                As an aside, I will be replacing the multiline chart with a different component (non-nvd3 chart) within a couple weeks so that code will be replaced and retested at that point.

                 

                -- Mike

                1 of 1 people found this helpful
                • 5. Re: 4.7 new graphs system - graphs not showing at all
                  pathduck

                  Hey Mike, and sorry for the late reply - been a long weekend here

                   

                  Thanks for finding that BZ report, it certainly sounds like the issues I am seeing.

                   

                  I still got some JS logs from Chrome so hope they are useful, even though there is work underway to improve the graphing. Attaching these.

                   

                  I notice logging like:

                  drawGraph in CompositeGroupD3GraphListView for: null, 10480 (program): 3460

                  Note sure if the "null" is related to it not drawing a graph?

                   

                  Also I notice the message:

                  Draw nvd3 charts for composite multiline graph (program):92317

                   

                  This seems to be missing in the "TomcatCPU-Fails" log from when the graphs were empty.

                   

                  regards,

                  Stian

                   

                  BTW: I have been thinking of posting a list of possible UI and feature improvements on the graphs system, but not sure what plans you have on that point?

                  • 6. Re: 4.7 new graphs system - graphs not showing at all
                    jkremser

                    Hi,

                      it is perhaps a dumb question, but have you tried to clear the browser cache? Sometimes between the upgrades the browser works still with the old client ui version. From what I've seen and read, it looks like the bug, I'd already fixed.

                     

                    jk

                    • 7. Re: 4.7 new graphs system - graphs not showing at all
                      mithomps

                      Stian,

                       

                      By all means post the possible UI and feature improvements. The  feedback will go back to our user experience team and product management and hopefully get incorporated into the product.

                       

                      -- Mike

                      • 8. Re: 4.7 new graphs system - graphs not showing at all
                        pathduck

                        Jirka Kremser wrote:

                         

                        Hi,

                          it is perhaps a dumb question, but have you tried to clear the browser cache? Sometimes between the upgrades the browser works still with the old client ui version. From what I've seen and read, it looks like the bug, I'd already fixed.

                         

                        jk

                         

                        Yeah I've tried clearing all cache in Chrome (and Firefox) and it still has the same problem I'm afraid.

                         

                        Is this related to the JBoss AS7 agent? Because I am using a snapshot and possibly the fix did not make it into that? But since I see the problem for non-Jboss resources I guess it probably is not related.

                         

                        I also notice the BZ report is still status ON_QA?

                         

                        Mike: I've posted a list here: https://community.jboss.org/thread/228427?tstart=0

                        Great if you could take a look

                         

                        cheers,

                        Stian

                         

                         

                        • 9. Re: 4.7 new graphs system - graphs not showing at all
                          mithomps

                          Hi Stian,

                           

                          Aha...

                          Is this related to the JBoss AS7 agent? Because I am using a snapshot and possibly the fix did not make it into that? But since I see the problem for non-Jboss resources I guess it probably is not related.

                          I'm afraid the use of a snapshot agent with RHQ 4.7.0 server "voids the warranty". Mixing server and agent versions is not advised the code base for server/client is pretty well coupled and a change to either can cause issues. Please upgrade the agent (although you might have already corrupted the database with mixed data).

                           

                          Thanks for the chrome logs they are a very useful tool for our UI diagnostics. I do see a 'null' resource type that should not be there but this is likely a side effect of the real issue.

                           

                          I also notice the BZ report is still status ON_QA?

                          ON_QA means that it is committed to master but awaiting QA testing (unknown when it will be QA'd, depending on priority, more likely around the JON 3.2 release timeframe).

                           

                          We appreciate your feedback in https://community.jboss.org/thread/228427?tstart=0. I will comment back in that thread.

                           

                          -- Mike

                          • 10. Re: 4.7 new graphs system - graphs not showing at all
                            pilhuhn

                            Mike: I doubt that the as7-plugin internal change in discovery logic will cause that error

                             

                            Stian: keep the suggestions rolling those are all good. We nevertheless need to decide what to implement or not (and how).

                            Saving as PNG for sure makes a lot of sense

                            • 11. Re: 4.7 new graphs system - graphs not showing at all
                              pathduck

                              Hey.

                               

                              Like Heiko says, I doubt it is related, but I wanted to put it out there anyway. I could try downgrading to the official 4.7 AS7 plugin to be sure?

                               

                              I also had a look using Firebug. Attaching a file of output, but found it a bit hard to export from there. First there is the output from console, then details on the POST/Reponse parts.

                               

                              I notice when the charts are empty the response is very short. But when it only draws one graph (when it should draw two) there seems to be data coming from both resources.

                              There are also a lot of NaN's  - should these be there?

                               

                              regards,

                              Stian

                              • 12. Re: 4.7 new graphs system - graphs not showing at all
                                mithomps

                                Sorry for the late reply Stian, we had a holiday in US.

                                 

                                Thanks for the firebug output it is very useful. This really looks like https://bugzilla.redhat.com/show_bug.cgi?id=951266 that we talked about earlier. Where a race condition can occur and the chart is drawn before the countdown latch is released - resulting in one less graph than expected.

                                 

                                I'm still keeping my eyes open for this one but I have not been able to reproduce yet.

                                 

                                The NaN are normal for metrics. The most common circumstance is an 'unknown' availability state. It is unknown because possibly the agent is down and we don't know what the availability of the monitored resources really is so it is unknown.

                                 

                                -- Mike

                                • 13. Re: 4.7 new graphs system - graphs not showing at all
                                  pathduck

                                  What, you guys actually still have holidays over there? j/k 

                                   

                                  Thanks for the update Mike, and please let me know if you find anything or manage to reproduce. I do see that there is not only "1 less than expected" graph,  some of my examples show 0 of 6, or one of 17 and so on. But it definitely might be related.

                                   

                                  And I'll be happy to test out suggestions, look in the base, and even test built code if possible - this bug is a real showstopper for us going into production with 4.7

                                   

                                  regards,

                                  Stian

                                  • 14. Re: 4.7 new graphs system - graphs not showing at all
                                    pathduck

                                    Update after installing 4.8:

                                     

                                    I installed 4.8 hoping it would fix some of my problems on the graphs. Unfortunately it seems just as bad or worse for some things... I have tried to clear cache in Chrome but no luck. Most graphs don't show at all, especially for groups, and there are a lot of "Globally Uncaught exceptions" going on in the background even when I get some graphs showing.

                                     

                                    What browser versions are you guys using where it works? I know Chrome isn't officially supported but I see the same in Firefox.

                                     

                                    Anyway, Mike fixed BZ976926 (On MultiResource Graphs allow deselection of Resources) so at least I am able to see now that in the situations where only 1 graph shows, there is actually two, but only one of them is showing. Might be a clue to what is wrong possibly?

                                     

                                    See attached images. In one both are selected but only one show. I deselect the first (dark) and the second is showing.

                                     

                                    Stian

                                    1 2 Previous Next