1 2 3 4 5 6 Previous Next 224 Replies Latest reply on Apr 27, 2018 4:39 PM by serena Go to original post
      • 75. Re: NPM 12.2 Upgrade Experience Feedback?

        Thank you for this in depth feedback. We are working on improving the timeout architecture for the remote APEs, so I've flipped that feature request to what we're working on. I hope to hear your feedback the next time you're upgrading to see how we've done to improve that scenario for you.

        • 76. Re: NPM 12.2 Upgrade Experience Feedback?

          I think I owe my problem free upgrade to Serena's advice about uninstalling IPAM first.  I followed this instruction on my primary Orion server and all additional pollers.  I did not see this advice in any documentation and because of my installed versions the Product Update Advisor tool wasn't very helpful this time around.  Thank you Serena!


          I upgraded from Orion Platform 2016.2.100, WPM 2.2.1, IPAM 4.3.2, NPM 12.0.1, DPA 10.2.0, QoE 2.2.0, VIM 7.0.0, SAM 6.3.0, NetPath 1.0.1 to without any problems at all.  I have 2 additional webservers and pollers plus a VMAN appliance and I think I was all done in less than 4 hours.  Great experience with the new installer and it definitely pays to read Thwack!

          • 77. Re: NPM 12.2 Upgrade Experience Feedback?

            Our upgrade from previous versions went extremely well, the web based online and all in one experience started with a check of the environment. We have an additional poller and a VM with NTA which it detected and told me about the fastbit upgrade which I needed to do after along with the additional poller.

            It did the complete upgrade and then run through the configuration wizard. We have

            So took all in all about 30-40 minutes (as I wasn't really checking)

            Sucked the main poller install down to the additional poller went fine then the config wiz runs.

            Upgraded NTA server which went fine


            We has warnings about our server:

            CPU requirements

            DISCOVERED: 15/11/2017 21:33:36

            DESCRIPTION: Your environment does not meet the minimum CPU requirements for the following products: Web Performance Monitor 2.2.1. Performance may be slower than expected.

            RESOLUTION: For better performance ensure that you have more than 4 CPU cores that are faster than 3000MHz.


            but have installed it all - we had issues with a service stopping and stopping after the upgrade but tech support helped which was this, and doing this helped alot!

            2 of 2 people found this helpful
            • 78. Re: NPM 12.2 Upgrade Experience Feedback?

              Wow this is interesting extra information.  I'm wondering now how these settings might help some of my other busy servers that do a lot of network activity!

              • 79. Re: NPM 12.2 Upgrade Experience Feedback?

                After going through the same upgrade, I found several items that improve performance by adjusting them:

                • Ensure failing NetPath monitors are removed.
                • Reduce logging to NPM and offload it to a SIEM.  I can easily send seven or eight million syslog messages per second (yes, PER SECOND!) to NPM, and NPM's SLX onboard syslog environment only scales up to two million per second.  Overloading NPM with syslog messages results in some pretty quirky behavior; save yourself the trouble and send big syslog outputs elsewhere.  Our Security Admins want our 80+ ASA's syslogging in Debug Mode, and our WLC's do the same.  Both of those kinds of appliances generate far more syslog information than NPM's syslog can handle.
                • Ensure hot fixes and patches are applied.  I wish SW had a one-touch button that automatically went out and discovered my products and then discovered their patches & hot fixes, and showed me what to install, and that even offered a way to automate the process with a single click if I wanted.  Applying the right updates & patches & fixes, in the correct order, and rebooting and distributing the updates to all APE's in the right order, too--well, that would be heaven.
                • Over the last fourteen years I'd retired a couple of main NPM instances and converted them to APE's.  But the upgrades / installs over that time didn't reveal that NTA still thought those two main instances should be primary NTA servers.  Only yesterday did I discover that, and learned the process to remove them.  That improved performance, too.
                • Cleaning up nodes that send syslog is also very useful.  We'd had an environment that operated off of resilience and duplication, so switches & routers & firewalls were reporting syslogs to two different APE's, AND to two different SIEM's.  Reducing that duplication at the nodes has improved NPM's performance.


                The list of tweaks goes on and on, but every little modification shows a corresponding improvement in NPM's performance.  But I'd be lying if I said I wouldn't want a few Solarwinds second-level engineers to come and go through my environment with a fine-toothed comb and make recommendations/suggestions, or actually do tweaks and clean-ups for me.

                • 80. Re: NPM 12.2 Upgrade Experience Feedback?

                  I feel the same way about the upgrading... it's getting better but really isn't there yet.

                  • 81. Re: NPM 12.2 Upgrade Experience Feedback?

                    Few further issues that I'd like to share since our upgrade.


                    To recap our upgrade included replacing the primary server with a new 2012 R2 node and a clean install. Turns out the installation included some hotfixes but not all. SAM 6.4 HF 2 was not installed and consequently we were unable to gather windows mount volume metrics, to our surprise after the install. The hotfix was installed on the APEs as they were upgraded and not replaced with a new node. Seeing the HF installed on the APEs and not the primary added to the confusion.


                    SAM 6.4 Hotfix 2 resolved the Windows Mount issue. A few days after that installation we realized we had issues with RabbitMQ not responding and the backup MSMQ overloading and filling up the HDD. This leak also caused intermittent SAM monitors stopping with ephemeral ports being exhausted.

                    Ephemeral Port Exhaustion - SolarWinds Worldwide, LLC. Help and Support


                    A complete uninstall and reinstall of RabbitMQ, along with running the configuration wizard on the primary engine with all the APEs shutdown resolved our issues. It was important for all the APEs to be shutdown.


                    We have been running stable now for a week.


                    One note I'd like to pass along is I would love to see better release notes that specifically call out which hotfixes are included in the Core roll-up Hotfix bundle.

                    1 of 1 people found this helpful
                    • 82. Re: NPM 12.2 Upgrade Experience Feedback?

                      Agreed.  Particularly when patching/upgrading/creating/changing APE's.


                      Each time I patch / install / upgrade, the Config Wizard generates two windows for upgrades.  That seems like a bug to me, but I run them each sequentially.  The polling engine updates have the same issue.

                      • 83. Re: NPM 12.2 Upgrade Experience Feedback?

                        How unfortunate that parts of, or all of, APE's must be shut down to correctly perform an update or a fix.  I'm fighting that same challenge right now.

                        • 84. Re: NPM 12.2 Upgrade Experience Feedback?

                          So how did your own upgrade go?

                          • 85. Re: NPM 12.2 Upgrade Experience Feedback?

                            The two window thing doesn't sound good.

                            • 86. Re: NPM 12.2 Upgrade Experience Feedback?

                              We've corrected that in releases since the time that Richard posted that comment.

                              1 of 1 people found this helpful
                              • 87. Re: NPM 12.2 Upgrade Experience Feedback?

                                To be perfectly honest, it is going the wrong direction.  The new "manage nodes" interface I shutoff, I revert to the old. OpenGL issues, when I try to open the "new" manage nodes section, that stopped after a patch, but still the interface doesn't let me do any admin work faster. It is all more clicking, more gui navigaation that doesn't let the easy access to custom properties for sorting....total downgrade in GUI.

                                The new "edit views" is awful, hangs up and times out 7/8ths of the time.

                                • 88. Re: NPM 12.2 Upgrade Experience Feedback?

                                  Just for some clarity are you saying that the actual product is going in the wrong direction, rather than the upgrade experience itself? Both are interesting points of feedback.

                                  For the new manage entities, there's still a fair amount of work to be done on that page which is why it's not replacing the default views. Until it has feature parity we of course would not replace the default.

                                  The edit views, it sounds like you're running into something unexpected, have you created a support ticket for this?

                                  • 89. Re: NPM 12.2 Upgrade Experience Feedback?

                                    As Serena noted, that problem is corrected.  She demonstrated that with me two days ago, and I must say that the ENTIRE upgrade/patching process is faster, has fewer questions raised, is more complete . . . in fact, it is better in every way!


                                    Kudos go to SW and serena for their caring and efficiency and improvements!

                                    1 of 1 people found this helpful
                                    • 90. Re: NPM 12.2 Upgrade Experience Feedback?

                                      I can second your observation in regards to the new Manage Entities screen.  Once it was corrected so it actually worked, I used it for a while, just to see if there were efficiencies gained by it. 


                                      And like you, I shut it off.  It is significantly less efficient than the previous solution.  It does not display all the nodes on one screen, and it wastes a lot of screen real estate.  It'll stay off as long as possible, and I hope the original solution is not removed in future releases in favor of the new Manage Entities screen.  Unless, of course, the new Manage Entities screen can show all entities in one screen, and not waste so much space.  Which would make it very much like the original solution.

                                      2 of 2 people found this helpful
                                      • 91. Re: NPM 12.2 Upgrade Experience Feedback?

                                        The upgrade went well, the new installer, brilliant. It was nice to only have one file, instead of 4, on each server.


                                        I feel the new Manage Entries page wastes a ton of real estate on large icons, thick rows, and lots of white-space, that annoying square loading box, the new filter part and display make it hard to sort the data. Before I would have polling engine, polling method, or any of the other stuff that makes it easy to sort the list from. I mean, you can add it via filter results, but you could do that already, and then sort again with he columns.

                                        I haven't spoken with support about this issue, only a few others. Time is not something that I have a lot of to sit on the phone. I have installed a second instance of SolarWinds this last week for testing, it has the same problems with the Edit views not populating consistently, and the Manage Entries page being a downgrade in functionality.
                                        I would like to see some mobile friendly management pages. I would be a lot more supportive of the change if it rendered nice on a mobile. I am often in meetings, or on the other side of campus, being able to pop in and adjust something on the mobile would be great. Currently there is a lot of zooming involved.


                                        I would like to know what functionality it gained, if any. Keep up the great work on the installer.

                                        2 of 2 people found this helpful
                                        • 92. Re: NPM 12.2 Upgrade Experience Feedback?

                                          I'm glad the new installer was back ported from 12.2 to 12.1 as I'm still doing upgrades on some systems from back as far as 11.5.  Kinda wild thinking about how far things have come from 10.x now.

                                          • 93. Re: NPM 12.2 Upgrade Experience Feedback?

                                            I have MANY improvements with the latest code versions, and very few caveats or items left to tweak and tune.  I really like the installer that was just updated on 1/16/2018.  It fixed every complaint I had in the installation and APE Polling Engine install areas.

                                            1 of 1 people found this helpful
                                            • 94. Re: NPM 12.2 Upgrade Experience Feedback?

                                              Hopefully that'll make some of my upgrades easier then... it's really all about getting off windows 2008R2 and older SQL Server version VM's for everyone now that product doesn't support them anymore.

                                              • 95. Re: NPM 12.2 Upgrade Experience Feedback?

                                                Upgrades are DEFINITELY easier now.  Most of the thinking is done in the background by SW, and they've done a NICE job of it with this week's release/update.


                                                I'm not sure who has access to it yet--my experience seems to have been a beta test, and serena supervised it with me.  She indicated that this would soon be published and made available to all, but didn't state when.


                                                It's a keeper!

                                                1 of 1 people found this helpful
                                                • 96. Re: NPM 12.2 Upgrade Experience Feedback?

                                                  I was heaving quite a lot of difficulties.

                                                  The new installer was not working for me because i have additional polling engines globally deployed and the installer was not able to transfer all the data from my main polling engine to all my additional polling engines.

                                                  It took my up to 12 hours to deploy everything and after that NCM was not working because of a bad hotfix.

                                                  I'm still not able to run the configuration wizard on non of my systems, it always get stuck in stopping services. I'm really worried that i will no longer be able to get something done.

                                                  Also after the upgrade all my polling engines are instable, it seems that more and more of polling engines are running out of diskspace.

                                                  So no success for me after more then 1 month i'm struggling to keep everything running.

                                                  I hope that the next release will give also the opportunity to have an offline installer otherwise i will not be able to do an upgrade anymore.

                                                  • 97. Re: NPM 12.2 Upgrade Experience Feedback?

                                                    I experienced many of those same issues, and a dozen or two Support tickets later they've been resolved.  The best solution is the one I recently implemented through the kind graces of serena.  I recommend you:

                                                    1. Carefully document each individual issue
                                                    2. Aggregate similar problems into Solarwinds Support tickets
                                                    3. Work with Support (or perhaps @serena?) to get the latest updater/installer, which has not yet been released (at the time of this writing--Jan 20, 2018).  I did a Beta test of it this week and it resolved SO MANY of the issues!  I hope it will be published and made available to everyone soon, but I have no schedule.
                                                    4. Review Thwack for cases of users' pollers' C drives filling up, and see if the descriptions match your experience.  I had that same issue multiple times after upgrading to 12.2 and installing three APE's while simultaneously adding new modules (IPAM, UDT, VNQM).  SW Support remoted into my servers several times, stopped services, copied & moved problem files, removed some applications, and then re-installed them.  This proved to be only a temporary treatment of the symptom, and didn't remove the problem.  But together, we eventually got this corrected.
                                                      1. The problem was caused by communications between APE's and the Main Poller not flowing out smoothly, and not being purged as new communications arrived.
                                                      2. Set up an easily-viewed C Drive Space monitor on the front page of NPM and keep a steady eye on it to see if your efforts have fixed the problem.
                                                    5. The offline installer and the product update / installer and Polling Engines Scalability Engine all seem to be MUCH improved as of 1/17/2018--and the fixed versions are not yet published for general access, as mentioned above.
                                                    6. You'll save some time by generating diagnostics on the affected pollers while you open tickets online.  Update the diagnostics to the cases you create online, then call SW Support and reference the new cases you created.
                                                    3 of 3 people found this helpful
                                                    • 98. Re: NPM 12.2 Upgrade Experience Feedback?

                                                      Please try using the new installer that was uploaded this last Monday: file version <-- this contains an updated download algorithm that should speed things up for you.  Are you interested in participating in a dev assisted upgrade?

                                                      2 of 2 people found this helpful
                                                      • 99. Re: NPM 12.2 Upgrade Experience Feedback?

                                                        Love this list! Absolutely spot on.

                                                        1 2 3 4 5 6 Previous Next