13 Replies Latest reply on May 18, 2017 7:41 AM by ecklerwr1

    Compliance report stuck in cashing

    hozenya

      Started an update all for a report and it is still running after 12 plus hours, is there a way to stop the cashing? I booted the server that SW is running on and active as poller 1 and the cashing remained running or never stopped running, also re-started all services on poller 2 with no change in the cashing still running.

       

      How can I stop the cashing as I think the report is not really running at all.

        • Re: Compliance report stuck in cashing
          hozenya

          After waiting a day to hear back from support, I stopped Orion services on both pollers, waited 3 min then started poller one, waited and then started poller 2. Compliance cache job now stopped but I have no idea what root cause was for the job hanging and now I have to poke around to see if the report has a configuration issue before starting an update all for that report.

            • Re: Compliance report stuck in cashing
              hozenya

              Update to an unresolved problem:

              I started the compliance report again and still get the following;

               

              Report starts to cache and just sits there and there is are no updates being posted in the transfer status which tells me nothing is happening . Also when I look at another report it says "Did not search any device configs, no devices were selected." which I know is not true as I have run these reports before this new issue started.


              The delay in getting assistance is crushing from where I sit.

            • Re: Compliance report stuck in cashing
              nathanscott

              Did you ever resolve the issue with the Compliance Report stuck in "caching"?  My report just hangs in "caching" when trying to update.

                • Re: Compliance report stuck in cashing
                  foonly

                  This happened to me the other day, and this fix worked for me - truncating 2 tables:

                   

                  Re: Compliance Policy Reports do not run in NPM

                   

                  Since the time that was written, the NCM database was merged into the NPM database, and the table names changed. So the queries are a little different:

                   

                  - Truncate Table NCM_PolicyCache
                  - Truncate Table NCM_PolicyCacheResults

                   

                  [edit]:

                   

                  Oh, and the services are all different now, so I shut down everything and restarted it. I hate when I have to do that.

                   

                  =Foon=

                    • Re: Compliance report stuck in cashing
                      CourtesyIT

                      Yes, I know that happens from time to time and it would be nice if there was a timeout feature or fail out feature associated with it.  Here is how I clear it.

                       

                      1.  Log on to Solarwinds Server locally.

                      2.  Start > Solarwinds Orion > Advanced Features > Database Manager

                      3.  Add Server >> your Solarwinds Server

                      4.  Expand the Database and scroll down to > NCMPolicyCache

                      5.  Double click and "Execute Query"

                      6.  Click the "Edit Table" button next to Execute Query

                      7.  Right click on line entry and delete.

                      8.  Run Configuration Wizard and select only the "Database Option"

                      9.  You may need to bounce the server from time to time but should not be often.

                       

                      Or, if some smart programmer can come up with a script to do all this that would be great.

                       

                      Thanks,

                      Courtesyit

                    • Re: Compliance report stuck in cashing
                      just4now88

                      I had this happen to me as well. The root cause was a report that was caching forever. On the Solarwinds server,

                      - I opened the Database Manager and expanded Solarwinds Orion -> NCM_Policy reports.

                      - Execute the query attached to "NCM_Policy reports".

                      -In the CacheStatus column, I searched for the report with a status that is not "0" or "3". I found the culprit, it had a status of 2 and the name matched the report that was caching forever.

                      - I enabled table editing and changed the status to 0, then hit enter.

                      - Back on the web portal, the policy caching has stopped and I was able to delete the annoying report.

                      Problem resolved.

                      5 of 5 people found this helpful
                    • Re: Compliance report stuck in cashing
                      CourtesyIT

                      which reports are getting "Stuck" in cacheing.

                        • Re: Compliance report stuck in cashing
                          ecklerwr1

                          For me it's some compliance ones... ones in Cisco Folder named Tenable.

                          I'm running NCM 7.4.1 and the only way I've been able to fix is to manually edit the database table NCM_Policy reports and change the caching status for the report from 2 to 0 in the database table to get it unstuck.  I have a case #1075066.  Does anyone know what really is causing this?  I'm on the phone with support and they said something about bug in regex or indexing as two reasons caching could get stuck.  The real problem with this is it stops all of your other compliance reports from running which is really bad.  Also you can't do anything with any of the other reports until I edit the table.  This has happened with more than one report.  Apparently there's a way to isolate which rule is having regex problems..  According to SW it's not a bug in the product but how it's being used??? We'll see support is supposed to be mailing me some process to try.

                        • Re: Compliance report stuck in cashing
                          krishnamishra0786

                          Hi,

                           

                          if i disable the same compliance report, then it can help, but is really hard to find the root cause, how we can immidiate stop and start,

                          please advice if any one got any update for this issue.

                           

                          Thanks

                          K

                            • Re: Compliance report stuck in cashing
                              ecklerwr1

                              I had this happen to me as well. The root cause was a report that was caching forever. On the Solarwinds server,

                               

                              - I opened the Database Manager and expanded Solarwinds Orion -> NCM_Policy reports.

                               

                              - Execute the query attached to "NCM_Policy reports".

                               

                              -In the CacheStatus column, I searched for the report with a status that is not "0" or "3". I found the culprit, it had a status of 2 and the name matched the report that was caching forever.

                               

                              - I enabled table editing and changed the status to 0, then hit enter.

                               

                              - Back on the web portal, the policy caching has stopped and I was able to delete the annoying report.

                               

                              Problem resolved.

                               

                              We really need some button inside NCM or some timeout or something that will break hangup though... when this happens until doing something like above (the easiest).  I didn't even have to shut down any of the services.  The huge problem with this is NONE of your compliance reports run while it's stuck like this!!!