10 Replies Latest reply on Jul 5, 2018 4:05 AM by yaquaholic

    Group Member Added/Removed Frequently??

    blueyviii

      I've noticed recently that one of our SolarWinds groups keep regularly losing and gaining a member, but I don't know why this is. Is there anyway to ascertain which member(s) are getting added/lost to try and figure out what is happening. This is happening when I'm confident there are no new nodes being added or removed on the system.

       

      Any ideas? Could this be a bug? The behavior started about a week ago (I suspect after I applied the latest HF bundle) but none of our other groups are doing this....

       

        • Re: Group Member Added/Removed Frequently??
          yaquaholic

          Hi blueyviii

           

          How did you define the group?

          Is it a static or dynamic assignment? 

          • Re: Group Member Added/Removed Frequently??
            blueyviii

            Is there a way to see which node(s) is getting added/removed?? I'm pretty sure If I can figure that out I can solve the problem...

              • Re: Group Member Added/Removed Frequently??
                yaquaholic

                If you were to view the group, in say Manage Nodes and ensure you refresh the screen every 30-45 minutes, it should be obvious.

                You could also create a report to list the group members and run it every 30-45 minutes with a schedule, until you catch it.

                 

                I did a search of my Orion databases events and auditevents tables, and then added and removed a few devices to a group or two, but all I could see was that the group had lost/gained members not actual device details.

              • Re: Group Member Added/Removed Frequently??
                blueyviii

                OK, I've now found the server that is repeatedly being removed/added but I can't see any reason for it. The server had been constantly available, and if I check the node it has a 100% availability???

                 

                Any ideas?

                  • Re: Group Member Added/Removed Frequently??
                    yaquaholic

                    Good news on finding the culprit, but I have no idea without seeing how the query is built

                    Can you screenshot (obscuring anything sensitive) or at least break down in words the Dynamic Query(ies) the group uses ?

                     

                    And the Group notifications you are seeing, aren't node down events, they are Audit Events. If the node had gone down, you may well have seen the Group go into a warning state (depending on your status propagation setup), but these would be seen in the Events table, not the Auditing one.

                    .

                    It is the group definition that define what is in the group, so there must be something in the definition which is not static, on that device.

                    At times the node qualifies to be in the group, and at others it doesn't.

                    And not to forget, this could still be a bug, have you raised a support call with Customer Support?

                     

                     

                    On a side note, here's some SQL if you want to have have look at your database audit table, to get you started.

                     

                    SELECT TOP (250) AE.TimeLoggedUtc

                          ,AE.AccountID

                          ,AAT.ActionTypeDisplayName

                          ,AE.ActionTypeID

                          ,AE.AuditEventMessage

                          ,AE.NetworkNode

                          ,AE.NetObjectID

                          ,AE.NetObjectType

                      FROM AuditingEvents AE

                    INNER JOIN AuditingActionTypes AAT ON AAT.ActionTypeID = AE.ActionTypeID

                    ORDER BY AE.TimeLoggedUtc DESC

                     

                     

                    The ActionTypeIDs you might be interested in are:

                       

                    ActionTypeIDActionTypeActionTypeDisplayName
                    19Orion.GroupAddedGroup added
                    20Orion.GroupDeletedGroup deleted
                    21Orion.GroupChangedGroup edited
                    22Orion.ContainerMemberDefinitionAddedGroup Member Definition added
                    23Orion.ContainerMemberDefinitionDeletedGroup Member Definition deleted
                    24Orion.ContainerMemberDefinitionChangedGroup Member Definition changed
                      • Re: Group Member Added/Removed Frequently??
                        blueyviii

                        The Node itself is behaving perfectly, but for some reason it's still getting added/removed from the Group. The Dynamic Group query is really simple and consists only of Vendor=Windows and SystemName contains "SRVPROD" There are 49 other members found by the dynamic query but only this 1 particular server is exhibiting this behaviour.

                         

                        I deleted the node and the re-added it about 90 mins later. The  dynamic query picked up the server and added to the group within 30 secs. But after around an hour it was removed, and then re-added 15 minutes later!!

                         

                        In the end I got so frustrated I just manually assigned this particular node to the group and it hasn't been removed/re-added since!! I'm happy with the workaround for now but would be an issue if it starts happening to more groups/nodes. I've been monitoring other groups and none of them are showing this behaviour...