Hello all,
I am having an extremely annoying issue im hoping someone can help me isolate and repair. We installed orion NPM a few weeks ago and at this time have very basic alerts with email notifications being sent. These include node down, interface down, high packet loss, high reponse time, and node reboot notifications. All of these have been working as expected since we configured them and no changes have been made to NPM or any alerting in the past week or two.
This morning when i got up i had about 250 email tickets basically saying every node on our network had rebooted, all of which were false. i acknowledged the alerts and they still kept coming in so i removed the alert all together and once again acknowledged all outstanding events and alerts. Unfortunately this didnt help at all with the false notification flooding. Now i am getting a nonstop stream of blank orion alerts. They have blank subject and bodies and are coming in at an alarming rate. The NPM is not showing any alerts or events that would trigger any email notifications at all. Our admin is current on honeymoon so i dont have a lot of in house help to isolate this. I have restarted all orion services and acknowledged all pending alerts and events and still no improvement. This is a major nuisance that is flooding all employee inboxes and blackberrys which is no doubt costing us money as well.
Any pointers on what to look for would be greatly appreciated, without a subject or any properties in the email body it has been difficult for me to diagnose. Thanks in advance for any assistance provided...