Last week I noticed some of the alerts were not coming through. Then I noticed one of the reports wasn't refreshing its data. Testing the custom pollers with the Universal Device Poller gave the expected results. Then I noticed the Last Database Syncs on the Polling Engines page were HUGE numbers.
Somehow, the system datetime changed on two VMs (the third VM on that blade did not change) to August 21, 2011. One machine was my main SolarWinds server. The other was an additional poller.
I've reset the system dates on those machines, removed any 2011 poller results I could find, and restarted the services on all machines. Things still are not back to normal. One of my poller charts updated once this weekend instead of once every 30 minutes. Testing an email alert shows ${CustomPollerStatus.Rate} as if it were text instead of a variable, and the actual alert has not come through yet.
Any clue what I need to do to get this straightened out?