We are currently showing a SAM polling rate of 95% on one of our additional polling servers. Generally we rebalance the load to keep them lower but I figured I'd use this as an opportunity to look at exactly what is going on with this.
Resource-wise, this polling server has 8 Cores and 16GB and is showing 38% CPU usage and 49% memory usage. Network traffic is averaging around 10MBPS Send, 15MBPS Receive so that is not saturated at all. Highest process using memory is the SolarWinds.Collector.Service with 1.5GB CPU is mostly idle (63% on average).
It would seem that the SAM polling rate is not affected by resource availability since the server has quite a lot of excess capacity but the SAM polling rate is still at 95%.
For the WPM Players we have been able to adjust the settings to allow for far more synthetic transactions per player then it could support out of the box by adding threads and using more server resources. Are there any settings that would allow us to increase resources available to SAM and therefore increase the SAM polling rate? We do not want to cut the current monitoring levels to reduce the polling rate which is really what most of the solutions I have read are. We currently have 8 additional polling servers on this instance and will probably be adding a couple more in the next few months so we are trying to get the best utilization of resources we can, so if we can scale up the polling servers to use additional resources that is a big help.
If not, I will probably decrease the CPU core count and memory at the next upgrade since it is mostly idle since it is a waste of resources to have these polling servers overbuilt if they are maxed out in what they can do with half the resources.
Any ideas on this would be appreciated.
Thanks
-Jim