We have a Load Balancer in front of our Orion web servers (2 Web servers + 2 Core servers in HA) all pointing to a single SQL Server. Everything has been running mostly fine, but over the last weeks we’ve started seeing some pretty serious performance issues that we haven’t been able to pin down yet.
Here’s what we’re seeing:
- SQL queries taking 70–80+ seconds
- Frequent CryptographicException events on all Web servers (around ~70 per server per day)
- Database Maintenance taking about 1h 22m
- Information Service timeouts
- Occasional drops in platform availability
While going through the web.config on all Web servers, we noticed this setting:
<machineKey decryptionKey="AutoGenerate" validationKey="AutoGenerate" />
According to Microsoft’s documentation, this might not be ideal in a load-balanced environment, since each server would be generating its own key. I couldn’t find anything in the SolarWinds docs mentioning this specifically, so I’m not sure if this is expected behavior or something we should change.
My questions for the community:
- In a load-balanced Orion setup, should the Web servers have a static machineKey instead of AutoGenerate?
- Has anyone seen performance issues or strange behavior caused by this?
- Is there any official guidance from SolarWinds on machineKey configuration?
- Could this AutoGenerate setup be putting extra load on SQL or contributing to the slowdowns?
Any feedback or experience would be appreciated. Thanks.