I have a few questions, mostly just best practices or recommendation questions.
I have (for example):
NPM 9.5.1 with APM
10 load-balanced web servers - Windows Server 2003, IIS6
5 web applications named as distinct application pools in IIS (apool1, apool2...)
I can successfully monitor the pools individually, so this isn't a bug or technical issue. Yay!
1. While I have 10 web servers, I don't always have all 5 applications sent to all 10 web servers at any given time. Often, apool1 is pretty busy so it gets sent across 5 servers. But sometimes apool2 is not so busy, so I drop it down to just 2 web servers. This means if I monitor apool1 and apool2 across all 10 web servers, I'm going to get alerts from the servers that aren't actively hosting those apps. This is fairly dynamic and I do change them pretty often. Any suggestions? In my case, due to the way I manage my apps across the web servers, so far I permanently have yellow colors across all my web servers because at least one apool monitor is not applicable to that server at the present time.
2. My next question is the same setup, but what do I do at 2am when my web servers are not getting much traffic and the application pools naturally recycle or shut off. I don't really care about the up/down of these individual pools, but I do care about their performance or lackthereof historically, i.e. I want to know how heavy they run when they are running. Is there a way I can turn off the up/down monitoring so I don't see unnecessary red or yellow every night? Let's pretend that any true outages where an application pool screws up and crashes is covered with event log monitoring and other uptime monitoring of the web site itself.
3. More generically, does anyone else have any insight on monitoring IIS app pools like this? Should I have individual application monitors in the APM for each pool, or one aggregate application monitor with 5 components? Or maybe 6 components and include an overall w3wp.exe monitor so I get an idea of the total load?
This may end up diving deeply into the best way to organize my app monitors in the APM, and that's ok. I'm pretty flexible!