Hey all, first time posting here, let me know if you need any other information(or if there's too much, I honestly don't know). Little background - I manage an enterprise SW implementation with around 2k server nodes, mostly Windows that are polled via WMI in SAM. Version is 2020.2.6 HF2. All of our SW environment was on Windows Server 2012 until last week. We have a primary poller and 3 APEs, along with a web server and SQL server. Due to being on the outdated version, we're trying to upgrade and SW support told us to upgrade off 2012 first as that's no longer supported by SW. Last week we updated all of our servers (all on prem) to Windows Server 2019 and after the upgrade we're seeing that on the APEs about half the nodes are showing the NIC either grey or not there anymore in Node Management and they can't connect to the APEs at all, but they can connect to the primary polling engine. The rest are connecting to the APE without issue. I've been troubleshooting the last few days trying to figure out the issue, SW support suggested it's a WMI issue on the servers the APEs are on, which to me, that tracks, but unsure why only half the nodes are experiencing issues.
Here's a screenshot of some of the nodes with the issue, the impacted nodes all have their NIC showing in an unknown state or are just not there at all anymore and WMI connection test fails in Edit Node and if you delete the node and try to re-add it, but it can be re-added via WMI to the primary polling engine:
Meanwhile other nodes on the same APE are working just fine:
When I log into the server and run wbemtest to the nodes failing, it fails, but it goes through just fine on the one connecting:
Node from above that is connecting through the web console showing 'Test Successful':
Node showing Test Failed:
If I check the WMI service on the example server that is failing above, it's up and working:
All that's changed was the upgrade to Windows Server 2019 and these nodes that are having issues were connecting just fine prior to the upgrade. While they're like this, they show green like they're polling but I have no idea if that's actually the case. Anyone see anything like this before or know where I can look next? One last thing I noticed is that on one of the APEs, the network icon shows "No Internet Access" in the system tray, but the others don't and they're all having the same issue:
