Sudden increase in Memory Consumption by Polling Engines

We upgraded from 2022.2.6 to 2023.1 around February 15th last month. I've noticed since about 20 days after that all of my APEs are consuming 98% memory and I am having rolling blackouts for 10-20 minutes per poller. No other change to the systems has occurred and it only seems to be the SW Pollers having his issue. I'm worried that the upgrade introduced some code that has memory leaking. Is anyone else having this issue? Case # - 01305923 Polling engines suffering from rolling blackouts. If I'm lucky I can remote to the Poller and it will respond. Pollers are 14CPU with 24gig memory Windows 2016

ALERT: Orion Polling Engine POLL15PRD at 10.xxx.xxx.xxx has not updated in 3/20/2023 5:40:05 AM minutes.
RESET: Orion Polling Engine POLL15PRD at 10.xxx.xxx.xxx was last updated 3/20/2023 6:36:56 AM minutes ago.

Poller: POLL15PRD

Engine ID: 16

Last KeppAlive: 3/20/2023 5:40:05 AM

Version: SolarWinds Platform 2023.1.0.196

Type: AdditionalPoller

Top Replies

umutdedeoglu 5 months ago in reply to jameslindsay +1

Thank you for the quick answer, cheers!

Parents

0 bmrad over 1 year ago

Has this problem been resolved? If you have opened a ticket with support, please share the number here.

Note that 2023.1.1 (SR) and 2023.2 RC have been released. I don't see a fix that aligns to this problem.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 jameslindsay over 1 year ago in reply to bmrad

Case number is mentioned above. We were not able to isolate the symptoms well enough to say it had anything to do with the upgrade. After a couple of reboots the APEs and AWE seem to be behaving themselves. In another twist we activated our HCO licenses and got another significant jump in memory consumption, but it has leveled off without any serious impacts.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 bmrad over 1 year ago in reply to jameslindsay

Thanks, missed the case number above.

After applying your HCO license (assuming you were moving from modules to HCO), did you add additional monitoring?
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 jameslindsay over 1 year ago in reply to bmrad

Some modules within the HCO bundle became enabled such as VMAN, SCM, and LA. In that sense yes. For example, with the Vman module enabled, we went from around 80 active alerts to 700.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Reply

0 jameslindsay over 1 year ago in reply to bmrad

Some modules within the HCO bundle became enabled such as VMAN, SCM, and LA. In that sense yes. For example, with the Vman module enabled, we went from around 80 active alerts to 700.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Children

No Data