cancel
Showing results for 
Search instead for 
Did you mean: 
Highlighted
Level 10

12.0.1 running out of memory

Jump to solution

Anyone else seeing this?

I'm seeing the the 'SolarWinds Information Service V3' service balloon in memory usage 8.7GB and runs the server out of memory and everything crashes. Reboot the server and then it happens again, over and over all day long so far today. Last night I applied HotFix 1 for 12.0.1 and ran well over night. When people are in Orion working during the day it does this. Overnight it seems to run just fine when people are not using the system.

Where do I even start to troubleshoot this?

Running NPM 12.0.1 and SAM 6.3

Server 2012 R2

VM on VMware

12GB RAM

4vCPU

Tags (2)
1 Solution

Accepted Solutions
Highlighted
Level 10

Re: 12.0.1 running out of memory

Jump to solution

Support came back with this answer:

------------------------------------------------

The steps are below.

Enable schema caching.

1. Find this file, C:\inetpub\SolarWinds\web.config.

2. Add this key inside the web.config <appSettings> sections(If the key already exists just change the value):

<add key="SwisEntityMacroParserPluginCacheEnabled" value="True" />

3. Hopefully this will enable schema caching which we are using for alerting service.

4. Next Open this file SolarWinds.InformationService.ServiceV3.exe.config

- Should be located in C:\Program Files (x86)\Common Files\Solarwinds\Information Service\V3.

5. Add this key to SolarWinds.InformationService.ServiceV3.exe.config inside <runtime> section (If the key already exists just change the value):

<gcServer enabled="true" />

6. Restart IIS (IISRESET) and SWISv3 to take effect.

----------------------------------------------------

I've implemented this on our server. We'll see how it holds up tomorrow when people are back in the Orion console.

View solution in original post

13 Replies
Highlighted
Level 12

Re: 12.0.1 running out of memory

Jump to solution

Weird. I can say that our deployments are nearly identical and I'm only seeing ~320 MB of memory in use right now. Same versions of both products and a similar VMWare setup. Did it start happening right after an upgrade, or kind of out of the blue? Maybe if you re-run the configuration wizard (if you can do so), otherwise you might have to schedule that.

0 Kudos
Highlighted
Level 10

Re: 12.0.1 running out of memory

Jump to solution

Its been happening since we went to version 12.

After a reboot that service is around 261.7MB for a bit then it takes off and balloons and crashes quickly to where it takes the services down so we don't get a high memory usage alarm from the system.

0 Kudos
Highlighted
Level 14

Re: 12.0.1 running out of memory

Jump to solution

Raise a support case, Harry Griffiths (SolarWinds Application Engineer) has identified the problem and has a fix.

This problem killed our upgrade a few weeks ago and ended in a rather hasty rollback.

The case number, with the fix in it was #1079283 "Orion very slow after upgrade, many elements not being displayed".

0 Kudos
Highlighted
Level 10

Re: 12.0.1 running out of memory

Jump to solution

Thanks yaquaholic​ I opened a case with that info. Hopefully they'll have some good news for me.

0 Kudos
Highlighted
Level 17

Re: 12.0.1 running out of memory

Jump to solution

Please reply back with results mjsweet130

0 Kudos
Highlighted
Level 10

Re: 12.0.1 running out of memory

Jump to solution

Support came back with this answer:

------------------------------------------------

The steps are below.

Enable schema caching.

1. Find this file, C:\inetpub\SolarWinds\web.config.

2. Add this key inside the web.config <appSettings> sections(If the key already exists just change the value):

<add key="SwisEntityMacroParserPluginCacheEnabled" value="True" />

3. Hopefully this will enable schema caching which we are using for alerting service.

4. Next Open this file SolarWinds.InformationService.ServiceV3.exe.config

- Should be located in C:\Program Files (x86)\Common Files\Solarwinds\Information Service\V3.

5. Add this key to SolarWinds.InformationService.ServiceV3.exe.config inside <runtime> section (If the key already exists just change the value):

<gcServer enabled="true" />

6. Restart IIS (IISRESET) and SWISv3 to take effect.

----------------------------------------------------

I've implemented this on our server. We'll see how it holds up tomorrow when people are back in the Orion console.

View solution in original post

Highlighted
Level 17

Re: 12.0.1 running out of memory

Jump to solution

mjsweet130​ did that clear your issue up?  Thx

0 Kudos
Highlighted
Level 10

Re: 12.0.1 running out of memory

Jump to solution

njoylif​ Yesterday was the first day we were back in the GUI. It held up yesterday without fail. Hopefully it will continue to work and that was our fix.

Highlighted
Level 9

Re: 12.0.1 running out of memory

Jump to solution

I am having the same problem now with NPM version 12.0. The solarwinds information service v3 will suddenly start using up around 3gb memory per minute until it maxes out all of the available memory.

This is happening on our main poller and web server which has 64gb ram, so the information service v3 will use ALL of this. Only way for me to fix this at the moment is to restart the information service.

Support already sent the fix to the web.config file above, but this hasn't made any difference.

It's very frustrating as solarwinds is unusable until I resart the information service. Spent 2 1/2 hours on the phone with support yesterday, but still have the problem.

0 Kudos