I am having issues where the netflow service crashes all the time. What seems to happen is I get a ton of "System.OutOfMemoryException" errors in the event log followed by the service crash.
Event Type: Error
Event Source: NetFlowService
Event Category: None
Event ID: 0
Date: 10/12/2008
Time: 11:12:37 PM
User: N/A
Computer: BCOLSW01
Description:
Exception: error occurred during packet processing. Exception of type 'System.OutOfMemoryException' was thrown.
For more information, see Help and Support Center at go.microsoft.com/.../events.asp.
The I will see something like:
Event Type: Error
Event Source: .NET Runtime 2.0 Error Reporting
Event Category: None
Event ID: 5000
Date: 10/12/2008
Time: 11:16:17 PM
User: N/A
Computer: BCOLSW01
Description:
EventType clr20r3, P1 netflowservice.exe, P2 3.0.0.184, P3 480e2418, P4 solarwinds.orion.common, P5 2.0.0.0, P6 480e2421, P7 39, P8 22, P9 system.outofmemoryexception, P10 NIL.
For more information, see Help and Support Center at go.microsoft.com/.../events.asp.
Data:
0000: 63 00 6c 00 72 00 32 00 c.l.r.2.
0008: 30 00 72 00 33 00 2c 00 0.r.3.,.
0010: 20 00 6e 00 65 00 74 00 .n.e.t.
0018: 66 00 6c 00 6f 00 77 00 f.l.o.w.
0020: 73 00 65 00 72 00 76 00 s.e.r.v.
0028: 69 00 63 00 65 00 2e 00 i.c.e...
0030: 65 00 78 00 65 00 2c 00 e.x.e.,.
0038: 20 00 33 00 2e 00 30 00 .3...0.
0040: 2e 00 30 00 2e 00 31 00 ..0...1.
0048: 38 00 34 00 2c 00 20 00 8.4.,. .
0050: 34 00 38 00 30 00 65 00 4.8.0.e.
0058: 32 00 34 00 31 00 38 00 2.4.1.8.
0060: 2c 00 20 00 73 00 6f 00 ,. .s.o.
0068: 6c 00 61 00 72 00 77 00 l.a.r.w.
0070: 69 00 6e 00 64 00 73 00 i.n.d.s.
0078: 2e 00 6f 00 72 00 69 00 ..o.r.i.
0080: 6f 00 6e 00 2e 00 63 00 o.n...c.
0088: 6f 00 6d 00 6d 00 6f 00 o.m.m.o.
0090: 6e 00 2c 00 20 00 32 00 n.,. .2.
0098: 2e 00 30 00 2e 00 30 00 ..0...0.
00a0: 2e 00 30 00 2c 00 20 00 ..0.,. .
00a8: 34 00 38 00 30 00 65 00 4.8.0.e.
00b0: 32 00 34 00 32 00 31 00 2.4.2.1.
00b8: 2c 00 20 00 33 00 39 00 ,. .3.9.
00c0: 2c 00 20 00 32 00 32 00 ,. .2.2.
00c8: 2c 00 20 00 73 00 79 00 ,. .s.y.
00d0: 73 00 74 00 65 00 6d 00 s.t.e.m.
00d8: 2e 00 6f 00 75 00 74 00 ..o.u.t.
00e0: 6f 00 66 00 6d 00 65 00 o.f.m.e.
00e8: 6d 00 6f 00 72 00 79 00 m.o.r.y.
00f0: 65 00 78 00 63 00 65 00 e.x.c.e.
00f8: 70 00 74 00 69 00 6f 00 p.t.i.o.
0100: 6e 00 20 00 4e 00 49 00 n. .N.I.
0108: 4c 00 0d 00 0a 00 L.....
The service will attempt to restart and it will fail. I discover that the service has crashed only when someone complains that netflow data is missing or I log in int he morning to check it. I am missing huge chunks of data because of this and management isn't exactly happy with me as we just spent a whole lot of money on upgrades. We are planning on replacing our DB server with better hardware but I don't see why a struggling DB server would cause the service to crash on a separate machine. I really need to stabling this service. Help!
Orion is running on Dual Core AMD 1.8 Ghz (blade server) with 8 GB RAM. Windows 2003 Standard SP2 and DB server is separate box. Running Orion 9.1, Netflow sp4.
