14 Replies Latest reply on Jan 6, 2009 9:26 AM by Andy McBride

    Netflow Service constantly crashing

    pguenther

      I am having issues where the netflow service crashes all the time. What seems to happen is I get a ton of "System.OutOfMemoryException" errors in the event log followed by the service crash.

       

      Event Type:    Error
      Event Source:    NetFlowService
      Event Category:    None
      Event ID:    0
      Date:        10/12/2008
      Time:        11:12:37 PM
      User:        N/A
      Computer:    BCOLSW01
      Description:
      Exception: error occurred during packet processing. Exception of type 'System.OutOfMemoryException' was thrown.

      For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.

       The I will see something like:

       

      Event Type:    Error
      Event Source:    .NET Runtime 2.0 Error Reporting
      Event Category:    None
      Event ID:    5000
      Date:        10/12/2008
      Time:        11:16:17 PM
      User:        N/A
      Computer:    BCOLSW01
      Description:
      EventType clr20r3, P1 netflowservice.exe, P2 3.0.0.184, P3 480e2418, P4 solarwinds.orion.common, P5 2.0.0.0, P6 480e2421, P7 39, P8 22, P9 system.outofmemoryexception, P10 NIL.

      For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
      Data:
      0000: 63 00 6c 00 72 00 32 00   c.l.r.2.
      0008: 30 00 72 00 33 00 2c 00   0.r.3.,.
      0010: 20 00 6e 00 65 00 74 00    .n.e.t.
      0018: 66 00 6c 00 6f 00 77 00   f.l.o.w.
      0020: 73 00 65 00 72 00 76 00   s.e.r.v.
      0028: 69 00 63 00 65 00 2e 00   i.c.e...
      0030: 65 00 78 00 65 00 2c 00   e.x.e.,.
      0038: 20 00 33 00 2e 00 30 00    .3...0.
      0040: 2e 00 30 00 2e 00 31 00   ..0...1.
      0048: 38 00 34 00 2c 00 20 00   8.4.,. .
      0050: 34 00 38 00 30 00 65 00   4.8.0.e.
      0058: 32 00 34 00 31 00 38 00   2.4.1.8.
      0060: 2c 00 20 00 73 00 6f 00   ,. .s.o.
      0068: 6c 00 61 00 72 00 77 00   l.a.r.w.
      0070: 69 00 6e 00 64 00 73 00   i.n.d.s.
      0078: 2e 00 6f 00 72 00 69 00   ..o.r.i.
      0080: 6f 00 6e 00 2e 00 63 00   o.n...c.
      0088: 6f 00 6d 00 6d 00 6f 00   o.m.m.o.
      0090: 6e 00 2c 00 20 00 32 00   n.,. .2.
      0098: 2e 00 30 00 2e 00 30 00   ..0...0.
      00a0: 2e 00 30 00 2c 00 20 00   ..0.,. .
      00a8: 34 00 38 00 30 00 65 00   4.8.0.e.
      00b0: 32 00 34 00 32 00 31 00   2.4.2.1.
      00b8: 2c 00 20 00 33 00 39 00   ,. .3.9.
      00c0: 2c 00 20 00 32 00 32 00   ,. .2.2.
      00c8: 2c 00 20 00 73 00 79 00   ,. .s.y.
      00d0: 73 00 74 00 65 00 6d 00   s.t.e.m.
      00d8: 2e 00 6f 00 75 00 74 00   ..o.u.t.
      00e0: 6f 00 66 00 6d 00 65 00   o.f.m.e.
      00e8: 6d 00 6f 00 72 00 79 00   m.o.r.y.
      00f0: 65 00 78 00 63 00 65 00   e.x.c.e.
      00f8: 70 00 74 00 69 00 6f 00   p.t.i.o.
      0100: 6e 00 20 00 4e 00 49 00   n. .N.I.
      0108: 4c 00 0d 00 0a 00         L..... 

       The service will attempt to restart and it will fail. I discover that the service has crashed only when someone complains that netflow data is missing or I log in int he morning to check it. I am missing huge chunks of data because of this and management isn't exactly happy with me as we just spent a whole lot of money on upgrades. We are planning on replacing our DB server with better hardware but I don't see why a struggling DB server would cause the service to crash on a separate machine. I really need to stabling this service. Help!

      Orion is running on Dual Core AMD 1.8 Ghz (blade server) with 8 GB RAM. Windows 2003 Standard SP2 and DB server is separate box. Running Orion 9.1, Netflow sp4.