To begin:
I already have a Orion Ticket opened, with diagnostics dump submitted.
Any helpful feedback-useful comments from 'thwack_' are appreciated.
I have inherited an Orion NPM v10 install and am coming up to speed. The alerts for our monitored nodes has recently failed to generate the email alerts to the events.
I have stopped\started the Alert Service.
I have removed from alerting the main alerting item and added it back.
I am seeing problems in the host server event logs.
My first cut is to address the (not all inclusive) reported errors in the server program logs at
Computer Management
System tools
Event Viewer
SolarWinds.net
like these:
Event Type: Warning
Event Source: TrapService
Event Category: None
Event ID: 1024
Date: 7/27/2010
Time: 12:28:58 PM
User: N/A
Computer: OrionInstance
Description:
ManagedNodeState.AddNewNode()
Error getting node from Nodes table!
Error Details -System.ArgumentException: An item with the same key has already been added.
at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
at System.Collections.Generic.Dictionary`2.Add(TKey key, TValue value)
at SWTrapService.ManagedNodeState.AddNewNode(String ip)
Event Type: Error
Event Source: AlertingEngine
Event Category: None
Event ID: 0
Date: 7/23/2010
Time: 1:02:21 AM
User: N/A
Computer: OrionInstance
Description:
2010-07-23 01:02:21,772 [MainTaskThread] ERROR All - Error in SetupDBConnection System.Data.SqlClient.SqlException: A transport-level error has occurred when sending the request to the server. (provider: TCP Provider, error: 0 - An existing connection was forcibly closed by the remote host.)
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParserStateObject.WriteSni()
at System.Data.SqlClient.TdsParserStateObject.WritePacket(Byte flushMode)
at System.Data.SqlClient.TdsParserStateObject.ExecuteFlush()
at System.Data.SqlClient.TdsParser.TdsExecuteRPC(_SqlRPC[] rpcArray, Int32 timeout, Boolean inSchema, SqlNotificationRequest notificationRequest, TdsParserStateObject stateObj, Boolean isCommandProc)
at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)
at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)
at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior)
at AlertingEngine.SWAlertingEngine.SetupDBConnection(SqlConnection& DBConnection, SqlCommand& DBCommand, SqlDataReader& DBReader.