Error in Sam.Adm.BusinessLayer.log file.

Question

Has anyone else run across this error and know how to fix it?

2019-07-22 07:17:47,760 [44] ERROR SolarWinds.Orion.Core.Common.MessageUtilities - Exception caught in method ProcessInventoryResult

System.Data.SqlClient.SqlException (0x80131904): The MERGE statement attempted to UPDATE or DELETE the same row more than once. This happens when a target row matches more than one source row. A MERGE statement cannot UPDATE/DELETE the same row of the target table multiple times. Refine the ON clause to ensure a target row matches at most one source row, or use the GROUP BY clause to group the source rows.

at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)

at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)

at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)

at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)

at System.Data.SqlClient.SqlDataReader.TryHasMoreRows(Boolean& moreRows)

at System.Data.SqlClient.SqlDataReader.TryReadInternal(Boolean setTimeout, Boolean& more)

at System.Data.SqlClient.SqlDataReader.Read()

at System.Data.Common.DataAdapter.FillLoadDataRow(SchemaMapping mapping)

at System.Data.Common.DataAdapter.FillFromReader(DataSet dataset, DataTable datatable, String srcTable, DataReaderContainer dataReader, Int32 startRecord, Int32 maxRecords, DataColumn parentChapterColumn, Object parentChapterValue)

at System.Data.Common.DataAdapter.Fill(DataSet dataSet, String srcTable, IDataReader dataReader, Int32 startRecord, Int32 maxRecords)

at System.Data.Common.DbDataAdapter.FillInternal(DataSet dataset, DataTable[] datatables, Int32 startRecord, Int32 maxRecords, String srcTable, IDbCommand command, CommandBehavior behavior)

at System.Data.Common.DbDataAdapter.Fill(DataSet dataSet, Int32 startRecord, Int32 maxRecords, String srcTable, IDbCommand command, CommandBehavior behavior)

at System.Data.Common.DbDataAdapter.Fill(DataSet dataSet)

at SolarWinds.Orion.Common.SqlHelper.ExecuteDataSet(SqlCommand command, SqlConnection connection, SqlTransaction transaction)

at SolarWinds.Orion.Sam.Adm.BusinessLayer.DataProcessing.DALs.SqlDataHelper.ExecuteStoredProcedureAndGetResults(String storedProcedureName, SqlParameter[] parameters)

at SolarWinds.Orion.Sam.Adm.BusinessLayer.DataProcessing.DALs.ApplicationTcpConnectionDal.Merge(DataTable dataTable)

at SolarWinds.Orion.Sam.Adm.BusinessLayer.DataProcessing.Managers.ApplicationTcpConnectionManager.HandleApplicationTcpConnectionsInSwis(ExistingDependencyData existingDependencyData, IEnumerable`1 clientServerConnections, DateTime pollTime)

at SolarWinds.Orion.Sam.Adm.BusinessLayer.DataProcessing.Managers.DependencyDataManager.CreateDependencies(IEnumerable`1 dependencyDataList)

at SolarWinds.Orion.Sam.Adm.BusinessLayer.DataProcessing.AppCorrelation.NewInventoryUnhandled(Int32 nodeId, String ipAddress, Inventory inventory, DateTime pollTime)

at SolarWinds.Orion.Sam.Adm.BusinessLayer.DataProcessing.AppCorrelation.NewInventory(AdmJobResult admJobResult)

at SolarWinds.Orion.Sam.Adm.BusinessLayer.BusinessLayerService.ProcessInventoryResult(AdmJobResult admJobResult)

ClientConnectionId:f16c4b32-11bf-4fa0-9bd8-de5ab2e23138

Error Number:8672,State:1,Class:16

jfaldmo · Accepted Answer

There was a similar stack trace next, to the one I already posted, that showed an IP address it was choking on. I believe I resolved this by doing two things--

1. Removed duplicate node information. I'm not sure which one of these actions helped, but I think it was an incorrect interface associated with the node. There were two interfaces with the same information, from what I could tell, one that was active and one that was unknown. I deleted the interface that was unknown.

Somehow I found about 10 nodes that had duplicate IPs of other nodes. The IP was the one the Poller was assigned to poll so I reassign it to the accurate IP and ran rediscover.

2. I disabled the Automatic dependency discovery, got busy with something else for a little while, then came back and enabled it.

After that I haven't seen this error.