cancel
Showing results for 
Search instead for 
Did you mean: 
Create Post
Level 7

"Flapping" Agent becoming Available and Unavailable constantly

Ever since I upgraded from Orion 10.7 to 11.1 Yesterday, our main Agent (The one solarwinds is hosted on) has been reportedly becoming unavailable and available constantly. I have attempted to restart the services and reboot the server, and I have had no luck. I have not seen anyone else with this issue, and I am unsure of what to try next.

Capture.PNG

Labels (1)
0 Kudos
3 Replies
Level 17

There could be quite a few reasons why the local agent is flapping. A support case is likely the best course of action. Barring that, agent logs may be found here:

c:\ProgramData\Solarwinds\Logs\AgentManagement\
c:\ProgramData\Solarwinds\Logs\Agent\

0 Kudos

i am also facing same problem in one site. below are my logs any help much appreciated.

 

AgentUpdateStatus - Agent device ID [500ea2c7-e48e-4409-b644-ab8ed242ce12], host [AMMX-XX], AMS connected [], agent version [], update context [Disconected]
2020-10-19 08:48:38,486 [2] ERROR SolarWinds.AgentManagement.ServiceCore.AgentManagementServiceApp - Unobserved (observed=False) task exception occured. System.AggregateException: A Task's exception(s) were not observed either by Waiting on the Task or accessing its Exception property. As a result, the unobserved exception was rethrown by the finalizer thread. ---> System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'Microsoft.Owin.Host.HttpListener.RequestProcessing.OwinHttpListenerResponse'.
at Microsoft.Owin.Host.HttpListener.RequestProcessing.OwinHttpListenerResponse.ResponseBodyStarted()
at Microsoft.Owin.Host.HttpListener.RequestProcessing.ExceptionFilterStream.OneTimeCallback.TryInvoke()
at Microsoft.Owin.Host.HttpListener.RequestProcessing.ExceptionFilterStream.Write(Byte[] buffer, Int32 offset, Int32 count)
at Microsoft.AspNet.SignalR.Owin.ServerResponse.Write(ArraySegment`1 data)
at Microsoft.AspNet.SignalR.Infrastructure.BufferTextWriter.<.ctor>b__0(ArraySegment`1 data, Object state)
at Microsoft.AspNet.SignalR.Infrastructure.BufferTextWriter.ChunkedWriter.Flush(Byte[] byteBuffer, Boolean flushEncoder)
at Microsoft.AspNet.SignalR.Infrastructure.BufferTextWriter.Flush()
at Microsoft.AspNet.SignalR.Transports.ServerSentEventsTransport.WriteInit(ServerSentEventsTransport transport)
at Microsoft.AspNet.SignalR.TaskAsyncHelper.FromMethod[T1](Func`2 func, T1 arg)
--- End of inner exception stack trace ---
---> (Inner Exception #0) System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'Microsoft.Owin.Host.HttpListener.RequestProcessing.OwinHttpListenerResponse'.
at Microsoft.Owin.Host.HttpListener.RequestProcessing.OwinHttpListenerResponse.ResponseBodyStarted()
at Microsoft.Owin.Host.HttpListener.RequestProcessing.ExceptionFilterStream.OneTimeCallback.TryInvoke()
at Microsoft.Owin.Host.HttpListener.RequestProcessing.ExceptionFilterStream.Write(Byte[] buffer, Int32 offset, Int32 count)
at Microsoft.AspNet.SignalR.Owin.ServerResponse.Write(ArraySegment`1 data)
at Microsoft.AspNet.SignalR.Infrastructure.BufferTextWriter.<.ctor>b__0(ArraySegment`1 data, Object state)
at Microsoft.AspNet.SignalR.Infrastructure.BufferTextWriter.ChunkedWriter.Flush(Byte[] byteBuffer, Boolean flushEncoder)
at Microsoft.AspNet.SignalR.Infrastructure.BufferTextWriter.Flush()
at Microsoft.AspNet.SignalR.Transports.ServerSentEventsTransport.WriteInit(ServerSentEventsTransport transport)
at Microsoft.AspNet.SignalR.TaskAsyncHelper.FromMethod[T1](Func`2 func, T1 arg)<---

0 Kudos

Thank you rob, I've taken a look at the logs and have noticed a lot of errors and warnings. However, I really don't have any clue of what they actually mean. Here is an example of them:

  • 2014/08/26 09:28:34:368 PID: 15772 TID:  9340 [ERROR] SignalRClientBase::OnError() - SignalR error: Error in: WinHttpQueryDataAvaliable
  • 2014/08/26 09:29:59:131 PID: 15772 TID: 13224 [ERROR] ewAsyncRpcCommon::AsyncRpcClientLoopImpl::Loop -  ping() failed: client id [(400D4F78-6C1C-46E4-992F-E1223DE738F4.EWA) -> (2fd055f2-5e2d-4d9d-9b4b-d93375b4ca4f.AMS) UEMF-APP04.UEMF.local:17778], incomplete, error code [0x65b], message [w32_exception caught: Error [1627L], [ProvisionClientLib::SignalRClientBase::RegisterClient - continuation failed with exception], File: ..\AsyncRpcCommon\AsyncRpcClientLoopImpl.cpp, Line: 174]</li>
  • 2014/08/26 09:31:32:051 PID: 15772 TID: 11344 [ERROR] ProvisionClientLib::SignalRClientBase::begin_async_exchange::<lambda_55673ec5eed72fc54f09638561deb169>::operator ()- Exception calling Exchange on the server, deviceId [400D4F78-6C1C-46E4-992F-E1223DE738F4.EWA], callCounter [1] : std::exception caught: Description: [Exchange called from deviceId [400D4F78-6C1C-46E4-992F-E1223DE738F4.EWA] (ConnectionId [47b25962-244c-46b1-b26d-970136c5c49c], HubId [Messaging]) rejected, client is not registered.], File: SignalRClientBase.cpp, Line: 327
  • 2014/08/26 09:31:32:051 PID: 15772 TID: 13224 [ERROR] ewAsyncRpcCommon::AsyncRpcClientLoopImpl::Loop - begin_async_exchange() failed, client id [(400D4F78-6C1C-46E4-992F-E1223DE738F4.EWA) -> (2fd055f2-5e2d-4d9d-9b4b-d93375b4ca4f.AMS) UEMF-APP04.UEMF.local:17778], error code [0x65b], message [w32_exception caught: Error [1627L], [ProvisionClientLib::SignalRClientBase::begin_async_exchange - continuation failed with exception, Exchange #224, deviceId [400D4F78-6C1C-46E4-992F-E1223DE738F4.EWA]], File: ..\AsyncRpcCommon\AsyncRpcClientLoopImpl.cpp, Line: 96]

These errors repeat a LOT throughout the log. Maybe I can remove and re-add the agent?

0 Kudos