POST-ing alerts to Teams channels in Orion 2023.1 (and 2023.3 as of today) was working up until 3 weeks and then it suddenly stopped, across all four Teams channels we've been POST-ing alerts to.
Attempting to simulate / execute alerts: "Failed to execute HTTP request"
In Message Center:
Failed to execute an HTTP request. Method: POST, Url: https://.webhook.office.com/webhookb2/, Body: { "title": "test", "text": "test" })In the logs:
2023-07-27 10:29:43,431 [26] ERROR AlertingLogger - (null) Failed to execute an HTTP request. Method: POST, Url: https://.webhook.office.com/webhookb2//IncomingWebhook/, Body: {
"title": "test",
"text": "test"
}
System.Net.WebException: The remote server returned an error: (400) Bad Request.
at System.Net.HttpWebRequest.GetResponse()
at SolarWinds.Orion.Core.Actions.Impl.SendHttpRequest.SendHttpRequestExecutor.ExecuteInternal()
2023-07-27 10:29:43,447 [26] ERROR AlertingLogger - (null) Action [Action: ID: 342, ActionType: SendHttpRequest, Title: test POST- to private dev Teams channel, Description: Post to https://vallartamkts.webhook.office.com/webhookb2/8b6a6607-5d66-4d53-8dc9-8dff61414a87@c78d95f8-eb07-4c4d-8513-420330d4a422/IncomingWebhook/bc9ce31883a54e849b46232552e0fdbf/92909c42-afe1-4bd2-835f-b88945146a47, Enabled: False, Order: 2, Approved: , Context: SolarWinds.Orion.Core.Models.Actions.Contexts.AlertingActionContext, EnviromentType: Alerting, ExecutionMode: Trigger, EntityType: Orion.NPM.CustomPollerAssignmentOnNode, EntityUri: swis://GMCORION.VALLARTAMKT.COM/Orion/Orion.Nodes/NodeID=35/CustomPollerAssignmentOnNode/ID=6, AlertContext: AlertName: test UPS alert, CreatedBy: , AlertActiveId: , AlertObjectId: ] execution has failed.
System.Exception: Failed to execute HTTP request ---> System.Net.WebException: The remote server returned an error: (400) Bad Request.
at System.Net.HttpWebRequest.GetResponse()
at SolarWinds.Orion.Core.Actions.Impl.SendHttpRequest.SendHttpRequestExecutor.ExecuteInternal()
--- End of inner exception stack trace ---
at SolarWinds.Orion.Core.Actions.Impl.SendHttpRequest.SendHttpRequestExecutor.ExecuteInternal()
at SolarWinds.Orion.Core.Actions.ActionExecutorBase.Execute(IServiceProvider serviceProvider, ActionDefinition definition, ActionContextBase context, CancellationToken cancellationToken)
The SolarWinds server (server itself, not SolarWinds SAM) has no issues sending similar notifications to the same webhook URL / Teams channels via PowerShell:
$host_name = & hostname
$message = "test from " + $host_name
$msg_body = '{"text":"' + $message + '"}'
Invoke-RestMethod -Method post -ContentType 'Application/Json' -Body $msg_body -Uri $webhookURI
SolarWinds SAM has no issues sending notifications to a test Slack channel.
Here is the action:
What could I be doing wrong?
Thanks!
