Community
- Command Central
- MVP Program
- Monthly Mission
- Blogs
- Groups
- Events
- Media Vault
Products
- Observability
- Network Management
- Application Management
- IT Security
- IT Service Management
- System Management
- Database Management
Content Exchange
- SolarWinds Platform
- Server & Application Monitor
- Database Performance Analyzer
- Server Configuration Monitor
- Network Performance Monitor
- Network Configuration Manager
- SQL Sentry
- Web Help Desk
Free Tools & Trials
Store

ModifyCustomProperty is returning an error in prod server but is working in our dev server – "Object reference not set to an instance of an object."

Hello Thwack Community!

My name is Ian, and I am a new member here.

We have developed an automation for SolarWinds NCM to modify a custom property by invoking the ModifyCustomProperty function. It has been working properly on our dev server, but we are getting the error message below in our prod server. Does anyone have an idea on what the error is about and/or encountered the same issue?

Error Message:

{
    "Message": "Object reference not set to an instance of an object.",
    "ExceptionType": "System.NullReferenceException",
    "FullException": "System.NullReferenceException: Object reference not set to an instance of an object.\r\n   at SolarWinds.Orion.Core.Common.DALs.InlineCustomPropertyDAL.ChangeCustomPropertySize(SqlTransaction transaction, CustomProperty prop)\r\n   at SolarWinds.Orion.Core.Common.DALs.CustomPropertyDAL.ModifyCustomProperty(SqlConnection connection, SqlTransaction transaction, CustomProperty newProperty, CustomProperty originProperty)\r\n   at SolarWinds.Orion.Core.Common.DALs.CustomPropertyDAL.ModifyCustomProperty(SqlConnection connection, CustomProperty newProperty, CustomProperty originProperty)\r\n   at SolarWinds.Data.Providers.Orion.Verbs.NodesCustomProperties.ModifyCustomProperty(SqlConnection connection, CustomProperty property)\r\n   at SolarWinds.Data.Providers.Orion.Verbs.CustomProperties.ModifyCustomProperty(String PropertyName, String Description, Nullable`1 Size, String[] Values, Dictionary`2 Usages, Boolean Mandatory, String Default, String SourceId, String SourceName, String propertyDisplayName)\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()\r\n   at SolarWinds.InformationService.Verb.VerbExecutor.ReflectionInvocation(Object hostInstance, Object[] parameters)\r\n   at SolarWinds.InformationService.Verb.VerbExecutorContext.Invoke()\r\n   at SolarWinds.InformationService.Core.InformationService.Invoke[T](String entity, String verb, Action`1 setupParameters, Func`2 extractReturnValue)",
    "status": 400
}

SolarWinds Version:

Dev:

Prod:

Working Scenario (Dev):

POST
https://172.31.131.109:17778/SolarWinds/InformationService/v3/Json/Invoke/Orion.NodesCustomProperties/ModifyCustomProperty

Headers:
Same in both dev and prod requests

Request:
{
"PropertyName": "CustomerName",
"Description": "Customer Name",
"Size": 400,
"Values": [
"Test33",
"Test",
"Test55",
"(99999) Automation Bank"
]
}

Response:
{
"body": null,
"headers": {
"content-length": "4",
"content-type": "application/json",
"server": "Microsoft-HTTPAPI/2.0",
"strict-transport-security": "max-age=31536000,includeSubDomains",
"date": "Tue, 14 Feb 2023 15:48:32 GMT",
"connection": "close"
},
"status": 200,
"statusText": "OK"
}

Non-Working Scenario (Prod):

POST
https://hostname:17778/SolarWinds/InformationService/v3/Json/Invoke/Orion.NodesCustomProperties/ModifyCustomProperty

Headers:
Same in both dev and prod requests

Request:
{
"PropertyName": "CustomerName",
"Description": "Customer Name",
"Size": 400,
"Values": [
"Value 1",
// //
"Value 179",
"New Value"
]
}

Response:
See error message above

Actual Word Count of Values Array as per Microsoft Word:

Troubleshooting:

We tried sending a different payload in our request to our prod server in this format but received a different error.

Request:
{
    "PropertyName": "CustomerName",
    "Description": "Customer Name",
    "Size": 400,
    "Values": [
        {
            "Value": "Value 1"
        },
        //  //
        {
            "Value": "Value 179"
        },
        {
            "Value": "New Value"
        }
    ]
}

Response:
{
    "Message": "Verb Orion.NodesCustomProperties.ModifyCustomProperty cannot unpackage parameter 'Values' (#3) with type System.String[]",
    "ExceptionType": "SolarWinds.InformationService.Verb.VerbExecutorException",
    "FullException": "SolarWinds.InformationService.Verb.VerbExecutorException: Verb Orion.NodesCustomProperties.ModifyCustomProperty cannot unpackage parameter 'Values' (#3) with type System.String[] ---> Newtonsoft.Json.JsonReaderException: Error reading string. Unexpected token: StartObject. Path 'Values[0]'.\r\n   at Newtonsoft.Json.JsonReader.ReadAsString()\r\n   at Newtonsoft.Json.JsonReader.ReadForType(JsonContract contract, Boolean hasConverter)\r\n   at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.PopulateList(IList list, JsonReader reader, JsonArrayContract contract, JsonProperty containerProperty, String id)\r\n   at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateList(JsonReader reader, Type objectType, JsonContract contract, JsonProperty member, Object existingValue, String id)\r\n   at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateValueInternal(JsonReader reader, Type objectType, JsonContract contract, JsonProperty member, JsonContainerContract containerContract, JsonProperty containerMember, Object existingValue)\r\n   at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReader reader, Type objectType, Boolean checkAdditionalContent)\r\n   at Newtonsoft.Json.JsonSerializer.DeserializeInternal(JsonReader reader, Type objectType)\r\n   at SolarWinds.InformationService.Verb.VerbExecutorContext.<>c__DisplayClass26_0.g__GetParameterByIndex|0(Int32 index)\r\n   --- End of inner exception stack trace ---\r\n   at SolarWinds.InformationService.Verb.VerbExecutorContext.<>c__DisplayClass26_0.g__GetParameterByIndex|0(Int32 index)\r\n   at SolarWinds.InformationService.Verb.VerbExecutorContext.CreateParameters(Func`2 getParameterAt, Int32 parametersCount, Stream stream)\r\n   at SolarWinds.InformationService.Verb.VerbExecutorContext.UnpackageParameters(JObject parameters)\r\n   at SolarWinds.InformationService.Core.InformationService.Invoke[T](String entity, String verb, Action`1 setupParameters, Func`2 extractReturnValue)",
    "status": 400
}

We do not own/manage the server where NCM is running on, but we can engage that team if we need server-level logs/troubleshooting.

Any lead/info would be greatly appreciated.

Thank you very much!

Find more posts tagged with

Comments

WJMuhle

Howdy,

So the "Object not set.." error basically means that it is looking for something that does not exist. In your case, you are attempting to update the config of a custom property on the two systems. Specifically you are trying to update the config of the CustomerName custom property. Is that custom property (with that exact name) created in your prod environment? Based on the error message, it does not.

iunite

Hi there! Thanks for responding. You are correct, we are modifying the custom property named "CustomerName" in both dev and prod environments, specifically trying to add a new value which is the input from our automation workflow. The custom property is created in both environments with the same name and parameters.

Which brings me to raise this discussion as I do not know why it is erroring out given that we are sending the same payload structure, simply different payload lengths. I am suspecting, but not sure, if it is the "length" property and/or something has to be restarted or something in the server level (perhaps a package, service, etc.).

In addition, we can do a GET call to that custom property in prod -- we are getting the current value of the array, and just adding in the new value from the automation. This is the same process/workflow that we tested successfully first in dev environment. It is only the invoke of the ModifyCustomProperty function that isn't working for some reason...

vinay.by

Well I havent tried updating those fields via an API call, but then based on my experience to me this seems like an issue with that custom property itself, you could try 2 things to check where the issue is:

1. Try updating this custom attribute value manually on SolarWinds - check if that works, even if it does try the point mentioned below which is point 2

2. Just to be sure this has nothing to do with the custom attribute in question, try creating a new custom attribute in SolarWinds for testing purpose and try updating that through your API call.

What I am trying to do is to make sure the issue is not with the specific custom attribute that you are trying to update in Production, try the above steps if its feasible.

iunite

Thanks for the suggestions! This sounds like a good plan.

We may be facing a bigger issue, I think -- we had the application owner create a new custom property for us named "CustomerNameTest", but he got an error when creating it. NCM seems to have created it, but he is getting an error when trying to assign a value.

He has already opened a ticket with SolarWinds. I will keep you all posted as details unravel.

iunite

We just got an update that the UI is now functioning properly. I have run another automation job but still getting the same error, unfortunately.

Here are the results of my tests:

1) I tried manually adding the value that I am pushing in "CustomerName", and it accepted it – I was able to save. I verified that the value is indeed there by clicking "Edit" and checking the list of values.

2) I created a new custom property, CustomerNameTest, with a single initial value and I was able to save. However, when I tried to edit it by clicking “Edit”, I got this error:

{
      "message": "An error has occurred.",
      "exceptionMessage": "One or more errors occurred.",
      "exceptionType": "System.AggregateException",
      "stackTrace": "   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)\r\n   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)\r\n   at System.Threading.Tasks.Task`1.get_Result()\r\n   at SolarWinds.Orion.CustomProperties.Common.Helpers.Utility.RunSwisQuery[T](String query, ISwisRepository proxy, Func`2 func, Boolean appendErrors, Object[] parameters)\r\n   at SolarWinds.Orion.CustomProperties.DAL.CustomPropertyDAL.GetCustomPropertyDistinctRestrictedValues(String sourceEntity, String fieldName)\r\n   at SolarWinds.Orion.CustomProperties.DAL.CustomPropertyDAL.<>c__DisplayClass25_0.b__1(IDataReader reader)\r\n   at SolarWinds.Orion.CustomProperties.Common.Helpers.Utility.RunSwisQuery[T](String query, ISwisRepository proxy, Func`2 func, Boolean appendErrors, Object[] parameters)\r\n   at SolarWinds.Orion.CustomProperties.DAL.CustomPropertyDAL.GetCustomProperties(String propertyName, String sourceEntity, Nullable`1 siteId, String sourceId)\r\n   at SolarWinds.Orion.CustomProperties.DAL.CustomPropertyDAL.GetCustomPropertyBySite(String propertyName, String sourceEntity, Int32 siteId, String sourceId)\r\n   at SolarWinds.Orion.Settings.WebApi.OrionCustomPropertiesController.GetCustomPropertyBySite(ExistingCustomPropertyRequest request)\r\n   at lambda_method(Closure , Object , Object[] )\r\n   at System.Web.Http.Controllers.ReflectedHttpActionDescriptor.ActionExecutor.<>c__DisplayClass10.b__9(Object instance, Object[] methodParameters)\r\n   at System.Web.Http.Controllers.ReflectedHttpActionDescriptor.ActionExecutor.Execute(Object instance, Object[] arguments)\r\n   at System.Web.Http.Controllers.ReflectedHttpActionDescriptor.ExecuteAsync(HttpControllerContext controllerContext, IDictionary`2 arguments, CancellationToken cancellationToken)\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Tracing.ITraceWriterExtensions.d__18`1.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Controllers.ApiControllerActionInvoker.d__0.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Tracing.ITraceWriterExtensions.d__18`1.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.ActionFilterAttribute.d__5.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Web.Http.Filters.ActionFilterAttribute.d__5.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.ActionFilterAttribute.d__0.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.ActionFilterAttribute.d__5.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Web.Http.Filters.ActionFilterAttribute.d__5.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.ActionFilterAttribute.d__0.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Controllers.ActionFilterResult.d__2.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.AuthorizationFilterAttribute.d__2.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.AuthorizationFilterAttribute.d__2.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Controllers.ExceptionFilterResult.d__0.MoveNext()",
      "innerException": {
            "message": "An error has occurred.",
            "exceptionMessage": "RunQuery failed, check fault information.\nEntity Orion.NodesCustomProperties does not contain requested property CustomerNameTest of navigation property e.CustomProperties",
            "exceptionType": "System.ServiceModel.FaultException`1[[SolarWinds.InformationService.Contract2.InfoServiceFaultContract, SolarWinds.InformationService.Contract, Version=2022.4.0.0, Culture=neutral, PublicKeyToken=null]]",
            "stackTrace": "   at SolarWinds.Orion.Core.Common.ChannelProxy`1.HandleException(Exception ex, Int32 currentRetryCount, ChannelProxyBehavior behavior, String methodName)\r\n   at SolarWinds.Orion.Core.Common.ChannelProxy`1.Invoke[TResult](Func`2 fnc, ChannelProxyBehavior behavior, String methodName)\r\n   at SolarWinds.Orion.Core.Common.ChannelProxy`1.Invoke[TResult](Func`2 fnc, ChannelProxyBehavior behavior)\r\n   at SolarWinds.Orion.Core.Common.InformationService.InformationServiceProxy.Query(String query, IDictionary`2 parameters)\r\n   at SolarWinds.Orion.Core.Common.InformationService.InformationServiceProxyImpersonate.Query(String query, IDictionary`2 parameters)\r\n   at SolarWinds.Orion.Web.Platform.Data.SwisRepository.Query(ISwisQuery query)\r\n   at SolarWinds.Orion.Web.Platform.Data.SwisRepository.DoQueryWithRetries(ISwisQuery query)\r\n   at SolarWinds.Orion.Web.Platform.Data.SwisRepository.<>c__DisplayClass12_0.b__0()\r\n   at SolarWinds.Orion.Web.Platform.Globalization.TaskFactoryHelper.<>c__DisplayClass4_0`1.b__0()\r\n   at System.Threading.Tasks.Task`1.InnerInvoke()\r\n   at System.Threading.Tasks.Task.Execute()"
      }
}

Then, I just see the whole page grayed out with "Cancel" as the only thing that is clickable. All fields are blank. (Sorry, I did not see an upload functionality at the time of this writing, so I was unable to share the screenshot here.)

Thanks.