Community
- Command Central
- MVP Program
- Monthly Mission
- Blogs
- Groups
- Events
- Media Vault
Products
- Observability
- Network Management
- Application Management
- IT Security
- IT Service Management
- System Management
- Database Management
Content Exchange
- SolarWinds Platform
- Server & Application Monitor
- Database Performance Analyzer
- Server Configuration Monitor
- Network Performance Monitor
- Network Configuration Manager
- SQL Sentry
- Web Help Desk
Free Tools & Trials
Store

NPM and APM service constantly restarting

After a servicewindow this weekdne (normal windows security updates) to our servers, the Solarwinds Job Scheduler and Solarwinds Orion Module engine keeps shutting down, and restarting.This causes the APM and NPM service to constantly reload.

This behaviour is the same on my extra polling engine, and my hot standby.

I have been looking at logfiles, but i must admit that i´m no windows expert

In the logfile, APM.BusinessLayer.log file i see this:

2009-10-18 15:38:21,810 [21] ERROR SolarWinds.APM.BusinessLayer.APMBusinessLayerService - Failed to update application based on Node table changes.
System.ServiceModel.FaultException`1[System.ServiceModel.ExceptionDetail]: There is insufficient disk space to complete operation. (Fault Detail is equal to An ExceptionDetail, likely created by IncludeExceptionDetailInFaults=true, whose value is:
System.Data.SqlServerCe.SqlCeException: There is insufficient disk space to complete operation.
   at System.Data.SqlServerCe.SqlCeCommand.ProcessResults(Int32 hr)
   at System.Data.SqlServerCe.SqlCeCommand.ExecuteCommandText(IntPtr& pCursor, Boolean& isBaseTableCursor)
   at System.Data.SqlServerCe.SqlCeCommand.ExecuteCommand(CommandBehavior behavior, String method, ResultSetOptions options)
   at System.Data.SqlServerCe.SqlCeCommand.ExecuteNonQuery()
   at SolarWinds.JobEngine.Data.SqlCeHelper.ExecuteNonQuery(SqlCeCommand command, SqlCeConnection connection, SqlCeTransaction transaction)
   at SolarWinds.JobEngine.Scheduling.ScheduledJobDAL.UpdateScheduledJob(Guid jobId, ScheduledJob scheduledJob, DateTime nextExecution, Boolean updateNextExecution)
   at SolarWinds.JobEngine.Scheduling.ScheduledJobStore.UpdateJob(Guid jobId, ScheduledJob scheduledJob, Boolean executeImmediately)
   at SolarWinds.JobEngine.S...).

However, after consulting our database admins, they claim that filespace is not an issue on the SQL box. - And i dont see any problem on either of the Solarwinds servers.

Anyone having seen this before ?

Find more posts tagged with

Accepted answers

bshopp

Your call on whether to try or not or wait until morning, but see this post regarding the SDF file, I think this may help, see here

All comments

bshopp

What about the disk space on the Orion server? How is the space on each of the hard drives?

JesperVestergaard

Hi Brandon

I have 60+ gb on each drive

I also found this in the NPM.BusinessLayer.log

2009-10-18 15:36:54,138 [7] ERROR SolarWinds.Orion.Common.SWEventLogging - Starting NPM Service [I00379]

2009-10-18 15:36:54,544 [7] ERROR SolarWinds.Orion.Common.SWEventLogging - NPM Service [I00379] Started

2009-10-18 15:37:02,044 [Scheduler] WARN SolarWinds.NPM.BusinessLayer.JobScheduler - UpdateJob: JobScheduler channel threw FaultException

2009-10-18 15:37:02,060 [Scheduler] WARN SolarWinds.NPM.BusinessLayer.JobScheduler - Job Scheduler Exception:

System.ServiceModel.FaultException`1[SolarWinds.JobEngine.JobNotFoundFault]: The specified job to update was not found (Fault Detail is equal to SolarWinds.JobEngine.JobNotFoundFault).

2009-10-18 15:37:02,138 [Scheduler] WARN SolarWinds.NPM.BusinessLayer.JobScheduler - AddJob: JobScheduler channel threw FaultException

2009-10-18 15:37:02,138 [Scheduler] WARN SolarWinds.NPM.BusinessLayer.JobScheduler - Job Scheduler Exception:

System.ServiceModel.FaultException`1[System.ServiceModel.ExceptionDetail]: The database file is larger than the configured maximum database size. This setting takes effect on the first concurrent database connection only. [ Required Max Database Size (in MB; 0 if unknown) = 257 ] (Fault Detail is equal to An ExceptionDetail, likely created by IncludeExceptionDetailInFaults=true, whose value is:

System.Data.SqlServerCe.SqlCeException: The database file is larger than the configured maximum database size. This setting takes effect on the first concurrent database connection only. [ Required Max Database Size (in MB; 0 if unknown) = 257 ]

at System.Data.SqlServerCe.SqlCeCommand.ProcessResults(Int32 hr)

at System.Data.SqlServerCe.SqlCeCommand.ExecuteCommandText(IntPtr& pCursor, Boolean& isBaseTableCursor)

at System.Data.SqlServerCe.SqlCeCommand.ExecuteCommand(CommandBehavior behavior, String method, ResultSetOptions options)

at System.Data.SqlServerCe.SqlCeCommand.ExecuteNonQuery()

at SolarWinds.JobEngine.Data.SqlCeHelper.ExecuteNonQuery(SqlCeCommand command, SqlCeConnection connection, SqlCeTransaction transaction)

at SolarWinds.JobEngine.Scheduling.ScheduledJobDAL.AddScheduledJob(ScheduledJobInfo jobInfo)

at SolarWinds.JobEngine.Scheduling.ScheduledJobStore.AddJob(Guid jobId, Schedu...).

2009-10-18 15:37:02,138 [Scheduler] ERROR SolarWinds.Common.Utility.ScheduledTask - CheckNPMNodes threw an exception.

at System.Data.SqlServerCe.SqlCeCommand.ProcessResults(Int32 hr)

at System.Data.SqlServerCe.SqlCeCommand.ExecuteCommandText(IntPtr& pCursor, Boolean& isBaseTableCursor)

at System.Data.SqlServerCe.SqlCeCommand.ExecuteCommand(CommandBehavior behavior, String method, ResultSetOptions options)

at System.Data.SqlServerCe.SqlCeCommand.ExecuteNonQuery()

at SolarWinds.JobEngine.Data.SqlCeHelper.ExecuteNonQuery(SqlCeCommand command, SqlCeConnection connection, SqlCeTransaction transaction)

at SolarWinds.JobEngine.Scheduling.ScheduledJobDAL.AddScheduledJob(ScheduledJobInfo jobInfo)

at SolarWinds.JobEngine.Scheduling.ScheduledJobStore.AddJob(Guid jobId, Schedu...).

2009-10-18 15:37:04,091 [18] ERROR SolarWinds.Orion.Common.SWEventLogging - NPM Service [I00379] Stopped

JesperVestergaard

I did nome additional troubleshooting and found that i´m getting .NET 2.0 errors on all my SolarWinds servers.

I´v tried to reinstall practialy all components, running config wizzard and removed a windows update related to .net (KB974417) Still with no luck. I guess this will be a case for support soon

bshopp

Your call on whether to try or not or wait until morning, but see this post regarding the SDF file, I think this may help, see here

JesperVestergaard

Hi Brandon.

It did help - i´ts only 20 minutes since i removed the jobengine, and re-installed in manually, and not one single restart of the services, yet.

Tnx !!!

Wondering whay may have caused it.,. And also why that is not fixed by re-installing the various modules.

bshopp

Still might be worth opening a support ticket to make sure that was the issue and not a band-aid