Community
- Command Central
- MVP Program
- Monthly Mission
- Blogs
- Groups
- Events
- Media Vault
Products
- Observability
- Network Management
- Application Management
- IT Security
- IT Service Management
- System Management
- Database Management
Content Exchange
- SolarWinds Platform
- Server & Application Monitor
- Database Performance Analyzer
- Server Configuration Monitor
- Network Performance Monitor
- Network Configuration Manager
- SQL Sentry
- Web Help Desk
Free Tools & Trials

Statistical Data Consolidation Question?

For reporting, I need to filter out blocks of NMS statistics based on date/time ranges, but to do that I need to fully understand how that data is summarized over time.

How are monitoring statistics summarized from detail to hourly, and from hourly to daily? For example, I need to know what time a detailed record at 2:29 or 2:31 will be aggregated into. Similarly, which day would an hourly record at 10/7/2010 11:00 am, or 12:00 pm get rolled into?

Find more posts tagged with

Accepted answers

byrona

I was able to get to the bottom of how all this works...

Data is consolidated with Stored Procedures in SQL

For example when hourly CPU statistics are being converted to daily CPU statistics the procedure is named:
"dbm_CPULoad_HourlyToDaily"

Similarly interface detailed traffic is rolled into hourly statistics using this procedure:
"dbm_InterfaceTraffic_DetailToHourly"

Those stored procedures have a date that is passed to them...

The date is formulated by the SQL function Getdate() – retentionsettings(indays)

So if detail is kept for 7 days it would do get date for today returning 10/20/10 and subtract 7 days giving you 10/13/2010 then it moves anything older than that to the Hourly table once completed it returns and deletes the old information from the hourly table.

In the web interface you set the Database Maintenance time, that is also stored in the database in the settings table, the setting is called SWNetPerfMon-Settings-Archive Time and that number is figured with the following formula...

The value held in the database multiplied by 24 (hours) will give you the time of day this will run at.
For example in my setup the value is:
0.09375
when multiplied by 24 you will get 2.25
0.09375 * 24 = 2.25
This refers to 2 and a quarter hours.
This is 2:15am

So, that is the very long answer to the question that I asked. Thanks so very much to SolarWinds Support Tech Cormac O'Loughlin who was able to help me figure this all out.

All comments

mattjenkins

Bryon,

If you check the 'Polling Settings' in the admin section of the webconsole. this is where you can see the statistic rentention periods. Hope this is what you want...

Matt

byrona

I understand how to configure the statistic retention period. What I want to understand are the specifics of the algorithm used when the consolidation takes place.

njoylif

I think you'd have to hack up the rollup stored procedures for that area.

I was looking at this for the IPSLA stuff, but didn't go far enough before changing directions.

mattjenkins

Ah ok Bryon sorry about that.... I had a look at the Stored Procedures but there doesnt seem to be any criteria in them (im not a DBA so i may be missing something) so looks like SW will need to respond

byrona

Some of the reports we are working on that pull data directly from the Orion database require that we understand how this works.

I was hoping that I could get a response from the SolarWinds development team.

If this is something that I should open a support ticket on please let me know, thanks!

byrona

I was able to get to the bottom of how all this works...

Data is consolidated with Stored Procedures in SQL

Those stored procedures have a date that is passed to them...

So, that is the very long answer to the question that I asked. Thanks so very much to SolarWinds Support Tech Cormac O'Loughlin who was able to help me figure this all out.