Community
- Command Central
- MVP Program
- Monthly Mission
- Blogs
- Groups
- Events
- Media Vault
Products
- Observability
- Network Management
- Application Management
- IT Security
- IT Service Management
- System Management
- Database Management
Content Exchange
- SolarWinds Platform
- Server & Application Monitor
- Database Performance Analyzer
- Server Configuration Monitor
- Network Performance Monitor
- Network Configuration Manager
- SQL Sentry
- Web Help Desk
Free Tools & Trials
Store

Database storage rate.

Quick question for the folks here.

About how much space does each poll take up in the database? For example, if I have a router with 5 interfaces, and I monitor traffic rates and errors, add in the router itself...and that's about 11 pollers IIRC. How much space does one full cycle take up?

I'm trying to estimate how much space I'm going to need on a SQL server...but I'm looking to know about what to expect for about 3,000 routers w/ an average of 3 interfaces apice, polled every 120 seconds.

Details stats are to be kept for a one-month period before being crunched into hourlies.

Thanks!

-I

Find more posts tagged with

Accepted answers

All comments

Network_Guru

-I,

You may want to re-think your polling strategy.
Depending on if you are gathering Stats every 120 secs.
or just polling for availability.

Here is the database info from our installation:

Network Elements 3048 Elements
Nodes 602 Nodes
Interfaces 2060 Interfaces
Volumes 386 Volumes
Retain Detail Stats 14 Days
Retain Hourly Stats 90 Days
Retain Daily Stats 365 Days
Retain Events 90 Days

# Exported from Database Manager
# 7/23/2003 3:53:58 PM
#
Table Size
ActiveAlerts 112 Kbytes
Alerts 160 Kbytes
AlertSuppression 24.0 Kbytes
CiscoBuffers 10 Mbytes
CiscoCPULoad 8192 bytes
CPULoad 256 Mbytes
Engines 8192 bytes
Events 25 Mbytes
EventTypes 24.0 Kbytes
InterfaceErrors 754 Mbytes
Interfaces 5.35 Mbytes
InterfaceSignalNoise 0 bytes
InterfaceTraffic 1.3 Gbytes
NMSTools 8192 bytes
Nodes 1.29 Mbytes
Pollers 0.98 Mbytes
ResponseTime 263 Mbytes
Settings 24.0 Kbytes
Volumes 360 Kbytes
VolumeUsage 165 Mbytes
Total Space Used 2.7 Gbytes

As you can see, there are many different variables which
can affect the size of the database.
With the cost of disks these days, I'm not sure why this would be a concern ?

-=Cheers=-
NG

iunderwo

It's just a matter of planning, really. You know how the PHBs can be.

Thanks for the input!

// Ian Underwood - Service Management Specialist
// Level 3 Communications

jonwhitear

NetworkGuru,

How long had you been running that database for when you produced those statistics? If that databse has been running for less than one year, it doesn't necessarily reflect the space requirments accurately. Aslo, I assume that you are polling stats at the default rate.

Cheers,

Jon

Network_Guru

Those stats were from over a years worth of polling.
Ping & Device stats(CPU&Mem.) are polled every 5 minutes.
Interface stats are polled every 15 minutes.

Historical Statistics

Cisco Buffer Statistics
43,796 Detail records From 01-Oct-03 To 15-Oct-03 10:24 AM 0 To 14 days ago
69,808 Hourly records From 07-Jul-03 To 30-Sep-03 11:00 PM 15 To 100 days ago
12,925 Daily records From 08-Jan-03 To 06-Jul-03 12:00 AM 101 To 280 days ago

CPU Load Statistics
1,511,502 Detail records From 01-Oct-03 To 15-Oct-03 10:24 AM 0 To 14 days ago
704,786 Hourly records From 07-Jul-03 To 30-Sep-03 11:00 PM 15 To 100 days ago
51,446 Daily records From 08-Jan-03 To 06-Jul-03 12:00 AM 101 To 280 days ago

Response Time Statistics
2,888,751 Detail records From 01-Oct-03 To 15-Oct-03 10:24 AM 0 To 14 days ago
1,098,055 Hourly records From 07-Jul-03 To 30-Sep-03 11:00 PM 15 To 100 days ago
109,055 Daily records From 25-Sep-02 To 06-Jul-03 12:00 AM 101 To 385 days ago

Interface Traffic Statistics
2,501,261 Detail records From 01-Oct-03 To 15-Oct-03 10:24 AM 0 To 14 days ago
3,422,296 Hourly records From 07-Jul-03 To 30-Sep-03 11:00 PM 15 To 100 days ago
212,517 Daily records From 25-Sep-02 To 06-Jul-03 12:00 AM 101 To 385 days ago

Interface Error Statistics
2,468,618 Detail records From 01-Oct-03 To 15-Oct-03 10:24 AM 0 To 14 days ago
8,003,839 Hourly records From 10-Nov-02 To 30-Sep-03 11:00 PM 15 To 339 days ago
17,976 Daily records From 25-Sep-02 To 10-Nov-02 12:00 AM 339 To 385 days ago

Looks like I need to clean up the Interface Error Statistics....

-=Cheers=-
NG

Network_Guru

Just an update regarding database size and maintenance.
I highly recommend compacting the database at least once a month,
and checking the status of the daily roll-up/statistics tables.
You can find this in the Web admin page > Admin > Database details > historical statistics.

When nodes are added or removed, the indexes on the tables start
to grow, and need to be re-indexed (compacted).

Also my nightly roll-up was corrupted as evidenced by the following:

8,003,839 Hourly records From 10-Nov-02 To 30-Sep-03 11:00 PM 15 To 339 days ago

I ran the advanced database maintenance to correct this problem.
The hourly records are down to a manageable 3 million now.
I then re-ran the compact database utility and it went
from 2.3Gb down to 1.2Gb. Things are running much smoother & faster now!

-=Cheers=-
NG

rpereda

How often do you run the 'compact database maintenance' utility?

Robert Pereda

Network_Guru

If you are adding/changing/removing a lot of network elements, I would run it once a month.
If everything is more or less kept fairly static, then every 3-4 months should do.

-=Cheers=-
NG