3 Replies Latest reply on Apr 22, 2010 11:59 AM by ctanner

    How scalable is Profiler

    robertcbrowning

      Hi, Just taking a 1st look at the eval & the docs, I wondered -
      Does the product scale on a single server from the PL50 to the PL5000
      Are there recommendations for server spec for the varying levels and if the other 2 products were to be included
      Is Profiler supported on VMWare
      Can it be further expanded with additional servers running scalability engines - as Orion does
      What constitues a element for each of the three modules
      If I were to run 2 or more individual Profile servers, could I conbine their data - as in Orion's EOC
      Is there an intention to migrate the database from MySQL to SQL?
      I guess that will do for the moment. %^)
      Thanks
      Robert

        • Re: How scalable is Profiler
          animelov

          For the moment eh? :)

           

          I'll start off by saying, yes, we do support Profiler Server installs on VMWare and have many customers that do (some are very large environments as well).  

           

          Scaling is always going to be an ambiguous question because it's going to be determined on what you plan on monitoring.  Someone who is simply monitoring a couple of ESX hosts and a moderately sized storage array can get away with just a single Profiler Server with no additional Pollers.  However, the greater your environment, the more pollers you will want in order to ease the burden of collection.  In general we'd recommend the following per polling agent (and like servers, polling agents can be VMs):

           

          ~200 Virtual machines (generally about 10 ESX hosts)

          ~3 Storage Arrays

          ~20-30 Switches

          ~Other polling agents if you plan on doing File Analysis/Data Classification

           

          Again, this is just a generalization.  Also, as the environment grows, the better the Profiler Server ought to be.  At the moment, no, you cannot combine multiple databases into one big one such as Orion.

           

          Maybe this might be easier, what do you plan on monitoring and I can give an example of what kind of environment you'd need.

            • Re: How scalable is Profiler
              robertcbrowning

              We're running around 2000 servers and are partway through P2V. Currently about 80 VMWare hosts supporting 600 Win2k3/2k8. Estate is spread over 8 data centres and many small offices. There's a mix of server OS's left to go. It's taking 4 additional polling engines for Orion to poll the important servers.
              Decided to look at Profiler to see if we could better understand our disk utilization across NAS, SAN & direct.
              The closer we get to completion, the more information we realise we need to collate!

                • Re: How scalable is Profiler
                  ctanner

                  What type(s) of SAN Arrays and NAS devices are you running and how many? Also, the amount of pollers you would need is dependent on how powerful the pollers are. 

                  Example Environment: 

                  EMC CLARiiON (3) - approx 100 disks each

                  IBM DS 5k Series (22) - approx 25 disks each

                  NetApp (6)

                  Cisco MDS (30)

                  Virtual Center (2)

                  VC1: VMs (200)

                  VC2: VMs (800) 

                  Physical Servers (100) - only monitoring storage relevant servers 

                   

                  How I would scale it: 

                  Profiler Server - 64bit 2 CPUs 8 GB RAM

                  Pollers (5) - 64bit 1-2 CPUs 2-4 GB RAM

                   

                  Server:

                  EMC CLARiiON (3)

                  NetApp (1)

                  Cisco MDS (5)

                   

                  Poller 1:

                  IBM DS 5k Series (4)

                  NetApp (1)

                  Cisco MDS (5)

                  VC1: VMs (200)

                   

                  Poller 2: 

                  IBM DS 5k Series (4) 

                  NetApp (1)

                  Cisco MDS (5)

                  VC2: VMs (200) 

                   

                  Poller 3: 

                   

                  IBM DS 5k Series (4) 

                  NetApp (1)

                  Cisco MDS (5)

                  VC2: VMs (200) 

                   

                  Poller 4: 

                   

                  IBM DS 5k Series (5) 

                  NetApp (1)

                  Cisco MDS (5)

                  VC2: VMs (200) 

                   

                  Poller 5: 

                   

                  IBM DS 5k Series (5) 

                  NetApp (1)

                  Cisco MDS (5)

                  VC2: VMs (200)