The ability to run a silent (or quiet) install would be great. Either the option to provide command line options in calling the installer or the use of a config file with the options/settings.
Possibly the use of a standard MSI instead of the setup exe to utilize Microsoft's existing installer toolset?