Take a look at Alert central. Free product - pretty simple to configure. Does exactly what you want. If the on-call engies put the vacation time in there, they won't get messages during that time either.
Good answer, Nazar -- Didn't register with me that Alex was *already* asking in the Alert Central area !