Time "wrong" in email alerts and event logts

I don't know if this is an 8.5.1 thing, or something else, but I just noticed this morning that my email alerts don't have the correct time stamp. For example, the DOWN event log is as follows:

	11/7/2007 09:43 AM		T300 : Hagerman - NM (ANIRA) is Down at 11/07/2007 9:11:35 AM
	11/7/2007 09:41 AM		T300 : Hagerman - NM (ANIRA) has stopped responding (Request Timed Out)

The "A" icon is an email alert, that I also have log an event to include the SECONDS in the time stamp, since the built-in Orion events only drill down to the MINUTE LEVEL. The actual variables in this alert are:

${NodeName} is ${Node.Status} at ${M}/${DD}/${Year} ${H}:${MM}:${Second} ${AMPM}

The time on the server is correct, and is obtained via NTP. Thoughts on why my events at 9:41am have a time stamp of 9:11am in the email notification and event logs? I don't think it's an 8.5.1 thing because this condition only started yesterday. Below are my Triggered Alerts over the past few weeks:

	11/7/2007 09:43 AM		T300 : Hagerman - NM (ANIRA) is Down at 11/07/2007 9:11:35 AM
	11/7/2007 07:59 AM		T112 : Foreman/Ash Grove - AR (Frame Relay) is Down at 11/07/2007 7:11:52 AM
	11/6/2007 05:46 PM		T300 : Hagerman - NM (ANIRA) is Down at 11/06/2007 17:11:06
	11/6/2007 04:08 PM		T198 : Green Bay - WI (ANIRA) is Down at 11/06/2007 16:11:40
	11/6/2007 03:33 PM		T216 : Dalhart - TX (ANIRA) is Down at 11/06/2007 15:11:56
	11/6/2007 03:12 PM		T036 : Romeoville, IL (VPN) is Down at 11/06/2007 15:11:16
	11/6/2007 02:48 PM		T036 : Romeoville, IL (VPN) is Down at 11/06/2007 14:11:36
	11/6/2007 02:45 PM		T082 : Columbus - MS (Frame Relay) is Down at 11/06/2007 14:11:05
	11/6/2007 02:31 PM		T036 : Romeoville, IL (VPN) is Down at 11/06/2007 14:11:14
	11/6/2007 02:03 PM		T036 : Romeoville, IL (VPN) is Down at 11/06/2007 14:11:47
	11/6/2007 01:54 PM		T036 : Romeoville, IL (VPN) is Down at 11/06/2007 13:11:13
	11/6/2007 01:48 PM		T036 : Romeoville, IL (VPN) is Down at 11/06/2007 13:11:11
	11/6/2007 01:41 PM		T067 : Columbus - MS (ANIRA) is Down at 11/06/2007 13:11:08
	11/6/2007 01:32 PM		T036 : Romeoville, IL (VPN) is Down at 11/06/2007 13:11:34
	11/6/2007 01:14 PM		T112 : Foreman/Ash Grove - AR (Frame Relay) is Down at 11/06/2007 13:11:57
	11/6/2007 01:10 PM		T112 : Foreman/Ash Grove - AR (Frame Relay) is Down at 11/06/2007 13:11:40
	11/6/2007 12:39 PM		T556/T564 : SouthGate - CA (ANIRA) is Down at 11/06/2007 12:11:27
	11/6/2007 12:04 PM		T198 : Green Bay - WI (ANIRA) is Down at 11/06/2007 12:11:13
	11/6/2007 10:27 AM		T216 : Dalhart - TX (ANIRA) is Down at 11/06/2007 10:11:02 AM
	11/6/2007 06:00 AM		Deb Schmidt - IA (VPN) is Down at 11/06/2007 6:11:10 AM
	11/5/2007 05:39 PM		T384 : Los Angeles - CA (ANIRA) is Down at 11/05/2007 17:11:30
	11/5/2007 05:16 PM		T556/T564 : SouthGate - CA (ANIRA) is Down at 11/05/2007 17:11:05
	11/5/2007 05:06 PM		T680 : Burlington : NJ (ANIRA) is Down at 11/05/2007 17:11:01
	11/5/2007 04:23 PM		T318 : Victorville - CA (ANIRA) is Down at 11/05/2007 16:11:13
	11/5/2007 03:33 PM		T561B : Muscatine - IA (ANIRA) is Down at 11/05/2007 15:11:38
	11/5/2007 03:21 PM		T583 : Holstein - IA (Frame Relay) is Down at 11/05/2007 15:11:48
	11/5/2007 02:19 PM		T384 : Los Angeles - CA (ANIRA) is Down at 11/05/2007 14:11:52
	11/5/2007 01:56 PM		T384 : Los Angeles - CA (ANIRA) is Down at 11/05/2007 13:11:57
	11/5/2007 12:34 PM		T384 : Los Angeles - CA (ANIRA) is Down at 11/05/2007 12:11:52
	11/5/2007 10:55 AM		T082 : Columbus - MS (Frame Relay) is Down at 11/05/2007 10:11:25 AM
	11/5/2007 08:34 AM		T384 : Los Angeles - CA (ANIRA) is Down at 11/05/2007 8:11:52 AM
	11/5/2007 07:56 AM		T012 : Buffalo - IA (Frame Relay) is Down at 11/05/2007 7:11:52 AM
	11/5/2007 07:53 AM		T583 : Holstein - IA (Frame Relay) is Down at 11/05/2007 7:11:50 AM
	11/5/2007 07:53 AM		T012 : Buffalo - IA (Frame Relay) is Down at 11/05/2007 7:11:20 AM
	11/5/2007 07:39 AM		T560B : Cedartown - GA (ANIRA) is Down at 11/05/2007 7:11:14 AM
	11/5/2007 07:39 AM		T560A : Cedartown - GA (ANIRA) is Down at 11/05/2007 7:11:14 AM
	11/5/2007 07:25 AM		T583 : Holstein - IA (Frame Relay) is Down at 11/05/2007 7:11:54 AM
	11/5/2007 06:39 AM		Kent Havens - FL (VPN) is Down at 11/05/2007 6:11:50 AM
	11/5/2007 06:00 AM		Bill Gonzales - NE (VPN) is Down at 11/05/2007 6:11:03 AM
	11/4/2007 03:10 AM		SW18-OLDDMZ1 is Down at 11/04/2007 3:11:48 AM
	11/2/2007 05:45 PM		T329 : Petaluma - CA (ANIRA) is Down at 11/02/2007 17:11:40
	11/2/2007 05:39 PM		T329 : Petaluma - CA (ANIRA) is Down at 11/02/2007 17:11:22
	11/2/2007 05:26 PM		Bob Doxsee - WA (VPN) is Down at 11/02/2007 17:11:32
	11/2/2007 04:41 PM		T624 : Monroe - WI (Frame Relay) is Down at 11/02/2007 16:11:58
	11/2/2007 04:35 PM		Johnbar - IA (VPN) is Down at 11/02/2007 16:11:26
	11/2/2007 03:31 PM		T122A : Eau Claire - WI (VPN) is Down at 11/02/2007 15:11:44
	11/2/2007 03:29 PM		Johnbar - IA (VPN) is Down at 11/02/2007 15:11:13
	11/2/2007 02:30 PM		Johnbar - IA (VPN) is Down at 11/02/2007 14:11:18
	11/2/2007 02:06 PM		T576 : Shelbyville - IN (ANIRA) is Down at 11/02/2007 14:11:23
	11/2/2007 02:03 PM		T017A : Chicago - IL (VPN) is Down at 11/02/2007 14:11:22
	11/2/2007 02:03 PM		T017B : Chicago - IL (VPN) is Down at 11/02/2007 14:11:22
	11/2/2007 11:06 AM		AVIS : DSMAIRPORT - IA (ANIRA) is Down at 11/02/2007 11:11:37 AM
	11/2/2007 11:06 AM		RuanAIR : DSMAIRPORT - IA (ANIRA) is Down at 11/02/2007 11:11:37 AM
	11/2/2007 09:35 AM		T309C : Tipton - CA (ANIRA) is Down at 11/02/2007 9:11:29 AM
	11/2/2007 09:34 AM		T384 : Los Angeles - CA (ANIRA) is Down at 11/02/2007 9:11:14 AM
	11/2/2007 08:10 AM		T594 : Butler - PA (ANIRA) is Down at 11/02/2007 8:11:54 AM
	11/2/2007 07:30 AM		George Neely - TN (VPN) is Down at 11/02/2007 7:11:22 AM
	11/2/2007 07:15 AM		T583 : Holstein - IA (Frame Relay) is Down at 11/02/2007 7:11:46 AM
	11/1/2007 03:29 PM		T511 : Chicago - IL (VPN) is Down at 11/01/2007 15:11:21
	11/1/2007 01:44 PM		T045 : MasonCity - IA (Frame Relay) is Down at 11/01/2007 13:11:33
	11/1/2007 01:25 PM		T082 : Columbus - MS (Frame Relay) is Down at 11/01/2007 13:11:55
	11/1/2007 12:28 PM		T122A : Eau Claire - WI (VPN) is Down at 11/01/2007 12:11:01
	11/1/2007 11:28 AM		T187 : Columbus - MS (Frame Relay) is Down at 11/01/2007 11:11:51 AM
	11/1/2007 11:18 AM		Alert: The System Description of T107 : Rocky Mount - NC (ANIRA) (10.20.39.1) has changed from : 8100 4.4.20 to 8100 4.6.38
	11/1/2007 10:54 AM		T187 : Columbus - MS (Frame Relay) is Down at 11/01/2007 10:11:52 AM
	11/1/2007 10:52 AM		T187 : Columbus - MS (Frame Relay) is Down at 11/01/2007 10:11:51 AM
	11/1/2007 10:50 AM		T187 : Columbus - MS (Frame Relay) is Down at 11/01/2007 10:11:05 AM
	11/1/2007 10:23 AM		T107 : Rocky Mount - NC (ANIRA) is Down at 11/01/2007 10:11:54 AM
	10/31/2007 07:23 PM		SW25-RCMOBILE is Down at 10/31/2007 19:10:23
	10/31/2007 07:21 PM		SW06-RC30-netadm is Down at 10/31/2007 19:10:22
	10/31/2007 05:47 PM		T036 : Bolingbrook - IL (VPN) is Down at 10/31/2007 17:47:28 PM
	10/31/2007 05:44 PM		T594 : Butler - PA (ANIRA) is Down at 10/31/2007 17:44:56 PM
	10/31/2007 05:29 PM		T594 : Butler - PA (ANIRA) is Down at 10/31/2007 17:29:50 PM
	10/31/2007 05:26 PM		T036 : Bolingbrook - IL (VPN) is Down at 10/31/2007 17:26:03 PM
	10/31/2007 05:18 PM		T594 : Butler - PA (ANIRA) is Down at 10/31/2007 17:18:15 PM
	10/31/2007 05:17 PM		T036 : Bolingbrook - IL (VPN) is Down at 10/31/2007 17:17:00 PM
	10/31/2007 05:12 PM		T594 : Butler - PA (ANIRA) is Down at 10/31/2007 17:12:13 PM
	10/31/2007 04:45 PM		T036 : Bolingbrook - IL (VPN) is Down at 10/31/2007 16:45:01 PM
	10/31/2007 04:36 PM		T036 : Bolingbrook - IL (VPN) is Down at 10/31/2007 16:36:58 PM
	10/31/2007 12:55 PM		T511 : Chicago - IL (VPN) is Down at 10/31/2007 12:55:48 PM
	10/31/2007 12:28 PM		T127 : Adams - WI (Frame Relay) is Down at 10/31/2007 12:28:50 PM
	10/31/2007 11:10 AM		T384 : Los Angeles - CA (ANIRA) is Down at 10/31/2007 11:10:47 AM

I find the re-occurance of the "11" minute very coincidental. Anyone have any thoughts on this?

Find more posts tagged with

Accepted answers

All comments

chris.schear

Actually...now I think it's an 8.5.1 thing. I upgrade from 8.1 on Oct 31 at 6:30pm-ish. All of my event/alert time stamps since that time have almost always included some-hour, 11 MINUTES. The "xx:11:xx" is a reoccurring theme. There appears to be something wrong with hour, minute, seconds in variables in 8.5.1.

	11/1/2007 01:25 PM		T082 : Columbus - MS (Frame Relay) is Down at 11/01/2007 13:11:55
	11/1/2007 12:28 PM		T122A : Eau Claire - WI (VPN) is Down at 11/01/2007 12:11:01
	11/1/2007 11:28 AM		T187 : Columbus - MS (Frame Relay) is Down at 11/01/2007 11:11:51 AM
	11/1/2007 11:18 AM		Alert: The System Description of T107 : Rocky Mount - NC (ANIRA) (10.20.39.1) has changed from : 8100 4.4.20 to 8100 4.6.38
	11/1/2007 10:54 AM		T187 : Columbus - MS (Frame Relay) is Down at 11/01/2007 10:11:52 AM
	11/1/2007 10:52 AM		T187 : Columbus - MS (Frame Relay) is Down at 11/01/2007 10:11:51 AM
	11/1/2007 10:50 AM		T187 : Columbus - MS (Frame Relay) is Down at 11/01/2007 10:11:05 AM
	11/1/2007 10:23 AM		T107 : Rocky Mount - NC (ANIRA) is Down at 11/01/2007 10:11:54 AM
	10/31/2007 07:23 PM		SW25-RCMOBILE is Down at 10/31/2007 19:10:23
	10/31/2007 07:21 PM		SW06-RC30-netadm is Down at 10/31/2007 19:10:22
	10/31/2007 05:47 PM		T036 : Bolingbrook - IL (VPN) is Down at 10/31/2007 17:47:28 PM
	10/31/2007 05:44 PM		T594 : Butler - PA (ANIRA) is Down at 10/31/2007 17:44:56 PM
	10/31/2007 05:29 PM		T594 : Butler - PA (ANIRA) is Down at 10/31/2007 17:29:50 PM
	10/31/2007 05:26 PM		T036 : Bolingbrook - IL (VPN) is Down at 10/31/2007 17:26:03 PM
	10/31/2007 05:18 PM		T594 : Butler - PA (ANIRA) is Down at 10/31/2007 17:18:15 PM

chris.schear

Case 23265 opened.

Network_Guru

If you wait until December, I wouldn't be surprised if all the timestamps have 12s in them.... LOL.

chris.schear

That would be a curious pointer as to what the issue is

I might set the clock on the server ahead a month and see what happens.

chris.schear

I conducted a test at 11:40:52. Below are the outputs of the variables I was testing with. As you will note, there is a problem with the "${MM}" variable, which is what I'm using. It always reports "11". ${Minute} works normally, so I can painfully update around 50 different alerts (and their resets) and change MM to Minute, as a work around.

MM: 11
Minute: 40
Time: 11:40
LongTime: 11:40:52
ShortTime: 11:40

FormerMember

I've captured this bug.

bleearg13

Just out of curiosity, why do you use individual Hour, Minute, and Second variables as opposed to ${DateTime}?

chris.schear

Couple of reasons... Many moons ago, in a version far, far away, there was an issue with the ${DateTime} and I went to using the individual variables. Just never switched back. I also wanted to use 24 hour time and this was an attempt to do that, also a long time ago.

bleearg13

Cool, thanks for the explanation. I wasn't suggesting you switch, I just didn't know if there was some advantage - and it looks like there is!

chris.schear

As an update... Now that we are in December, all time stamps in email notifications are being reported in the "12th minute", because it is Dec, the 12th month. My time is no longer stating "11", as it was in November. Clearly, the month is being incorrectly stated in the ${MM} variable.

SamuelB

According to the list of variables that are in the Administrator guide, ${M} is both the current month and the current minute. The guide states that ${MM} is current month as a two digit number and ${Minute} is the current minute two digit number. This was obviously an oversight on SolarWinds part that needs to be corrected both in Orion and in the Administrator guide. The excerpt I am looking at was the variables that (I think) Mark Wiggans posted as the latest variable guide.