This discussion has been locked. The information referenced herein may be inaccurate due to age, software updates, or external references.

You can no longer post new replies to this discussion. If you have a similar question you can start a new discussion in this forum.

Help! High Packet Loss with Voice Jitter IPSLA

rashy17 over 14 years ago

Hi All,

Hoping someone could help me explain why I see high PacketLossDS on a voice jitter IPSLA I have set up between two of my sites. I have a number of other sites working fine. This site with the high reported packet loss has the highest latency due to geographical distance from my site (about 250ms). I don't see any packet loss with a standard ICMP IPSLA. There are no firewalls in the way. Below are an extract from my router showing the config and the latest results. Both sides /routers show this high PacketlossDS value.

Entry number: 40007
Owner: SW.IpSla.DCPWVSOLA01.NetPerfMon
Tag:
Type of operation to perform: jitter
Target address: 10.x.y.z

Source address: 10.a.b.c
Target port: 17000
Source port: 0
Operation timeout (milliseconds): 180000
Codec Type: g711ulaw
Codec Number Of Packets: 100
Codec Packet Size: 100
Codec Interval (milliseconds): 20
Advantage Factor: 0
Type Of Service parameters: 0xB8
Verify data: No
Vrf Name:
Control Packets: enabled
Operation frequency (seconds): 300
Next Scheduled Start Time: Start Time already passed
Group Scheduled : FALSE
Life (seconds): Forever
Entry Ageout (seconds): 3600
Recurring (Starting Everyday): FALSE
Status of entry (SNMP RowStatus): Active
Threshold (milliseconds): 1000
Number of statistic hours kept: 2
Number of statistic distribution buckets kept: 1
Statistic distribution interval (milliseconds): 20
Enhanced History:

Start Time Index: 19:32:52.071 UTC Thu Mar 11 2010
Number of successful operations: 12
Number of operations over threshold: 0
Number of failed operations due to a Disconnect: 0
Number of failed operations due to a Timeout: 0
Number of failed operations due to a Busy: 0
Number of failed operations due to a No Connection: 0
Number of failed operations due to an Internal Error: 0
Number of failed operations due to a Sequence Error: 0
Number of failed operations due to a Verify Error: 0
Voice Scores:
MinOfICPIF: 26 MaxOfICPIF: 26 MinOfMOS: 3.45 MaxOfMOS: 3.45
RTT Values:
NumOfRTT: 288   RTTAvg: 248     RTTMin: 246     RTTMax: 250
RTTSum: 71454   RTTSum2: 17728204
Packet Loss Values:
PacketLossSD: 0 PacketLossDS: 875
PacketOutOfSequence: 0 PacketMIA: 37   PacketLateArrival: 0
InternalError: 0        Busies: 0       PacketSkipped: 0
Jitter Values:
MinOfPositivesSD: 1     MaxOfPositivesSD: 2
NumOfPositivesSD: 59    SumOfPositivesSD: 64    Sum2PositivesSD: 74
MinOfNegativesSD: 1     MaxOfNegativesSD: 3
NumOfNegativesSD: 46    SumOfNegativesSD: 66    Sum2NegativesSD: 110
MinOfPositivesDS: 1     MaxOfPositivesDS: 2
NumOfPositivesDS: 30    SumOfPositivesDS: 33    Sum2PositivesDS: 39
MinOfNegativesDS: 1     MaxOfNegativesDS: 1
NumOfNegativesDS: 28    SumOfNegativesDS: 28    Sum2NegativesDS: 28
Interarrival jitterout: 0       Interarrival jitterin: 0
One Way Values:
NumOfOW: 288
OWMinSD: 122    OWMaxSD: 126    OWSumSD: 35672 OWSum2SD: 4418572
OWMinDS: 123    OWMaxDS: 126    OWSumDS: 35782 OWSum2DS: 4445782

Many Thanks

0 mcbridea over 14 years ago

Is that number incrementing?
Cancel
Vote Up 0 Vote Down

Cancel
0 rashy17 over 14 years ago in reply to mcbridea

Yes It is, below are two consecutive outputs for test 11 and 12 and you can see this PacketDS goes up.

Start Time Index: 07:32:52.841 UTC Fri Mar 12 2010
Number of successful operations: 11
Number of operations over threshold: 0
Number of failed operations due to a Disconnect: 0
Number of failed operations due to a Timeout: 0
Number of failed operations due to a Busy: 0
Number of failed operations due to a No Connection: 0
Number of failed operations due to an Internal Error: 0
Number of failed operations due to a Sequence Error: 0
Number of failed operations due to a Verify Error: 0
Voice Scores:
MinOfICPIF: 26 MaxOfICPIF: 26 MinOfMOS: 3.45 MaxOfMOS: 3.45
RTT Values:
NumOfRTT: 264   RTTAvg: 248     RTTMin: 246     RTTMax: 253
RTTSum: 65601   RTTSum2: 16301387
Packet Loss Values:
PacketLossSD: 0 PacketLossDS: 803
PacketOutOfSequence: 0 PacketMIA: 33   PacketLateArrival: 0
InternalError: 0        Busies: 0       PacketSkipped: 0
Jitter Values:
MinOfPositivesSD: 1     MaxOfPositivesSD: 4
NumOfPositivesSD: 48    SumOfPositivesSD: 62    Sum2PositivesSD: 100
MinOfNegativesSD: 1     MaxOfNegativesSD: 6
NumOfNegativesSD: 49    SumOfNegativesSD: 60    Sum2NegativesSD: 106
MinOfPositivesDS: 1     MaxOfPositivesDS: 2
NumOfPositivesDS: 26    SumOfPositivesDS: 27    Sum2PositivesDS: 29
MinOfNegativesDS: 1     MaxOfNegativesDS: 2
NumOfNegativesDS: 27    SumOfNegativesDS: 29    Sum2NegativesDS: 33
Interarrival jitterout: 0       Interarrival jitterin: 0
One Way Values:
NumOfOW: 264
OWMinSD: 122    OWMaxSD: 128    OWSumSD: 32741 OWSum2SD: 4060749
OWMinDS: 124    OWMaxDS: 126    OWSumDS: 32860 OWSum2DS: 4090162
----------------

Start Time Index: 07:32:52.852 UTC Fri Mar 12 2010
Number of successful operations: 12
Number of operations over threshold: 0
Number of failed operations due to a Disconnect: 0
Number of failed operations due to a Timeout: 0
Number of failed operations due to a Busy: 0
Number of failed operations due to a No Connection: 0
Number of failed operations due to an Internal Error: 0
Number of failed operations due to a Sequence Error: 0
Number of failed operations due to a Verify Error: 0
Voice Scores:
MinOfICPIF: 26 MaxOfICPIF: 26 MinOfMOS: 3.45 MaxOfMOS: 3.45
RTT Values:
NumOfRTT: 288   RTTAvg: 248     RTTMin: 246     RTTMax: 253
RTTSum: 71576   RTTSum2: 17788946
Packet Loss Values:
PacketLossSD: 0 PacketLossDS: 876
PacketOutOfSequence: 0 PacketMIA: 36   PacketLateArrival: 0
InternalError: 0        Busies: 0       PacketSkipped: 0
Jitter Values:
MinOfPositivesSD: 1     MaxOfPositivesSD: 4
NumOfPositivesSD: 53    SumOfPositivesSD: 67    Sum2PositivesSD: 105
MinOfNegativesSD: 1     MaxOfNegativesSD: 6
NumOfNegativesSD: 52    SumOfNegativesSD: 64    Sum2NegativesSD: 112
MinOfPositivesDS: 1     MaxOfPositivesDS: 2
NumOfPositivesDS: 30    SumOfPositivesDS: 33    Sum2PositivesDS: 39
MinOfNegativesDS: 1     MaxOfNegativesDS: 2
NumOfNegativesDS: 31    SumOfNegativesDS: 34    Sum2NegativesDS: 40
Interarrival jitterout: 0       Interarrival jitterin: 0
One Way Values:
NumOfOW: 288
OWMinSD: 122    OWMaxSD: 128    OWSumSD: 35718 OWSum2SD: 4430038
OWMinDS: 124    OWMaxDS: 126    OWSumDS: 35858 OWSum2DS: 4464678
Cancel
Vote Up 0 Vote Down

Cancel
0 mcbridea over 14 years ago in reply to rashy17

I'm not surprised that ping does not see the losses. IP SLA is sending packets at 20ms intervals so it is much more granular. I'm wondering if there is a problem on the circuit. Is this VoIP over MPLS? If so, have you specified the proper VRF in IP SLAM? can you get the circuit tested?
The thing that surprises me is how high the MOS is with that level of DS drops. Also the level of MIA drops is odd. This is what makes me think you may have a dirty circuit.
Andy
Cancel
Vote Up 0 Vote Down

Cancel
0 rashy17 over 14 years ago in reply to mcbridea

Hi Andy,
We have had the service provider test and they actually ran their own VOIP Jitter IPSLA but between the CE routers on the MPLS. As you can see they don't see the drops, see similar latency and similar MOS. Its almost like it eitehr something to do with my config or my remote switches.

Round trip time (RTT)   Index 10
        Latest RTT: 247 ms
Latest operation start time: 17:35:21.708 gmt Mon Feb 15 2010
Latest operation return code: OK
RTT Values
        Number Of RTT: 1000
        RTT Min/Avg/Max: 247/247/249 ms
Latency one-way time milliseconds
        Number of one-way Samples: 1000
        Source to Destination one way Min/Avg/Max: 123/123/125 ms
        Destination to Source one way Min/Avg/Max: 123/123/125 ms
Jitter time milliseconds
        Number of Jitter Samples: 999
        Source to Destination Jitter Min/Avg/Max: 1/1/1 ms
        Destination to Source Jitter Min/Avg/Max: 1/1/2 ms
Packet Loss Values
        Loss Source to Destination: 0           Loss Destination to Source: 0
        Out Of Sequence: 0      Tail Drop: 0    Packet Late Arrival: 0
Voice Score Values
        Calculated Planning Impairment Factor (ICPIF): 2
MOS score: 4.32
Number of successes: 25
Number of failures: 0
Operation time to live: Forever
Cancel
Vote Up 0 Vote Down

Cancel
0 mcbridea over 14 years ago in reply to rashy17

Yes - If you are running the operations between switches that might be the issue. TAC might have insight into this one.
Cancel
Vote Up 0 Vote Down

Cancel
0 Lijin over 3 years ago in reply to rashy17

Do we have a better solution for this issue?
Here the VoIP Jitter IPSLA is between Source - Switch and Destination - Router, which shows high packet loss even though the device "show IPSLA output shows 0%
Also same source and destination UDP Jitter shows 0% in Solarwinds
So looks like some issue at Solarwinds side, so please help
Cancel
Vote Up 0 Vote Down

Cancel
0 jbburks over 3 years ago in reply to mcbridea

I am having the same issue.
All of the IP SLA operations originate on a 4300 router but the target is a local switch.
Should I expect that to be wrong? Is there any bug ID I can reference to TAC?
Cancel
Vote Up 0 Vote Down

Cancel