packet loss between Newark and China Unicom

I'm seeing ~30-40% packet loss between my node in Newark and 112.91.175.149, a server on a China Unicom line in Zhanjiang. This has been consistent since I started hitting this box weeks ago. It takes more than an hour to download over HTTP a 5 megabyte file using wget in retry mode with –timeout=180, with many retries.

I get zero packet loss from a Comcast residential connection in Connecticut, and the same download takes only a couple minutes with no retries.

mtr from Newark:````
Packets Pings
Host Loss% Snt Last Avg Best Wrst StDev
1. 207.99.1.13 0.0% 115 0.5 2.4 0.4 33.8 5.0
2. 207.99.53.41 0.0% 115 0.6 0.9 0.4 16.7 1.6
3. vlan801.tbr1.mmu.nac.net 0.0% 115 0.5 0.7 0.3 3.7 0.7
4. 0.e1-1.tbr1.tl9.nac.net 0.0% 115 1.5 1.8 1.4 5.2 0.7
5. nyk-b3-link.telia.net 0.0% 115 1.7 2.3 1.4 38.5 3.7
6. nyk-bb1-link.telia.net 0.0% 115 1.8 8.5 1.7 132.4 22.3
7. sjo-bb1-link.telia.net 0.0% 115 76.3 75.6 74.9 85.4 1.7
8. chinaunicom-ic-141282-sjo-bb1.c.telia.net 32.5% 115 369.3 369.0 365.2 374.7 1.7
9. 219.158.29.237 28.9% 115 316.4 317.6 313.0 369.0 6.6
10. 219.158.96.217 40.7% 114 394.6 390.5 375.9 402.4 5.6
11. 219.158.11.153 39.5% 114 368.1 370.8 366.3 408.2 7.6
12. 219.158.19.90 43.9% 114 369.2 368.8 365.3 374.9 1.3
13. 120.82.0.110 43.0% 114 377.5 381.1 375.5 394.1 5.0
14. 120.80.213.30 49.1% 114 351.6 351.9 346.4 366.8 3.3
15. 120.80.213.246 36.8% 114 352.1 352.6 348.9 399.2 6.2
16. ???
17. ???
18. 112.91.175.149 42.0% 113 382.4 381.5 377.2 418.0 4.9

mtr from Comcast cable in Connecticut:````
                                                          Packets               Pings
 Host                                                   Loss%   Snt   Last   Avg  Best  Wrst StDev
 1\. 192.168.1.1                                          0.0%    22    1.8   1.2   0.8   4.5   0.8
 2\. 96.120.66.21                                         0.0%    22    8.8   9.5   7.0  16.9   2.6
 3\. te-3-1-rr01.whartford.ct.hartford.comcast.net        0.0%    22    7.9  10.5   7.2  30.2   4.8
 4\. po-51-rr01.bloomfield.ct.hartford.comcast.net        0.0%    22   12.4   9.9   7.2  18.2   2.5
 5\. be-50-ar01.chartford.ct.hartford.comcast.net         0.0%    22   16.2  14.8  10.7  23.5   3.2
 6\. pos-1-4-0-0-ar01.needham.ma.boston.comcast.net       0.0%    22   16.2  17.4  12.8  26.2   3.5
 7\. pos-3-11-0-0-cr01.newyork.ny.ibone.comcast.net       0.0%    22   20.1  23.1  19.1  32.8   3.4
 8\. pos-1-6-0-0-pe01.111eighthave.ny.ibone.comcast.net   0.0%    22   21.2  22.3  19.5  27.2   2.1
 9\. 192.205.37.33                                        0.0%    22   28.7  22.8  19.7  30.1   2.9
10\. cr1.n54ny.ip.att.net                                 0.0%    22  109.1 106.2 102.2 116.4   3.4
11\. cr2.cgcil.ip.att.net                                 0.0%    22  103.3 105.3 102.0 111.2   2.3
12\. cr1.cgcil.ip.att.net                                 0.0%    22  110.1 105.3 101.7 110.2   2.4
13\. cr2.dvmco.ip.att.net                                 0.0%    22  109.0 106.1 101.3 112.3   3.3
14\. cr1.slkut.ip.att.net                                 0.0%    22  105.8 105.2 101.2 115.2   3.2
15\. cr2.la2ca.ip.att.net                                 0.0%    22  106.6 107.9 101.8 118.7   4.9
16\. cr84.la2ca.ip.att.net                                0.0%    22  102.0 103.6 100.4 118.0   4.4
17\. gar3.lsrca.ip.att.net                                0.0%    22  104.3 103.5  99.5 118.1   4.5
18\. 12.116.103.6                                         0.0%    22  550.2 576.7 509.6 644.4  41.7
19\. 219.158.4.177                                        0.0%    22  559.5 580.5 519.1 646.7  41.3
20\. 219.158.15.14                                        0.0%    22  566.9 577.3 510.8 649.1  39.8
21\. 219.158.19.86                                        0.0%    22  563.4 577.5 513.9 645.3  41.0
22\. 120.82.0.118                                         0.0%    22  573.2 588.3 525.5 656.7  39.9
23\. 120.80.213.30                                        0.0%    22  575.2 587.4 523.6 655.3  41.7
24\. 120.80.213.246                                       0.0%    22  572.8 585.4 522.4 655.1  40.6
25\. ???
26\. ???
27\. 112.91.175.149                                       0.0%    20  569.7 581.3 521.5 652.0  39.5

I also tried from a Linode in Fremont. It wasn't as bad as in Newark, but there was significant packet loss and the download took 15 minutes with several timeouts and retries.

mtr from Fremont:````
Packets Pings
Host Loss% Snt Last Avg Best Wrst StDev
1. 184.105.143.86 0.0% 21 19.5 1.9 0.4 19.5 4.4
2. 10gigabitethernet2-2.core2.fmt1.he.net 0.0% 21 11.1 3.5 0.3 11.1 4.3
3. 10gigabitethernet2-2.core1.fmt1.he.net 0.0% 21 0.6 6.5 0.6 63.1 13.6
4. 10gigabitethernet1-2.core1.sjc2.he.net 0.0% 21 0.8 2.3 0.8 11.4 2.7
5. chinaunicom.gigabitethernet6-5.core1.sjc2.he.net 4.8% 21 33.6 33.9 31.6 35.4 0.8
6. 219.158.25.25 4.8% 21 216.4 216.6 214.2 228.2 2.9
7. 219.158.97.117 14.3% 21 217.5 218.8 216.5 234.1 4.0
8. 219.158.97.101 9.5% 21 220.3 219.9 218.4 222.6 1.1
9. 219.158.13.182 19.0% 21 232.4 233.6 229.4 252.7 5.1
10. 219.158.19.90 20.0% 21 234.0 232.5 230.1 234.1 1.1
11. 120.82.0.118 20.0% 21 246.6 242.7 240.3 247.0 2.1
12. 120.80.213.30 20.0% 21 306.4 306.0 304.1 308.7 1.1
13. 120.80.213.246 0.0% 20 243.2 243.0 240.4 247.7 1.5
14. ???
15. ???
16. 112.91.175.149 5.0% 20 229.7 228.7 227.6 229.7 0.7

````

Anything to be done about this? Also, if anyone has nodes in other datacenters, could you post an mtr to 112.91.175.149?

4 Replies

If it helps, mine from Newark:

Host                                Loss%   Snt   Last   Avg  Best  Wrst StDev
 1\. 207.99.1.13                       0.0%   109    0.5   1.2   0.4  22.5   3.1
 2\. 207.99.53.41                      0.0%   109    0.4   2.7   0.4 134.3  15.3
 3\. vlan805.tbr2.mmu.nac.net          0.0%   109    0.3   1.9   0.3  11.2   3.0
 4\. 0.e1-2.tbr2.ewr.nac.net           0.0%   109   11.9   3.2   1.0  11.9   3.5
 5\. nyk-b2-link.telia.net             0.0%   109    1.0   1.8   0.9  33.4   4.5
 6\. nyk-bb2-link.telia.net            0.0%   109    1.4   6.3   1.3  98.7  16.1
 7\. sjo-bb1-link.telia.net            0.0%   108   74.7  75.3  74.6 115.0   4.1
 8\. chinanetcom-ic-127288-sjo-bb1.c.  8.3%   108  376.3 374.2 370.7 377.8   1.5
 9\. 219.158.29.237                    0.0%   108  324.4 324.6 323.5 348.4   2.8
10\. 219.158.97.33                    18.5%   108  368.1 367.5 364.5 383.0   2.9
11\. 219.158.96.225                   14.8%   108  365.1 365.1 362.7 393.1   4.9
12\. 219.158.19.78                     9.3%   108  350.7 350.1 348.3 353.2   0.8
13\. 120.82.0.102                     14.8%   108  378.3 379.3 376.9 427.9   6.6
14\. 120.80.215.42                    10.2%   108  380.4 378.6 374.7 386.9   3.3
15\. 120.80.213.246                   19.6%   108  350.6 354.6 349.2 477.1  20.6
16\. ???
17\. ???
18\. 112.91.175.149                   14.0%   108  438.3 438.8 436.4 443.7   1.6

From the Caribbean:

|------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                   |
|                       Host              -   %  | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------|
|                            192.168.11.1 -    0 |   57 |   57 |    0 |    0 |    2 |    1 |
|                   No response from host -  100 |   12 |    0 |    0 |    0 |    0 |    0 |
| 1-0-27-72-br1-DYNAMIC-dsl.cwj -    2 |   54 |   53 |   35 |  209 |  370 |  221 |
|                           208.138.47.42 -    0 |   58 |   58 |   45 |  213 |  403 |  203 |
|                           208.138.47.21 -    0 |   58 |   58 |    9 |  208 |  402 |  234 |
|                          208.138.27.198 -    2 |   55 |   54 |   47 |  245 |  438 |  127 |
|xe-0-6-0-5.r04.miamfl02.us.bb.gin.ntt.net -    0 |   58 |   58 |   65 |  250 |  424 |  205 |
|                          192.205.35.117 -    4 |   50 |   48 |   79 |  249 |  407 |  279 |
|                   cr81.fldfl.ip.att.net -    4 |   51 |   49 |  111 |  320 |  531 |  124 |
|                    cr2.ormfl.ip.att.net -    2 |   54 |   53 |  151 |  321 |  492 |  364 |
|                    cr1.ormfl.ip.att.net -    4 |   50 |   48 |  117 |  315 |  508 |  387 |
|                    cr2.hs1tx.ip.att.net -    0 |   58 |   58 |  158 |  323 |  498 |  379 |
|                    cr1.dlstx.ip.att.net -    4 |   54 |   52 |  153 |  318 |  521 |  298 |
|                    cr2.dlstx.ip.att.net -    2 |   54 |   53 |  158 |  326 |  509 |  400 |
|                    cr2.la2ca.ip.att.net -    4 |   50 |   48 |  114 |  300 |  486 |  372 |
|                   cr84.la2ca.ip.att.net -    2 |   55 |   54 |  112 |  312 |  498 |  162 |
|                   gar3.lsrca.ip.att.net -   10 |   42 |   38 |  101 |  313 |  466 |  372 |
|                            12.116.103.6 -   18 |   35 |   29 |  589 |  808 |  974 |  690 |
|                           219.158.4.145 -   13 |   41 |   36 |  614 |  783 |  945 |  832 |
|                          219.158.22.254 -   22 |   32 |   25 |  653 |  798 |  995 |  682 |
|                           219.158.19.70 -   36 |   25 |   16 |  592 |  796 |  954 |  837 |
|                            120.82.0.102 -   18 |   35 |   29 |  607 |  822 |  973 |  689 |
|                           120.80.215.42 -   28 |   29 |   21 |  631 |  804 |  960 |  903 |
|                          120.80.213.246 -   16 |   39 |   33 |    0 |  831 | 1007 |  830 |
|                   No response from host -  100 |   12 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |   12 |    0 |    0 |    0 |    0 |    0 |
|                          112.91.175.149 -   17 |   37 |   31 |  569 |  777 |  948 |  833 |
|________________________________________________|______|______|______|______|______|______|

From London:````
Host Loss% Snt Last Avg Best Wrst StDev
1. 212.111.33.229 0.0% 100 0.5 0.9 0.4 14.6 2.0
2. 212.111.33.233 0.0% 100 0.4 1.4 0.3 69.2 7.2
3. te3-1-border76-01.lon2.telecity. 45.0% 100 0.8 0.7 0.7 0.9 0.0
4. 85.90.238.45 18.0% 100 0.9 6.2 0.8 131.8 21.1
5. 85.90.238.42 40.4% 100 0.9 8.4 0.9 156.5 29.3
6. ldn-b3-link.telia.net 3.0% 100 0.7 1.1 0.7 26.1 3.0
7. ldn-bb1-link.telia.net 0.0% 100 0.8 6.7 0.7 140.6 20.4
8. nyk-bb1-link.telia.net 0.0% 100 78.0 78.1 72.8 171.1 18.5
9. sjo-bb1-link.telia.net 0.0% 100 148.9 149.2 148.9 175.8 2.7
10. chinanetcom-ic-127288-sjo-bb1.c. 0.0% 100 147.2 147.2 147.1 147.4 0.0
11. 219.158.30.233 4.0% 100 374.1 375.7 373.2 415.6 5.9
12. 219.158.97.21 4.0% 100 379.8 379.7 378.2 380.2 0.3
13. 219.158.11.201 5.0% 100 371.9 373.4 369.8 435.8 7.6
14. 219.158.19.82 3.0% 100 382.0 381.5 380.8 382.2 0.3
15. 120.82.0.118 7.1% 100 396.0 396.9 395.2 407.2 2.0
16. 120.80.213.30 4.0% 100 391.3 391.3 390.0 393.3 0.5
17. 120.80.213.246 3.0% 100 392.9 392.9 391.5 396.0 0.5
18. ???
19. ???
20. 112.91.175.149 0.0% 100 394.7 394.6 393.0 395.5 0.4

From Amsterdam:````
 Host                                Loss%   Snt   Last   Avg  Best  Wrst StDev
 1\. fritz.box                         0.0%   100    0.6   0.7   0.5   1.0   0.1
 2\. lo1.dr9.d12.xs4all.net           18.0%   100   39.9  29.2  25.2  48.2   7.0
 3\. 1419.ae3.xr4.1d12.xs4all.net     16.0%   100   25.9  26.9  24.8  55.8   4.8
 4\. nl-asd-dc2-ice-ir01.kpn.net       6.0%   100   35.1  31.8  25.3  37.6   3.6
 5\. asd2-rou-1022.nl.eurorings.net    5.0%   100   25.3  29.1  25.0  88.5  12.2
 6\. rt2-rou-1041.NL.eurorings.net     1.0%   100   27.8  30.4  26.8  93.5  11.4
 7\. rt2-rou-1022.NL.eurorings.net     0.0%   100   27.3  31.2  26.9 107.4  12.6
 8\. nyk-s1-rou-1021.US.eurorings.net  0.0%   100  109.4 108.8 105.5 138.9   7.4
 9\. nyk-s1-rou-1001.US.eurorings.net  0.0%   100  188.0 189.5 188.0 239.4   6.0
10\. chg-s1-rou-1001.US.eurorings.net  7.0%   100  189.2 188.6 187.8 208.0   2.1
11\. chg-s1-rou-1041.US.eurorings.net  0.0%   100  188.7 192.0 187.7 254.2  12.0
12\. sjca-s1-rou-1041.US.eurorings.ne  0.0%   100  188.2 190.1 187.8 225.7   6.8
13\. sjca-s1-rou-1001.US.eurorings.ne  0.0%   100  188.2 190.2 187.8 267.9  10.0
14\. 134.222.249.86                    0.0%   100  188.4 188.2 187.7 191.2   0.5
15\. 219.158.30.45                     0.0%   100  333.7 332.6 330.4 357.4   4.2
16\. 219.158.97.1                      0.0%   100  330.8 331.1 330.4 338.0   0.8
17\. 219.158.3.253                     0.0%   100  348.7 348.1 347.2 357.4   1.1
18\. 219.158.19.82                     1.0%   100  351.2 351.2 350.4 358.6   1.1
19\. 120.82.0.102                      1.0%   100  353.9 353.9 353.1 371.6   1.8
20\. 120.80.215.42                     4.0%   100  359.5 359.4 358.1 367.5   1.5
21\. 120.80.213.246                    7.1%   100  355.2 355.1 353.7 385.5   3.3
22\. ???
23\. ???
24\. 112.91.175.149                   18.2%   100  358.3 358.3 357.5 359.4   0.4

From West Coast USA (Glendale, Charter Cable [Los Angeles Area])

|------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                   |
|                       Host              -   %  | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------|
|                                 GLNDRTR -    0 |    5 |    5 |    0 |    0 |    1 |    0 |
|                               10.91.0.1 -    0 |    5 |    5 |    5 |    8 |   11 |    9 |
|dtr03mtpkca-tge-0-1-0-0.mtpk.ca.charter.com -    0 |    5 |    5 |    8 |   11 |   13 |   13 |
|crr01mtpkca-tge-0-4-0-2.mtpk.ca.charter.com -    0 |    5 |    5 |    9 |   15 |   22 |   18 |
|crr02mtpkca-tge-0-0-0-6.mtpk.ca.charter.com -    0 |    5 |    5 |   12 |   12 |   13 |   12 |
|bbr01mtpkca-tge-0-3-0-6.mtpk.ca.charter.com -    0 |    5 |    5 |   13 |   14 |   16 |   16 |
|                          66.186.192.133 -    0 |    5 |    5 |   14 |   16 |   17 |   17 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|                           219.158.25.57 -    0 |    5 |    5 |  512 |  521 |  534 |  534 |
|                           219.158.97.89 -    0 |    5 |    5 |  281 |  283 |  286 |  286 |
|                          219.158.97.105 -    0 |    5 |    5 |  289 |  292 |  293 |  293 |
|                          219.158.97.138 -    0 |    5 |    5 |  282 |  284 |  287 |  287 |
|                           219.158.19.90 -    0 |    3 |    3 |  279 |  279 |  280 |  280 |
|                            120.82.0.102 -    0 |    5 |    5 |  291 |  292 |  295 |  292 |
|                           120.80.215.42 -    0 |    5 |    5 |  292 |  294 |  295 |  295 |
|                          120.80.213.246 -    0 |    3 |    3 |  295 |  338 |  370 |  351 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|                          112.91.175.149 -    0 |    5 |    5 |  293 |  293 |  294 |  294 |
|________________________________________________|______|______|______|______|______|______|
   WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider

After looking at the various MTRs, it does not look like the issue is with linode, but most probably by the hosts provider in China "ChinaUnicom" whose international links and backbone is saturated..

Reply

Please enter an answer
Tips:

You can mention users to notify them: @username

You can use Markdown to format your question. For more examples see the Markdown Cheatsheet.

> I’m a blockquote.

I’m a blockquote.

[I'm a link] (https://www.google.com)

I'm a link

**I am bold** I am bold

*I am italicized* I am italicized

Community Code of Conduct