Computation &General Wesley R. Elsberry on 16 Jan 2012 09:19 am
Verizon FIOS Doesn’t Talk to Verizon FIOS?
I have a bit more information about the connection difficulties I’ve been having with my ISP, Verizon FIOS. I have a residential account in Palmetto, FL with Verizon FIOS. Mostly, it works fine. I can get to a host of web sites without difficulty, and the transfer speeds are great.
I do remote system administration on two servers in the Dallas-Fort Worth Metroplex. Those servers get their connection via a Verizon FIOS Business plan link. (Yes, Verizon, the servers are on an account where serving is usual and expected.) One server provides my regular email, the other serves a whole bunch of web sites via virtual hosting. And things there are mostly working, where the outside world can merrily get pages served on demand.
But…
As of sometime early last Tuesday morning, January 10th, Verizon FIOS stopped reliably talking to Verizon FIOS. I can tell the approximate time of the outage as the last email message my computer here picked up from the server there was at 1:09 AM CT. The problem is very likely to have manifested within a very few minutes after that. And the problem’s characteristics are just plain weird. One expects most ‘problems’ with connections to be user error. Certainly that’s the primary basis of Verizon FIOS’s residential account tech support, who are ready to quit if the problem isn’t solved by having the user clear their browser cache or resetting the router. This problem, though, is more complex and is not localized to my particular account. First, not all connectivity is gone, just *most* connectivity. I can use SSH to log in remotely and use commands that return small amounts of information. Once I try a command that would return a page or more of text, the connection drops with a ‘Broken pipe’ message. There’s a web page that is static and is only a few hundred characters in size that I can successfully retrieve. But none of the web sites that rely on web applications (Drupal, WordPress, and IkonBoard) do anything but spin forever while the browser displays ‘Waiting on …’.
So let me jot down some things I’ve learned about this so far.
* It isn’t a DNS issue, as ‘nslookup’ finds any of the domain names and returns the correct IP address quite rapidly.
* It isn’t a single port failure. Ports 22, 25, 80, and 587 are, at a minimum, included in the affected list.
* It isn’t a complete break, as connections on the scale of a single packet of data at a time work.
* Using traceroute for other websites shows three hops taken within the Verizon routing center in Tampa. Traceroute for the affected servers shows two hops taken similarly, but the third times out.
* My parents live in Lakeland, Florida, a goodly distance away from where I live, and have Verizon FIOS as their ISP. I visited there this past weekend and asked my dad if he had been able to check this blog recently. He said no, not for about the past week. I tried traceroute from their connection, and it behaved the same way as from my home connection. The problem is not localized, it affects other Verizon FIOS customers.
* I’ve heard from Texas where another Verizon FIOS user of the email system cannot connect to the email server. I don’t have a traceroute result from them to compare.
I have two open tickets on this problem with Verizon, FLCP08NT6J and FLDQ090SXY. There are some other people who have posted to the web saying that they are having network difficulties with Verizon FIOS in the same time frame, but I haven’t seen a report that exactly matches what I am seeing. I’m writing this post by the expedient of using a proxy for my browser, which is a nuisance. (While it is on, my Google search results tend to come back in German, which I can’t read.) It’s a bit of a Catch-22, since I’d like to get feedback from Verizon FIOS users, but if the problem is of the nationwide scale that I expect it is, this post will be unaccessible to them from that account. On the other hand, if it is accessible via Verizon FIOS elsewhere, that would be useful information to have. If you are a Verizon FIOS user, I would appreciate it if you could run traceroute from the Verizon account to baywing.net and copy the results into a comment here. I’ll copy my traceroute results into a comment here shortly.
How to invoke traceroute:
Under Windows, open a command prompt. In the command prompt, type in the following:
tracert baywing.net > tr_baywing.txt
It will take a few minutes to complete if you also have the problem I’m having. The result ill be in a text file, ‘tr_baywing.txt’, in that directory. Copy and paste the text in a comment here if you aren’t seeing the problem, or contact me if you are having the problem.
On Mac or FreeBSD, open a terminal window. At the command prompt, type in:
traceroute baywing.net > tr_baywing.net
On Ubuntu Linux, open a terminal window. At the command prompt, type:
tracepath baywing.net > tr_baywing.net
Here’s my email, if you can’t leave a comment here (remove spaces and convert to symbols as indicated): w e l s b e r r at b a y w i n g dot n e t
Viewed 29054 times by 2208 viewers
CafePress Shop
on 16 Jan 2012 at 9:21 am 1.Wesley R. Elsberry said …
Tracing route to baywing.net [71.123.242.56]
over a maximum of 30 hops:
1 <1 ms <1 ms <1 ms myrouter.home [192.168.1.1]
2 6 ms 6 ms 6 ms L100.TAMPFL-VFTTP-138.verizon-gni.net [96.243.148.1]
3 10 ms 9 ms 8 ms G0-9-2-6.TAMPFL-LCR-22.verizon-gni.net [130.81.140.68]
4 * * * Request timed out.
5 40 ms 39 ms 38 ms 130.81.23.204
6 42 ms 43 ms 43 ms P13-0.DLLSTX-LCR-06.verizon-gni.net [130.81.199.45]
7 42 ms 42 ms 41 ms P14-0-0.DLLSTX-LCR-08.verizon-gni.net [130.81.27.43]
8 * * * Request timed out.
9 * * * Request timed out.
10 * * * Request timed out.
11 * * * Request timed out.
12 * * * Request timed out.
13 * * * Request timed out.
14 * * * Request timed out.
15 * * * Request timed out.
16 * * * Request timed out.
17 * * * Request timed out.
18 * * * Request timed out.
19 * * * Request timed out.
20 * * * Request timed out.
21 * * * Request timed out.
22 * * * Request timed out.
23 * * * Request timed out.
24 * * * Request timed out.
25 * * * Request timed out.
26 * * * Request timed out.
27 * * * Request timed out.
28 * * * Request timed out.
29 * * * Request timed out.
30 * * * Request timed out.
Trace complete.
on 27 Jan 2012 at 6:30 pm 2.Jon Fleming said …
Here’s a little something from just west of Boston (I have an extra router behind my Verizon router to operate a VPN).
Tracing route to baywing.net [71.123.242.56]
over a maximum of 30 hops:
1 1 ms 1 ms 1 ms 192.168.13.1
2 2 ms 2 ms 2 ms 192.168.1.1
3 26 ms 3 ms 3 ms 10.9.44.4
4 4 ms 3 ms 3 ms P9-0.BSTNMA-LCR-02.verizon-gni.net [130.81.37.250]
5 4 ms 4 ms 4 ms so-7-0-0-0.BOS-BB-RTR2.verizon-gni.net [130.81.29.166]
6 56 ms 55 ms 55 ms P14-0-0.DLLSTX-LCR-08.verizon-gni.net [130.81.27.43]
7 * * * Request timed out.
8 * * * Request timed out.
9 * * * Request timed out.
10 * * * Request timed out.
11 * * * Request timed out.
12 * * * Request timed out.
13 * * * Request timed out.
14 * * * Request timed out.
15 * * * Request timed out.
16 * * * Request timed out.
17 * * * Request timed out.
18 * * * Request timed out.
19 * * * Request timed out.
20 * * * Request timed out.
21 * * * Request timed out.
22 * * * Request timed out.
23 * * * Request timed out.
24 * * * Request timed out.
25 * * * Request timed out.
26 * * * Request timed out.
27 * * * Request timed out.
28 * * * Request timed out.
29 * * * Request timed out.
30 * * * Request timed out.
Trace complete.