House.gov Goes Offline

by

Those of us at Sunlight Labs spent the past few minutes panicking as House of Representatives member sites stopped responding to requests from our office. A brief round of recriminations followed (“Please don’t tell me you forgot to throttle your scraper”). But as www.house.gov winked out, and then requests from our EC2 machines stopped coming back, it started looking more likely that the House is down, and that its minutes-long death throes represented its DNS data timing out and disappearing from caches around the web.

So far this looks like a DNS outage, and one that affects the House MX records. That means that it isn’t just websites that are down: emails will be bouncing, too. That’s bad news.

The .gov root servers still show correct nameservers for the house:

tomlee@Toms-MacBook-Air:~$ dig @69.36.157.30 house.gov ANY
; <<>> DiG 9.8.3-P1 <<>> @69.36.157.30 house.gov ANY
; (1 server found)
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 32435
;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 2, ADDITIONAL: 2
;; WARNING: recursion requested but not available
;; QUESTION SECTION:
;house.gov. IN ANY
;; AUTHORITY SECTION:
house.gov. 86400 IN NS chyron.house.gov.
house.gov. 86400 IN NS mercury.house.gov.
;; ADDITIONAL SECTION:
chyron.house.gov. 86400 IN A 143.228.129.38
mercury.house.gov. 86400 IN A 143.231.1.67
;; Query time: 13 msec
;; SERVER: 69.36.157.30#53(69.36.157.30)
;; WHEN: Fri Mar 28 12:16:34 2014
;; MSG SIZE rcvd: 102
view raw gistfile1.txt hosted with ❤ by GitHub

But those nameservers currently respond to DNS requests with empty replies. As a result, external systems don’t have any information about how to contact House servers. Here’s the output from Google’s DNS:

tomlee@Toms-MacBook-Air:~$ dig @8.8.8.8 house.gov ANY
; <<>> DiG 9.8.3-P1 <<>> @8.8.8.8 house.gov ANY
; (1 server found)
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 45174
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION:
;house.gov. IN ANY
;; Query time: 66 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Fri Mar 28 12:14:57 2014
;; MSG SIZE rcvd: 27
view raw gistfile1.txt hosted with ❤ by GitHub

We’re sure the folks in the Sargeant at Arms’ office are plenty busy right now, so we’ll refrain from calling them. But we’re happy to lend a hand if they need it!

More updates here as we have them.

UPDATE: Phew! Looks like they’re back up.