A few Sunlighters took off for the west coast last week to attend PyCon, the largest annual gathering for the... View Article
Continue readingThis Is Why Government Should Use Open Formats
James Fee brings news of a dismaying decision by an Ohio court. A real estate appraiser named Robert Gambill tried... View Article
Continue readingOpen Data Day DC, 2013
A couple Saturdays ago, I helped Josh Tauberer, Kat Townsend, Dmitri Kachaev, Sam Lee, and Julia Bezgacheva organize a hackathon... View Article
Continue readingBreaking the Law, by Reading It
The United States continues to keep some of its most important laws behind a paywall. Many of the US’ public... View Article
Continue readingKeeping GPO’s Data Free
The Government Printing Office’s data portal, FDSys, is a major pillar of US government transparency and access to information. Information... View Article
Continue readingFDLP Allergic to Curl
Waldo Jaquith discovered that the FDLP (Federal Depository Library Program) appears to have an allergic reaction to people downloading their data with basic command line tools.
Continue readingfdlp․gov blocks requests from cURL with a 403 and a "malware detected" error. >:-/
— Waldo Jaquith (@waldojaquith) January 2, 2013
The Data and Tech Behind Sitegeist
It's been three weeks since we launched Sitegeist and the response has greatly exceeded (my) expectations! There have been over 27,000 downloads of the iOS and Android apps and a flood of feedback emails. Thanks again to the Knight Foundation and IDEO for their help in creating the app!
Continue readingSunlight from the Command Line
Are you as big of a fan of Paul Tagliamonte as I am? If so, then you are well aware of python-sunlight, his awesome, comprehensive Python API client for Sunlight's APIs. The latest release includes a command line interface, or CLI, so you can interact with the Sunlight APIs directly from the shell. Cool, right?
Continue readingInfluence Explorer API, Now with Entity Type Filtering
Last year, we wrote about how to get access to our political influence data via the Influence Explorer API. That post is a great introduction, but here's an update on a small, but significant, improvement we've made to make accessing our data easier.
Continue readingElection Night Snapshots
Late last week, we had an idea: election night was sure to be a confusing rush, and the closeness of the race in many states made result-reporting snafus seem possible. And the basic shape of election night data is deeply lousy (outside of media outlets that subscribe to the AP). Why not try to keep a record of what election authorities disclosed, so we could have a closer look in the morning?
Drew and Kaitlin adapted some of Politwoops' code, and we quickly researched as many URLs for election results as we could. The results are necessarily incomplete: some states don't aggregate their results in a central place, and some only went online during election night. But we managed a pretty good start.
We also decided to throw in a few media outlets, just for fun (and then a few more once the results began to come in and it became clear which sites might have to back off their predictions in a maximally screenshottable way). The results includes screenshots and HTML snapshots. Everything's timestamped -- the frequency of snapshots was determined both by when things changed (we only recorded new snapshots when something had been updated) and by the round-robining of the system (which was somewhat variable, based on the speed of the screenshot process).
We haven't had time to go through all of this data, but we'd love your help (or just the chance to satisfy your curiosity). So if you'd like, head over to electionshots.sunlightlabs.com. The content is organized by state -- ZZ is the media. We're working to put together bulk download options now.
Continue reading