As stated in the note from the Sunlight Foundation′s Board Chair, as of September 2020 the Sunlight Foundation is no longer active. This site is maintained as a static archive only.

Follow Us

Tag Archive: Regulations

How to Count Regulations: A Primer for Regulatory Research


Data and Research Intern Alex Engler wrote this post. The regulatory process is a politically charged arena, where the perception of over-regulating, or not regulating enough, can become a political liability.  Whether it’s Tom Donohue of the Chamber of Commerce warning of the oncoming “tsunami” of regulations from President Obama, or the National Resource Defense Council striking at the Bush administration for an “assault on our clean air protections,” there can be no doubt that the perceived level of regulation matters. However, one should look skeptically towards assertions about the degree of rulemaking, especially when those assertions include specific numbers.  These claims are often based on research that can be structured so as to intentionally mislead. And beyond the political motivation in how one measures regulatory action, there are also many opportunities for genuine methodological error.

Continue reading

Scout: Sunlight’s New Custom Alert Service


A core mission of the Sunlight Foundation is to enable citizen participation through technology and lower the bar to access government. Through our free tools we're constantly looking for ways to produce a more transparent and accountable government. Today, we're proud to introduce Scout, a tool that allows you to create customized keyword alerts to notify you whenever issues you care about are included in legislative or regulatory actions.

Continue reading Gets an API & More


Sunlight has been interested in the federal rule-making process for quite a while: we sponsored the app contest that lead to the current incarnation of, which lists federal regulations as they are published, and kick-started an effort to map regulations to the laws that authorize them during a hackathon late last year. We also have extensive experience in the analysis of corporate influence on the political process, having launched several prominent influence-related projects under the Influence Explorer banner. During the last year, we’ve begun to examine the confluence of these two interest areas: corporate influence on the regulatory process, and, in particular, the comments individuals and corporations can file with federal agencies about proposed federal regulations. The first glimpses of the results of this effort went live on Influence Explorer last fall, with the addition of regulatory comment summaries to corporations’ profile pages.

Given this history, we’ve been excited to explore this week’s relaunch of, the federal government’s primary repository of regulatory comments, and the source of the data that powers our aforementioned Influence Explorer regulatory content. This new release brings with it a much-needed visual spruce-up, as well as improved navigation and documentation to help new users find and follow regulatory content, and a suite of social media offerings that have the potential to expose rule-making to new audiences. There have also been some improvements to document metadata, such as the addition of category information visitors can use to filter searches by industry, or browse rule-makings topically from the homepage.

Of more interest to us as web developers is the addition, for the first time, of official APIs to allow programmatic access to regulatory data. It’s clear that the team has taken note of current best practices with respect to open data APIs, and have produced clean, RESTful endpoints that allow straightforward access to what is, especially for a first release, a reasonably comprehensive subset of the data made available through the general end-user web interface. While we have been successful in performing significant regulatory analysis absent these tools, our work required substantial effort in screen-scraping and reverse engineering, and we expect that other organizations hoping to engage in regulatory comment analysis will now be able to do so without the level of technical investment we’ve had to make.

Of course, there is still work to be done. Much of the work we’ve done so far on regulations, and that we hope still to do, revolves around analysis of the actual text of the comments posted to (which can take the form of PDFs and other not-easily-machine-readable documents), and depends on being able to aggregate results over the entirety of the data, or at least significant subsets of it. As a result, even with these new APIs, we’ll still need to make large numbers of requests to identify new documents, enumerate all of the downloadable attachments for each one, download these attachments one at a time, and maintain all of the machinery necessary to do our own extraction of text from them. While we’re fortunate to have the resources to do this ourselves, and have made headway in making the fruits of our labors available for the public, it would certainly behoove the team to move forward with bulk data offerings of their own. Sunlight has a long history of advocating the release of bulk data in addition to (and perhaps even before) APIs, and the regulatory field illustrates many of our typical arguments for that position; the kinds of questions that can be answered with all of the data are fundamentally different than those that can be answered with any individual piece. We recognize that offering all of the PDFs, Word documents, etc., to the public might be cost-prohibitive from a bandwidth point of view, but is doing text extraction of their own (it powers the full-text search capabilities that the site provides), and offering bulk access to the extracted text as we have done could provide a happy medium that would facilitate many applications and analyses without breaking the bandwidth bank.

In general, we see plenty of reasons to applaud this release and the team at EPA that's behind it. While many of its changes are cosmetic and additional improvements will be necessary for to reach its full potential, this update promises further progress that will benefit developers and members of the public alike. We share the enthusiasm of the team for increasing access to and awareness of these crucial artifacts of the democratic process, and look forward to engaging with them and the broader open government community as they continue to improve this public resource.

Continue reading

Financial regulation deadlines missed


In April, federal financial agencies missed every single rulemaking deadline--26 of them--mandated by the massive Dodd-Frank financial overhaul law, according to a recent report by the law firm Davis, Polk & Wardell.

And with the year anniversary of the law's passage coming in July, a huge number of deadlines--108--are coming up this summer, many of which agencies are also likely to miss because of the huge workload. Most of these deal with the regulation of the risky derivatives market, and fall under the responsibility of the Commodity Futures Trading Commission (CFTC) and the Securities and Exchange Commission (SEC).

"It has ...

Continue reading

CFC (Combined Federal Campaign) Today 59063

Charity Navigator