As stated in the note from the Sunlight Foundation′s Board Chair, as of September 2020 the Sunlight Foundation is no longer active. This site is maintained as a static archive only.

Follow Us

Tag Archive: Open Data

Your Guideline to Open Data Guidelines Pt. 1: The History

by

Last summer, Sunlight released a series of Open Data Guidelines in reaction to a surge of municipal open data policy making. In anticipation of revamping these policies this summer (to add fresh context, ideas, and exemplary language) and in reaction to a recent surge in open data policy collaboration as evidenced by the interactive Project Open Data and the newly public (beta) Open Data Stack Exchange (or maybe more accurately in reaction to the Meta Open Data Stack Exchange...), we wanted to provide a roadmap to the world open data resources and recommendations that are available to put these resources in context of their evolution over time–a guideline to Open Data Guidelines, if you will. The first step in navigating the open data guidelines out there is to examine the chronology of how they surfaced.

The timeline below provides a landscape of current open data policy guidelines, guidance, and principles that exist and showcases the chronology in which they have manifested, each guideline often directly building off of (or crafted in reaction to) its predecessor. Looking at these guidelines in context exposes the pragmatic and technical evolutions in thought that have occurred under the banner of open data pursuit: from the foundational drive to define what information is legally available (through FOIA and other public records laws) to the trailblazing concept of proactive disclosure (where "public" access means "online" access) to establishing the qualities that make data more accessible and usable (emphasizing structured, bulk data, unique IDs, and APIs). The dialogue for discussing open data policy guidelines has itself evolved from the gathering of smaller open government groups of: Open House Project, Open Government Working Group, the Open Government Initiative, and early collaborative efforts such as the Open Gov Handbook, to the editable Project Open Data and the Q&A Open Data Stack Exchange.

Continue reading

The Landscape of Municipal Zoning Data

by

Zoning impacts the most physical elements of communities and impacts people's daily lives. When it comes to being transparent about the zoning process and its outcomes, many local governments are posting information -- one way or another -- on their websites. It's a varied landscape, but it is worth assessing to see where there might be room for improvement.

WHAT WE TALK ABOUT WHEN WE TALK ABOUT ZONING

It's not surprising, in a way, that so many local governments choose to proactively release various kinds of information related to zoning. Zoning regulations can impact everything from what can be built and where it can be built to how it can be built and more. How a lot is zoned doesn't just determine whether that land can be used for commercial or residential purposes (or something else entirely) -- it can also determine the very structure of buildings down to details like height and square footage. Zoning and planning ordinances can even impact how close certain kinds of buildings may be to one another -- schools and liquor stores are one example of a spatial relationship that is sometimes regulated. Zoning has an impact on many of the most concrete aspects of a municipality, and this makes it an issue that's of interest to residents, business owners, developers, and many other groups. This means zoning can also be a prime target for people who want to game the system to obtain influence over this important aspect of cities.

Madison-street-viewThe zoning process generally consists of elected or appointed officials making decisions about how land can be used and the specifications of structures. It has a direct impact on the shape communities take. The zoning process, and what it controls, however, varies from place to place. That means it's important for each municipality to be clear about what its process is so policymakers, residents, and businesses alike can all understand this powerful issue. For this look into the landscape of zoning data, we're including information most directly related to the process and its outcomes. We're not including other data that might be tied to land parcels, like data about tax breaks or special tax zones. Not all zoning data is created equal, of course. Some cities simply release a list of the ordinances related to zoning, others release PDF maps of how land parcels are zoned, and some have interactive maps with layers of information. To have open zoning data, a municipality should have structured data available online that makes it easy for people to analyze and reuse -- in addition to information that enables people to understand the zoning process.

Continue reading

When Are Public Officials’ Calls and Emails Public Records?

by

Public officials are elected or appointed to do the people's business, but what happens to transparency when they do that business through private channels? There have been cases across the country revolving around public officials using private methods of communication -- like personal email accounts or cell phones -- to conduct public business. When citizens request to know more about business done by their representatives, these private communications have, at times, served as blocks to the public's right to access information. As some of these cases are being decided in courts, we've seen a wide variety of responses from state and local governments about how to handle this public records issue.

In Alaska, such a case made it all the way to that state's Supreme Court. A citizen questioned the practice of former Governor Sarah Palin using a personal email account to conduct public business. Alaska's Supreme Court decided that if the state's employees use personal email for public business, those records must be made available to the public.

At least one government body on the other side of the country reached a similar conclusion about the value of keeping public business in the public record. The Washington, D.C., council voted to require members and employees to conduct public business on their public accounts. This move came after an open government group sued the council for not sharing public business done on personal accounts. The Mayor has also directed government employees to stay away from using personal email accounts for official business.

Not all government bodies are moving toward requiring this kind of disclosure, unfortunately.

Continue reading

How Unique is the New U.S. Open Data Policy?

by and

The White House’s new Executive Order may be significantly different than the open data policies that have come before it on the federal level, but where does it stand in a global -- and local -- context? Many folks have already jumped at the chance to compare this new US executive order and the new policies that accompany it to a similar public letter issued by UK Prime Minister David Cameron in 2010, but little attention has been paid to one of the new policy’s most substantial provisions: the creation of a public listing of agency data based on an internal audits of information holdings. As administrative as this provision might sound, the creation of this listing (and the accompanying scoping of what information isn’t yet public, but could be released) is part of the next evolution of open data policies (and something Sunlight has long called for as a best practice). So does this policy put the U.S. on the leading edge?

Continue reading

OpenGov Voices: Open Government goes on a field trip

by

Disclaimer: The opinions expressed by the guest blogger and those providing comments are theirs alone and do not reflect the opinions of the laciSunlight Foundation or any employee thereof. Sunlight Foundation is not responsible for the accuracy of any of the information within the guest blog.

Laci Videmsky (“lah-tsi” not “lay-see”) is the Project Director for the New California Water Atlas. He is also Co-founder of Nerds for Nature a group that promotes citizen science and civic engagement. When not building things on the internet, he is likely with his kids looking for magical waves to surf.

After a long day of participating in a Code of Oakland hackathon last year geared toward addressing the multitude of issues facing our city, many of us participants gathered at a local restaurant to debrief, talk shop, and unwind. We are programmers, data nerds, product designers and policy wonks. We are passionate about exploring the potential of information age resources to reshape our communities and the governing bodies that serve them. There have been some exciting success stories with projects that we have prototyped and many more epic failures. We adventure onward.

Continue reading

The Impact of Opening up Lobbying Data

by

We found a varied landscape when we explored what cities include in releases of lobbying data and how they release it, but one thing is clear: Disclosing and contextualizing lobbying data can have a high impact on a community. Journalists and other watchdogs who dig into municipal lobbying information have unearthed a wide range of stories illustrating the relationships between money, access to power, and the decisions made by those who have power. Raw lobbying information alone doesn't necessarily make for an insightful story about the world of political influence, but it's a key data set that is essential to revealing these kinds of narratives.

This is especially clear in Philadelphia, where information from the city's lobbying registrations and quarterly reports have been pulled into a searchable, sortable database called Lobbying.ph. Casey Thomas, a Philadelphia developer, was part of the team that created Lobbying.ph at a local hackathon in February 2012, and he expanded on it before joining AxisPhilly, a non-profit news organization, later that year. AxisPhilly now houses and maintains the project.

Continue reading

Open Data Executive Order Shows Path Forward

by

cords Today, the White House is issuing a new Executive Order on Open Data -- one that is significantly different from the open data policies that have come before it -- reflecting Sunlight's persistent call for stronger public listings of agency data, and demonstrating a new path forward for governments committing to open data. This Executive Order and the new policies that accompany it cover a lot of ground, building public reporting systems, adding new goals, creating new avenues for public participation, and laying out new principles for openness, much of which can be found in Sunlight's extensive Open Data Policy Guidelines, and the work of our friends and allies. Most importantly, though, the new policies take on one of the most important, trickiest questions that these policies face -- how can we reset the default to openness when there is so much data? How can we take on managing and releasing all the government's data, or as much as possible, without negotiating over every dataset the government has?

Continue reading

Evaluating Municipal Lobbying Data: Philadelphia

by

Philadelphia-sculpture

“Consistent” is not the first word one would use to describe the landscape of lobbying data released by municipalities. As revealed by our research, the formats and range of information local governments collect and disclose about lobbying activity varies quite a bit from one community context to another. After exploring the best practices for collecting and releasing this information, we created and recently published a Municipal Lobbying Data Guidebook. This guide addresses not only what kinds of information should be included in an ideal lobbying dataset, but also information about how that data should be collected and shared, regulated, and examples of the impact of having this information made available in an open way. (Something we’ll continue to explore in future posts.)

So how do municipalities measure up to these standards? We took a close look at three cities -- Austin, Chicago, and Philadelphia -- to explore what they’re doing well and where their lobbying disclosure can improve.

We've already covered Austin and Chicago. Now we turn to look at Philadelphia, which is a unique case in this set of cities.

WHAT COULD (AND WAS SUPPOSED TO) BE

Philadelphia's online lobbying disclosures were never supposed to look like they do now. When the lobbying disclosure law passed in 2010, the city contracted for software that would utilize electronic filing and share the information in a searchable format -- a requirement under the new law. The city had to cancel that contract, though, when the vendor failed to produce working software for the lobbying portal.

The city's current lobbying disclosure website is a temporary solution. Philadelphia recently put out a notice of intent to contract* for a new website with Acclaim Systems Inc -- the same company working on the state of Pennsylvania's lobbying disclosure system. The RFP for Philadelphia's new website includes a call for the use of unique ID numbers for filers; a way to publish registrations and expense reports "as PDFs and as data to the public searchable site"; user ability to search and download registration and expense reports "easily via the Internet" and to generate PDFs for each of these; and to create an online directory of lobbyists with photos.

The goal is essentially to have Philadelphia's website meet the two stipulations called for in the lobbying disclosure law: e-filing and searchability. The RFP calls for a system "that can be designed and implemented in a four-month timeframe or less," so if the contract receives final approval soon the site could be up this year.

Having some information available in the meantime is better than having none at all. We evaluate the current website with this in mind and with an eye toward how the next iteration of the website that comes after this placeholder might look.

WHAT EXISTS NOW

I. What data is available

Philadelphia links to its lobbying information from a webpage on its Board of Ethics site. It makes registration and reporting forms and instructions available. It also posts some completed lobbying registrations and expense reports.

The lobbying registration forms require the date of registration, the lobbyist name, address, and contact information, details about any affiliated political action committees or candidate political committees, and the name, address, and contact information for any principals or lobbying firms. This level of detail is in line with Sunlight’s Guidebook recommendations.

Continue reading

Calling for Common Sense (and Bulk Data) in California

by

  Request denied. That’s the response MapLight, California Common Cause, and 10 other media, transparency, and reform organizations (including Sunlight) received last Wednesday to a letter submitted to the office of California’s Secretary of State. The letter made a simple request of Secretary Debra Bowen’s office: Add the option of downloading bulk data from California’s campaign finance and lobbying database (Cal-Access) by posting this information in one, single, downloadable file on this public website, and keep this information up-to-date. Not quite a hamfisted transparency reform, but one that’s proved to be quite revealing about online disclosure in the Golden State. Currently there are only two ways to access the information contained on Cal-Access. The first is to slowly surf through the portal’s online interface, choosing limiting, specific sub-fields of information types (i.e Listing by Certified Election Candidates; Incumbents; etc), and relying on the system to generate specific reports that do not allow users to easily compare (or download) information. The second way is via CD-ROM. Yes, to gain “open” access to structured, bulk data from the state of California about campaign finance and lobbying information, you need to submit a request and pay $5 and wait for the state to send you a CD-ROM. There are a lot of problems evident in this scenario, not the least of which is the delay (up to a month!) caused by needing to translate information that already exists in an electronic format into a “physical” one (the CD-ROM). This delay not only costs the state in terms of staff time and resources, but also has a huge cost to the citizens of California. Californians have a right to unfettered access to public information -- like lobbying and campaign finance reports -- which provide vital knowledge and data about how the state government operates and who is trying to influence that power. Five dollars -- or fifty -- is too high a cost to pay for this access.

Continue reading

CFC (Combined Federal Campaign) Today 59063

Charity Navigator