Jason Williams shares his experience as part of a working group on Utah's GRAMA law where his team recommended new Open Data Policy guidelines.
Continue readingOpenGov Voices: MapStory: A data commons for a changing Earth
The goal is for MapStory.org to become a space where anyone can share openly licensed geospatial (temporal) data and store it from now until the end of time.
Continue readingOpenGov Voices: How an Open Source Candidate can Save the US House of Representatives
House members need a low-cost way to get elected, that also increases their bargaining power to deal with special interests. We can achieve this today, through the Open Source Candidate pledge and ProxiCast voting technology.
Continue readingOpenGov Voices: OpenCourts: Bringing transparency to the Slovak judiciary
According to the latest Global Corruption Barometer, the judiciary in Slovakia is the least trusted institution in the world, and 70% of Slovakians consider it to be corrupt. This is partly because the Slovak judiciary system has no external influence and enjoys a very high level of independence not only from other branches of power, but also from the general public. Last July, the OpenCourts portal (available only in Slovak and the first open data project dealing with the judiciary branch) was launched by Transparency International Slovakia. Its main goal is to make the Slovakian system more transparent and allow the public to control courts and judges in order to hold them accountable.
Continue readingOpenGov Voices: Announcing CitizenAudit, a free tool for fully-OCRd nonprofit financials
Disclaimer: The opinions expressed by the guest blogger and those providing comments are theirs alone and do not reflect the opinions of the Sunlight Foundation or any employee thereof. Sunlight Foundation is not responsible for the accuracy of any of the information within the guest blog.
Luke Rosiak is a former Sunlight Foundation reporter and database analyst who now writes for the Washington Examiner. Luke is also a winner of Sunlight Foundation’s OpenGov Grants for his project, CitizenAudit. You can reach Luke on Twitter at @lukerosiak.
In return for not paying taxes, nonprofits in the U.S. file detailed financial disclosures to the IRS, listing how much of their money goes to certain categories, how much they pay their top people and what groups they give money to.
But even though large nonprofits submit structured electronic data, the IRS takes pains to convert it into paper copies and doesn’t make them available publicly at all, instead directing interested parties to request a copy from the organization itself.
Recently, tech pioneer Carl Malamud’s Public.Resource.Org began successfully filing Freedom of Information Act requests for all disclosures--990s, as they are called---and paying the IRS on a monthly basis for reams of DVDs with TIFF images. Some are scanned paper filings, for others the IRS went out of their way to turn structured data into a mere image. None has an embedded text layer.
The information is invaluable for philanthropists, journalists and competitors--and the universe of nonprofits is enormous, including the major sports leagues, political groups, hospitals and universities and quasi-public institutions.
So I began an enormous OCRing spree, using open-source tools and home-built software and put the results in elasticsearch and PostgreSQL on a free site. The effort, half the funding for which came thanks to a Sunlight Foundation OpenGov grant of $5,000, is called CitizenAudit.org.
Continue readingOpenGov Voices: PDF Liberation Hackathon – At Sunlight in DC, SF and Around the World – January 17-19, 2014
Disclaimer: The opinions expressed by the guest blogger and those providing comments are theirs alone and do not reflect the opinions of the Sunlight Foundation or any employee thereof. Sunlight Foundation is not responsible for the accuracy of any of the information within the guest blog.
Marc Joffe is the founder of Public Sector Credit Solutions (PSCS), which applies open data and analytics to rating government bonds. Before starting PSCS, Marc was a Senior Director at Moody’s Analytics. You can contact him at marc@publicsectorcredit.org. Marc is also one of the winners of Sunlight Foundation’s OpenGov Grants.
Extracting useful information from PDFs is a problem as old as … PDFs. Too often, we focus on extracting information from a specific set of documents instead of looking at the bigger picture. If you’ve ever struggled with this problem, join us for Sunlight’s PDF Liberation Hackathon, dedicated to improving open source tools for PDF extraction.
Instead of focusing on one set of documents, coders will come together to add features, extensions and plugins to existing PDF extraction frameworks, making them more flexible, useful and sustainable. Sunlight’s PDF Liberation Hackathon will tackle real-world PDF data extraction problems. In doing so, we will build upon existing open-source PDF extraction solutions such as Tabula and Ashima’s PDF Table Extractor. ( A full list of PDF extraction technologies relevant to the hackathon can be found on our resource page here.) In addition, hackers will have the option of using licensed PDF software libraries as long as the implementation cost of these libraries is less than $1,000. If you have an idea for a library you want to use, please mention it in your signup form and we will try to work out the licensing ahead of time so that things run smoothly.
Register now to attend the PDF Liberation Hackathon!
Continue readingOpenGov Voices: Opening Italy’s Parliament with Open Parlamento
Disclaimer: The opinions expressed by the guest blogger and those providing comments are theirs alone and do not reflect the opinions of the Sunlight Foundation or any employee thereof. Sunlight Foundation is not responsible for the accuracy of any of the information within the guest blog.
Vittorio Alvino is the founder of Open Polis -- an independent organization that promotes transparency and the democratic participation of Italian citizens by developing and implementing projects to enable free access to public information on political candidates, elected representatives and legislative activity. Vittorio can be reached at v.alvino@openpolis.it
With Open Parlamento we wanted to tear down the wall between the Italian people and the institutions that govern the country by publishing and sharing all relevant information on the activity of the Italian parliament. When the project began in 2009, our organization was the first to publish data about parliamentary attendance and details about each voting session. Although we do not always succeed, our goal is to reach the everyday citizen with simplified and comprehensible information about what happens in the Parliament and offer some interpretation - based on data - of politicians’ behaviours and choices.
Sadly, the political debate in Italy in recent years has progressively deteriorated. Parties and institutions have lost much of their credibility and the focus of the general public has shifted towards scandals and corruption. In the meantime, far away from the center of attention, economic and political interest are at stake.
Through the simple use of parliamentary data, we want to empower citizens by giving them the chance to create and support their own political opinion. For this reason, the data needs to be elaborated graphically, making it easier to understand. The same information is also analyzed by our staff in order to find the “news” behind the data. All of our work is then shared via web, social media and Italy’s main news outlets. Interestingly enough, at times our users, besides national media, are the first to use the data from Open Parlamento as their source for graphic elaborations, articles, tweets and reports.
The obstacles in this field of work are many, but things have gotten better in recent times. Nonetheless, much still needs to be done in order to improve the process by which data are updated and collected. Due to incomplete and rarely updated open data, we’ve been forced to develop programs that on a daily basis scrape thousands of web pages from the sites of the Italian Parliament.
Continue readingOpenGov Voices: Using Data to Tackle Migration: #AmericasDF
Disclaimer: The opinions expressed by the guest blogger and those providing comments are theirs alone and do not reflect the opinions of the Sunlight Foundation or any employee thereof. Sunlight Foundation is not responsible for the accuracy of any of the information within the guest blog.
Kathryn Striffolino is the Advocate & Science for Human Rights Project Coordinator for Amnesty International. You can follow her @katiestriff. Ella Kirchner, an intern at Amnesty, contributed to this post.
Take a moment to imagine the possibilities if you were to gather individuals with a variety of skillsets—from migration policy experts, to migrants who have experienced the oftentimes deadly journey from Central America to the U.S., to technologists — in an attempt to tackle some of the most pressing migration related issues in our own hemisphere and leveraging technology and data whilst doing so.
The weekend of November 2-3 will do just this at the Americas Datafest — a 48-hour hackathon bringing together programmers, engineers, journalists, NGOs, human rights defenders, data scientists and migration experts around the Americas region to join forces to make a difference. We will collaborate in both physical and digital spaces in over 20 locations across the hemisphere (including Washington, D.C.) with the goal of making an actual impact on migration challenges in the Americas.
Teresa Bouza, the deputy Washington, D.C. bureau chief of Spain’s global news agency EFE and a recent alumna of the Knight fellowship program at Stanford University, is the lead organizer of the Americas Datafest. (She also worked with Sunlight to organize the Bicoastal Datafest we held in February.) Microsoft Research, Facebook, Univision, Intridea and Data Community DC are some of the organizations supporting the event, that also has the strong backing of Amnesty International.
Hackathons are increasingly being utilized by local and international communities as a means to address entrenched human rights challenges.
What is the problem we seek to tackle?
The world has 214 million migrants, but without enough information and data on these migrants, no one alone can adequately tackle the challenges that migrants in our hemisphere face. Bela Hovy, chief of migration at the United Nations, told Americas Datafest in an interview that "Misconceptions about immigration can only be dispelled through getting the facts on the table.” Computer scientists, software developers, data scientists and others can help tackle the issues of getting data online and analyzing the data to better solve the issues.
Thousands of people migrate across Mexico every year, most from Central America. This is a dangerous and often deadly journey; thousands are beaten, raped, kidnapped or murdered as they make their way across Mexico. They suffer these abuses mostly at the hands of criminal drug cartels, but officials are also complicit in these crimes. Hundreds of migrants die every year along the US-Mexico border alone and many more die while crossing Central America and Mexico. The importance of gathering, analyzing and leveraging data on abuses committed against migrants cannot be overstated.
Please join us in developing solutions!
Whether in person or virtually, please join us to collaborate with others across the Americas to make a difference – write code, build apps, create tools and resources to address the migration challenges in our hemisphere. You might even win an award! The top two winning teams at each location will be nominated for a global award—judged by an esteemed panel of international judges—including Amnesty International’s Frank Jannuzi.
Continue readingOpenGov Voices: You are invited to TransparencyCamp Alabama 2013!
Disclaimer: The opinions expressed by the guest blogger and those providing comments are theirs alone and do not reflect the opinions of the Sunlight Foundation or any employee thereof. Sunlight Foundation is not responsible for the accuracy of any of the information within the guest blog.
Jackson Stephen is the founder of OpenBama -- a nonpartisan website that compiles data from various sources pertaining to Alabama State government into an easy to use tool. OpenBama desires to inspire the citizens of Alabama to demand more transparency within state and local government. Jackson is also organizing the first TransparencyCamp in Alabama. He can be reached at jackson.stephen.r@gmail.com.
Around 2008 I began the work on what would become OpenBama.org. At the time I started the project, I had never heard of the Sunlight Foundation, open government, or any of the wonderful transparency projects across the country. I was one guy with a computer and an idea to make Alabama legislative data meaningful to the citizens of my state. Little did I know that there was an entire community of individuals working on similar transparency projects across the country, individuals like myself that desired to take government information to the people.
Continue readingOpenGov Voices: Transparency with Arlington Visual Budget
Disclaimer: The opinions expressed by the guest blogger and those providing comments are theirs alone and do not reflect the opinions of the Sunlight Foundation or any employee thereof. Sunlight Foundation is not responsible for the accuracy of any of the information within the guest blog.
This OpenGov Voices guest post was written by Alan H. Jones and Roger Zhu. Alan and Roger worked on a financial data visualization project for the town of Arlington, MA. Alan is a Vice-Chairman of Arlington’s Finance Committee in Arlington, MA and has spent the last 12 years helping organizations and individuals make effective use of information technology. You can read more of his work here. Roger is an improvisational engineer, industrial designer and interaction designer. He is a designer with Involution Studios.
See (and interact with) your town's budget: exploring the next generation of accessibility in financial information.
Government budgets can be tough to understand, but now the town of Arlington, Massachusetts is providing the next generation of accessibility in financial information that allows citizens to see, engage and discuss.
See:
The Arlington Visual Budget is an interactive web-based application that holds all the town’s financial budget information from 2008 to 2018. The data was broken down into three sections: revenues, expense and funds. In each section, you can drill down to see each government department’s total spending including percentage of totals compared to last year and what that data means.
On the right side of the data is a treemap (below) with interactive color populated by data in real time. The map below illustrates the impact of a particular revenue or expenditure compared to the whole budget and how that budget has changed over time.
All the data comes directly from Arlington town’s financial office where we used current technology to build a pipeline that converts files created in Microsoft Excel to JSON -- a lightweight data-interchange format used for computation within the site.
Continue reading