Sunlight Foundation

Tools for Transparency: URL Builder for Google Analytics

The Google Analytics URL Builder is a simple tool that helps you track traffic statistics for specific campaign related links.  The tool works by adding parameters to a link from a page on your site that you then track using Google Analytics.  When running an advertising or social media campaign, this is incredibly handy for tracking your ROI.

I'll walk you through how I used the URL builder for this past Tuesday's Sunlight Live coverage of the State of the Union address.

Below is a screenshot of the URL builder.  In the first field, you enter the main URL you want to track. In this case, I'm watching http://sunlightlive.com. The next few fields determine the "Campaign Source" or the traffic referrer you'd like to watch, the "Campaign Medium," the way in which the traffic referrer is driving to your site, and the "Campaign Name." For Sunlight Live, the source was Facebook, the medium was through an advertisement and the name of the campaign was SOTU-2012.

After entering in this information, click the "Generate URL" button, which will add those parameters to your original link:

http://sunlightlive.com/?utm_source=Facebook&utm_medium=Ads&utm_campaign=SOTU-2012

..Which we then used to direct Facebook ad traffic to the Sunlight Live site. Check out the full entry process below:

To track every medium you use, whether it's Facebook, Reddit, Google+, Delicious or some other site, you'll need to create a unique URL for each.

Once the campaign is over, open your site profile on Google Analytics to access your link statistics.  On the left side navigation, head over to Traffic Sources, then Sources, then Campaigns:

To set the date for the life of the campaign, look in the top right corner. Google Analytics will show you the campaigns for that time period, you'll need to sort them by Source so you can differentiate the sites. Above this list click on Source then Traffic Sources then Source:

Below you'll see the statistics by Source for the Sunlight Live State of the Union campaign over the course of two days. You can see that our Facebook Ads brought in the most traffic by far. (You may also notice I wasn't consistent with my naming conventions for Source -- I need to work on that.) For reference, our Facebook drivers are the Facebook link posted above (top driver) and our fan page (second driver):

Remember, this is only traffic to our Sunlight Live page through tracked links we pushed through social media and advertising. The screenshot below captures all traffic to the page, including both links we promoted and organic links from followers of Sunlight.  The first two links are ads we ran for the campaign, though the Google ads weren't captured in the campaign view (I'm unsure of the reason for that):

While Google Analytics provides plenty of information and site data, using the URL builder makes it much simpler to track the ROI on your campaigns and on your efforts to promote them.  What are your experiences with tracking campaigns? Have any of you used the URL builder tool in the past?

 

The Fresh Prince of Capitol Hill?

The Fresh Prince of Bel-Air comes on momentarily during a Sunlight Live coverage of a House Committee HearingSunlight's eagle-eyed developer, Luigi Montanez, took the above screenshot of the official video feed from the House Oversight Committee. It raises the question, who is watching the watchers watching Fresh Prince?

All the more reason to follow Sunlight Live. Tune in this afternoon at 1:30 for our coverage of the House Oversight Committee hearing on the Consumer Finance Protection Bureau...or perhaps Maury?

Sunlight Live Happening Now: House Hearing on Gas and Economy

This morning the Sunlight Foundation's award winning Sunlight Live platform will turn the spotlight on the Committee on Natural Resources' hearing on gas prices and U.S. jobs. Sunlight Live mashes up commentary and research from Sunlight's Reporting team with contextual data and graphics.

The hearing comes as gas prices approach $4 a gallon and amidst increasing pressure for more domestic oil drilling. Meanwhile, there is renewed attention to nuclear energy, thanks to the recent disaster in Japan. The full House Natural Resources will convene for the hearing as witnesses from the U.S. Energy Information Administration, U.S. Geological Survey, CRS, GAO, as well as the University of Texas and Center for Strategic and International Studies present testimony.

Members of the Natural Resources Committee have benefited from contributions from the oil and gas industry. According to Sunlight’s Influence Explorer, Committee Chairman Doc Hastings (R-WA) received $85,671 from the oil and gas industry in 2010, Ranking Member Edward Markey (D-MA) received $29,250 and committee member Rep. Dan Boren (R-OK) tops the list at $210,500.

Witnesses for the hearing include:
  • Richard G. Newell; Administrator, U.S. Energy Information Administration
  • Brenda Pierce; Energy Resources Program Coordinator, U.S. Geological Survey
  • Gene Whitney; Manager, Energy Research, Congressional Research Service
  • Michelle Michot Foss; Chief Energy Economist, University of Texas
  • Guy Caruso; Senior Adviser, Energy and National Security, Center for Strategic and International Studies
  • Frank Rusco; Director, Natural Resources and Environment, Government Accountability Office
Tune in right now for our live coverage at sunlightlive.com.

Financial reform Sunlight Live on Wednesday

On Wednesday morning, Sunlight Live will continue its coverage of financial reform as the House Finance Committee convenes for a hearing on regulations within the Dodd-Frank Act. Finance Committee Chairman Spencer Bachus (R-AL) announced that the hearing will address “The Final Report of the Financial Crisis Inquiry Commission” with six commissioners scheduled to testify.

Sunlight Live combines streaming video, government transparency data and social media coverage to provide real-time context and analysis of major congressional hearings, all from a single webpage. Members of the Sunlight Reporting Group will be covering the hearing along with Jim Tankersley, an economics correspondent with the National Journal.

Join us beginning at 9:45 am at http://sunlightlive.com.

Sunlight Live's State of the Union Coverage

Last night the Sunlight Foundation's award-winning Sunlight Live platform covered the State of the Union with context and fact-checking from Sunlight's Reporting Group and teams from the Huffington Post, National Journal, CQ Roll Call and the Center for Public Integrity. It was an exciting evening and we're honored so many of you chose to join our coverage for Obama's speech, the Republican response and the Tea Party followup.

More than 10,000 people tuned in and, while at times we were nearly technically overwhelmed by the response, our talented Sunlight Labs team held us together. The engaged viewers left over 1,000 comments and we published more than a third of them to be answered by the reporters or shared with other visitors. Hundreds of folks camped out on the site hours before the speech, indicating their preference to watch on our channel. As best as we can measure, 2,308 tweets and 908 shares on Facebook sent fans to Sunlight Live.

Here are some excerpts from the various news coverage our Sunlight Live project received:

Roshan Nebhrajani from Medill's School of Journalism joined Sunlight in our office and reported on the experience:

A group of 14 reporters gathered at the Sunlight Foundation, all centrally connected by one crucial link — a heavy-duty extension cord — as they typed through dinner to provide interactive coverage of the address to nearly 2,000 viewers. [...] visitors to the Sunlight Foundation’s site engaged in online conversation. One said: “This is perfect. Like sitting in the room, watching with a bunch of smart, informed people.”

GOOD Magazine initially promoted the White House live-stream online but switched to support Sunlight Live after learning the extent of our coverage:

While we indeed support the government smartly using technological advancements to spread information, in this case, we're going to direct you away from the White House's stream and toward the Sunlight Foundation's live blog. Not only will Sunlight be streaming video of the address, reporters from CQ Roll Call, the National Journal, the Center for Public Integrity, and the Huffington Post will be on hand to fact-check and offer context as the president speaks. We can almost guarantee that the information provided will be more objective and less dry than what the White House is offering. Happy viewing.

Fast Company did a roundup of all the various ways to watch the State of the Union and highlighted the collaborative and real-time reporting during Sunlight Live:

Traditionally, we’ve had to wait for the networks’ post-game shows before anyone starts to dissect the accuracy of various statements made by the president or the opposition. But last night, the Sunlight Foundation—in partnership with The Huffington Post, National Journal, CQ Roll Call, and the Center for Public Integrity—posted real-time fact-checking during the course of the addresses.

MediaBistro has an article about the new dawn of real-time fact checking that points to the work of the Sunlight Foundation and the Sunlight Live event:

Gone are the days when political junkies would have to wait for a speech to be over before talking heads could endlessly parse each word. [...] with our incredible shrinking news cycle and the rise of participatory journalism, the approach only makes sense.

It was a great team effort at Sunlight and we loved working with our partners from the Center for Public Integrity, National Journal, CQ Roll Call and the Huffington Post. Thank you to everyone who helped make this Sunlight Live event a success and we hope you join us for future coverage.

Photo by Nicko Margolies

Watch the State of the Union on Sunlight Live

Tonight the Sunlight Foundation will cover President Obama's 2011 State of the Union using our award-winning Sunlight Live platform of real-time investigative reporting. We will provide real-time transparency of the annual State of the Union and make our analysis participatory in a way we couldn't have before the Web. We invite all citizens to join us and submit questions as we live-blog, fact-check on-the-fly and provide contextual analysis about the influences shaping President Obama's statements at the moment they are spoken.

The unified Sunlight Live page brings together the speech's live streaming video, contextual data, reporting and social media. Sunlight's Reporting Group is joined by The Huffington Post, National Journal, CQ Roll Call and the Center for Public Integrity. We believe this expanded and accomplished team will be the most comprehensive live coverage available with insight to the proposals, people and policies mentioned during the speech. The Sunlight Foundation is committed to sharing this platform and encourage others to embed it on their own sites.

The fun begins at 8:30 pm EST at http://www.sunlightlive.com.

We hope you join us.

Join Sunlight on Election Night for Live Reporting of the Money Behind the Winners

This election season, we’ve tracked (in real time) the explosion of outside spending – now at $427 million and climbing, the D.C.-based fundraisers for candidates running on “outside the Beltway” credentials and, with your help, cataloged political ads and who pays for them using Sunlight CAM. All signs point to a record-breaking Election Day for campaign cash, so we’ll be up until the wee hours that night shining a light on the money behind the winners.

Join us Election Night from 7 p.m. – midnight(ish) as we use our award-winning "Sunlight Live" real-time, investigative platform to follow the money trail for midterm congressional seats as races are called. Our video coverage will include PBS Newshour and our own original reporting. We’ll follow the money behind the top competitive (or otherwise compelling) races, covering the campaign contributors and non-party groups—such as the U.S. Chamber of Commerce, Crossroads GPS and America's Families First Action Fund—that "won," showing data on the huge independent expenditures made in key races this cycle.

Confused about who the real winners are this election? Make sure to tune in and send us your questions, so you can know who won the shadow race.

And if you're in DC, please come to our office for our Election Night Watch Party. RSVP on our Facebook page. You can also organize your own watch party using our Meetup page.

(Sunlight Live is generously supported by the John S. and James L. Knight Foundation.)

Knight Foundation Awards Sunlight New Grant for “National Data Apps” & Sunlight Live

I’m thrilled to announce that the John S. and James L. Knight Foundation just announced a new $1.2 million two-year grant to us to support Sunlight in our nascent “National Data Apps” initiative that allows us to give you access to more government data that affects you in your daily life. The funding also allows us to further expand our award-winning Sunlight Live real-time accountability platform that combines streaming video, government transparency data, journalistic background and social media coverage of major events in Washington. (Be sure to tune in on Election night, when we’ll cover the results of this year’s mid-term elections.)

Because of Knight’s support, we will put more government information at your fingertips to help you make better sense of anything from local pollution and medical care to personal financial services. The new National Data Apps -- that will roll out over the next two years -- will give you unprecedented access to critical information that will bring us a step closer to closing the transparency gap in Washington. Imagine being able to check the reputation, pricing and accountability of a medical service provider from your phone -– before you decide to use them.

Our Sunlight Labs will design -- along with our Reporting Group --  the National Data Apps and issue reports on the government’s track record for making this kind of data available to the public. Additionally, the Sunlight Foundation Reporting Group will train journalists, bloggers and other members of the media on how to use the National Data Apps when they are launched in early-2011. (Use the comments below to let us know if you’re interested in this kind of training, or send us an email.)

Knight’s previous funding of Sunlight has supported our creation of Poligraft, Influence Explorer and our free embeddable Politiwidgets about members of Congress that you’ve seen used in our blog posts and on some of your hometown newspapers’ websites.

We are so proud to be supported by the Knight Foundation. We can’t wait to unveil the new National Data Apps beginning early next year.

The Future: Government Transparency and Tracking Money in Politics

Today, I humbly accepted the Knight Batten Award for Innovations in Journalism for our interactive reporting platform, Sunlight Live.

I've received multiple requests to post the speech and presentation - both of which you can find below.

And stay tuned for more exciting news about the further development of the Sunlight Live platform!

I am so happy to be with you today. We are honored by the award you have given us. And I am very happy to announce that Sunlight will use the $10,000 prize toward retooling Sunlight Live turning it into a full open source platform. Among the new bells-and-whistles we are exploring is the addition of facial recognition capabilities that will allow for the automated real-time display of relevant data as speakers change. I am also I am happy to say that the Knight Foundation's continuing work with us will include substantial support for Sunlight Live.

Sunlight was designed to use the power of the Internet to catalyze greater government openness and transparency and to provide new tools and resources for media and citizens alike.

We take inspiration from Justice Brandeis’ famous adage “Sunlight is said to be the best of disinfectants.” We were founded just four years ago on the cusp of the Abramoff Congressional ethics scandals. And our work has two fundamental goals:

……make it easier for journalists to do their reporting, to write the stories that need to be told by freeing data from the basements of the Capitol and other government buildings, and putting it online.

……to use the developing social nature of the web to engage citizens in a different kind of relationship with government. We are committed to improving access to government information , indeed…. redefining ‘public information’ as meaning “online” -- and by creating new tools and websites to access that information and engaging communities in its use.

Sunlight’s work falls into 5 major areas: digitization of data, building tools and websites to provide easy access to it, advocacy, organizing and media production. By digitization of data we mean redefining what disclosure means in the 21 st century -- developing databases out of either electronic or paper records (though we do very little of the latter). Part of this we do through funding (money is one of our resources), providing technical assistance, keypunching data, or plain ol’ scraping of websites.

Sunlight has supported the databases developed by the Center for Responsive Politics, the Institute on Money in State Politics, Taxpayers for Common Sense and OMB Watch. Think Money. Politics. Influence. Government Spending. We’ve also developed our own data sites – everything from databases on foreign lobbying to White House visitor logs to political fundraisers.

But where we excel and add special value is in building or supporting tool-building because we want to make it easy for journalists and citizens to find, use and consume government information. We’ve just released a suite of tools (many of which I am happy to say are funded by the Knight Foundation) to make political influence information more accessible.

We've started with a data 'holding tank' -- TransparencyData. This site lets you get the original data -- whether it’s state or federal campaign contributions, lobbying data or federal contracts and grants -- you get the information you need in either a journalist or developer friendly format. Sometimes you just need a quick overview of the influence around a person or an entity. So on top of TransparencyData we built Influence Explorer -- with just one search you can instantly see the top influencers and the influenced of your query.

Continuing this pattern, on top of Influence Explorer we built Poligraft which does the research for you and with one click on a bookmarklet shows you the influence connections between all the entities in a news article or blog post. Lastly, we have Politiwidgets a series of interactive infographics, fully customizable, filled with information about members of Congress, such as their campaign contributors, earmarks and the like.

Why would you use these tools? If you’re interested in BP, you can now can search through 4 or 5 datasets in one fell swoop to get a sense of their political power, including which lobbyists they have hired and how much they were paid. If you’re reading a press release put out by a member of Congress you can easily figure out whether the beneficiary of an earmark was also a campaign contributor. You can easily determine whether an individual has given political contributions to both state and federal candidates and just how much.

Sunlight is also interested in catalyzing a demand for greater government transparency so we’ve launched a national Public = Online organizing effort. We’ve already developed strong communities of technologists who are hacking away at government data, and Google groups of policy wonks and open government advocates. We are aiming to step up our work on the organizing front at both the municipal and state levels.

And, we produce our own media. From hosting 6 different blogs, to breaking stories on our Reporting Group site, to analyzing the quality of data coming out from the Administration to covering important events on Sunlight Live. We also produce reporting tools. Our latest is a one we’re calling Sunlight CAM (Campaign Ad Monitoring) -- a widget for citizens to use to record the political ads they are seeing and to contribute to a distributed database to help us follow ad spending in the post-Citizens United world.

We are advocates too –we have 3 registered lobbyists – because we need new laws and new policies in the Executive Branch and Congress – and we need to revise old ones -- to ensure that the public has online access to information in REAL time.

So let me turn for a moment to a candid assessment of how the current Administration is doing with respect to their plans to make data more accessible to the public. I should say at the outset that from the Executive Memorandum on transparency issued by President Obama on the first full day in office, to the full-blown Open Government Directive, to establishing new policies regulating lobbying of the Executive Branch, no organization has been more excited, enthusiastic or optimistic about the use of technology for data transparency than Sunlight. In many respects, this Administration has gone further and faster toward creating a transparent government than any that’s preceded it.

But now, 20 months later, the drive for transparency appears stalled. Lets look at several of the problems.

To be sure, there have been some meaningful first steps from agencies and the White House. The White House itself has posted its staffers’ ethics filings online, required extensive stimulus lobbying disclosure, and posted the Visitor Logs online for the first time. But these aren’t well-established policies, and exemptions to publishing this data are unclear and unstated. All of these initiatives need a steady hand and a clear commitment to mature into permanent, reliable, effective policies.

And one central Obama campaign promise -- to “create a centralized Internet database of lobbying reports, ethics records, and campaign finance filings” isn’t even on the drawing boards.

The Open Government Directive -- the Administration’s 10-month-old manifesto on government transparency – is teetering between becoming a dated relic or a transformative commitment to a new era of openness. As you may recall, the central thrust of the directive is its insistence that all government departments create and implement their own open data plans, aimed at releasing “high-value” data to the public.

The plans that resulted, however, were little more than aspirational. In the first of those plans, 12 out of 30 agencies didn’t identify any data for future publication and altogether only 75 new data sets were promised. 75 data sets? It would be an understatement to say that was hugely disappointing. Enforcement of these plans has always been ‘soft.’ And now they face even greater uncertainty with the departure of OMB Director Peter Orszag and WH Ethics Counsel Norm Eisen. The Directive is only as strong as its enforcement.

Data.gov started with enormous promise. A single catalog for all government data is very exciting in concept. As it has evolved, we have gotten a progressively better website. But it's still a pretty mediocre data repository and the types of data available remains an enormous concern. It turns out that the government has some wierd ideas about what counts as "high value" information. The Department of the Interior seems to feel that population counts of wild horses and burros are "high value" but records of safety violations like the ones that seem to have led to the recent West Virginia mine disaster are not.

We want to see data that can be used to hold government – and the entities that report to it – accountable: records and data that would allow the public to assess the effectiveness and efficiency of federal programs, policies and initiatives; the competence and integrity of its employees and contractors; its management of public resources.

USASpending was created to provide the public with information about how the federal government spends our tax dollars. It was launched in late 2007, but it's already gone through three redesigns, each one flashier than the next, with gradients and maps and now a sort of GapMinder-style visualization tool. It's pretty impressive…. looking.

Unfortunately, its data is almost completely useless…. Sunlight just launched an ongoing analysis of the grants data at ClearSpending.org.

The results aren’t pretty.

We found over 1.3 trillion dollars of broken reporting in 2009 alone. That's fully half of the spending for that year. Some of the numbers are too big, some are too small, some are missing. Others don't have the detail that's required, or were reported months later than the law demands. You can't trust any aggregate numbers you get from the site -- answers to questions about federal spending that rise above the micro level. When we say things just don’t add up, we mean it. The government has known about this problem, and they say they're working to fix it. But what we've actually gotten is a series of redesigned websites, each one with data just as unreliable as the one before it.

We are beginning to worry that the Administration is more interested in style than substance. If we settle for a superficial kind of approach, transparency – Obama style will be remembered as a failure. Government has learned to say the right things -- now we need government to actually get serious about technology and transparency.

I’d like to close with a few contextual thoughts the world of technology, transparency, citizen engagement and government.

First, what gets us up every morning is that we believe that armed with more access to all kinds of vital public information, citizens can play a more productive and effective role in self-government and civic life.

Second, technology is critical to all of our work – it allows us to build communities, to disburse information, to engage citizens in improving it, and to deliver it however and whenever people want it. Technology is key for citizens as a tool for government accountability. Third, the Internet is the public space of the modern world, and through it government now has the opportunity to better understand the needs of their citizens. Through its magic, citizens can participate more fully in their government.

Fourth, our role as citizens is only as strong as our government is open. And we strongly believe that open data promotes increased civil discourse, improved public welfare, and a more efficient use of public resources. The key actions that make up our civic lives – informed voting, active participation, and taking action – all depend on access to public information. And, finally transparency of government information is the basis for accountable government. In an age of Facebook and Smartphones, Twitter and Foursquare, we have rising expectations of greatly expanded access to government information and easy access to our government officials to ask them questions.

Once again, let me thank you again for the wonderful honor you have given to the Sunlight Foundation today. We are thrilled to be celebrated in this way and to have been chosen from the amazing group of organizations that you considered.

Thank you!

Knight-Batten Winners

I was traveling earlier this week when the Knight-Batten Awards were announced and so I wanted to add my two cents about the enormous honor of receiving the top prize.

First of all, we are simply thrilled to have been selected. We had fabulous competition from many of our friends and peers and we were honored that Sunlight Live, experimental as it is, was able to garner the attention and support of the judges.

As is the case of much of Sunlight’s work, our initial Sunlight Live event – covering the President’s Health Care Summit -- was a deliberately experimental undertaking. Our two senior strategic consultants, Andrew Rasiej and Micah Sifry from the Personal Democracy Forum, suggested the initial idea. We had all just returned from PDF’s first European conference and their observations of the team from CivicoLive.com who provided live coverage of that conference, sparked their thinking about developing a one page view combining the live feed of a newsworthy event with relevant data and analysis from Sunlight’s ecosystem of grantees, along with aggregating and curating user-generated content. If Sunlight thinks that transparency in real time is important – and we do – then we thought we should also try explanatory journalism in real time too.

We had always imagined that Sunlight might one day take on our own media production – beyond blogging -- and Sunlight Live has become our most successful undertaking in this arena. It’s designed as a news delivery device that provides reporting and contextual data about political events as they unfold in a format that merges the immediacy of live television, the depth of investigative reporting and the interaction of the Internet. Our first effort was a huge success in terms of metrics, team building, and changing the nature of reporting a live event.

We know we want to make some changes in this effort in the future, indeed create a Sunlight Live Web App. Right now, Sunlight Live relies on a hodge-podge of proprietary services, and its back end architecture is not able to take advantage of the rich array of data Sunlight and our grantees have available. We know that we want to create data feeds to automate data, allowing us greater control over it, replace the Cover-It-Live commenting software and the Twitter monitor with open source solutions better integrated to our platform; and begin to use facial recognition software to identify speakers, triggering the display of relevant data. Our goal is to launch a beta version of an open source, self-contained Sunlight Live platform that other organizations can adopt.

One of the biggest limitations to Sunlight Live is the absence of live feeds for events. Sunlight will explore the feasibility of partnering with a news organization—broadcast or cable—with access to events. We will explore the feasibility of developing partnerships on a case-by-case basis, or via a long-term agreement. Right now we are at the mercy, in most instances, of those running the event for the video feed.

Success, as they say, has many mothers and fathers.

While this project was initially instigated by Micah and Andrew it wouldn’t have happened without a large segment of others who played key roles. Clay Johnson and Josh Ruihley did the wire framing of it and built out the back end. In the lead on reporting staffing were Paul Blumenthal and Bill Allison and other staff from the Reporting Group Team. Noah Kunin was a superb producer and ring master  and Jake Brewer who did an amazing job of herding the cats. Gab Schneider lead the team that spearheaded getting the word out. We couldn’t have done any of it without the data produced by the team over at the Center for Responsive Politics. And perhaps the biggest hero of all was Tim Ball who kept the whole thing from crashing. The day the Health Care Summit happened there were 12-15 staff sitting in a darkened conference room working on a constant deadline for seven hours.

Since our first effort, after creating multiple iframes both for display and for sharing with other outlets, rethinking the video intake, and establishing a better interface for displaying names and information we have used the platform to cover the Financial Reform Conference Committee (yes, every day of it) and the recent GOP agenda setting meeting with lobbyists.

What I think all of us at Sunlight liked best about this was the team effort -- the idea that nearly half our staff, from different areas came together to work on a common experimental, novel and ultimately groundbreaking effort. We are honored to be recognized by the Knight-Batten Awards.

« Previous
1 2