Blog

Stay up to date on Sunlight’s work in D.C., throughout the country and around the world, as well as the latest open government, transparency and technology news.

CFTC's Credit Swap Reporting Requirements Result in Chaos

The U.S. is trying to monitor the kinds of transactions that contributed to the 2008 financial crash, and subsequent recession, but the effort has shot itself in the foot, all for lack of a data standard. The Commodity Futures Trading Commission has been tasked with oversight of credit default swaps, but their attempts to define a standard for reporting in this previously unmonitored market have not worked out as planned.

Read more

Name Standardization: Problems and a Solution

Name standardization, on its surface, would appear to be a primarily aesthetic problem (no pun intended). People's names can be listed "last, first" or "first last". Simple, right? Not exactly. When you're naming different things— people vs. organizations, for instance— and dealing with different ordering, capitalization styles, honorifics, suffixes, metadata or other additional info embedded in names (e.g. politicial party signifiers, company departments or locations), or just general cruft and typos, name standardization is a thorny problem. Add to that the fact that there are no universal identifiers for people or companies in many datasets, names rarely (if ever) come split into their constituent parts, and we are often expected to link data via little more than a name string, and you can see how relevant the issue is to the world of open government data.

Read more