Posted by: structureofnews | January 31, 2011

The Age of Discovery

If you build building blocks, will they come and build buildings?

Perhaps it’s my personality, but when I think about reasons for trying out the ideas embedded in structured journalism, I tend to focus on the practical: We can build new products that will serve people better, and maybe throw up additional revenue streams.

But there are other, less concrete, reasons as well: To build the building blocks of information that could lead to things we can’t yet see; to power and allow more serendipity and discovery in information.

Meaning what, exactly?

Imagine phone books didn’t exist.   Imagine that instead we had long articles/files with peoples’ names, addresses and phone numbers.  We can do keyword searches and find pretty much anyone we want, so the main purpose of a phone book – to find someone’s phone number and address – is achieved.  We can even search for and find all the people with the last name of say “smith,” something else you can do with phone book.  But there would be things we couldn’t do easily.  For example, we would be much more hard-pressed to discover a cluster of smiths on main street without this being organized in a data structure that allowed for quick queries and integration with a map.

Lucky for us, then that phone books, by virtue of how they’re organized – with data fields for names, addresses, etc – allow for that kind of new application.  After all, Google Maps is essentially a mashup of phone books with maps.  If phone books weren’t set up that way – if they were simply long strings of text –  it would be much harder to create Google Maps.

Or take stock markets.  If we had daily stories about the stock market that mentioned every companies’ closing share price, we’d have all the information we could find in stock tables.  But it would be very hard to build a stock chart from that – let alone try to correlate its ups and downs with, say, hemlines.

The point is, it’s not simply the information that allows the chart to be built; it’s the structure of the information.

And it’s that structure that gives us the building blocks of potential new applications – things that in many cases we can’t foresee.

So how can we rethink what we do so that we can get more structure in what we do, and hence build new building blocks of information?  And what are these possible new applications that we can’t foresee?  It’s tempting to say we can’t foresee them – which would be true by definition – but that’s probably a tad too glib.

But if you think back to the time before Google Maps, you might remember how amazing it seemed when it came into existence.  It seems obvious now, but it’s not like there was a long line of people creating it before Google did.   Ditto EveryBlock and Adrian Holovarty.

Geocoding, of course, does allow us to build maps of events and news, and sites like are busy trying to extract location information from stories and blog posts.  Silobreaker not only looks for information, but also relationship information.

But we journalists don’t do all that much.  At least, not yet.  We routinely collect reams of information, and generally the best we do with it is throw it up online or into a document cloud of some kind; but without structuring it, it’s like posting a long text string of stock prices and hoping someone can find some value in it.

If instead we captured more relationship information in a useful format, we could be creating sites like WhoRunsHK everywhere; if we followed a format like Politifact on political fact-checking, we could start to see more patterns on what politicians say and do.  (And, to be fair, the franchising of the Politifact model around the US is helping that process along.)

The trick, of course, is deciding what kind of information to capture to build our building blocks.  I suspect one reason that geocodes have been so popular is that they’re relatively easy to extract from stories – they don’t involve a lot of extra work for reporters or editors, and they don’t make us change our ways very much.  They can be helpful – location does matter in many stories, and mapping incidents or events can bring up new insights.

But doing anything else will require work.  If we want reporters to file relationship information, that will be a new task.  If we want them to evaluate and rate politician’s truthfulness, that’s different from writing a story.  If we want death tolls at set times during a natural disaster, that takes an effort.

And it’s important, of course, not to create work for the sake of getting new data.  Some of it will be valuable; some of it will not.   We probably want to know who someone’s spouse is; but it’s unlikely the knowing his great-grand uncle is going to be helpful.   Or what color his hair is.

The point is, we have to make some choices about what we want to collect – and in the process make some leaps of faith about what may be valuable to others, and to the process of more creation.

Like it or not,  journalism is moving into an age of data – we will increasingly create value by aggregating, linking, analyzing and understanding it.  And we can help ourselves move strongly into that age by not only doing all that, but also create the new building blocks of this new era.


  1. […] This post was mentioned on Twitter by Geoff Spencer, reg chua. reg chua said: Structuring the information journalists collect each day can help us build the building blocks of new news products […]

  2. Reg,

    One of the things Adrian Holovatny once said about EveryBlock, something worth repeating, is that the project was never really designed to act as a standalone website but to instead be a part of something else. An idea seemingly in conflict with the conventional wisdom of sites using broad-based economies of scale within a narrow market segment, and where the niche grinds exceedingly fine.

    Yet another unusual thing about EveryBlock is that, unlike a lot of Knight-funded projects ( for some examples), it managed to get to a more-or-less finished state and was released as open source code. I mention this because it seems to me that in order for some of the digital news experimentation going on to be useful, it’s as important to track and understand the failures of projects as it is to understand those that succeed.

    As a matter of clarification, it might also be noted that Google Maps was not the first implementation of online mapping software. Prior to Google Maps there was MapQuest which was in fairly wide use, if memory serves, for two or three years roughly a decade ago. Two reasons Google Maps was able to gain traction were that it both provided developers with an API allowing them to relatively easily embed maps on separate sites, and in doing so not require expensive license fees. If there’s a parallel with EveryBlock, it’s that Google Maps could also be used as a component of a larger implementation of something.

    Both EveryBlock and Google Maps also point to yet another consideration in the sense that the news business seems to put a lot of concentration into those things which are an outwardly facing part of the user experience. There doesn’t seem to be much discussion about the development of tools to streamline workflow or augment the ability to gather or generate news itself. Although the work of Jonathan Stray of the AP from your post back in December is remarkable, it seems to be an exception to the general rule. We might also ask ourselves this: To what extent should the AP SIGACTS infographics be used for end-user display as opposed to the extent they might be used internally to generate other stories?


    • Perry,

      Thanks for keeping me honest on MapQuest and Google Maps. And for a very thoughtful posting as well.

      Adrian has a good point about how each site – and frankly, each piece of information – should really be thought of as a part of another, bigger whole. Although as a practical reality, it’s hard to justify building something just so it can contribute to a greater good/whole. Finding that sweet spot of monetizable standalone that also fits into something bigger is the holy grail, to mix a few metaphors. Which is what I think structured journalism can be – a way to help us straddle the two worlds and gently ease us from one into the other.

      And I’m definitely with you about the focus on the front-facing elements at the expense of the back-end processes that will ultimately create new value. Not that we should ignore readers/users. But we are most certainly ignoring processes.

      Thanks for reading and commenting.


  3. […] years, why not help the process along by starting to structure our content now?  Why not build the building blocks of a potential new information age?  Why cling to the processes developed for a different age and […]

  4. […] architecture.  But there’s real power, too, in giving ourselves standards to conform to.  If we build the building blocks of data-driven journalism in our day-to-day work, we open up new possibilities for creating new and better ways of uncovering […]

  5. […] So are we at a similar junction today?  Can we also begin to standardize some forms of text information – certain types of stories, or at least parts of stories – even at the cost of some creativity, in order to unlock potentially much more creativity when we have much more consistent building blocks of information? […]

  6. […] If we had that information at hand – whether on homicides, or car accidents, or school board minutes, or whatever – we could, at least in theory, reuse that information in new and interesting ways. […]

  7. […] such regular coverage means you can collect information consistently, and that gives you the building blocks for data businesses that can scale. Homicide Watch works because it covers every murder in DC, not […]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s


%d bloggers like this: