Archives for posts with tag: Free data

Coverage of “points of interest” in OpenStreetMap is a point of pride for many mappers. Our maps have much richer detail than commercial competitors, they provide endless handy data for mashups, and as a consequence have been a big focus of mapping party efforts in London.

But should we really be so keen? I’m not so comfortable for two reasons.

First, how up-to-date is our data? I’ve recently re-surveyed my local area in minute detail and found several takeaways, shops and banks that have closed down or changed hands. I’ve also discovered that we have very poor coverage of cycle parking in Southwark following two years of massive expansion by the council.

How likely is it that these are being regularly checked and updated? I suspect “not very likely at all”, and have therefore decided to delete all my points of interest in my local area that I’m not confident anyone will update. I mostly deleted minor shops, especially those like hairdressers that change a lot and that aren’t very important to know about. I’ve left all the amenities like banks, post offices, cycle parking and pubs.

My second concern is that the completeness and up-to-dateness will vary according to the number of active and nutty OpenStreetMappers in the area. And that tends to translate to affluent areas.

In their useful paper on the “completeness” of OpenStreetMap, Muki Haklay and Claire Ellul issue this rather stark warning:

“The large number of contributors for applications such as OSM or Google Map Maker might convey the false impression that [they] represent a real democratisation of geographical information collection, whereas the reality is that these many voices are coming from the more affluent and naturally empowered sections of society. This cacophony is likely to be silencing the voices of the marginalised and excluded even further.”

As I have auto-traced buildings in deprived parts of Southwark from Ordnance Survey StreetView tiles and sporadic re-surveying, I have noticed the very patchy and thin coverage of points of interest in those areas. Probably half the churches and schools are marked with nodes (no ways describing sites and building, though I’ve tried to draw them in) whilst the rest are missing entirely; occasionally there is a smattering of takeaways and convenience stores.

A comparison of allotments with an open dataset from the Greater London Authority reveals a similar pattern (previewed above). Most of those we have missed are in deprived areas. I’ll be revealing more work on completing our allotment coverage soon, courtesy of some help from friends and contacts in various local/regional government departments.

Muki and Claire suggest public agencies should step in to improve coverage in deprived areas, but that requires a high level of committment to OSM from those agencies. Currently we are in the very early stages on this front in the UK.

Given all of this, I would be interested to hear what other OpenStreetMap contributors and followers think. Should we bother with minor points of interest like hairdressers and takeaways until public agencies step in? Is it better to leave them out to avoid a database full of out-of-date information that only increases inequalities of coverage?

Low carbon power in OpenStreetMapMy latest experimentation in environmental maps has been launched on the Peckham Power web site. It grabs the set of energy generators in London (updated every hour from OpenStreetMap) and plots low/zero carbon generators on the map with icons and information to tell you what sort of technology each one uses. The idea is to, eventually, impress people who didn’t realise just how much of this exists in London already.

In developing the code that creates the clickable points, I realised that the OpenStreetMap tagging schema doesn’t cope with the many different types of technologies very well. So I am currently taking a detailed proposal through the wiki process to rationalise and expand the “power=generator” feature – comments welcome! It will go to a vote in a couple of weeks.

As Oliver Kühn has pointed out, data contributors aren’t always aware of the needs of data consumers. The very sparse coverage of energy generators in OpenStreetMap is a case in point; the cluster pictured in this post was a result of a little stroll I took with a friend and Peckham Power founder Anna Plodowski. But across London there are only a few generators visible, out of hundreds or thousands that must exist. I hope this map might spur others to contribute more data.

I am also talking with contacts in the Greater London Authority and Southwark Council about getting data they hold into the public domain, to be imported into OpenStreetMap. Public bodies, and organisations like housing associations, must hold lots of data on their own kit without complex data protection issues that would stop installation companies contributing their data.

In time, it might become an interesting point of collaboration with government and third sector groups, as currently nobody holds any data indicating the extent of low and zero carbon energy generators in London!

Some lively debate flared up on the tail of my previous post on OpenStreetMap governance, where I made my criticism of the “Just Fucking Do It” philosophy that was labelled “do-ocracy”. Harry noted in his diary that there has been some bickering on Twitter on the question of what might be wrong with the otherwise-excellent OpenStreetMap.

My principal objection to the “do-ocratic” model is that it excludes “those who can’t” from setting the direction of the project, and that as a consequence OpenStreetMap is unlikely to meet the needs of a great many people.

Did I mean that developers are lazily or selfishly ignoring others’ needs? No, I am aware of and indebted to the efforts of many volunteers working to make OpenStreetMap more accessible and usable. Only a handful of community members refuse to engage in grown-up debate.

Do I mean to whine because I am excluded? Not at all. I consider myself to be very technically skilled and sufficiently time rich tohave contributed a lot over five years. I’ve dropped off mailing lists because I’m not that time rich and I’ve not got the skills to develop many tools I’d like, but that’s life.

So do I want developers to be subject to the force of a governing body, to dance to a top-down tune? No, I am a great fan of communities that harness the energy and enthusiasm of people who choose of their own accord to hack on things that interest them.

Do I think OpenStreetMap will fall apart if it doesn’t address my concerns? No, Tom Hughes rightly pointed out that a legitimate path for the project would be to remain a haven for the technically skilled and time rich, leaving others to step in and enable a wider community of enthusiasts or create business opportunities just as MapQuest have recently announced.

Am I suggesting that none of this is being discussed elsewhere? Not at all, I’m aware that some Foundation members are trying to tackle these sorts of issues.

My objection to the do-ocracy boils down to thinking that it’s a shame. I think OpenStreetMap could be much more, and that it stands in danger of being forked or ignored (as it already is) by a great many who would find it useful and add a great deal to the community. So long as key decisions and discussions are dominated by the technically skilled and time rich who can “just fucking do it”, the project will continue to reflect their preferences.

Giving the OpenStreetMap Foundation a wider and deeper remit, putting a corporate fundraiser at the top of the priority list and making an effort to include a variety of Board members from backgrounds other than core OSM hacking will all help. I’m glad that Mikel Maron, Thea Clay, Harry Wood and countless others are actively working to make this happen.

Thea Clay made the killer point in Chris Osborne‘s “What’s wrong with OpenStreetMap” session (video here). It was even better than Mikel Maron‘s observation that people should agree with founder Steve Coast just a little bit less!

Foundation Board member Henk Hoff (a very nice-sounding chap) was describing the classic technocratic argument that in a “do-ocracy”, those who get on with doing things make decisions by default. Steve must have loved it, you just get on with useful stuff and avoid getting bogged down in pointless debates. Right?

Thea pointed out that in a community of tens of thousands, only a few hundred can “do” stuff like making amazing tools and creating useful maps from the tags they’ve invented. I’m in the bigger mass of people who want to contribute data, see lots of good uses and ways in which OpenStreetMap can improve, but lack the skills to “just get on and do” much that I’d like to with the data. I’ve been at it for five years.

I spend a lot of time involved in local groups trying to improve their town centre, grow food on their housing estate, represent tenants or establish a community-owned renewable energy company. They’ve come up with some great ideas for using OpenStreetMap, but none of us have the skills or money to “just do it”. I’ve tried, for two years, to get others to help with this with very little success. So is OpenStreetMap just not for us? Do I leave them to use Google Maps and miss out on the potential of such an amazing open platform?

Henk’s suggestion that the decisions of the “do-ers” are generally accepted is also just plain wrong. Nobody has ever been able to agree on the appropriate difference between marking a feature as a footway or a path, after years of debate. The same goes for wood/forest and countless other features.

That’s a pretty sad inditement as it makes for even more confusing map detail (the map key is absurdly long, and why should the average map user care if it’s a footway or a path?) that also makes applications like routing needlessly complicated.

Anarchy gives OpenStreetMap real energy and the space for innovation by the do-ocracy elite. But it leads to very inconsistent data and the exclusion of all but a technically hyper-literate few.

Most mappers come from countries run by democratic governance; they use software created by communities with clear and functional democratic structures like this, this and this; there’s a great study on Debian that drives the point home. Many mappers have engaged with the pseudo-democratic process of voting on new tagging proposals. I suspect that most mappers – if you canvassed beyond the extremely vocal elite – would support a more democratic approach to basic decisions about core tags, use of funding, etc.

That won’t stop people “just doing” what they want to do, but it will make the data more useful and the project more accessible for the vast majority of people outside of the technical elite.

Finally, just as we let people who prove their technical skill loose on the technology, why not let people with proven organisational and political skills loose on these problems? An audience member suggested OpenStreetMap was going through puberty. Well as much as teenagers hate to admit it, sometimes authority borne of experience and training is worth listening to.

For these reasons and more we need to hear much more from the likes of Thea and Mikel, and a lot less from techno-junkies like Steve.

Following past discussions with staff at Southwark Council and the Greater London Authority, I helped organise a technical  workshop in City Hall this weekend. We brought some key OpenStreetMap geeks together with some keen potential early adopters from the GLA, Southwark and Brent to talk open maps and hack on data & tools.

Harry Wood will post a useful rundown of some of the stuff people hacked on over the two days.

The only practical thing I did was to work with Rob Scott (OSM) and Scott Day (Southwark Council) to try and extract buildings from the open Ordnance Survey maps so we could merge them into OpenStreetMap without having to manually trace every single one (yawn). For the nerds, I’ve written up our initial results on the wiki.

Talking with Scott, it was clear that Southwark probably have a lot of data we could benefit from, and that they would really like to use OpenStreetMap in lots of places where they don’t need the pinpoint accuracy for road shapes, gardens, etc. that they get with commercial products like UK Map and Ordnance Survey’s Mastermap.

Alisdair Maclean from Brent brought the whole road network on a USB stick. Robert did a quick visual analysis of differences with OSM data using his “musical chairs” app, and Grant overlayed the two sets of data to spot roads he had missed over the years. Again, I hope Alisdair really benefited from the opportunity to chat.

The trick is really just to keep experimenting and helping government people to try things out. Expecting local authorities to just come and use OSM without any decent documentation or personal contact is… well, it won’t happen. Without those relationships, open data initiatives like the London Datastore could just end up dumping data on the public without benefiting from our capacity to correct and improve upon that data.

I met up with two map/GIS officers from Southwark Council this evening to continue a discussion about OpenStreetMap; they’re very interested in it. The obvious starting point, with some help from ITO, will be to use OpenStreetMap for the new web mapping service on all zoom levels up to the very detailed Ordnance Survey master maps (which have exact road shapes, buildings, etc.). That’s right – they might replace the commercial stuff with maps that were made by the community and shared for free!

Southwark has some pretty well known landmarks – Tower Bridge, the Globe Theatre, Peckham library and Nunhead Cemetery to name but a few. It will be exciting to have OpenStreetMap data of these on the Southwark web site.

But wait – it gets better. They’re also interested in discussing real, actual collaboration. To begin with, they might be able to provide data for OpenStreetMap and help us keep it up to date, for example sharing the street gazetteer so we can check if we have missed anything, seeing if they can let us know when roads change, and putting in all the cycle parking & recycling points they’ve gone around the borough finding themselves. They’re even interested in getting officers across the council to use and contribute OpenStreetMap where it is easy and helps them do their job.

It’s very early days, but look out for a hack or mapping party with Southwark Council later this year. Some of this might just come true, and establish a really interesting experiment where council officers and people in the community collaborate for their mutual benefit.

How could the Greater London Authority, Southwark Council or tenants on estates use OpenStreetMap? I regularly use it to get around, but of course I’m an OSM nerd. Most people have never heard of it, which is a shame because they could really benefit from it.

This evening I introduced the Southwark Group of Tenants Organisations to the project, handing around some printouts showing how OSM has many estates much better mapped than Google, and how we have nice (but very incomplete) public transport and cycling maps which are much more useful for your average tenant than a map for car drivers.

Everyone seemed really enthusiastic, which was lovely! One lady thanked me for getting the name of her estate right; it changed in 1979 but lots of maps still have the old name.

So I’m going to do some workshops with tenants on a couple of estates to get them started, probably using Walking Papers, and we’ll see where we go from there.

In a different world, I’ve been talking with Emer Coleman who heads up the London Datastore, a fantastic Open Data initiative. She’s enthusiastic about making public data available for OpenStreetMap, about entering OSM data sources in the Datastore, and collaborating where public authorities struggle to gather information like cycle parking stands or building accessibility.

On Tuesday evening Emer and I met up with Gareth who leads on GIS in the GLA, Christopher Osborne from ITO, Muki Haklay from University College London, and Harry and Shaun from OSM, to discuss all this. We aren’t gunning for paradigm shifts overnight, but it’s good to start developing a relationship and talking about how to get those ideas right. Gareth is also going to broker us into the world of London Council GIS bods.

That’s quite enough OSM for one week. Now back to getting elected and holding down my job!

Open AccessGavin Baker, a really fantastic free data activist from the US, nudged me recently about his post on the position of different European parties on open access to research. Scott Redding, one of our Green Party candidates in the elections and also doing amazing work getting more online activism for the party, gave a fairly strong statement on his intention to support the cause of open/free data.

So where do we stand? It’s easier to explain by talking about our wider policy and activism around intellectual property. So here’s an update on a previous post:

The Green Party in England & Wales hasn’t done much work specifically on open access to research but I guess the message to Gavin and other activists is: we have strong, clear policy on this, and we’re an open door. Green MEPs will always listen to you, turn up to vote on directives, write letters and within reason support the cause!