Tagged: data

OpenTech 2013

Another year - another OpenTech! See blog posts from 2010 and 2011.
It feels like every year the event gets bigger and better. It's still the same crowd of politically aware techies, and it still costs a ridiculously cheap fiver to come along, and the talks were of an abnormally high quality.

Here are my thoughts from the day.

Farmification Of Factories

Fascinating talk from Lisa Ma about living and working with workers in a Chinese joystick factory.

Raises interesting questions about how we treat workers in terms of resources, and whether urbanisation is seen as a universally good thing by young people.
It got me to thinking about how we treat factory workers compared to how we treat animals. It's now a badge of pride for cosmetics to carry a label reading "Not Tested On Animals." Following the recent disasters in Bangaladesh, should clothes carry a "No Sweatshop Labour" tag?
Or, perhaps as Rob Manuel suggested, shops should publicly display how much tax they pay.


@ and a x% of purchase price will be paid as tax to HMRC label?
@robmanuel
Rob Manuel

Or even


@ print the CEO to employee salary ratio on the tags.
@alexstapleton
Alex Stapleton

There's a great interview with Lisa at VisionOnTV

Putting Your House on GitHub

What if you put all your niggling household issues on a bug tracker? Superficially, a very entertaining talk by Francis Irving - but raised a serious point about how we communicate with tradespeople.
Why can't I put a big list of jobs out to tender and let plumbers and electricians compete for my work?
I asked him about the security aspect of the project. In open source software, it's usually considered polite to raise a security bug in private before disclosing it to the wider world. You wouldn't want to raise a public bug which read "Burglar Alarm Broken", would you?

Constitutional Excerpts Project

Another great "what if" made real. What if you were to gather all the versions of countries' constitutions up in one place? What would a searchable database be like? What lessons can we learn?
Given that most countries constitutions change over time, and most changes are done by non experts in the field, this could be a very valuable resource.


This taxonomy of constitutional issues is anthropologically problematic. Relies on eurocentric assumptions. But totally fixable. #opentech
@blangry
Alex

It also touched on the limits of crowd sourcing from the general population. When very dense legal language is involved, it is usually best to get experts to decide what it means. Of course, that's also an argument for having laws written in plain and unambiguous language.

GOV.UK

The GOV.UK team have gone from a twinkle in the eye of some techies - to a fully fledged team kicking arse in the heart of the Civil Service.
Of particular interest to me was how they managed a complex redirection project as they closed various sites. Certainly not for the faint hearted.

Also interesting was the tales of some of the internal difficulties they faced. Including some "interesting" thoughts on Open Source.


CESG tech dir: "If anyone in UK government says CESG has banned open source send their name to me and I'll have them killed" #opensource13
@NickJHeath
Nick Heath

I asked an awkward question about their priorities. The DWP site only works on IE6! That means trying to claim benefits if you have a modern computer or browser (or even an old Mac or Linux box) is impossible.
The problem, as I understand it, is that contracts have been signed which mean making even simple changes comes with a high cost. As we've seen with PFI contracts in hospitals, the initial cost can seem attractive but outsourced companies with a strong profit motive will screw you over without providing any real benefit.

Another interesting question was asked about the "dumbing down" of content. Firstly, the pages link to the relevant legislation if you really want the nitty gritty detail. Secondly, nerds aren't average users. Average users tend to skim pages rather than reading them comprehensively. Given the average reading age in the UK is 12 (that's a hugely problematic statement, BTW) it's important that the information on the pages is as clear as possible.

I can't begin to describe how incredbly proud UK citizens should be at having such an amazing team reshaping the Government's digital portfolio.

The Bill and Gavin Show

Oh, look, just read Bill's talk and be enlightened.
Given that the punk music revolution is now being used to sell cars and butter, how do we stop the digital revolution from being hijacked in such a way? One suggestion is to "weaponize" openness. Can we have a "Creative Commons MAX" licence which promises extreme legal retribution for violators? Can we create Open Source licences which prevent evil being done in our name? I suppose GPLv3 is an attempt at that.

Gavin Stark's talk on Open Data gave me a thought about the ongoing issues with privatizing the PAF (that's the data which makes up the UK's PostCode system). Several years ago, I suggested that mutual ownership would be preferable to privatisation of the Post Office - could the same be true of PAF? Would enough techno-utopians be able to club together to run PAF in an open and sustainable way?

Bribing MPs

I've been thinking a lot about political donations and "political donations". It seems that some people are able to influence the legislative process by donataing modest sums of money, and giving favours to politicians. Other people would call for a database of lobbyists, or some form of push notification service for whenever your MP receives a bribe donation. Not me. I want to make a crowd sourcing site to help you influence your MP.

(Many thanks to Alex Blandford for the name suggestion.)
Yes, this talk is (mostly) humorous satire. I haven't really built "KickbackStarter" - although the mood in the room seemed of the opinion that it would be a viable idea. More than a few people came up to me afterwards and asked if they could help get it started. I think they're all crazy...

Permit me to indulge in some vanity over the feedback and photos I received.


@ is giving a great talk proposing KickbackStarter to donate to MPs 'when they vote the right way' #OpenTech http://t.co/mJzCIdpDby
@kevglobal
Mr Anderson


"Clicktivism doesn't work. Bribe MPs instead" #opentech http://t.co/JGdtRo1zME
@RDBinns
Reuben Binns


KickBackStarter - GLORIOUS. Let's stop funding failed campaigns and just 'gift basket' our representatives. #opentech http://t.co/HBqqUiGhLR
@nuttyxander
Alex Ingram


@ 's potentially libellous, audience-compromising talk about crowd sourcing political lobbying ( /bribery) Kickbackstarter! #opentech
@RDBinns
Reuben Binns


@ makes a fab point abt the nonsense of MPs and who runs the country. Now this is a question .. do MPs take Bitcoin #opentech #A5


.@ have you seen http://t.co/HPHQ33s4d6 for a related concept and proposed fix in the USA? #opentech
@DRMacIver
David R. MacIver


Delighted2c n hear Valued Patron of the Library @ 's awesome #opentech talk ... with this satire u r really spoiling us Sir!
@Librarian
Librarian


@ Your Kickbackstarter talk at #opentech yesterday was amusing educational and inspirational. Bravo sire. Bravo.
@faintdreams
Faintdreams

Essentially, clicking on petitions doesn't work. Emailing doesn't work. Protesting doesn't work. Cash and gifts work reliably.
Kickbackstarter - let's club together to influence MPs directly!

Thanks to VisionOnTV for conducting this interview with me.

Inclusive Issues In Technology - A Practical Guide

Only 17% of the STEM workforce is female. 2/3rds of female STEM graduates don't enter the profession. 50% of technology customers are female. See the problem?

Three very different speakers talked about how they were helping encourage more diversity in technology.

Firstly Stemettes is showing young women positive role models of women in science and technology. They're showing parents that their daughters can find a rewarding and useful career in computing.

Flossie is a project to get more women involved in the open source movement. They have a conference coming up in November. If you're a woman and want to present - give them a shout. Men are welcome at the event, but not as speakers. Given the aims of the project, I think that's fair enough.

Finally, Meri Williams gave perhaps the most informative talk of the event. Practical Diversity.

We hear a lot about how being a straight white male is like playing life on the easy setting, but this was the first time I'd seen someone talk through practical steps to include more people.

I especially loved her remark about tolerance. No one wants to be tolerated - you only tolerate things you hate. If you're talking tolerance, you're essentially saying "I dislike you and have to put up with you." No one wants that.

I highly recommend having a quick read of her deck.

Odds and Sods

One of the great things about OpenTech is that all the talks are audio recorded. I think, if possible, they should be videoed as well.

There were lots of people I knew - albeit some only digitally


Thirty seconds after arriving: "You're Jonty, I recognise your name from twitter!". I had forgotten #opentech is essentially internet LARP.
@jonty
Jonty Wareing

I wonder what the "newb" diversity is like. Are we just preaching to the choir?

Gender diversity of participants seemed much higher than a "normal" conference. Why is that? 10 speakers out of ~40 were female - perhaps that encourages more attendees. Or, is it the fact that the conference is cheap and held on a weekend?

Scheduling against both finales of Doctor Who and Eurovision was a tactical mistake ;-)

Huge thanks to Sam Smith and his merry band for organising. For all the speakers and attendees for putting such wonderful thoughts into my head, and to everyone who chuckled along at my jokes.

Same time next year? You bet!

Surrey Police and the Case of The Misleading Pie Charts

Surrey County Council have sent every household in the county a booklet explaining how our council tax is being spent. Within it is a highly political comment from Kevin Hurley, the newly elected Police and Crime Commissioner.

He presents a pie chart showing how the police force spend its money. Take a look at it and ask yourself this question: what percentage is spent on "Employees".

Surrey Police Pie Chart

Please use this poll to record your guess - answers at the end of this blog.

Pie charts have a long and noble history. They were popularised by Florence Nightingale and were hugely effective in helping politicians understand the causes of death among soldiers during the Crimean War.
Nightingale-mortality

As we understand more about the human brain and how we perceive shapes, it is becoming clear that pie charts are ineffective for representing complex information.

2D pie charts can still serve a useful purpose in limited circumstances. The real problem is with 3D pie charts. As far as I can tell, these abominations were popularised by Microsoft's Excel charting software.

3D charts distort the view of the data in such a way that it becomes increasingly hard to understand the information being presented. A picture being worth 1000 words, allow me to demonstrate:
GraphJam3d

So, just how bad is Surrey Police's Pie Chart? In an extremely scientific study of asking half a dozen people, they all guessed between 75% and 85%. That's quite a wide range considering it's a multi-million pound difference.

On the opposite page to the pie chart is this summary of spending.
Police Spending

In slightly more readable format, it is:

Category £ %
Employees £181.70 81.9%
Premises £8.00 3.6%
Supplies £27.20 12.3%
Transport £5.00 2.3%
Total £216.90 97.7%

A few interesting things to note here.

Firstly, how do we calculate the percentages? The total spend isn't mentioned in the report (£216.90). If we use that, "Employees" accounts for 81.9% of spending.

If we take into account the gross expenditure (£207.70) the figure jumps to 87.5%.

Secondly, if we do assume that we're using the unreported total spend - there is at least 2% missing. Some of which can be explained by rounding - but I wonder what the rest of the money is spent on.

Given the above, I don't think the provided pie chart allows Surrey residents to see an accurate view of how their hard earned money is being spent.

Hopefully, this side-by-side - of the above data - will show you how 3D pie charts distort data and end up misleading their audience.
3d 2d pie chart side by side

With this overlay, we can see the distortion much more clearly. The smaller sections of the chart look disproportionately larger.
Pie Charts Overlayed
It's time to announce a zero tolerance crackdown on dodgy data representation.

Rewired State - UK Parliament 2012

This weekend, I went to Rewired State's Parliament hackday. I teamed up with amazing front end designer Max Bye and statistician par excellence John Sandall to create a data visualisation of Parliament's Demographics.

Are the houses representative of the people in terms of gender diversity? Are the Labour Party younger than the Conservatives? Are the parties in the Lords particularly dissimilar?

You can play with the hack at ParliamentDemographics.tk/ or watch a video demonstration.

  • Each bubble represents a political party
  • The size of the bubble represents how many members they have
  • The Y-Axis (Vertical) represents the average age of MPs / Lords
  • The X-Axis (horizontal) represents how gender balanced the parties are

(As you can tell, the hack was heavily inspired by Hans Rosling)

Data

A quick word about the data we used.

The (beta) APIs had some reasonably good documentation - although the examples could have been better. It seemed to assume that a user was already intimately familiar with the (sometimes arcane) principles of Parliament.

It also only spat out XML, so that needed to be converted to JSON.

The main issue we had was with the quality of the data. Let's look at two examples.

First, Linda Perham (picked solely because she's a mate of my mum!)

{
  "FullTitle": "Linda Perham MP",
  "DateOfBirth": "1947-06-29T00:00:00",
  "DateOfDeath": {
    "-xsi:nil": "true",
  },
  "Gender": "F",
  "Party": {
    "-Id": "15",
    "#text": "Labour"
  },
  "House": "Commons",
  "MemberFrom": "Ilford North",
  "HouseStartDate": "1997-05-01T00:00:00",
  "HouseEndDate": "2005-05-05T00:00:00",
  "CurrentStatus": {
    "-IsActive": "False",
    "StartDate": {
      "-xsi:nil": "true",
    }
  }
},

That's pretty comprehensive. We can see when she joined, left, her age, that she's still alive, and who she represents.

Now, let's take George Galloway who has had an... interesting... Parliamentary career.

{
  "FullTitle": "Mr George Galloway MP",
  "DateOfBirth": "1954-08-16T00:00:00",
  "DateOfDeath": {
    "-xsi:nil": "true",
  },
  "Gender": "M",
  "Party": {
    "-Id": "26",
    "#text": "Respect"
  },
  "House": "Commons",
  "MemberFrom": "Bradford West",
  "HouseStartDate": "2012-03-30T00:00:00",
  "HouseEndDate": {
    "-xsi:nil": "true",
  },
  "CurrentStatus": {
    "-Id": "0",
    "-IsActive": "True",
    "Name": "Current Member",
    "StartDate": "2007-10-31T00:00:00"
  }
},

All we have is his current status. It doesn't mention his previous life as a Labour MP, nor does it mention that he was the Respect MP of Bethnal Green in 2005.

For MPs who have subsequently gone to the House of Lords, the data is also unhelpful.

Betty Boothroyd was a Labour MP (for two different constituencies), then became The Speaker of the House of Commons, then went to the House of Lords. This is all the information we have on her.

{
  "FullTitle": "The Rt Hon. the Baroness Boothroyd OM",
  "DateOfBirth": "1929-10-08T00:00:00",
  "DateOfDeath": {
    "-xsi:nil": "true",
  },
  "Gender": "F",
  "Party": {
    "-Id": "6",
    "#text": "Crossbench"
  },
  "House": "Lords",
  "MemberFrom": "Life peer",
  "HouseStartDate": "2001-01-15T00:00:00",
  "HouseEndDate": {
    "-xsi:nil": "true",
  },
  "CurrentStatus": {
    "-Id": "0",
    "-IsActive": "True",
    "Name": "Current Member",
    "StartDate": "2001-01-15T00:00:00"
  }
}

There's also a significant lack of historical data. There are some Lords & MPs in the dataset who were in Parliament in the 1940s - but only a few. It would be great to have a comprehensive record of, say, the last 100 years.

There needs to be a better representation of when a member has "changed" - whether that's affiliation, leaving and then returning, being elevated, changing constituency, or even gender. (Although, as far as I'm aware, there have been no Trans MPs. Nor any MPs with non ASCII characters in their name.)

The data represents a very monochromatic view of the world.

For examining broad trends, it was sufficient for a hackday. We had tried scraping Wikipedia to get full details of every election, but that was a bit beyond us (over 1000 people for every election, plus by-elections, for the last 50 years.)

What We Found

I was particularly surprised by how little gender diversity there is. 50% of the population is female, yet the Labour Party have roughly 33% women MPs. Caroline Lucas is the sole (female) representative of the Green Party - which doesn't quite balance out the entirely male Bishops in the House of Lords.

In our data, you can see the big jump after the 1997 election - where the number female MPs doubled.

Labour are consistently older than the Tories. That was completely against my expectations.

So, play with the hack at ParliamentDemographics.tk/ and see what you notice.

Thanks

As well as my amazing team mates Max Bye and John Sandall, I must thank the team from Rewired State; they put on a storming hackathon. There was plenty of interesting data, a good mix of people, healthy food and drink (as well as the obligatory pizza).

While it would have been lovely to hold the event in Parliament - I appreciate that a hoard of geeks turning up with a panoply of dodgy electronics may not have best pleased the Serjeant-at-Arms. So The Hub Westminster was a fine substitute.

Special mention to Alex Blandford who was very helpful at explaining the data and helping us navigate through the peculiarities of the system.

Finally, massive thanks to the Speaker for this fine certificate.
rewired state 2012 certificate

The Death Of The BlackBerry

For years I was a BlackBerry fanboy. I remember snatching a departing colleague's 6710 and lying to the IT department that I was authorised to have my email on my phone. I never looked back. Despite a brief flirtation with the Nokia N95 - I was a BlackBerry Boy through and through. Until this happened.

Dead BlackBerry

In early March 2010, my beloved BlackBerry Bold took a tumble out of a cab and died. I've been an Android man ever since. Magic, Hero, Nexus, Galaxy - all great phones, but none could hold a candle to the 'berry.

Or so I thought.

A Torch In The Night

A good friend of mine - who updates his phones as frequently as I do - offered me his discarded BlackBerry Torch. How could I refuse a chance to get back to a real phone?
Give Up Android
The main thing that was bothering me about Android was the lack of a physical keyboard and the general instability of the platform and radio software.

The Torch is a phenomenal BlackBerry. The action on the slider is exquisite. The keyboard is a joy to pound away on. The email and calendaring are rock solid with a powerful and practical UI. The browser has improved immeasurably. The range of apps is much broader than a year ago - and includes the all important trifecta of Foursquare, Dropbox, and Expensify.

And I hate it.
Continue reading

OpenTech 2010

A quick report on OpenTech 2010 - the London event for geeks interested in Government data, openness and generally doing good things with tech and data.

Get Excited And Make Things
Copyright Matt Jones used under a Creative Commons non-commercial, attribution, share-alike licence.

I attended last year's event which inspired me to create my "VoteUK" service for the 2010 general election. I had considered doing a talk about the trials and tribulations of using open - and not so open - data. Instead, I gave a more general talk about how to harness the power of the mobile web to empower people - and why iPhone apps are the wrong way to get data to the masses.

More details in a moment. First off, my thoughts on the rest of the presentations.
Continue reading