Open Data is dear to my heart. It is the idea that raw data should be public published, free of restrictions, and in a form that is most usable for others. When people talk about Open Data, they usually mean "Data that has been paid for by tax-payers" - often data created or collected by Government agencies. But it also extends to the data used by researchers, scientists, economists and any…
Continue reading →
My wife and I run a side project called OpenBenches.org - it is a fun little crowd-sourced memorial bench site. It's mostly fun, except when the bills come due! Most hobby sites and side projects don't cost a lot to run. Lots of services have generous free tiers to (ab)use, and they can pay well in "exposure". But OpenBenches is reaching a tipping point where it is slowly overwhelming us. …
Continue reading →
After 3 full years of having solar panels on our London roof, they've generated 11,950kWh of electricity. Nice! Here's how those three years look, according to our smart meter. kWh Solar Generation 11,950 Solar Export 7,346 Grid Import 7,521 Quick maths! The difference between the generation and the export is our solar consumption: 4,604kWh over 3 years. So we…
Continue reading →
Many years ago, I was involved in student politics. It was a great way to understand the fundamental disconnect between the ways different people see the world. I remember having a blazing row high-spirited discussion with someone about the way I thought about society. In a fit of rage an attempt to provide clarity, I tried using a metaphor: "Didn't your mother ever tell you to share your…
Continue reading →
About a million years ago, the then Coalition Government in the UK announced a slew of Open Data projects. They wanted - in their words - to "mobilise an army of Armchair Auditors". That is, ordinary people would be able to look through the data and find interesting errors. I'm a civil servant (this is a personal blog) so I can't comment on the politics behind the idea. But I think it is fair…
Continue reading →
Force Directed Graphs of the London Underground have been done many times before - but I think I'm the first person to add the new Elizabeth Line (CrossRail). I've also created a JSON graph of all of London's rail services - including DLR, Trams, C2C, ThamesLink etc. Demo Play with it yourself Grab the code from GitLab I've also created a version with every London station and train line. …
Continue reading →
I'm an advocate for open data - both in my professional role and in a personal capacity. One of the hard things is succinctly explaining that "open data" means "non-personally identifiable data at a sufficient granularity to be useful without proving a risk to any individual's (or group's) reasonable expectations of privacy while still being useful to researchers and civic society." What a…
Continue reading →
It's quite popular to see high street shops names "Somesuch and Sons". Indeed, my grandparents ran "Eden & Sons" for many year. Much rarer is seeing "... & daughters". But, of course, the plural of anecdote is not data! The UK register of businesses - Companies House - has a pretty good search engine. Doing a search for AND SON returns 220,000 results. We use the singular because that…
Continue reading →
Back in 2014, I released a year's worth of solar generation data. I was enormously proud to recently discover that the data were cited in a couple of academic papers: Colantuono, Giuseppe & Kor, Ah-Lian & Pattinson, Colin & Gorse, Christopher PV with multiple storage as function of geolocation (2018) page: 217-232. Elsevier BV. Solar Energy. https://doi.org/10.1016/j.solener.2018.03.020…
Continue reading →
I have a Tado smart thermostat - part of my smarthome project. As well as letting me set the temperature from my phone, it records environmental data, and provides a handy API for me to retrieve it. This blog post will show you why I've gathered the data, let you download the full dataset, and explain what I learned from it. Why do this? There's a long-standing plan to use waste-heat from a…
Continue reading →
Glasgow City Council has released a treasure-trove of open data. Nearly one-hundred datasets ranging from Live Traffic Information - to historic climate data. A fantastic boon for researches and open government enthusiasts. But there's a sting in the tail. The majority of the datasets are under the Open Government Licence (OGL). That's basically Creative Commons Attribution (CC-BY 4.0). …
Continue reading →
For the last year-and-a-bit, Liz and I have been running OpenBenches.org. An open data website dedicated to memorial benches. Here are some rough and ready numbers about how it has gone so far. 9,870 Benches At the time of writing, we're a little shy of 10,000 benches. As you can see, we have photos from all around the world. 9,000 UK Benches The majority of our benches are in the UK. …
Continue reading →
