That's it. That's the post. Fine! I'll expand a little more. Large Language Models are a type of Artificial Intelligence. They can read text, parse it, process it using the known rules of English, and then regurgitate parts of it on demand. This means they can read and parse a question like "In Python, how do I add two numbers together?" and then read and parse the Python documentation. It…
Continue reading →
I saw a prominent AI proponent asking why people always focus on the things that AI gets wrong. AI works so well, he asserted, that it was churlish and childish to focus on a few minor mistakes? Which reminds me of an experience I had a few years ago. I was in a rural pub and got chatting to one of the locals. We were getting on great, so I asked him what his name was. "You know," he said,…
Continue reading →
Last week I attended an unofficial discussion group about the future of AI in Government. As well as the crypto-bores who have suddenly pivoted their "expertise" into AI, there were lots of thoughtful suggestions about what AI could do well at a state level. Some of it is trivial - spell check is AI. Some of it is a dystopian hellscape of racist algorithms being confidently incorrect. The…
Continue reading →
A week is a long time in politics and a couple of years is an aeon in AI. Published in 2019, just before the dawn of the LLM, this is an overview of all the weird and charming ways Artificial Intelligence can go wrong. It is fully of delightfully silly examples and rather charming illustrations. Lots of the examples are drawn from the always-entertaining AI Weirdness blog. But it does suffer…
Continue reading →
There's a popular saying; "No One Wants a Drill. What They Want Is the Hole". It's a pithy (and broadly) correct statement. But I don't think it goes far enough. Let's apply the Five Whys method to the issue: No one wants a drill. What they want is the hole. No one wants a hole. What they want is a picture hook. No one wants a picture hook. What they want is art hanging on the walls. No one…
Continue reading →
I'm sure I remembered there once being a clock app for Linux which was deliberately vague. It would declare the time as "Nearly tea-time" or "A little after elevenses" or "Quite late" or "Gosh, that's early". But I can find no evidence that it ever existed and am beginning to wonder if I dreamt it. So I built it. First thing's first - there are a lot of existing fuzzy clocks. But they mostly…
Continue reading →
A group of authors are suing various vendors of Large Language Model AIs. The authors claim that the AIs are trained on material which infringes their copyright. Is that likely? Well, let's take a quick look at the evidence presented. First up, Meta's LLaMA Paper. It describes how the LLM was trained: We include two book corpora in our training dataset: the Gutenberg Project, which contains…
Continue reading →
I'm obsessed with the idea that human progress could be accelerated - if only we realised how to properly combine existing technology. I don't want to go "Ancient Aliens" here - but even a cursory reading of scientific history will show you were humanity's progress could have been dramatically fast if only knowledge was more widely shared and recognised. The book "How To Invent Everything" makes …
Continue reading →
One of the (many) problems with AI is that training data usually needs to come from "natural" sources. If you want to emulate human-written text, you need to train something on human-written text. But with the proliferation of cheap and fast AI tools, it is likely that training data will unwillingly become contaminated with AI-written text. In order to prevent the "Habsburg Jaw" effect, I…
Continue reading →
As we head unto an AI dominated future, the Turing test will probably become less like a Voight-Kampff test and more like a warzone Shibboleth. Yesterday, I asked the Alexa to set a timer. "What do you want to name your timer?" She It asked. "Bow," I replied. "Bow timer set," it said. Except… that isn't quite right. I wanted a timer for my bāo buns (包). That's pronounced /baʊ/ - as in to bow o…
Continue reading →
I was in one of those interminably dull video-conferences a few weeks ago. The presenter was pitching their grand vision of what our next steps should be. "So!" They said, "Any comments before we launch?" No one said anything. After half a minute the presenter said "As there are no objections, we'll proceed. Silence is consent." At that phrase, my whole body did an involuntary spasm which I'm …
Continue reading →
I was recently interviewed in the BCS Magazine discussing the intersection of AI and Open Source. We're at a weird time with AI and Intellectual Property. Well, IP has been in a weird place since Napster launched at the turn of the century! None of the issues around sharing, remixing, and controlling have been properly resolved. Copyleft is a noble goal - but seems more honour'd in the breach…
Continue reading →
