A few weeks ago, I won a Raspberry Pi at the #OTA12 hackday. It arrived on Friday, so I thought I would turn it into an SMS server using the incredible FrontlineSMS.

0. Setting up the Pi

This is the easy part. Follow the excellent guide on the eLinux wiki. Essentially, download the Debian image, extract, and dd it onto an SD card.

The hardest part was finding a full sized SD! In the end, I found an old adapter and stuck in a 2GB micro SD card.

1. First Boot

My first boot was a failure. Nothing appeared on the screen. So, I switched off the power, unplugged every lead, plugged them back in, and powered it on. Success!

The first thing I did was ensure the operating system was up to date.

Check for updates:

sudo apt-get update

Then, apply those updates

sudo apt-get upgrade

This took a few minutes.

Finally, set up SSH or VNC if you plan on using the machine remotely.

2. Dongle Hardware

FrontlineSMS maintains a list of USB dongles which work with its service. I used a Vodafone branded Huawei E220. Sold as Vodafone K3565 The Raspberry Pi only has 2 USB slots - the dongle was slim enough not to interfere with the other USB cable, but it did mean I could only run either a keyboard or a mouse without using a hub. It's recommended that you use a powered USB hub - although my keyboard and mouse didn't seem to draw too much power.

3. Frontline SMS

Downloading Frontline SMS via the commandline (using v1.6 because v2 isn't ready for Linux yet)

wget http://frontlinesms.com/download/secure/FrontlineSMS-distribution-1.6.16.3-linux_i686-dist.zip

Unzip

unzip FrontlineSMS-distribution-1.6.16.3-linux_i686-dist.zip

Run

cd FrontlineSMS-distribution-1.6.16.3
./FrontlineSMS.sh

Gave an error - FrontlineSMS requires Java.

4. Installing Java

The Java install takes about 140MB of disk space. After downloading and extracting FrontlineSMS, I only had about 220MB of free space. I deleted the FrontlineSMS zip file and had 234MB free. Just about enough room!

sudo apt-get install openjdk-6-jdk

Wait several minutes and you'll be good to go.

5. Running for the First Time

Frontline SMS requires a GUI.

Running a GUI is as easy as typing

startx

The resolution was set at the slightly odd dimensions of 1264*672 - which meant there was a large black border around the screen.

Open a terminal (Start, Accessories, LXTerminal, then type

cd FrontlineSMS-distribution-1.6.16.3
./FrontlineSMS.sh

After several minutes of waiting, FrontlineSMS started!

However, no matter what I tried, I couldn't get FrontlineSMS to detect the dongle. The OS could see it fine (using "lsusb" and "dmesg"), but it just didn't appear to be detected by FrontlineSMS.

A delve into the commandline, showed this error:

librxtxSerial.so: cannot open shared object file: No such file or directory
(Possible cause: can't load IA 32-bit .so on a ARM-bit platform)
thrown while loading gnu.io.RXTXCommDriver

6. Installing the Correct Libraries

We need to load the correct (ARM) version of rxtx.

sudo apt-get install librxtx-java

Find where the install process has dumped it

find . -name "librxtxSerial.so"

It should show you two location - the first being where the correct version is, the second where the FrontlineSMS version is.

./usr/lib/jni/librxtxSerial.so
./home/pi/Desktop/FrontlineSMS-distribution-1.6.16.3/librxtxSerial.so

All we need to do is overwrite the incorrect version.

cp /usr/lib/jni/librxtxSerial.so /home/pi/Desktop/FrontlineSMS-distribution-1.6.16.3/

Then, run

./FrontlineSMS.sh

And, after some warnings and waitings, you should see

Hey Presto! FrontlineSMS up and running on a Raspberry Pi!

(Oh! I finally worked out how to do screenshots! install scrot and run "scrot -d 10" to take a screenshot after 10 seconds.)

7. Manually Sending an SMS

Running FrontlineSMS via Java on a 700MHz ARM device is very slow. It is possible to talk directly to the dongle and manually tell it to send SMS.

First, I installed picocom.

sudo apt-get install picocom

To find out where the dongle has been installed, type:

dmesg

Which will give an long output, which should contain some text like this like this:

option 1-1.2:1.1: GSM modem (1-port) converter detected
usb 1-1.2: GSM modem (1-port) converter now attached to ttyUSB0
option 1-1.2:1.0: GSM modem (1-port) converter detected
usb 1-1.2: GSM modem (1-port) converter now attached to ttyUSB1

The dongle installs itself in two places - ttyUSB0 & 1. It's the first one we want.

Connect by issuing this command

picocom /dev/ttyUSB0 -b 115200 -l

Which will give you the output

port is        : /dev/ttyUSB0
flowcontrol    : none
baudrate is    : 115200
parity is      : none
databits are   : 8
escape is      : C-a
noinit is      : no
noreset is     : no
nolock is      : yes
send_cmd is    : ascii_xfr -s -v -l10
receive_cmd is : rz -vv

Terminal ready

From now on in, we're typing commands directly into the dongle. You cannot press the delete key! Copy & paste, or be careful when typing!

First, to make sure everything is working, we type

AT

We should see this response

OK

Next, set the dongle to text mode

AT+CMGF=1

Again, the response should be

OK

Let's send our first SMS!

AT+CMGS="+447700900123"

This will not say "OK", rather, it will prompt us to type a message

> 

Type your message, so the screen looks like

> This is a test

DO NOT HIT ENTER. Instead, hit CTRL and Z at the same time.

You should see a response like

+CMGS: 193

OK

The number is the "sent items" reference. Within a few moments, the SMS should have been received.

You can send an SMS to the dongle. To check for messages, type the command

AT+CMGL="ALL"

You should see all the messages in the inbox

+CMGL: 0,"REC READ","+447700900000",,"12/06/19,13:53:19+04"
Received
+CMGL: 1,"REC READ","+447700900321",,"12/06/23,17:16:29+04"
Testing
+CMGL: 2,"REC UNREAD","+447700900555",,"12/06/23,23:27:48+04"
This is another test

To quit picocom, hold down CTRL, then hold down A, then hold down X.

Useful Links

A collection of links I found useful when writing this blog post

• http://designbuildtestrepeat.wordpress.com/2008/04/29/huawei-e220-on-linux-for-sms/
• http://www.diafaan.com/sms-tutorials/gsm-modem-tutorial/
• http://www.shapeshifter.se/2008/04/30/list-of-at-commands/
• http://raspberrypi.homelabs.org.uk/raspberrypi-the-arduino-development-tool/
• http://developer.vodafone.com/labs/opensource/linux- connection-manager/operating-systems/ubuntu-linux-setup/
• For unlocking Huawei modems

My first attempt used the proximity sensor. However, on all the Android phones I tried the sensor's accuracy was binary - it could sense if something was close by, but not say how close.

So, what else could I use to detect how near or far a hand was from the screen? I decided to co-opt the Light Sensor. This is normally used to automatically adjust the brightness of the screen - making it easier to see in strong light.

When the light sensor is uncovered, the total lux (that's the measure of light) may be 100. As a hand moves closer to it, that value will dip until it reaches 0 (or, on my phone, 4).

We can then represent that light value as a sound - essentially transforming lx into Hz!

This is what is sounds like

Beautiful, I'm sure you agree! You can hear an interview where I discuss this app with the BBC's Jamillah Knowles on the Outriders Podcast (22m 50s in).

If you want to have a play with it, the Optical Theremin Demo is in the Google App Store. Do note, it was coded in a couple of sleep deprived hours, crashes when you exit, and can produce "music" which scares children and animals. You have been warned!

Use The Source, Luke!

I've included the full source below, but I'd like to pick out two points which may be of interest.

Getting The Lux Value

Firstly, we need to register a listener for the light sensor.

@Override public void onCreate(Bundle savedInstanceState) {
   super.onCreate(savedInstanceState);
   mSensorManager = (SensorManager) getSystemService(SENSOR_SERVICE);
   mLightSensor = mSensorManager.getDefaultSensor(Sensor.TYPE_LIGHT);
   mSensorManager.registerListener(this, mLightSensor, SensorManager.SENSOR_DELAY_FASTEST);
}

Every time the light sensor changes, this method will be called. It takes the light value and performs a simple mathematical transformation on it (adds 10, multiplies by 5). I found that this gave the most pleasing sound - but you can adjust it to your tastes

@Override public void onSensorChanged(SensorEvent event){
   if (event.sensor.getType()==Sensor.TYPE_LIGHT){
       mLux = event.values[0];
       freqOfTone = (mLux +10) * 5;
   }
}

Cum on Feel the Noize

So, how do we get Android to generate a tone? I faffed around with this audio generating code from StackOverflow until I could successfully generate a tone.

Essentially, this creates a WAV of a tone and gets it ready to play.

However, this sounded rather boring, so I added some reverb.

audioTrack.attachAuxEffect(EnvironmentalReverb.PARAM_DECAY_TIME);

And that's it!

Download the Optical Theremin Demo App - or use the source to create something much more melodious.

Full Source

package mobi.shkspr.android.theremin;

import java.util.Random;

import android.app.Activity;
import android.hardware.Sensor;
import android.hardware.SensorEvent;
import android.hardware.SensorEventListener;
import android.hardware.SensorManager;
import android.media.AudioFormat;
import android.media.AudioManager;
import android.media.AudioTrack;
import android.media.audiofx.EnvironmentalReverb;
import android.os.Bundle;
import android.os.Handler;
import android.util.Log;
import android.widget.TextView;

    public class TheraminActivity
        extends Activity
        implements SensorEventListener{
        // originally from http://marblemice.blogspot.com/2010/04/generate-and-play-tone-in-android.html
        // and modified by Steve Pomeroy steve@staticfree.info

        private final int duration = 5; // seconds
        private final int sampleRate = 8000;
        private final int numSamples = duration * sampleRate;
        private final double sample[] = new double[numSamples];
        private double freqOfTone = 440; // hz

        private final byte generatedSnd[] = new byte[2 * numSamples];

        private SensorManager mSensorManager;
        private Sensor mLightSensor;
        private float mLux = 0.0f;
        private String tLux = "Lux is ";

        public AudioTrack audioTrack;

        Handler handler = new Handler();

        @Override public void onCreate(Bundle savedInstanceState) {

            super.onCreate(savedInstanceState);


            mSensorManager = (SensorManager) getSystemService(SENSOR_SERVICE);
            mLightSensor = mSensorManager.getDefaultSensor(Sensor.TYPE_LIGHT);

            mSensorManager.registerListener(this, mLightSensor, SensorManager.SENSOR_DELAY_FASTEST);

        }

        @Override public void onSensorChanged(SensorEvent event){
            if (event.sensor.getType()==Sensor.TYPE_LIGHT){
                mLux = event.values[0];
                String luxStr = String.valueOf(mLux);
                TextView tv = new TextView(this);
                tv.setText(tLux);
                setContentView(tv);
                Random r = new Random();
                freqOfTone = (mLux +10) * 5;
            }

        }
        @Override protected void onResume() {
            super.onResume();
            final Thread thread = new Thread(new Runnable() {
                public void run() {

                    for (int i = 0; i < 300; i++)   {
                        genTone();

                        audioTrack = new AudioTrack(
                                        AudioManager.STREAM_MUSIC,
                                        sampleRate,
                                        AudioFormat.CHANNEL_OUT_MONO,
                                        AudioFormat.ENCODING_PCM_16BIT,
                                        numSamples,
                                        AudioTrack.MODE_STATIC);


                            try {

                                playSound();
                                Thread.sleep(505);
                            } catch (IllegalStateException e) {

                            } catch (InterruptedException e) {
                                // TODO Auto-generated catch block
                                e.printStackTrace();
                            }
                    }
                }
            });

            thread.start();
        }

        void genTone(){ // fill out the array
            tLux = "Frequency is " + freqOfTone;
            //Log.d("LUXTAG", "Lux value: " + tLux);

            for (int i = 0; i < numSamples; ++i) {
                sample[i] = Math.sin(2 * Math.PI * i /(sampleRate/freqOfTone));
            }

        // convert to 16 bit pcm sound array
        // assumes the sample buffer is normalised.
            int idx = 0; for (final double dVal : sample) {
                // scale to maximum amplitude
                final short val = (short) ((dVal * 32767)); // in 16 bit wav PCM, first byte is the low order byte
                generatedSnd[idx++] = (byte) (val & 0x00ff);
                generatedSnd[idx++] = (byte) ((val & 0xff00) >>> 8);

            }
        }

        void playSound(){
            genTone();
            try {                   audioTrack.attachAuxEffect(EnvironmentalReverb.PARAM_DECAY_TIME);
                audioTrack.write(generatedSnd, 0, generatedSnd.length); audioTrack.play();
            } catch (IllegalStateException e) {
                audioTrack.release();
            }
        }

        @Override
        public void onAccuracyChanged(Sensor sensor, int accuracy) {
            // TODO Auto-generated method stub
        }

        @Override
        public void onPause() {
            super.onPause();
            audioTrack.stop();
            audioTrack.flush();
            audioTrack.release();
        }

        @Override
        public void onStop() {
            super.onStop();
            audioTrack.stop();
            audioTrack.flush();
            audioTrack.release();
        }

        @Override
        public void onDestroy() {
            super.onDestroy();
            audioTrack.flush();
            audioTrack.stop();
            audioTrack.flush();
            audioTrack.release();
        }
    }

The Wifi just about held up. Although I think it's fundamentally impossible to provide decent connectivity to 200+ people. Especially when they're geeks.

Dan Benton

@dogsbodyorg

It's people like @edent that break conference Wi-Fi ;-) #ota12 pic.x.com/dl2fibfi

---

Which, in turn, lead to this:

Terence Eden is on Mastodon

@edent

My data usage at #ota12 may have been a bit excessive... twitpic.com/9s35rx

---

As per my post of two years ago, I tried to encourage people to record video or audio of the talks they were in. It was a reasonable success. We captured several great sessions, but others have been lost to the æther.

I honestly believe that BarCamps, unconferences, and hack-days are part of our culture and should be preserved. There's a selfish element in that I want to see the talks that I missed - but more than that, I want to ensure that what we're doing isn't lost forever.

So, here are my thoughts (and videos) of the day.

Everything You Know About QR Codes is WRONG!🔗

The devilishly handsome Terence Eden gave one of his excellent talks upon the subject of QR codes.

I was really pleased with how this went, a packed room and lots of great questions. Thanks to Craig Heath for videoing it.

Responsive Web Design - the Specs Behind the Sex🔗

Bruce Lawson talked through some of the issues with RWD especially when it comes to adaptive images.

My thoughts on the subject are still developing, but I think that it ought to be the server / CDN which adapts the images, rather than the handset relying on JavaScript and CSS. I've two primary reasons for this,

1. There are billions of phones already on the market which don't support CSS or JS sufficiently to handle this. There's no realistic way to upgrade their browser.
2. Programmers and web designers are lazy. I don't believe that the more complex mark-up will be used, nor that they will generate several different images.

A Means to Interact: A Guided Tour of Arts Programming Platforms🔗

I must confess, I misread the subject of this talk - I thought it would be about artistic APIs. Instead, it was a fascinating talk about different ways to create graphics programatically. Becky Stewart stepped us through the pros and cons of each platform and showed us how they worked. I love interactive sessions - so coding along was great fun. She wisely distributed Windows, Mac, and Linux versions of the SDKs on memory stick so we wouldn't spend half the session downloading them.

Mobile Websites Can Have Nice Fonts Too🔗

I'm a bit of a philistine when it comes to fonts. I have the vague feeling they're important, but I don't really know why - nor how to implement them on a website. Laura Kalbag to the rescue then!

After the session, I was talking to my friend Saqib (who is blind) about fonts. He wanted a better understanding of how they affected the reading of text. I realised that fonts are like the background music in a film. It's the music which makes Star Wars as much as the dialogue and special effects. Imagine watching a Schindler's List with a jaunty comedy score - it would completely destroy the meaning of the film. As well as readability, picking a font changes the emotional engagement that a reader has with your text.

TheLab: Demo Cool Things!🔗

I say! Those chaps from O2's TheLab are rather clever, aren't they? Just goes to show what a bit of ingenuity can do when applied to a telco. We saw a demo which tracked which country people were in based on whether their phone was roaming, HashBlue which backs up your text messages and provides an API to access them, and O2 Connect which routes your calls over WiFi if you're out of signal. Evidently lots of smart thinking going on in Slough!

Connecting Microcontrollers to the Cloud🔗

The guys from Vodafone were showing off mbed. It's a micro-controller similar to the Arduino. The idea is that you can rapidly prototype sensor data, send it via a data or SMS connection and do other cool stuff with it. The session I attended went into the C code behind it (which was a little over my head) as well as demoing practical uses for it. It's great to see kit electronics like this and the Raspberry Pi become popular - hopefully it will make hardware more accessible.

An Illustrated History of Computation🔗

What a delightful session! Professor Bernie Cohen took us through a history of computing, mixed with personal anecdotes, and live algorithm solving. He seems to know a thing or two - I predict the lad'll go far!

ePatient 101: An Introduction to the Asymmetrical World of Technology and Healthcare🔗

Mark Kramer (AKA Mamk) joined us via a dodgy Skype connection from the US, where he has just finished being treated for cancer. Fuck cancer. Seriously, fuck it. Mark was talking about the disparity between the technology which the medical profession has access to versus that of their patients. Doctors may have MRI machines - but they're often stuck with handwritten notes, or ancient PCs. Patients have more CPU power in their phones than a whole office full of medical staff.

Hacking

Over The Air is where geeks come to play. Some of the inventions on display were simply marvellous. I think there were 39 hacks presented - I'm going to highlight the ones I thought were exceptional.

Sam Machin built a tool to allow you to send tweets via a DNS lookup! As he said during his introduction:

Without going into too much detail, you do a lookup on my-message-is-this.example.com, when the server receives the NS, it tweets on your behalf. So, as long as you can do a DNS request - even if the response is blocked - you can tweet. Amazing!

Tom Hume built an app which lets you post your call history on Facebook. It's not as creepy as it sounds! Remember "poking"? Well, a phone call is a private poke, in essence. So, your friends can see that you called X to wish them happy birthday.

Jatrobot was the scariest looking hack I'd seen! Herx The Vampire Slayer! The team had built a modern farming tool. It measured soil moisture, weather, gps, and a bunch of other stuff via mbed - then reported it all back via Android.

Finally, my hack! This was the first time I'd entered a hack at OTA and I was unusually nervous!

I took inspiration from Ariel Waldman's mesmerising keynote about creating accessible interfaces to science. I was reminded of the Music of the Spheres (not the Doctor Who episode!) - which is the idea that the movement of the planets and celestial bodies can be thought of as a musical arrangement. We can also tune in to the background radiation of the universe and turn that into music. My phone doesn't have a gamma ray detector - but it does have a solar radiation sensor - the Lux Meter! It also has a proximity sensor - so it can tell how far away my hand is from the screen.

So, I created an ersatz Theremin! Having created a musical instrument (despite having no musical talent) I set about composing a work to be played via the medium of light.

I'm chuffed to say it worked really well and the crowd seemed to like it!

Christian Payne

@Documentally

Still liking @edent’s ‘Music of the Geeks’ on his android theremin. Beautiful. :) #OTA12

---

Hadley Beeman

@hadleybeeman

Replying to @edent@edent got his Android to play music in response to hand waving & dancing in front of it. Great use of lux sensor & proximity sensor. #ota12

---

Grant Kemp

@ukdatageek

Replying to @edent@edent playing the music of the geeks. #ota12 pic.x.com/wos7nayj

---

Craig Heath

@heathcr

#OTA12 @edent brings house down with smartphone music performance art :-)

---

Duncan Cragg

@duncancragg

Things I liked @overtheair: @edent's theremin app, @edent's QR code talk, Bernie Cohen's computing history, @emabolo's HTML5 & AppFire..

---

Terence Eden is on Mastodon

@edent

#OTA12 rather nervous about presenting my hack. Never performed music in public before.

---

littlepurplegoth

@HelenArmfield

Replying to @edent@edent was fantastic... Want! (theremin 'proper' is my instrument on The List!)

---

The app won one of the awards for Best Android App and was crowned Best In Show! Utterly gobsmacked, truly humbled, and over-excited to receive a Galaxy Nexus and a Raspberry Pi.

You can download the theremin and read all about the technology behind it.

Massive thanks to Dan, Maggie, Matt, and all the others involved in the highlight of the mobile geek calendar.

I cannot wait for next year!