This Bench Does Not Exist


We forced an AI to look at thousands of photos of memorial benches. Just because. Here are the results.

This slideshow requires JavaScript.

You can view more at This Bench Does Not Exist.

Here's a video which shows how the process generates images. It gives you an idea of what the model "thinks" a bench is.

Download the model

You can download a 300MB StyleGAN neural net .PKL for your own use.

WHY?!?

What does a bench look like? How can you recognise it? Does the human brain process images of inanimate objects differently than it does with faces and animals? Is there an "uncanny valley" for seats?

5 years ago, my wife and I launched OpenBenches - a site to crowdsource photos, inscriptions, and locations of memorial benches. We have been astonished at how popular it has. People have uploaded over 55,000 photos of about 22,000 benches! That's around 191GB of photos. Nice ☺

I wanted to take all the photos of the benches, and train a computer to produce artificial images of benches. In a similar vein to This [Cat|Person|Paper] Does Not Exist, it's just an interesting way to show off how good (or not) computers are at generating images based off a large dataset.

HOW?!?!

It is relatively simple to create this. There is a pre-built set of scripts called StyleGAN3. You can follow along with the tutorial provided. I was doing relatively well, until I hit the system requirements:

1–8 high-end NVIDIA GPUs with at least 12 GB of memory. We have done all testing and development using Tesla V100 and A100 GPUs.

Ah. I don't even have one NVIDIA GPU - let alone 12! And the sponsorship for OpenBenches barely covers hosting. Let along buying expensive hardware.

I put the call out on Twitter and, very kindly, Simon Butcher volunteered some hardware. Aren't people on the Internet nice!

The computation for the 512x512px training set was run for 20 days on an IBM AC922 POWER9 server running RHEL7, utilising all four Nvidia Tesla V100 SXM2 16GB GPUs.

The OpenBenches API lets us grab the URls of all images, and metadata about whether they're a photo of the inscription or the bench. There were about 25,000 photos to download and crunch through.

With that many images, it wasn't possible to manually go through to find images which shouldn't have been in the set. That might have led to some weirdness in the generation process.

OK, so here's an odd question. All of the photos on the site have been licenced under Creative Commons. Mostly BY-SA 4.0 but a few imported from Flickr and other sites with different CC licences.

What's the copyright situation of the generated images?

I honestly don't know. If you do, stick a comment in the box below.

WEIRD?!?!

There are a number of "glitches" which seem inherent in AI generated images. Some are just weird little graphical quirks.

A bench with a deformed arm.

It's pretty easy to see where the AI has got a little confused. It is totally recognisable as a bench - but just the wrong side of the "uncanny valley" to look real.

Others, however, are full-on psychedelic hellscapes.

This slideshow requires JavaScript.

Inscriptions

Training a text model using GPT-2 was relatively easy. A few years ago I taught an AI to write Shakespearean sonnets. I used the same Google notebook to read in several thousand inscriptions and then generate new ones.

EN. HE LIKES THIS PLACE, BUT HE ONLY SERVES HIS LOVE FOR HIM.  In loving memory of Margaret Sheppard 1935 - 2017  Dedicated with love to the memory of Alan (Alan) Hutton who loved this place, as did his wife, his dogs. From his friends and family.  "Seat here and get a view Of the world We all love. Enjoy the view."  IN LOVING MEMORY OF JACK AND JIM KORIN (BILL KORIN) WHO LOADED MANY HAPPY HOURS IN THIS GARDEN  IN LOVING MEMORY OF TONY DALRY OBEY "SIT AND VISIT MY SPAIN"  In loving memory of MARY & KATE STEWART  IN MEMORY OF DAVID DICKERSON WHO LOVED THIS PLACE  This Chair Is Left To Rest "IN LOVING MEMORY OF WIFE MRS. & DOG SIT AND VISIT MY SPAIN  IN LOVING MEMORY OF JOHN KURTUS FROM A FOUNDEE OF ALL LIVEN ARE BEING SITTING HERE TO SIT AND REST HIS CHEST  IN MEMORY OF FRED AND MARGARET BEELL WHO LOVED THIS PLACE  IN MEMORY OF RENEE CAMPBELL 1930-2015  This seat is donated in thanks for the years to be spent on the park by the Rt. Air Staff with gratitude to the staff of P.E.I & the R.A.A.L. For your love and understanding  This seat is donated in thanks for the years to be spent on the park by the R.A.A.L. and the R.A.A.L.  IN LOVING MEMORY OF MARY GILLESPEAK WHO LOVED THIS PLACE.

But… we decided not to use them in the end. It's downright creepy generating the name of someone and their date of death. It would be horrible to stumble on the website and find the details of you or a friend listed on there.

As there have already been lots of attempts to automatically generate semantically valid text based on an existing corpus - we dropped it from the site.

THANKS!!!

Huge thanks to:

  • Simon Butcher for training the model on his supercomputer.
  • Tom O'Connor for the doesnotexi.st subdomain.
  • All the hundreds of people who have generously uploaded their photos to OpenBenches.

Here is another video for you to enjoy:

You can view more at ThisBench.DoesNotExi.st.


Share this post on…

9 thoughts on “This Bench Does Not Exist”

  1. Alan Turner says:

    The AI has figured out that sometimes benches are made of planks bolted to metal or concrete bases, but not that the bolts have to align with the bases.

    Reply
  2. Neil says:

    What's the copyright situation of the generated images?

    My view, from an English law point of view, is somewhere between "there is no copyright in the generated images, as they are not original in the sense that they are the author's own intellectual creation: there was no creative process on your part" and "the generated images are copyright works, and you own the copyright in them since you undertook the arrangements necessary for the creation of the works". I'd tend more towards the former, I think.

    Reply

What are your reckons?

All comments are moderated and may not be published immediately. Your email address will not be published.Allowed HTML: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong> <pre> <p> <br> <img src="" alt="" title="" srcset="">