Last week, a suspicion I have long held was confirmed. Americans not only use the word ‚Äòturtle‚Äô to mean ‚Äòtortoise‚Äô, all the time, but in fact may not know what a turtle or, more precisely a ‚Äòsea turtle‚Äô is.
Google released an AI experiment called Quick, Draw!, which is teaching a computer to recognise drawings by crowdsourcing as many drawings of certain things ‚Äì mug, racoon, television, dress ‚Äì as possible, and having the computer guess what they are.
The game gives you 20 seconds to draw something it chooses, and as you draw it, the computer guesses what it is: ‚ÄúI see square‚Äù ‚ÄúI see snorkel‚Äù ‚ÄúI see van‚Äù ‚ÄúOh, I know, it‚Äôs submarine.‚Äù
The poor computer now recognises the following as ‚Äòsea turtle‚Äô, when in fact the majority are lettuce-eating, giant Gal√°pagos brethren-having tortoises.
When it was released, others intentionally misled the computer by drawing ‚Äì what else? ‚Äì dicks for everything. One poor TV presenter in England played Quickdraw live on air and was told to draw a canon. It didn‚Äôt go according to plan.
The computer was also accused of being sexist, because when guessing ‚Äúa shoe‚Äù (a school shoe-like thing with laces), it didn‚Äôt recognise high heels, i.e. a woman‚Äôs shoe. It did, however quickly recognise as a shoe a witch‚Äôs boot, drawn by me. So I‚Äôm on the side of the computer here.
I‚Äôm not good at drawing, but playing this sweet little game made me feel extremely proud of myself. It also reminded me of some key junior school trends.
That S made of many vertical parallel lines, and flocks of flying Ms. The coolest way to draw a face was to start with a U-shape. That deranged puppy face with the long ears and tongue sticking out and railway-tunnel eyes.
What‚Äôs interesting about the way that the Quickdraw computer is learning to recognise pictures, is that it looks not just at the final picture, but watches what the first strokes are, or how you draw it, too. It‚Äôs the way that Google Translate learned to recognise handwritten letters.
As this video explains, the words ‚Äòlook‚Äô and ‚Äòbook‚Äô, for example, can look similar when written in cursive, but the way that someone draws the first letter can tell a computer which one it is. (The video is worth watching just to hear a Danish man who looks like an owl say, ‚ÄúAll doodles of cats have pointy ears, a small nose and whiskers.‚Äù)
This might also help Quickdraw tell the difference between an octagon and a hexagon ‚Äì rather than counting the number of straight lines at angles to one another, it monitors how many times your cursor changes direction or is lifted up and down.
Another way that cataloguing or recognising words has been crowdsourced for years is via reCaptcha, the text you have to enter on some websites, with those two wriggly words as a reference, to prove that you‚Äôre human. This process is helping computers to decipher words they can‚Äôt recognise when turning books into e-books. A word the computer can‚Äôt recognise is placed beside a word that it knows:
‚ÄúThe unknown word is then paired with a second Captcha word whose correct translation is already known. This is the ‘control’.
Several Web users seeking entry to secure sites are then given both words and asked to decipher them separately.
A correct answer for the control word proves that the user is a human and not a machine. Answers for the unknown word are compared with the O.C.R. guesses and the context analysis. If the system is satisfied that the answer is correct, then the game is over.‚Äù
Google seems to be promoting Quickdraw purely as an experiment, though it‚Äôs pretty good timing considering how much more common drawn pictures and text are becoming in SnapChat, Facebook Messenger and iMessage.
They‚Äôre finding a way to read our drawings, and making it fun for us to help them. Our last trace of invisible ink will finally be gone. The note passed back and forth in class, at each turn someone drawing a vertical line, finally making a killer ‚ÄòS‚Äô will soon be snatched by the teacher. (Unrelated, but Zadie Smith‚Äôs Swing Time just reminded me: remember pushing drawing pins into the soles of your shoes so you could tap your way down the halls?)
I played Quickdraw with a child, and modern children being what they are, she quickly tired of the drawing and recognition, and instead decided to test whether Quickdraw would say ‚ÄòWell drawn!‚Äù no matter how terribly she did. (It said ‚ÄúWell Drawn!‚Äù as long as at least ‚Öô drawings were recognised by the computer).
I like the game because it‚Äôs always my turn. And look, let‚Äôs be honest, this whole article was just so I could show you my drawing of a dragon.
Helen Sullivan is the co-founder and editor of Prufrock, a multilingual print quarterly of African fiction, nonfiction and poetry. To submit, subscribe, find stockists or get in touch, visit prufrock.co.za. Follow her monthly column on Casimir¬†about new technologies and how they interact with, or replace the things they aim to improve upon.¬†