Open Thinkering


Month: October 2022

Sticks and stones (and disinformation)

AI-generated image of sticks and stones

I guess like most people growing up in the 1980s and 1990s, the phrase “sticks and stones may break my bones, but words will never hurt me” was one I heard a lot. Parroted by parents and teachers alike, the sentiment may have been fairly unproblematic, but it’s a complete lie. In truth, whereas broken bones may heal relatively quickly, for some people it can take years of therapy to get over things that they experience during their formative years.

This post is about content moderation and is prompted by Elon Musk’s purchase of Twitter, which he’s promised to give a free speech makeover. As many people have pointed out, he probably doesn’t realise what he’s let himself in for. Or maybe he does, and it’s the apotheosis of authoritarian nationalism. Either way, let’s dig into some of the nuances here.

Here’s a viral video of King Charles III. It’s thirteen seconds long, and hilarious. One of the reasons it’s funny is that it pokes fun at monarchy, tradition, and an older, immensely privileged, white man. It’s obviously a parody and it would be extremely difficult to pass it off as anything else.

While I discovered this on Twitter, it also did the rounds on the Fediverse, and of course on chat apps such as WhatsApp, Signal, and Telegram. I shared it with others because it reflects my anti-monarchist views in a humorous way. It’s also a clever use of deepfake technology — although it’s not the most convincing example. I can imagine other people, including members of my family, not sharing this video partly because every other word is a profanity, but mainly because it undermines their belief in the seriousness and sanctity of monarchy.

In other words, and this is not exactly a deeply insightful point but one worth making nevertheless, the things we share with one another are social objects which are deeply contextual. (As a side note, this is why cross-posting between social networks seems so janky: each one has its own modes of discourse which only loosely translate elsewhere.)

A few months back I wrote a short report for the Bonfire team’s Zappa project. The focus was on disinformation, and I used First Draft’s 7 Types of Mis- and Disinformation spectrum as a frame.

First Draft - 7 Types of Mis- and Disinformation

As you can see, ‘Satire or Parody’ is way over on the left side of the spectrum. However, as we move to the right, it’s not necessarily the content that shifts but rather the context. That’s important in the next example I want to share.

Unlike the previous video, this one of Joe Biden is more convincing as a deepfake. Not only is it widescreen with a ‘news’ feel to it, the voice is synthesised to make it sound original, and the lip-syncing is excellent. Even the facial expression when moving to the ‘Mommy Shark…’ verse is convincing.

It is, however, still very much a parody as well as a tech demo. The video comes from the YouTube channel of Synthetic Voices, which is a “dumping ground for deepfakes videos, audio clones and machine learning memes”. The intentions here therefore may be mixed, with some videos created with an intent to mislead and deceive.

Other than the political implications of deepfakes, some of the more concerning examples are around deepfake porn. As the BBC has reported recently, while it’s “already an offence in Scotland to share images or videos that show another person in an intimate situation without their consent… in other parts of the UK, it’s only an offence if it can be proved that such actions were intended to cause the victim distress.” Trying to track down who created digital media can be extremely tricky at the best of times, and even if you do discover the culprit, they may be in a basement on the other side of the world.

So we’re getting to the stage where right now, with enough money / technological expertise, you can pretend anyone said or did anything you like. Soon, there’ll be an app for it. In fact, I’m pretty sure I saw on Hacker News that there’s already an app for creating deepfake porn. Of course there is. The genie is out of the bottle, so what are we going to do about it?

While I didn’t necessarily foresee deepfakes and weaponised memes, a decade ago in my doctoral thesis I did talk about the ‘Civic’ element as one of the Eight Essential Elements of Digital Literacies. And then in 2019, just before the pandemic, I travelled to New York to present on Truth, Lies, and Digital Fluency — taking aim at Facebook, who had a representative in the audience.

The trouble is that there isn’t a single way of preventing harms when it comes to the examples on the right-hand side of First Draft’s spectrum of mis- and disinformation. You can’t legislate it away or ban it in its entirety. It’s not just a supply-side problem. Nor can you deal with it on the consumption side through ‘digital literacy’ initiatives aiming to equip citizens with the mindsets and skillsets to be able to detect and deal with deepfakes and the like.

That’s why I think that the future of social interaction is federated. The aim of the Zappa project is to develop a multi-pronged approach which empowers communities. That is to say, instead of content moderation either being a platform’s job (as with Twitter or YouTube) or an individual’s job, it becomes the role of communities to deem what they consider problematic.

Many of those communities will be run by a handful of individuals who will share blocklists and tags with admins and moderators of other instances. Some might be run by states, news organisations, or other huge organisations and have dedicated teams of moderators. Still others might be run by individuals who decide to take all of that burden on themselves for whatever reason.

There are no easy answers. But conspiracy theories have been around since the dawn of time, mainly because there really are people in power doing terrible things. So yes, we need appropriate technological and sociological approaches to things which affect democracy, mental health, and dignity. But we also need to engineer a world where billionaires don’t exist, partly so that an individual can’t buy an (albeit privatised) digital town square for fun.

One thing’s for sure, if Musk gets his way, we’ll be able to test the phrase “sticks and stones may break my bones…” on a new whole generation. Perhaps show them the Fediverse instead?

Main image created using DALL-E 2 (it seemed appropriate!)

Weeknote 43/2022

Autumn leaves

It’s fair to say that I’m not a fan of this time of year. Yes lovely autumn colours and let’s get the snuggly jumpers out, but given it was was only a few weeks ago I was rocking shorts, sunglasses, and a t-shirt, I’m still in a state of shock. Where did the light go?

After working on Monday, I spent most of this week fighting off a cold in rainy Scotland at a pretty average Airbnb near Dundee. Our first choice one in Dumfries & Galloway wasn’t available, which makes me sad because I think we’d have had a better time.

It wasn’t terrible, but I didn’t sleep very well, there wasn’t loads to do that didn’t involve driving somewhere, and food prices in rural Scotland are insane. Still, we managed to entertain the kids at Glamis Castle (the setting for Macbeth), the V&A Dundee, and by visiting St Andrews. The latter was interesting despite, rather than because of, its connection to golf and royalty.

We returned on Friday night to watch my son play an exhibition match at the Newcastle Eagles arena before the pros played against Plymouth. Good stuff.

Next week, I’ll mostly be counting down the clock until Christmas working on various client projects and making remarks about how the nights are drawing in. No, I won’t be celebrating Halloween.

Are you sure we’re not supposed to hibernate until the springtime?

Photo of autumnal leaves taken near our Airbnb. If I’d taken it two seconds earlier I’d have captured lots of geese flying past overhead…

Weeknote 42/2022

Lille opera house

I seem to have relapsed in recent weeks to the bullet-point weeknote. This week is going to be no different, I’m afraid. Who knows, some readers might even prefer it?

Anyway, this week I’ve been:

  • Travelling to Lille, France for ePIC 2022. I had a great time, presenting a couple of times on Keep Badges Weird and with Julie Keane and Don Presant on the OSN Open Recognition working group. It was my first time on the Eurostar and it definitely won’t be my last!
  • Moving to new managed hosting with Fedi Monster. I wrote more about this here.
  • Buying a second car. We’ve gone for a high-spec 2018 VW Up! as we need to take our kids to different sporting activities at the same time in different places at the moment. We don’t live in a city, so public transport would take a ridiculously long time, sadly.
  • Not leasing a main family car. We were all set to lease a Hyundai IONIQ 5 through my business, but the funder rejected my application. Given that I’ve got a perfect credit score, I’ve leased a car through the business before, and I’m earning more than I was when I last did that, I can only blame the Tories and Brexit for wrecking the economy. We’ll probably end up just replacing our (lovely) nine year-old Volvo V60 with another one at some point.
  • Listening to politics podcasts, mainly The Rest is Politics, hosted by Alaistair Campbell and Rory Stewart, and Today in Focus from The Guardian. What a crazy week.
  • Running, both at home and in Lille, trying to keep my heart rate at around 155. This seems to be enough to get enough of a workout, without pushing my heart too much. Not so many endorphins, but safer — I’m also taking my phone running these days, just in case.

Next week, I’m working on Monday, seeing my sister and her kids, and then heading off with Team Belshaw to Scotland for a few days as it’s half term.

Photo of the opera house in Lille taken in the early hours of Friday morning, after a whisky with friends to celebrate the lettuce’s victory!