Platforms Systematically Removed A User Because He Made “Most Wanted CEO” Playing Cards
On December 14, James Harr, the owner of an online store calledComradeWorkwear, announced on social media thathe planned to sella deck of Most Wanted CEO" playing cards, satirizing the infamous Most-wanted Iraqi playing cards" introduced by the U.S. Defense Intelligence Agency in 2003. Perthe ComradeWorkwear website, the Most Wanted CEO cards would offer a critique of the capitalist machine that sacrifices people and planet for profit," and Unmask the oligarchs, CEOs, and profiteers who rule our world... From real estate moguls to weapons manufacturers."
But within a day of posting his plans for the card deck to his combined 100,000 followers on Instagram and TikTok, theNew York Postran a front page story on Harr, calling the cards disturbing." Less than 5 hours later, officers from the New York City Police Department came to Harr's door to interview him. They gave no indication he had done anything illegal or would receive any further scrutiny, but the next day the New York police commissioner held the New York Post story upduring a press conferenceafter announcing charges against Luigi Mangione, the alleged assassin of UnitedHealth Group CEO Brian Thompson. Shortly thereafter, platforms from TikTok to Shopify disabled both the company's accounts and Harr's personal accounts, simply because he used the moment to highlight what he saw as the harms that large corporations and their CEOs cause.
Harr was not alone. After the assassination, thousands of people took to social media to express their negative experiences with the healthcare industry, to speculate about who was behind the murder, and to show their sympathy for either the victim or the shooter-if social media platforms allowed them to do so.Many usersreported having their accounts banned and content removed after sharing comments about Luigi Mangione, Thompson's alleged assassin. TikTok, for example reportedly removed comments that simply said, Free Luigi." Even seemingly benign content, such as a post about Mangione's astrological signora video montage of him set to music, was deleted from Threads, according to users.
The Most Wanted CEO playing cards did not reference Mangione,and the cards-which have not been released-would not include personal information about any CEO. In his initial posts about the cards, Harr said he planned to include QR codes with more information about each company and, in his view, what dangers the companies present. Each suit would represent a different industry, and the back of each card would include a generic shooting-range style silhouette. As Harr put it in his now-removed video, the cards would include the person, what they're a part of, and a QR code that goes to dedicated pages that explain why they're evil. So you could be like, Why is the CEO of Walmart evil? Why is the CEO of Northrop Grumman evil?'"
A design for the Most Wanted CEO playing cards
Many have riffed on themilitary's traditionof using playing cards to help troops learn about the enemy. You can currently find Gaza's Most Wanted" playing cardson Instagram, purportedly depicting leaders and commanders of various groups such as the IRGC, Hezbollah, Hamas, Houthis, and numerous leaders within Iran-backed militias." A Shopify store selling Covid's Most Wanted" playing cards, displaying figures like Bill Gates and Anthony Fauci, and including QR codes linking to a website where all the crimes and evidence are listed,"is availableas of this writing. Hero Decks, which sells novelty playing cards generally showing sports figures, even produced a deck of Wall Street Most Wanted" cardsin 2003(popular enough to have a second edition).
Aswe'vesaidmanytimes, content moderation at scale, whether human or automated, is impossible to do perfectly and nearly impossible to do well. Companies often get it wrong and remove content or whole accounts that those affected by the contentwould agree do not violate the platform's terms of service or community guidelines. Conversely, they allow speech that could arguably be seen to violate those terms and guidelines. That has beenespeciallytruefor speech related to divisive topics and during heated national discussions. These mistakes often remove important voices, perspectives, and context, regularly impacting not just everyday users butjournalists,human rights defenders,artists,sex worker advocacy groups,LGBTQ+ advocates,pro-Palestinian activists, andpolitical groups. In some instances, this even harms people's livelihoods.
Instagram disabled the ComradeWorkwear account for not following community standards," with no further information provided. Harr's personal account was also banned. Meta has apolicyagainst the glorification" of dangerous organizations and people, which it defines as legitimizing or defending the violent or hateful acts of a designated entity by claiming that those acts have a moral, political, logical or other justification that makes them acceptable or reasonable." Meta's Oversight Board hasoverturnedmultiplemoderation decisionsby the company regarding its application of this policy. While Harr had posted to Instagram that the CEO must die" after Thompson's assassination, he included an explanation that, When we say the ceo must die, we mean the structure of capitalism must be broken." (Compare this to a series ofInstagram story postsfrom musician Ethel Cain, whose account is still available, whichused the hashtag #KillMoreCEOs, for one of many examples of howmoderationaffects some people and not others.)
TikTok reported that Harr violated the platform's community guidelines with no additional information. The platform has apolicyagainst promoting (including any praise, celebration, or sharing of manifestos) or providing material support" to violent extremists or people who cause serial or mass violence. TikTok gave Harr no opportunity for appeal, and continued to remove additional accounts Harr only created to update his followers on his life. TikTok did not point to any specific piece of content that violated its guidelines.
On December 20, PayPal informed Harr it could no longer continue processing payments for ComradeWorkwear, with no information about why. Shopify informed Harr that his store was selling offensive content," and his Shopify and Apple Pay accounts would both be disabled. In a follow-up email, Shopify told Harr the decision to close his account was made by our banking partners who power the payment gateway."
Harr's situation is not unique.Financialandsocial media platformshave an enormous amount of control over our online expression, and we've long been critical of their over-moderation, uneven enforcement, lack of transparency, and failure to offer reasonable appeals. This is why EFF co-createdThe Santa Clara Principleson transparency and accountability in content moderation, along with a broad coalition of organizations, advocates, and academic experts. These platforms have the resources to set the standard for content moderation, but clearly don't apply their moderation evenly, and in many instances, aren't even doing the basics-like offering clear notices and opportunities for appeal.
Harr was one ofmanywho expressed frustration online with the growing power of corporations. These voices shouldn't be silenced into submission simply for drawing attention to the influence that they have. These are exactly the kinds of actions that Harr intended to highlight. If theMost Wanted CEO deckis ever released, it shouldn't be a surprise for the CEOs of these platforms to find themselves in the lineup.
Originally posted to the EFF's Deeplinks blog.