by Matt Taibbi
For the accompanying Twitter Thread, click here. TK version coming
In the first week of May, 2020, at the peak of Covid-19 panic, Twitter senior legal executive Stacia Cardille received a communication from the Global Engagement Center (GEC), the would-be operational/analytical arm of the U.S. State Department. Founded in the Obama years under Secretary of State Hillary Clinton, the GEC was like the State Departmentâs wannabe version of the NSA or the Defense Intelligence Agency.
Appended to an attachment with a long list of names was a note from the GEC â remember, these were the Trump years â that read, in part:We are providing these 5,500 accounts that display inorganic behavior and follow two or more of the 36 Chinese diplomatic twitter accounts that we have identified in the report. Due to the fact that these accounts follow two or more of these diplomatic accounts, and a good portion of them are newly created, we believe that they are suspicious.
The list of âaccounts that display inorganic behaviorâ was part of what another Twitter legal executive described as an effort by Mike Pompeoâs State Department to pull a âfull court press in the mediaâ to âhold China accountableâ for âspreading misinformation about the COVID crisis.â
Just a day before, on Wednesday, May 6th, the Associated Press broke news of a four-page report by the Department of Homeland Security claiming Chinese leaders âintentionally concealed the severityâ of the Covid-19 outbreak. Now the State Department, by way of GEC, was getting in on the action.
Within a day of receiving the GEC list, Twitter executives were in a lather. A high-speed examination of the accounts revealed what company executives euphemistically called âconcerns.â Cardille, Trust and Safety Chief Yoel Roth, and others immediately drafted a response to the GEC:Thank you for sharing informationâĤ We have begun reviewing the list of 6,000 accounts that GEC provided this morning and have serious concerns… In our initial review, we have already identified numerous accounts belonging to government entities in the Americas including Canada, NGO and human rights organizations, and journalists.
The drama that subsequently broke out between Twitter and the State Department would prove revealing, both about the nature of the public-private âcontent moderationâ bureaucracy, and about the internal culture at Twitter, which that year would end up rolling over in a big way for outside moderation demands, again, despite an initial show of resistance.
âWEâRE ALL ON THAT LISTâ
Twitter executives seemed particularly put out by the idea that the GEC was taking someone elseâs intelligence, then using the press to squeeze its way into an exclusive moderation club. The DHS circulated a report on Chinese disinformation just a few days before the GEC reached out to Twitter.
By then the company was no longer shy about working with Congress, the FBI, DHS, and the Office of the Director of National Intelligence (ODNI). However, they were not anxious to work with the GEC, which they seemed to perceive as a weak sister of the intelligence community, and also âpolitical,â as Roth put it, which in Twitter-ese was code for âpro-Trump.â The company reportedly had similar issues with some Pentagon agencies beginning in 2017. One former defense intelligence source suggested Twitter preferred the FBI because it was âless Trumpy.â
How âTrumpyâ or not the GEC was is hard to say, but itâs clear Twitter executives were opposed to letting the fledgling State agency lay hands on its magic moderation machine, preferring to âkeep the circle of trust quite smallâ as Roth put it.
âObviously, State is a significant voice and one we don’t want to neglect,â wrote Roth on May 6th, 2020, âbut I do want us to continue to maintain a distinction between the highly trusted, valued relationships weâve built over years with entities with considerable expertise and authorityâĤ and other parts of USG that may engage on these questions from time to time (sometimes in more political ways than others).â
Cardille argued shutting the agency out entirely was a bad idea, preferring to build âgoodwill,â but agreed the GEC was amateurish, and bad news. They âcannot be trusted, particularly if they can score political points,â she said.
A cursory internal review at the company revealed the State Department list included accounts belonging to the Canadian military, Western NGOs, and journalists, including a CNN account. Stateâs methodology was incredibly broad, including accounts that followed âtwo or moreâ Chinese diplomats. âWeâre all on that list,â joked one Twitter staffer.
Roth internally even circulated a Bellingcat tweet making fun of the GECâs conclusions. âOh yeah, the disinformation that U.S. sanctions are contributing to the death of Iranians during the pandemic,â sneered Aric Toler.
Twitter and GEC ended up clashing publicly that Friday, May 8th. The State Department released news to friendly journalists that âBeijing appears to be increasingly adopting Russian tactics to sow discord and spread disinformation on social mediaâ about the origins of COVID-19.
Meanwhile, articles like CNNâs âTwitter disputes State Department claims China coordinated coronavirus disinformation accountsâ presented Twitterâs side, claiming the Trump State Department included âauthentic accountsâ in its list of names. A GEC spokesperson replied, defensively, to CNN:The GEC provided Twitter with a small sample of the overall dataset that included nearly 250,000 accounts,â adding that it was âwas not surprising that there are authentic accounts in any sample.
On the surface, this episode looked bad for State, and made it seem Twitter wasnât the soft touch seemingly every other agency had found them to be. But GEC would get the last laugh, sort of, in an episode that showed that partisan conceptions of how this moderation system worked are likely off base.
âSTATE/GEC, NSA, AND CIA HAVE EXPRESSED INTERESTâ
When GEC sent its list of 5000+ accounts in May, the move was seen as amplifying messaging from Trumpâs Secretary of State Mike Pompeo, whoâd accused China of withholding information. Twitter executives agreed, with Musketeerish spirit: with a vote ahead, they wouldnât be party to that.
âEspecially as the election heats up in the coming months, introducing an actor like GEC into what has to date been a stable and (relatively) trusted group of practitioners and experts poses major risks,â is how Roth put it.
About a month after the Chinese disinformation fiasco, Roth got word via his counterpart at Facebook, Nathaniel Gleicher, that GEC wanted a seat at the regular âindustryâ meeting that included the FBI, DHS, and ODNI. This was too much. It was the opinion of Roth, Gleicher, and Googleâs Rick Salgado that GECâs participation should be opposed. One of the reasons given was startling:â The GECâs mandate for offensive IO to promote American interests
Eventually, Cardille chimed in, saying she âpreviewedâ the GEC problem to the FBI. Her words resonated âwith Elvis, not Laura,â i.e. with San Francisco FBI agent Elvis Chan, but not Foreign Influence Task Force chief Laura Dehmlow:
I just spoke to the FBIâĤ I previewed to them that they will find resistance to adding the GEC. I talked through the issues we have encountered, and also raised that the GEC/State is focused outside of the U.S., and that we should deal with U.S. elections separately. That resonated with Elvis, not Laura.
As the 2020 election approached, the FBI, via Chan, negotiated with Roth and others to make sure every interested government agency had a seat at the table. A concerned Roth asked, âWhat USG agencies will be allowedâ on a new Signal channel for centralizing industry briefings?
âI think the easy ones will be FBI, DHS/CISA, and ODNI,â Chan replied. âFor your awareness, State/GEC, NSA, and CIA have expressed interest in being allowed on in listen mode only. Welcome your thoughts on this.â
Roth protested the GECâs participation, noting the âpress-happyâ nature of the GEC, adding, âI’m also not entirely sure that every member of that group wants their phone number quite so broadly available.â
Chan replied that the Signal group would be a âone-way communication from USG to industry.â If âindustryâ could ârely on the FBI to be the belly button for the USG,â then âwe can do that as well.â
A belly button for the USG! Chan elaborated, explaining that the FBI would essentially coordinate federal-level reports, while the DHSâs Cybersecurity and Infrastructure Security Agency would handle domestic traffic.
âWe can give you everything weâre seeing from the FBI and USIC agencies,â he wrote. âCISA will know what is going on in each state.â
This, it seems, ended up being the compromise solution Twitter accepted. A significant portion of the government analytical sector â from the FBI to the CIA to the GEC â was able to at least listen in, in the fashion of someone auditing a college class, to regular âindustryâ intelligence briefings. This was important because, as Twitter knew full well, anyone who saw any information flow about suspect accounts could leverage them in the media.
Though not every agency got Yoel Rothâs number (which agent Chan, in a curious display of operational security, sent in a Word Document called âSignal Phone Numbers,â via an email subject-lined âList of Numbersâ), every agency, Trumpy or not, got to see the intel headed to and from Twitter in those meetings. They could also all send requests via the FBI.
This led to the situation described by Michael Shellenberger two weeks ago, in which Twitter was paid $3,415,323, essentially for acting as an overwhelmed subcontractor. Requests poured in from FBI offices all over the country, day after day, hour after hour: Las Vegas, Los Angeles, Baltimore. âDo you guys have a list of those 132 accounts action was taken against on 09/29/2020? We wanted to get process served on those accounts,â an FBI agent asked one of Twitterâs senior lawyers just before the 2020 election. âI apologize in advance for adding to your work load.â
Twitter also ended up taking in requests from every conceivable government agency, from state officials in Wyoming, Georgia, Minnesota, Connecticut, California and others to the NSA, FBI, DHS, DOD, DOJ, and many others. They even, ultimately, elevated requests from the GEC, which appeared to grab intelligence passed during one of the industry briefings and went to the media about it. Once Twitter realized the State Department planned on publicly identifying accounts like @BricsMedia and @RebelProtests as âGRU-controlled,â they backed down.
This is the background of the email described in an earlier thread, in which a Twitter executive with a CIA background explained how he previously had elected to wait for more evidence in those cases, he now thought a âmore aggressiveâ stance by Twitterâs government âpartnersâ made that impossible. âOur window on that is closing,â he said.
Twitter ended up receiving so many requests from so many different avenues, their executives seemed to get confused. âHi Elvis!â wrote one, receiving a notice about something called the Northern California Regional Intelligence Center. âIs this something different than what weâll already be receiving through the Signal channel?â Chan explained: âWe will be sharing the typical threat indicators through Signal,â he said, while the NCRIC was part of a Homeland Security-based network called HISN, which would be âfocused on local public safety matters (riots shootings, bombings, etc).â
âMy in-box is really fâ up at this point,â wrote Cardille, referencing the swarm of FBI requests.
Remember the âinternal guidanceâ Twitter leaders circulated in late 2017, in which they formally agreed to remove any user âidentified by the U.S. intelligence communityâ as a state-sponsored entity involved in âcyber operationsâ? Such âUSICâ identifications by 2020 came regularly and in bulk, asserting that Russiaâs Internet Research Agency was targeting Africans, South Americans, even African-Americans (spreading âracially derogatory contentâ in July of 2022, according to an âOther Government Agencyâ report). There was even an âOGAâ warning about publicity for a book written by former Ukrainian prosecutor Viktor Shokhin, who claims he was fired at the behest of Joe Biden, for investigating his son.
In some cases the reports were incredibly short, as small as a single paragraph, saying things like âAdvanced Persistent Threat (APT) cyber actors used the attached email accountsâĤ for use in influence operations, social media collection, or social engineering.â An excel document containing 660 email addresses would then be passed to Twitter. There are multiple emails in the record in which Twitter execs express frustration that government âpartnersâ didnât even do the legwork of matching phone numbers or email addresses to Twitter handles, leaving that work to the company.
Not every request was honored. In one remarkable case, Twitterâs government liaison passed word from the office of Democratic congressman and Intelligence Committee then-chair Adam Schiff asking to âsuspend the many accounts, includingâĤ @paulsperry, which have repeatedly spread false QAnon conspiracies.â Journalist Paul Sperry of Real Clear Investigations by an extraordinary coincidence was the reporter who revealed the name of Schiffâs âwhistleblowerâ in the Ukrainegate affair. The coincidence was so extraordinary that even Twitter cringed at first. âWe donât do thisâĤ No, we donât do this,â came an immediate response.
These episodes from the Twitter Files show how the digital censorship system evolved from 2017. Early on, company emails were entirely internal and requests about, say, âRussia-linkedâ accounts came on a case-by-case basis, in some cases through physical meetings with officials at places like the Senate Intelligence Committee.
By 2020, the moderation machine was a high-speed, formalized information highway, with federal and international requests passed through the FBI via Signal and Teleporter, and domestic asks funneled upward through Homeland Security mechanisms like HISN. The $3 million tab Shellenberger revealed Twitter was paid by the state looks like a bad deal for the company, the more you examine the documents. Twitter had to assign reams of personnel to deal with these requests, and during the election season there were clearly too many âreportsâ to handle.
Moreover the FBI and DHS stopped asking Twitter, and soon simply sent long lists with the expectation of fulfillment. If Twitter didnât act fast enough, they got quick follow up emails from the Bureau. âWas action takenâĤ? We wanted to get process served.â Or: âAny movement?â
Working through the âbelly button,â Twitter was an involuntary subcontractor. And an underpaid one.
The DOJ needs an enema and the FBI, instead of being the belly button, is where the tube gets inserted.
Funny Twitter, making every decision as to censorship they made based on the political views of the FBI, DOJ and their own employees, worried about the political influence on GEC requests, particularly in as much as under Pompeo, they were acting based on FACTS.
An observation that is revealing. They were ALL on the list of those actually spreading disinformation while they themselves were suppressing the truth, the very definition of fascism and propaganda. Comparing this to the enthusiasm to suppress the information on Hunter’s laptop, basically, Twitter will suppress and censor what comports with their own prejudices and bias. The FBI didn’t have to twist their arms in either case.
Hmm… kind of like the Mafia operates once they have their talons sunk into a victim.