Introducing PropOrNot: Identifying & Combatting Russian Online Propaganda

Executive Summary: Russia’s attempts to influence the US election via hacking and selectively leaking sensitive US government and political data are not being conducted in isolation. They are accompanied by large-scale and long-term efforts to build online propaganda outlets with significant audiences in the US, which we estimate to number in the tens of millions of Americans. 

Thus far we at PropOrNot have identified over 200 distinct websites which qualify as Russian propaganda outlets according to our criteria, and target audiences in the United States. We estimate the regular US audiences of these sites to number in the tens of millions. We are gathering data to measure that more precisely, but we are confidant that it includes at least 15 million Americans. 

The messaging used by these Russian propaganda outlets seems intended to confuse public opinion, encourage paranoia, distract American audiences away from relying on actually-accurate journalism, and influence the upcoming US election, while blunting opposition to and strengthening popular support for Russian strategic priorities - and even going so far as to lay the groundwork for, in the immediate aftermath of the upcoming election, Russian-orchestrated political violence in the US.

We at PropOrNot do not reach our conclusions lightly. We have arrived at them after systematically employing a combination of manual and automated analysis of open-source non-classified information, and building on the work of other researchers and journalists, in order to map out a related collection of websites, social media, video, and other outlets, which:
  1. Include official state-owned and semi-official Russian propaganda outlets, such as RTSputnik NewsRussia Insider, etc.;
  2. Consistently cite official state-owned and semi-official Russian propaganda outlets, including the Russian defense ministry and other official spokespeople, etc.;
  3. Consistently reuse text directly from official state-owned and semi-official Russian propaganda outlets and government spokespeople, often with minimal or no attribution;
  4. Have a history of generally echoing the Russian propaganda "line", by using themes, arguments, talking points, images, and other content similar to those used by official state-owned and semi-official Russian propaganda outlets;
  5. Have a history of echoing the Russian propaganda "line" in ways unrelated to the purported focus of their branding, and in sequence with (at the same time as, or shortly after) official state-owned and semi-official Russian propaganda outlets;
  6. Qualify as propaganda under a rigorous definition: “A systematic form of purposeful persuasion that attempts to influence the emotions, attitudes, opinions, and actions of specific target audiences for political, ideological, and religious purposes, through the controlled transmission of deceptive, selectively-omitting, and one-sided messages (which may or may not be factual) via mass and direct media channels”;
  7. Have in many cases already been called out by other fact-checkers, researchers, journalists, debunkers, etc.;
  8. Share technical “tells”, such as Google Analytics IDs, Amazon affiliate codes, WHOIS data, hosting data, ad-network utilization, SEO techniques, etc., in some cases implicating direct Russian involvement;
  9. Refer their audiences to each other, via hyperlinks and other means, at disproportionately high rates;
  10. Are consistently visited by the same audiences, both directly and via search, demonstrating that those intra-network referrals build “brand loyalty” in their audiences over time;
  11. Are consistently visited by their audiences after searches for terms which congrue with the Russian propaganda “line”, and are unrelated to the purported focus of their branding; 
  12. Are categorized as "similar sites" by automated services in spite of their purportedly distinct focuses;
  13. Have content characterized by automated services in ways that are consistently very different from their purported subjects, but align with the Russian propaganda “line”;
  14. Have content aligning with the “Eurasianist” philosophy of Alexander Dugin;
  15. Include specialized sites targeted at a wide range of audiences, including US military veterans, Wall St. finance types, environmentalists, peace activists, racists, conspiracy theorists, political junkies, etc.;
  16. Appear to be effectively influencing public opinion in significant and very problematic ways, by promoting:
    • Conspiracy theories about and protests against US military exercises,
    • Isolationism/anti-interventionism generally, 
    • Support for policies like Brexit, and the breakup of the EU and Eurozone,
    • Opposition to Ukrainian resistance to Russia and Syrian resistance to Assad,
    • Support for the anti-vax, anti-Zika spraying, anti-GMO, 9/11-”truther”, gold-standard, and other related movements;
  17. Have extremely large audiences in the US, such that tens of millions of people appear to use them as primary “news” sources, supplanting actual journalism;
  18. Appear to be part of a larger “active measures”-style Russian influence operation, which also includes hacking and selectively leaking sensitive US government and political data, along with more-traditional espionage and military activity, intended to:
    • Confuse public opinion, encourage paranoia and passivity, and distract American audiences away from relying on actually-accurate journalism,
    • Blunt opposition to and strengthen popular support for Russian strategic priorities, 
    • Influence the US election, and
    • Lay the groundwork for orchestrated violence, in the immediate aftermath of the election, against the US government.
Please bear in mind that these characteristics of propaganda outlets are motivation-agnostic. It is not up to us to determine whether the sites we’ve identified are being knowingly directed and paid by Russian intelligence officers (although some of them almost certainly are), or whether the individuals involved even knew they were echoing Russian propaganda at any particular point: If the outlets meet criteria like the ones above, then they are echoing Russian propaganda, have effectively become tools of the Russian intelligence services, and are worthy of further investigation.

Please also note that it is possible that this being effectively addressed by the US government in ways we're unaware of yet, but we have done our due diligence, and this does not seem to be the case. We have had extensive conversations with national security professionals in the legislative branch, executive branch, active and retired, and to a person, none of them are aware of it being addressed by the national security apparatus.

On the contrary, we have been advised that the US government is deliberately and purposely not getting involved, and steering clear of this in order to avoid inadvertantly influencing domestic politics and our democratic process. This has backfired, creating a US government blind spot, and opening an opportunity for a foreign power to do exactly what our government is so carefully trying to avoid doing: Directly manipulate our democratic process.

Methodology

We use a combination of manual and automated analysis, including analysis of content, timing, technical indicators, and other reporting, in order to initially identify (“red-flag”) and then confirm an outlet as Russian propaganda. Our volunteers have developed a suite of software tools, leveraging publicly available data and commercial services, in order to perform automated analysis, but everything we do is in principle replicable using manual searching and data entry.

We initially red-flag a new site based on content-based criteria like those outlined above. Does it:
  1. Consistently cite official state-owned and semi-official Russian propaganda outlets?
  2. Consistently reuse text directly from official state-owned and semi-official Russian propaganda outlets?
  3. Have a history of generally echoing the Russian propaganda "line", especially in ways unrelated to the purported focus of their branding, and in sequence with other Russian propaganda outlets?
  4. Has it been called out by other fact-checkers, researchers, journalists, and debunkers for posting fake news?
From there we use our software tools to fill in the blanks, collecting a wide range of data about the new target site, and seeing how it fits into the existing network of previously red-flagged and identified outlets. We have built out a significant network of websites, and every time we feel confidant that we have discovered most of them, we keep finding more.

In the process of doing this, we have also identified a significant set of YouTube channels, Facebook pages, Twitter accounts, etc, which are acting as part of the same larger Russian influence operation.

Preliminary Conclusions

Our initial findings include:
  • There are well over 200 distinct websites which qualify as Russian propaganda outlets according to our criteria, and target audiences in the United States.
  • We estimate the regular US audiences of these sites to number in the tens of millions. We are gathering data to measure that more precisely, but we are confidant that it includes at least 15 million Americans.
  • We have yet to to analyze at least hundreds more websites, along with numerous more YouTube channels, Facebook pages, Twitter accounts, etc.
  • The US government is fully aware that this is the case.
  • The US government has refrained from publicizing it, primarily to avoid interference in the domestic political process.
  • However, this inaction has deprived the American public of information they need to vote in an informed manner, and allowed Russia to manipulate the US domestic political process and interfere in the 2016 election.

X