key: cord-278119-8k2j3kjv
authors: Kawchuk, Greg; Hartvigsen, Jan; Harsted, Steen; Nim, Casper Glissmann; Nyirö, Luana
title: Misinformation about spinal manipulation and boosting immunity: an analysis of Twitter activity during the COVID-19 crisis
date: 2020-06-09
journal: Chiropr Man Therap
DOI: 10.1186/s12998-020-00319-4
sha: 
doc_id: 278119
cord_uid: 8k2j3kjv

BACKGROUND: Social media has become an increasingly important tool in monitoring the onset and spread of infectious diseases globally as well monitoring the spread of information about those diseases. This includes the spread of misinformation, which has been documented within the context of the emerging COVID-19 crisis. Understanding the creation, spread and uptake of social media misinformation is of critical importance to public safety. In this descriptive study, we detail Twitter activity regarding spinal manipulative therapy (SMT) and claims it increases, or “boosts”, immunity. Spinal manipulation is a common intervention used by many health professions, most commonly by chiropractors. There is no clinical evidence that SMT improves human immunity. METHODS: Social media searching software (Talkwalker Quick Search) was used to describe Twitter activity regarding SMT and improving or boosting immunity. Searches were performed for the 3 months and 12 months before March 31, 2020 using terms related to 1) SMT, 2) the professions that most often provide SMT and 3) immunity. From these searches, we determined the magnitude and time course of Twitter activity then coded this activity into content that promoted or refuted a SMT/immunity link. Content themes, high-influence users and user demographics were then stratified as either promoting or refuting this linkage. RESULTS: Twitter misinformation regarding a SMT/immunity link increased dramatically during the onset of the COVID crisis. Activity levels (number of tweets) and engagement scores (likes + retweets) were roughly equal between content promoting or refuting a SMT/immunity link, however, the potential reach (audience) of tweets refuting a SMT/immunity link was 3 times higher than those promoting a link. Users with the greatest influence on Twitter, as either promoters or refuters, were individuals, not institutions or organizations. The majority of tweets promoting a SMT/immunity link were generated in the USA while the majority of refuting tweets originated from Canada. CONCLUSION: Twitter activity about SMT and immunity increased during the COVID-19 crisis. Results from this work have the potential to help policy makers and others understand the impact of SMT misinformation and devise strategies to mitigate its impact.

More than half of all persons on earth (53.5%) are estimated to now have regular internet access with 47% in low-middle income countries and 86.6% in high income countries [1] . With this level of penetration, the internet is the most influential tool on earth for distributing information, whether it be accurate or otherwise. Therefore, understanding the creation, spread and uptake of internet misinformation is of critical importance [2] given that misinformation can be given credibility and create negative impacts [3, 4] .

Social media has been used in recent decades to anticipate various health events including the spread of infectious disease [5] and new cases of back pain [6] . With recent advances in social media analytics, it is now possible to not only apply these tools to anticipate the onset and spread of various health conditions, but to also identify the onset and spread of information about those conditions. Specifically, various studies have been conducted that show how social media can be used in this regard [7] , how social media is consumed [8] and how it can be used to set agendas [9, 10] . Importantly, social media is not always a positive force. Many publications now document how social media can create and disseminate misinformation [11] [12] [13] [14] . Even in the short time since the COVID crisis was declared a pandemic on March 11, 2020 [15] , several publications have now documented various types of misinformation arising during the COVID crisis [16] [17] [18] including potential treatments, methods of prevention and protection, dietary recommendations and disease transmission [19] .

While all misinformation is concerning, the public does not expect misinformation to be propagated by regulated health professions whose activities are overseen for public protection. Unfortunately, this has not been the case during the COVID-19 outbreak. Claims that personal immunity can be improved or "boosted" through spinal manipulative therapy (Axén I Bergström C, Bronson M, Côté P, Glissman CN Goncalves G, Hebert J, Hertel AJ, Innes S, Larsen KO, Meyer A, Perle SM, O'Neill S, Weber K, Young K, Leboeuf-Yde C: Putting lives at risk: Misinformation, chiropractic and the COVID-19 pandemic, in submission), an intervention applied by many professions but most commonly by chiropractors [20] , appeared on social media as the COVID crisis evolved. Not only is there no clinical evidence of this claim [21] , major organizations representing those who provide SMT reacted immediately to condemn the promotion of this idea as potentially dangerous to public health [21] [22] [23] [24] [25] [26] [27] [28] [29] .

In this descriptive study, we detail how Twitter activity can be used to not only document the magnitude and time course of misinformation describing a link between spinal manipulative therapy (SMT) and boosting immunity, but how social media activity promotes or refutes these claims. Specifically, our study aimed to answer the following research questions:

Has Twitter activity describing a relation between SMT and "boosting" immunity increased during the COVID-19 crisis? What is the magnitude and engagement of Twitter activity that promotes or refutes an SMT/immunity link? Does Twitter activity differ between health professions that are mentioned in relation to SMT and immunity? What are the demographics (i.e. language, country) of Twitter authors who promote or refute a SMT/ immunity link?

We anticipate that knowledge gained from answering these questions will be important not only in predicting future internet misinformation about SMT, but also in preventing and/or mitigating its impact.

Social media searching was performed using Talkwalker Quick Search (Luxembourg, Luxembourg). Similar to tools used for searching health literature (e.g. EMBASE), Talkwalker performs searches of specific internet content including social media platforms, news agencies, forums and blogs. Talkwalker's functionality allows searching to be limited to specific content sources, date ranges, electronic devices and many other parameters using standard Boolean syntax. Analysis of search results can be performed in several ways including descriptive metrics generated by Talkwalker using existing data (e.g. sex distribution), derived metrics generated by Talkwalker using artificial intelligence algorithms (e.g. sentiment) and user-generated metrics obtained by downloading raw search results directly into other software (e.g. Excel, SPSS).

For this project, Talkwalker searches were performed exclusively on Twitter for the 3 months before March 31, 2020. Twitter was searched preferentially for the following reasons. First, the entirety of Twitter is searchable (except for direct messaging which is a private discussion between Twitter users) compared to sources such as Facebook whose users must purposefully make their activity available for searching. Second, Twitter is a one-to-one communication model where direct dialogue is possible between all users compared to news media where unbalanced communication occurs through a one-to-many model. Finally, Twitter activity is unmoderated creating potential for a full range of conversation (except for content excluded by Twitter's rules and policies).

Our primary search (Search #1) was constructed of three main components using Boolean syntax: 1) [procedure] terms related to SMT, 2) [profession] terms related to professions most often associated with SMT and 3) an immunity term [immun*]. In this study, we limited professions to be those that most often provide SMT (chiropractic, physiotherapy, naturopathy, osteopathy and naprapathy). No additional filters were used (e.g. language). Procedure terms included wildcard representations of words commonly used to describe SMT including manipulation, adjustment and SMT. Profession terms included wildcard card representations of chiropractic, physical therapy, naturopathy, osteopathy and naprapathy. As Talkwalker lacks the ability to perform Boolean operations between searches (i.e. union, intersection, difference), we performed additional searches to explore how search terms contributed to the primary search. Search #2 and Search #3 were performed to understand the impact of procedures and professions on the main search. Similarly, we conducted searches #4-8 to understand if procedure terms occurred more frequently for specific professions. Searches #9-13 were performed to understand how individual professions were linked specifically to immunity. Finally, Search #1 was performed again for the 12 months before March 31, 2020 as this is the longest period Talkwalker can search backwards in time (not listed in Table 1 ).

The above searches identified tweets that contained the search terms in the body of the tweet as words and/ or hashtags (e.g. #chiropractic). For each individual tweet identified, multiple attributes describing its content were provided including date, creator, content, country of origin, language, likes, retweets, followers etc. A glossary of Twitter-related terms such as #hashtag can be found in Table 2 .

The above searches resulted in mentions (see Table 2 ) over time that were then tallied and plotted.

Tweets arising from Search #1 were first coded for their tone using the Twitter Tone Index (TTI). The TTI (Table 3) is a nominal index constructed for the purpose of this paper from a training set of 86 tweets that resulted in four coding options: 1) promoting a relation between SMT and/or a profession providing SMT and improved immunity, 2) refuting that same relation, 3) neutral content or 4) irrelevant content. This sample of 86 tweets was then scored independently by four evaluators (LN, SH, CN, JW) to calibrate their use of the TTI. This calibration resulted in 95% of tweets having at least three authors in agreement, and a Fleiss Kappa score of 0.85 interpreted as 'almost perfect agreement' [31] . These same evaluators then independently assessed each tweet arising from Search #1 using the TTI. Tweets not having at least 3 evaluators in agreement were discussed to agree on a majority TTI rating. Unresolved ties were broken by a fifth evaluator (GK). Additionally, the sentiment score of each tweet as determined by a proprietary Talkwalker artificial intelligence algorithm scored Tweets using positive or negative integers. The sentiment score is a rolling sum. If 3 Tweets have sentiment scores of 1, 2, 3 and another 3 Tweets have scores of − 1, − 2, − 3, then the resulting sentiment score for that topic is 0.

Following TTI scoring, four evaluators (LN, SH, CN, JW) individually scored tweets arising from Search #1 regarding professions mentioned within each tweet (chiropractic, physical therapy, naturopathy, osteopathy, naprapathy). Tweets that did not mention a relevant profession were coded as "none mentioned". Tweets not having at least 3 evaluators in agreement were discussed to agree on a majority rating. Unresolved ties were broken by a fifth evaluator (GK). Importantly, it was possible to code only whether tweets mentioned a profession; it was not possible to determine if or how the author was associated with a specific profession.

The content of all tweets obtained from Search #1 were pooled, analyzed for word frequency by a public website [32] , then separated by TTI value (promoting or refuting).

Influencers were considered to be tweet authors having an engagement score (retweets + likes) of greater than zero. Tweets from each author were segregated by their TTI value and sorted by engagement score.

Descriptive statistics from Search #1 were derived for each Twitter user including language, and country of origin using geographical coordinates.

Total mentions over the 3 month study period are described in Table 4 . 3 ). This figure also shows that mentions involving a profession differ over time; Twitter activity related to most professions peaked near March 9, 2020 and then waned or oscillated. In contrast, Twitter activity related to mentions of "chiropractic" increased on March 9 and were sustained until the end of the study period.

In the 12 months before March 31, 2020 (Fig. 4) , baseline Twitter activity consisted of a relatively low volume of mentions punctuated by small activity peaks. This baseline activity preceded a large activity peak coinciding with the onset of the COVID crisis. The number of times a tweet is liked and retweeted.

Follower A Twitter user who subscribes to the Tweets (i.e. posts) of another Twitter user.

A word or phrase preceded by a hash sign (#) used on social media to identify a specific theme or topic.

An individual who has the power to affect purchase decisions of others because of their authority, knowledge, position, or relationship with their audience (Talkwalker's definition).

Like When a Twitter user acknowledges another user's tweet (i.e. post).

Any Twitter activity that contains the search terms (Tweets, retweets, likes etc.)

The number of potential followers (i.e. subscribers) reached by the Tweet.

When a tweet is retweeted (re-posted) by another Twitter user.

Sentiment Score Sentiment is an expression of the emotional tone behind the tweet that attempts to summarize the attitudes and opinions being expressed. The sentiment score is an integer value which sums the sentiment values of individual mentions [30] .

Tweet A post on Twitter made by an individual on their own behalf or as a representative of a group/organization. 

There were 1118 individual tweets generated from Search #1 (Table 5) . When coded to the TTI, 778 tweets were classified as not relevant with the remaining tweets divided between promoting (187 (24%)), refuting (141 (18%)) and neutral (12 (2%)). Although both promoting and refuting tweets were similar in their engagement scores (3319 vs. 3590), refuting tweets had a potential reach that was 3 times greater than promoting tweets (4,626,820 vs. 1,558,937). Overall, Talkwalker sentiment scores were positive for promoting tweets and negative for refuting tweets. When these 1118 tweets were coded for the 5 professions related to SMT, there were 809 tweets where a profession was not mentioned and 7 tweets mentioning an irrelevant profession. Of tweets mentioning a profession relevant to SMT, some mentioned a single profession while others mentioned multiple professions; a distinction retained in our coding (Table 5) . From all mentions of professions (11280), chiropractic was mentioned most often (237 (21%)) compared to naturopathy (64 (6%)). Tweets mentioning chiropractic had a potential reach of 4,549,642 Twitter users with a total engagement of 3515 and a total sentiment score of − 10 while for naturopathy, the potential reach was 634,365 with a total engagement of 3114 and a total sentiment score of + 30.

When analyzing mentions of profession for tweets that either promoted (189 mentions) or refuted (148 Procedures are terms related to SMT where health professions include chiropractic, physiotherapy, naturopathy, osteopathy and naprapthy mentions) a link between SMT and immunity, chiropractic was mentioned 108/189 times (57%) in promoting tweets and 123/148 times (83%) in refuting tweets. Naturopathy was the next-most mentioned profession with 40/189 (21%) mentions in promoting tweets and 20/148 (14%) mentions in refuting tweets.

The major themes (frequent words) contained within the 1118 tweets from Search #1 are presented in Table 6 . Terms related to chiropractic and the term "boost" were the most common themes with "evidence" mentioned only in the refuting themes. The expression "adjustment" was used more frequently than the expression "manipulation" or "spinal manipulation".

In total, there were 132 Twitter authors having engagement scores of > 0 for the study period. Table 7 stratifies these authors into those creating promoting or refuting tweets. While total engagement was similar between both these groups, the potential reach in the refuting group was 3.29 times larger. 

Demographics from Search # 1 were segregated by TTI value (promoting or refuting) and are displayed in Table 8 . For both promoting and refuting tweets, the majority of authors were male. English was the predominant language. The country of origin differed between promoting and refuting tweets. Tweets promoting a link between spinal manipulation and immunity were created most often in the United States. Canada generated the greatest number tweets refuting this link (Table 8) . Figures 5 and 6 were plotted using longitude and latitude data associated with each tweet.

This paper presents the novel finding that Twitter misinformation regarding a SMT/immunity link increased dramatically during the onset of the COVID crisis. Further, activity levels and engagement were roughly equal between tweets promoting a SMT/immunity link and tweets refuting this claim. Interestingly, the potential audience (reach) of tweets refuting these claims was 3 times higher than those promoting these claims.

The majority of search results (i.e. mentions) from Search #1 were coded as not relevant on the TTI and did not mention a specific profession (778 (70%)). Combined with tweets having a neutral tone (12 (2%)), the vast majority of mentions from Search #1 were not relevant to our analysis. While our search terms could have been made more restrictive to reduce this number of irrelevant mentions (e.g. using "spinal manip*"), we preferred to err on the side of having too many search results that were then coded by our team rather than construct too narrow a search that potentially missed relevant tweets.

Clearly, Twitter mentions about a SMT/immunity link increased during the onset of the COVID-19 crisis with peak activity being almost 5 x higher on March 9, 2020 (19.7 k mentions) compared to any other peak activity in the prior 12 months (e.g. September 9, 2019, 4.2 k mentions). This suggests that mentions during the COVID-19 crisis were intentional and not an aberration of baseline activity. To further assess baseline Twitter activity, we evaluated the second largest peak of mentions in the preceding 12 months (September 9, 2019, 4.2 k mentions). This activity consisted almost entirely of twitter content unrelated to the aims of the paper. However, our analysis did reveal a smaller activity peak on October 21, 2019 that appeared to be related to an automated message delivered from a web content subscription service.

"Chiropractic care can improve your immune system, mobility, strength, and so much more. If you want to see a positive change in your health, schedule an appointment with us".

This specific tweet appeared in 17/21 unique tweets on October 21, 2019 within hours of each other. These 17 tweets generated a total potential reach of 54 users and an engagement score of 1 (retweets + likes). In contrast, a single tweet in the same time period that refuted this message generated a potential reach of 2657 users with an engagement score of 25.

When a tweet is made, it automatically goes out to all persons who follow (i.e. subscribe) the author's Twitter account. While sometimes the potential reach of that author is in the thousands or even millions, there is no guarantee that their followers open their device and see the tweet let alone read it. Therefore, the number of followers, or the potential reach of an author is a measure of the potential impact of a tweet. In contrast, if someone acknowledges a tweet by giving it a like or retweeting it (i.e. rebroadcasting it to their own followers), this confirms that the original tweet was both read and acknowledged indicating a true interaction between users. Considering this, tweets that refute a SMT/immunity link had almost 3 times the potential reach compared to those that promoted this link although the engagement between these two groups was similar. This is an important finding as it suggests that promoting tweets create as much engagement as refuting tweets but with the important note that refuting tweets have the potential of reaching many more persons with their message. Still, it is highly likely that the engagement and potential reach of promoting and refuting tweets have differing audiences who are unaligned in their belief systems about SMT and immunity [33] . Regarding professions mentioned in tweets, our coding revealed that our initial wildcard search terms for physiotherapy and osteopathy were too broad resulting in tweets having topics related to physiology and osteology for example. Following coding to eliminate these tweets, chiropractic was the profession most often referenced with 4 times more mentions than the next profession (naturopathy). These data suggest that the majority of twitter activity regarding a SMT/immunity link is associated with the chiropractic profession with the total number of posts being roughly equal between those promoting and those refuting this link.

Tweet themes do not appear to be a good indicator of the impact of specific content as the frequency of the theme is not related to the potential reach or engagement associated with the message; an infrequent theme may be posted in a tweet with far greater reach and engagement than higher ranked themes with lower reach and engagement. 

The top influencers for tweets promoting and refuting a SMT/immunity link each had engagement scores that were~1000 points higher than the next influencer. This shows influence distribution is not equal within each group. Even more so, top influencers appear to be individuals and not academic institutions, regulatory bodies or professional organizations. Thus, few institutions (e.g. universities, associations) were identified as influencers although some individuals with a specific institutional affiliation could be identified. Although Twitter data is publicly available, and Twitter users agree to make their information available publicly, we have chosen not to identify user names of influencers so as not to inadvertently legitimize those who promote misinformation.

The majority of those promoting or refuting a SMT/immunity link were male and English speakers. Interestingly, tweets promoting a SMT/immunity link most commonly originated in the United States. Although tweets rarely were affiliated with specific institutions, we note that the majority of chiropractic, naturopathic and osteopathic schools in the world are in the United States. In contrast, the majority of tweets refuting a SMT/immunity link were from Canada which suggests that geographic proximity between countries is not a factor in establishing a position on this topic. These data likely reflect the distribution of Twitter use around the world. The United States is the number one user of Twitter with Japan in second place and Canada in 12th place [34] . 

Results from this work have the potential to help policy makers and others understand the impact of SMT misinformation and devise strategies to mitigate its impact. Specifically, our results suggest that while the potential reach of messaging that refutes misinformation about SMT was substantial, very few institutions added to this total. Assuming that most institutions related to SMT stand to gain from combating misinformation about SMT (educational programs, associations, regulators, health care administrators etc), these same institutions should re-evaluate their social media strategies lest their silence be taken to be complicit of misinformation or lead to their own demise from an erosion of public trust. The results reported here are different from those presented previously by investigators who explored chiropractic messaging on Twitter in December of 2015 [35] . In this prior work, Tweets refuting claims about questionable benefits from SMT, including changes in immunity, appeared to be less in proportion compared to those promoting such claims. Possible explanations for these incongruent results include the methodologies used, the year/month of data collection and an increasing awareness of social media misinformation especially during the covid crisis.

While Talkwalker can assess other electronic data sources, only Twitter provides full access to its "firehose", the entirety of its activity except for direct messaging between users (a private channel of communication between users). As a result, the data from this paper are presumed to be robust in that they represent all activity taking place on a single social media platform although search results from Talkwalker have not been compared against other services/techniques for accessing Twitter data.

Although Twitter provides a window into conversations within a social media community, it is limited in that it does not represent all persons in the world. Presently, Twitter ranks 13th in total monthly users; Facebook has 2.45 billion active monthly users compared to Twitter's 340 million [36] .

Some of the data used in this study were obtained from proprietary algorithms available from Talker-Walker Quick Search but whose methods of calculation were not available to us (e.g. sentiment scores). Similarly, Talkwalker Quick Search uses artificial intelligence to derive some demographic information not directly included in Twitter user profiles (age, occupation and interests). These proprietary metrics of defining user profiles were not used in our analysis.

Twitter activity regarding misinformation about spinal manipulation and immunity increased above baseline levels during the COVID crisis. Direct Twitter activity (posts, likes, retweets, engagement) was similar between tweets promoting and refuting a SMT/immunity link. Importantly, tweets refuting a SMT/immunity link had the potential to be viewed by 3 times more people than tweets promoting this link. Whether promoting or refuting in tone, the chiropractic profession was most often mentioned in tweets compared to other professions associated with SMT provision. Results from this work have the potential to help policy makers and others understand the impact of SMT misinformation and devise strategies to mitigate its impact. 

In: International Telecommunication Union (ITU)

Public health and online misinformation: challenges and recommendations

Expressions of pro-and anti-vaccine sentiment on YouTube

Twitter, #alternativefacts, careless whispers and rheumatology

Applications of google search trends for risk communication in infectious disease management: a case study of COVID-19 outbreak in Taiwan

Tweeting back: predicting new cases of back pain with mass social media data

Twitter as a tool for Health Research: a systematic review

Are public health organizations tweeting to the choir? Understanding local health department Twitter followership

Social media and flu: media twitter accounts as agenda setters

Micro Agenda Setters: The Effect of Social Media on Young Adults' Exposure to and Attitude Toward News. Social Media Society

How organisations promoting vaccination respond to misinformation on social media: a qualitative investigation

How do we respond to the challenge of vaccine misinformation? Perspect Public Health

RussiaGate and propaganda: disinformation in the age of social media: Routledge

Fact or Fiction? Misinformation and Social Media in the Era of COVID-19: An Infodemiology Study (Preprint)

WHO Director-General's opening remarks at the media briefing on COVID-19. In: WHO [Internet

Coronavirus: the spread of misinformation

Blocking information on COVID-19 can fuel the spread of misinformation

COVID-19: emerging compassion, courage and resilience in the face of misinformation and adversity

COVID-19 related misinformation on social media: a qualitative study from Iran

Epidemiology: spinal manipulation utilization

The Effect of Spinal Adjustment / Manipulation on Immunity and the Immune System: A Rapid Review of Relevant Literature

RCC Research Bulletins -Spinal manipulation and the immune system

Vetenskapliga rådets kommentar på ICA-dokumentet

The Canadian Chiropractic Association

False and misleading advertising on COVID-19

COVID-19: False and Misleading Advertising

URGENT COVID-19 STATEMENT

Let's Work Together to Protect and Serve Our Patients, Staff, Families and Communities

Talkwalker

The Measurement of Observer Agreement for Categorical Data

Online-Utility.org

How health care professionals use social media to create virtual communities: an integrative review

Statistica [Internet

Chiropractic and spinal manipulation therapy on twitter: case study examining the presence of critiques and debates

Social media users by platform

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

The authors would like to thank the staff at Talkwalker for their technical support and expertise, Khilesh Jairamdas for his assistance with our figures and Jessica Wong (JW) for her feedback.

All authors (GK, JH, SH, CN, LN) developed, wrote, edited and proofread this work. The author(s) read and approved the final manuscript.

Funds from the Canadian Chiropractic Research Foundation were used to purchase Talkwalker access.Availability of data and materials All data generated or analysed during this study are included in this published article.Ethics approval and consent to participate Approval for this project was provided by the University of Alberta Human Research Ethics Board (Pro00099881).

Not applicable.