key: cord-0867821-rpmehyzl authors: Musunuri, Sriharshita; Sandbrink, Jonas B.; Monrad, Joshua Teperowski; Palmer, Megan J.; Koblentz, Gregory D. title: Rapid Proliferation of Pandemic Research: Implications for Dual-Use Risks date: 2021-10-19 journal: mBio DOI: 10.1128/mbio.01864-21 sha: 80aff4c890fca41fc75bbcf7e1f0ce6e425faf8d doc_id: 867821 cord_uid: rpmehyzl The COVID-19 pandemic has demonstrated the world’s vulnerability to biological catastrophe and elicited unprecedented scientific efforts. Some of this work and its derivatives, however, present dual-use risks (i.e., potential harm from misapplication of beneficial research) that have largely gone unaddressed. For instance, gain-of-function studies and reverse genetics protocols may facilitate the engineering of concerning SARS-CoV-2 variants and other pathogens. The risk of accidental or deliberate release of dangerous pathogens may be increased by large-scale collection and characterization of zoonotic viruses undertaken in an effort to understand what enables animal-to-human transmission. These concerns are exacerbated by the rise of preprint publishing that circumvents a late-stage opportunity for dual-use oversight. To prevent the next global health emergency, we must avoid inadvertently increasing the threat of future biological events. This requires a nuanced and proactive approach to dual-use evaluation throughout the research life cycle, including the conception, funding, conduct, and dissemination of research. T he COVID-19 pandemic has revealed the world's vulnerability to biological threats and will shape pandemic preparedness efforts for decades to come. Recent discussions have particularly emphasized biosafety risks associated with gain-of-function experiments and accidental pathogen release (1) . However, global health security leaders have also cautioned that the COVID-19 pandemic may increase the threat from deliberate biological events, i.e., biosecurity risks, by potentially inspiring malicious actors (2) (3) (4) . These warnings come against the backdrop of existing global vulnerabilities to potential biosecurity risks, as both the WHO Joint External Evaluations and the inaugural 2019 Global Health Security Index have identified inadequate capacity and policies for biosecurity in the vast majority of countries (5, 6) . Additionally, biosecurity threats may be particularly concerning given that pathogens engineered for transmissibility or virulence may cause biological events of the largest magnitude, including global catastrophic biological risks (GCBRs) (7) . Such engineering may be enabled by the misapplication of publicly available insights and tools from certain "dual-use" life sciences research, even when this research was conceived with beneficial intent. Research associated with the greatest misuse potential constitutes "dual-use research of concern" (DURC), which the U.S. National Institutes of Health defines as "life sciences research that, based on current understanding, can be reasonably anticipated to provide knowledge, information, products or technologies that could be directly misapplied to pose a significant threat with broad potential consequences to public health and safety" (8) . Determining what research exhibits dual-use risks is an ongoing challenge, and if national policies on this exist, they frequently fall short of establishing comprehensive, flexible, and nuanced oversight. In the United States, in addition to the review of risks from public funding of the enhancement of potential pandemic pathogens under the P3CO framework, federally funded institutions are required to assess dual-use risks for only research involving 7 classes of experiments on 15 biological agents, and individual investigators are encouraged to voluntarily raise concerns about research that falls outside these categories (8, 9) . Currently, SARS and SARS-CoV-2 are not considered Select Agents under this classification. In contrast, in Canada all institutions working with pathogens and toxins, regardless of funding source, are required to assess dual-use risks of any conducted research (10) . According to the Global Health Security Index (GHSI), only 1% of countries worldwide are equipped with adequate review processes for research with especially dangerous pathogens (11) . This means that almost all research carried out in the wake of the pandemic will be both conducted and published without adequate dual-use oversight, underscoring the importance of improved guidance globally (Table 1) . Moreover, even when review processes are nominally in place, worrying research may nevertheless be conducted in the absence of robust efforts to implement and evaluate the effectiveness of existing policies (12, 13) . The COVID-19 pandemic may exacerbate biological risks stemming from the misapplication of research. We highlight several types of research with dual-use potential associated with pandemic response and preparedness efforts and emphasize how changes to the life science research enterprise complicate oversight of research with dual-use potential. We then describe the need for dual-use frameworks suited for application in the midst of emergency situations, as well as the need to consider dualuse risks associated with pandemic countermeasures. Ongoing dual-use review throughout the research life cycle is necessary to address increasingly common dissemination of research before peer review. The vast majority of research that is being conducted and published related to the development of countermeasures against SARS-CoV-2 aims to contribute to global pandemic response efforts. This research includes advances such as the identification of neutralizing monoclonal antibodies as therapeutics, genetic surveillance to rapidly characterize variants of concern, and immunogens that aim to elicit lasting protection against the disease (14, 15) . However, some work may have dual-use potential that increases the risk of deliberate misuse alongside the potential for accidents, thereby endangering not only the current response but also preparedness efforts for future outbreaks. For instance, certain research may inform the explicit identification of mutations to the genome of the virus to enhance its resistance to existing countermeasures (16), replicative fitness, or transmissibility. While such studies are often done to pinpoint exactly how current countermeasures, such as convalescent patient sera or monoclonal antibody therapeutics, are insufficient to address potential emerging variants of concern, they also offer a blueprint of changes to be made that could increase the virulence of the virus. Thus, a few of these studies constitute "gain-of-function" (GOF) experiments that have the potential to enhance the lethality and/or transmissibility of a virus. These types of experiments deserve additional review given the associated dual-use risks but may have received less scrutiny due to the urgency of the pandemic and already widespread circulation of the pathogen in question. Some of this information has been rapidly incorporated into countermeasures upon publication and dissemination, such as modification of vaccine formulations to reflect circulating variants (17, 18) . However, we must still be wary of the risk that the availability of granular mutational data linked to viral phenotype poses in the long term. This is especially important if it enables the engineering of more concerning strains of SARS-CoV-2, or other viruses, by malicious actors for deliberate release or strategic stockpiling as a biological weapon. While accidental and intentional misuse scenarios may be associated with the same lines of research, the latter could be more catastrophic. Instructions for the de novo reconstruction of replication-competent SARS-CoV-2 virus are another example of dual-use knowledge that has been created and disseminated as a result of the pandemic (19, 20) , as they may lower tacit knowledge barriers to conducting risky research. While methods such as restriction enzyme digestion, cDNA fragment assembly, and polymerase chain reaction are staple biochemistry techniques, detailed protocols regarding the assembly of functional virus and its derivative mutants may increase the number of researchers capable of using reverse genetics, regardless of prior training. Therefore, the likelihood that a bad actor acquires the practical knowledge necessary to culture recombinant viruses without safeguards, including those engineered for properties such as immune evasion, increases. It is important to recognize that transparent dissemination of protocols and reagents is a crucial aspect of accelerating pandemic response research among the scientific community. However, there may be specific tools or insights that pose greater risks than benefits and should require an additional screening step before being shared or should be replaced by a safer alternative. Similar to the practical use of pseudotyped viruses wherever possible to reduce biosafety risks, we should adopt approaches that minimize biosecurity risks. For instance, there are a number of available methods to obtain replicationcompetent virus other than through synthesis. Extraction of live virus from clinical isolates is not accompanied by straightforward methods of introducing mutations that accentuate certain viral properties in the way that reverse genetics approaches are (21) . Another viable alternative may be the use of a transcomplementation system producing nonvirulent SARS-CoV-2 that is infectious for only a single round of replication (22) . This approach is also attractive given that it duplicates authentic viral replication, can be implemented in biosafety level 2 (BSL-2) containment, and facilitates the development of countermeasures with fewer risks. Evidently, only a small fraction of response efforts is associated with dual-use risks. However, we must ensure that such studies do not endanger the overall response and preparedness effort. While an ongoing pandemic warrants rapid dissemination and collaboration to develop countermeasures, maintenance and consideration of dual-use concerns cannot be neglected either in order to avoid the possibility of an even larger crisis in the future. In addition to the potential dissemination of security-relevant insights during the direct pandemic response, increased infectious disease countermeasure research over the coming years may raise risks from deliberate and accidental biological events. To minimize biosecurity risks from deliberate events, conception and funding decisions regarding infectious disease countermeasure research need to consider how associated insights may inform pathogen engineering by malicious actors. For instance, research on viral vector platform-based vaccines may be associated with generating insights on engineering immune evasion could be translated to pathogens of concern (23). Previous natural exposure to the virus utilized as a vaccine vector may result in preexisting immunity that can limit the effectiveness of vaccination in certain individuals, and induction of antivector immunity through vaccine administration limits the reusability of a given vector platform (24) . To overcome this limitation, chimeric vector viruses have been created which evade neutralization by preexisting antibodies (25) . While most vaccine-related work focuses on less concerning viral families, such as Adenoviridae, researchers have also explored and engineered orthopoxviruses-related to variola virus, the agent that causes smallpox-like vaccinia virus. Less risky alternatives to solving antivector immunity include expanding the vector portfolio to include nonhuman viruses and focusing efforts on nongenetic modifications which are not passed onto viral progeny, such as PEGylation (26, 27) . Especially promising may be preferential investment into mRNA-based vaccines which both exhibit excellent properties as fast response platforms and are associated with few dual-use risks (23, 28, 29) . Another example of potentially concerning countermeasure research is the creation of transmissible vaccines for eradicating zoonotic pathogens, which has been advocated for with increased urgency in the wake of the pandemic (30, 31) . Despite some potentially useful applications, such research would be associated with substantial safety risks as well as ecological and ethical concerns about introducing a new transmissible agent into animal populations. Importantly, such research would also create unique incentives for engineering the transmissibility, genetic stability, and immune evasion of viruses and hence be associated with significant dual-use risks (32) . Beyond specific countermeasure research leading to dual-use insights on viral engineering, research conducted to investigate and predict zoonotic spillover events may also increase biosafety and biosecurity risks. Experiments that use a "gain-of-function" approach to determine the contribution of genotypic changes to the transmissibility or virulence of a virus could create enhanced potential pandemic pathogens (33) , such as the controversial generation of mammalian transmissible H5N1 avian influenza virus (34, 35) as well as more recent work on coronaviruses (36) . While this type of research should be conducted at facilities with the appropriate level of safety and security measures, even high-containment labs have an appreciable accident rate (33, 37) . Moreover, making specific insights on concerning mutations publicly available can pose information hazards if this enables malicious actors to reconstruct or enhance pandemic pathogens (38, 39) . Systematic approaches to the characterization of viruses with potential for zoonotic spillover bear particular biosecurity risks. Large-scale efforts with the aim to collect hundreds of thousands of samples of viruses and investigate them in laboratories have been proposed and initiated (40) . Such efforts are associated not only with accidental exposure and release risks (41) but also the potential of generating dual-use insights. Large-scale characterization of animal viruses may enable computational viral engineering capabilities by creating large data sets which link genetic sequence and function for thousands of viruses. This may be leveraged to create more transmissible and virulent pathogens (42) . In addition, broad genomic surveys and characterization of animal viruses have been suggested to be of little practical use to mitigate the emergence of biological events (43) . Therefore, preferential investment into approaches which are associated with little biosecurity risk may more robustly reduce overall health security risk. For instance, the real-time surveillance of human populations for emerging pathogens does not involve large-scale collection and characterization of zoonotic viruses and has been highlighted as an effective approach to mitigating outbreaks (44) . Transmissible vaccine research, specific GOF experiments, and large-scale efforts to characterize animal viruses are examples of research aimed at reducing zoonotic risks that at the same time may increase the biological risk from other sources, including deliberate and accidental release. Table 2 summarizes the potential dual-use nature of research across pandemic response and preparedness efforts. Assessing pandemic preparedness research for associated risks should be of particular importance during the coming years, given increased funding for necessary efforts to prevent future pandemics as well as potentially heightened interest in weaponizing viruses by malicious actors, inspired by the havoc caused by the COVID-19 pandemic. Changes to how scientific information is disseminated also pose new challenges for managing dual-use risks. From the rapid sharing of the SARS-CoV-2 genome by Chinese researchers (45) to the internationally coordinated vaccine development process, the swift dissemination of knowledge has been a cornerstone of the groundbreaking scientific advances since the beginning of the pandemic. Although this spread of information has been vital for efforts to curtail global outbreaks, the emergency conditions of the pandemic pose distinct challenges from the perspective of managing any emerging dual-use research of concern. Though dual-use concerns are ideally identified earlier in the research life cycle, in practice many concerns arise or are made apparent when insights are codified for wider release via publication. Only a minority of life science research journals have written policies for assessing dual-use risks (46) (47) (48) , but the role of journal review has featured prominently in historical controversies over DURC. In cases involving the reconstruction of the 1918 pandemic influenza virus (49) , GOF research on avian influenza A/H5N1 (50-52) and A/H7N1 (53, 54) viruses, and the synthesis of horsepox virus (39, 55, 56) , editors, journal DURC committees, and external bodies such as the U.S. National Science Advisory Board for Biosecurity (NSABB) ultimately decided in favor of publication of the manuscripts in question. In contrast, the Journal of Infectious Diseases decided in 2014 to redact information on key gene sequences from two manuscripts on the molecular characterization of a novel Clostridium botulinum toxin, following consultation between editors, authors, and various U.S. government agencies (57, 58) , while another journal previously rejected manuscripts on smallpox and anthrax out of security concerns (59) . Irrespective of each specific outcome, the discussions around these cases have emphasized the role of journal review in biosecurity. However, recent developments in publication practices as well as the unique circumstances of public health emergencies pose distinct challenges for this approach to managing dual-use risks. One such challenge relates to the use of preprint servers such as bioRxiv, medRxiv, and SSRN, which has been steadily increasing in recent years and surged as the COVID-19 pandemic unfolded. Clearly, preprint publishing provides many benefits, including the rapid dissemination, evaluation, and discussion of academic work; open-access research; the facilitation of interdisciplinary collaborations; and benefits for early-career researchers (60) (61) (62) . However, the discussion around preprints has primarily focused on scientific integrity (63) , and scant attention has been given to the implications of preprint publishing for research with dual-use potential (64) . While the effectiveness of (42) any peer review, with or without guidance, to reliably identify and resolve dual-use risks remains uncertain, preprint publishing removes a safeguard against the dissemination of potential biosecurity information hazards that cannot be redacted once published on public servers. Therefore, scientists who choose to publish research with dual-use implications must assume a greater responsibility for reviewing the benefits and risks of their work before publication, including consulting with appropriate experts and authorities, and take measures as relevant to minimize the information hazards posed by their research. Even when manuscripts are not posted to preprint servers, a public health emergency could influence the extent of scrutiny for dual-use risks, either due to accelerated review (65) or because the presence of a significant health threat-rather than a hypothetical or minor one-leads to a higher tolerance for potential risks than under usual circumstances. Consequently, it is critical that scientific journals and external committees are equipped to evaluate dual-use considerations swiftly and in a way that considers how the risks posed by some information hazards may persist longer than any given public health emergency (38) . To safeguard global pandemic response and preparedness efforts, we need to proactively address dual-use risks. Certain elements of a pandemic response, such as the publication of detailed protocols or insights on immune evasion engineering, bear dual-use potential and may increase the risk from deliberate biological events for the foreseeable future alongside accidents in the near term. Therefore, despite the importance of a fast pandemic response, scientists, funders, and publishers should not blindly conduct or publish any and all research that might help with these efforts but still pause and examine individual approaches for risks and benefits. Importantly, deliberative frameworks must be established and incorporated in the life science research cycle now, so as to avoid becoming an unwelcome burden during the next public health emergency and as the life science enterprise grows. Moreover, steps must be taken to ensure that established guidance has the intended effects on shaping scientific efforts. Specifically, it is vital that implementation of the guidelines is continually evaluated in terms of whether the assumptions embedded in their design hold true in practice, including whether they are correctly interpreted and adhered to by laboratory scientists and where ambiguities arise. Realizing the full potential of dual-use policies requires a strong feedback loop between implementation, evaluation, and review (12, 13) . Pandemic preparedness efforts directed at mitigating risks from different sources of biological risks may interfere with each other (66) . For instance, large-scale collection of viruses, GOF experiments, and research into acquisition of human transmissibility that is conducted to assess the risk of zoonotic spillovers may increase the pandemic risk from accidental or deliberate releases (67) . Consequences of actions by individuals in this space may have global repercussions, necessitating a global dialogue on how to manage tradeoffs from different lines of preparedness. Key drivers of such a global dialogue should be international organizations and scientific bodies including the World Health Organization, the Biological Weapons Convention, and the InterAcademy Partnership. Moreover, commercial, philanthropic, and public funders will need to play a more active role in incentivizing researchers to consider dualuse tradeoffs. To withstand the test of time and future emergencies, such evaluation must consider dual-use risks beyond lists of specific pathogens and existing technologies (68) . The changing landscape for how scientific information is disseminated necessitates a modern approach to managing dual-use research. The growing role of preprint publishing accentuates the disadvantage of relying exclusively on the academic review stage as a filter for biosecurity risks and the importance of evaluating research early on and throughout its life cycle (56, 69). Enabling stakeholders to manage dual-use concerns in a rapidly evolving landscape will require strategies and incentives to increase transparency, information sharing, and education about risk management (70) . At the same time, scientific journals continue to have a critical role in shaping norms and incentives in the life sciences, as research typically receives considerably more attention once it is published in prestigious outlets. Consequently, more publishers should follow the example of pioneering journals in the field that already have robust policies for dual-use review (68) . Successful efforts from academic journals will also influence the norms governing preprint servers, which could advance innovative practices. At the minimum, these may include providing guidance and conditions for submission of manuscripts including attesting to and disclosing reviews and moving toward implementing screening for biosecurity and biosafety risks in submitted manuscripts where needed. Given that a few prominent servers host the majority of life science preprints, such screening may be a high-leverage avenue for identifying and mitigating potentially concerning research. Adequately addressing dual-use risks will require updating assessment frameworks, strengthening oversight of life science research from proposal to publication, educating scientists and other stakeholders who shape the scientific landscape about the importance of this topic, and further developing a culture of responsible science (71) . The biosecurity community should also recognize that dual-use oversight is not just a scientific and technical matter but also has political and social dimensions, which must be taken into account when designing processes and systems designed to address dual-use concerns (72) . Many of the assumptions underlying the effectiveness of our governance strategies for risk management remain untested, and despite calls for applied biosafety and biosecurity research, this work has received little support (9) . In particular the social sciences can make an important contribution to designing institutions necessary to monitor, evaluate, and learn from dual-use governance measures (11) . Moreover, oversight is only part of what must be a more comprehensive approach that addresses incentives for proactive risk management-including rewarding innovations and highlighting best practices and champions (73) . COVID-19 continues to demonstrate the grave costs of pandemic events and that we cannot afford to wait to address dual-use risks until an inevitable, avoidable disaster strikes. The aftermath of this pandemic is an opportunity to proactively increase preparedness for a wide range of potential global catastrophic biological risks. Rethinking gain-of-function experiments in the context of the COVID-19 pandemic Secretary-General's remarks to Security Council Open Video-Teleconference on the Maintenance of International Peace and Security: Implications of COVID-19 Council of Europe Steering Committee on Counter-Terrorism (CDCT). 2020. Overview and preliminary reflection on the bioterrorism threat Nuclear Threat Initiative. 2021. Virtual global biosecurity dialogue. Nuclear Threat Initiative Global health security index. Nuclear Threat Initiative, Johns Hopkins Center for Health Security, and The Economist Intelligence Unit Joint External Evaluation (JEE) mission reports. World Health Organization Global catastrophic biological risks: toward a working definition Dual-use research. National Institutes of Health Framework for guiding funding decisions about proposed research involving enhanced potential pandemic pathogens. U.S. Department of Health and Human Services Biosecurity in emerging life sciences technologies, a Canadian public health perspective. Front Public Health 2:198 Global Health Security Agenda. 2020. APP3 statement on biosecurity and biosafety during the COVID-19 pandemic Learning to deal with dual use Embrace experimentation in biosecurity governance Neutralizing monoclonal antibodies for treatment of COVID-19 Efficacy of the ChAdOx1 nCoV-19 Covid-19 vaccine against the B.1.351 variant Prospective mapping of viral mutations that escape antibodies used to treat COVID-19 2021. NIH clinical trial evaluating Moderna COVID-19 variant vaccine begins 2021. Phase 1, open-label, randomized study of the safety and immunogenicity of a SARS-CoV-2 variant vaccine (mRNA-1273.351) in naïve and previously vaccinated adults. Clinical trial registration NCT04785144. National Institutes of Health (NIH) Establishment of a reverse genetics system for SARS-CoV-2 using circular polymerase extension reaction Engineering SARS-CoV-2 using a reverse genetic system Severe acute respiratory syndrome coronavirus 2 from patient with coronavirus disease, United States A trans-complementation system for SARS-CoV-2 recapitulates authentic viral replication without virulence Biosecurity risks associated with vaccine platform technologies Pre-existing immunity against vaccine vectors-friend or foe? Hexon-chimaeric adenovirus serotype 5 vectors circumvent pre-existing antivector immunity The vesicular stomatitis virus-based Ebola virus vaccine: from concept to clinical trials Effects of shielding adenoviral vectors with polyethylene glycol on vector-specific and vaccine-mediated immune responses RNA vaccines: a suitable platform for tackling emerging pandemics? Front Immunol 11:608460 Promoting versatile vaccine development for emerging pandemics Self-disseminating vaccines to suppress zoonoses Controlling epidemics with transmissible vaccines Safety and security concerns regarding transmissible vaccines The consequences of a lab escape of a potential pandemic pathogen. Front Public Health 2:116 Airborne transmission of influenza A/H5N1 virus between ferrets Experimental adaptation of an influenza H5 HA confers respiratory droplet transmission to a reassortant H5 HA/H1N1 virus in ferrets A SARS-like cluster of circulating bat coronaviruses shows potential for human emergence Management of accidental exposure to Ebola virus in the biosafety level 4 laboratory Information hazards in biotechnology Inoculating science against potential pandemics and information hazards The Global Virome Project Biosecurity, biosafety, and the management of dangerous pathogens for public health research Zoonotic risk technology enters the viral emergence toolkit Predicting virus emergence amid evolutionary noise Pandemics: spend on surveillance, not prediction A new coronavirus associated with human respiratory disease in China Dual-use review policies of biomedical research journals Biosecurity and the review and publication of dual-use research of concern Dual use life science research (DUR/C) dialogue with science editors and publishers -meeting report flu and responsible science Mammalian-transmissible H5N1 influenza: the dilemma of dual-use research The NSABB recommendations: rationale, impact, and implications Research on highly pathogenic H5N1 influenza virus: the way forward The decision to publish an avian H7N1 influenza virus gain-of-function experiment An avian H7N1 gain-of-function experiment of great concern Horsepox and the need for a new norm, more transparency, and stronger oversight for experiments that pose pandemic risks Inconvenient truths" in the pursuit of scientific knowledge and public health Novel clostridium botulinum toxin and dual use research of concern issues Dual-use research of concern (DURC) review at American Society for Microbiology journals and its effect on other organizations On the value of preprints: an early career researcher perspective Early in the epidemic: impact of preprints on global discourse about COVID-19 transmissibility Preprints with The Lancet are here to stay The perils of preprints Preprinting microbiology Pandemic publishing poses a new COVID-19 challenge Biosecurity reconsidered: calibrating biological threats and responses Risk and benefit analysis of gain of function research. Gryphon Scientific Dual-use research of concern (DURC) review at American Society for Microbiology journals A new synthesis for dual use research of concern Visibility initiative for responsible science. NTI Biosecurity Innovation and Risk Reduction Initiative Meeting The culture of biosafety, biosecurity, and responsible conduct in the life sciences: a comprehensive literature review Dual-use research as a wicked problem A more systematic approach to biological risk Risks and benefits of gain-of-function experiments with pathogens of pandemic potential, such as influenza virus: a call for a science-based discussion We thank Jassi Pannu, Jacob Swett, Claire Standley, James Wagstaff, and participants at a Future of Humanity Institute biosecurity seminar for insightful discussions on this topic and comments on early drafts. S.V.M., J.B.S., and J.T.M. also thank the Nuclear Threat Initiative and the Next Generation for Biosecurity for their encouragement and support of this work.M.J.P. receives funding support from the Open Philanthropy Project and the Nuclear Threat Initiative (NTI) (#2143). G.D.K. is a pro bono consultant on ethical, legal, and social issues for DARPA's PREPARE program on genome editing, and is a member of the Biological Threat Advisory Board for Heat Biologics, Inc. M.J.P. is a council member of the Engineering Biology Research Consortium, cochairs a World Economic Global Future Council on Synthetic Biology, serves as an advisor to the International Genetically Engineered Machine Competition, and is a member of the Board of Directors of Revive & Restore. M.J.P. and G.D.K. both serve on a World Health Organization working group on frameworks for the responsible use of the life sciences.