key: cord-031017-xjnbmah5
authors: Van Goethem, N.; Struelens, M. J.; De Keersmaecker, S. C. J.; Roosens, N. H. C.; Robert, A.; Quoilin, S.; Van Oyen, H.; Devleesschauwer, B.
title: Perceived utility and feasibility of pathogen genomics for public health practice: a survey among public health professionals working in the field of infectious diseases, Belgium, 2019
date: 2020-08-31
journal: BMC Public Health
DOI: 10.1186/s12889-020-09428-4
sha: 
doc_id: 31017
cord_uid: xjnbmah5

BACKGROUND: Pathogen genomics is increasingly being translated from the research setting into the activities of public health professionals operating at different levels. This survey aims to appraise the literacy level and gather the opinions of public health experts and allied professionals working in the field of infectious diseases in Belgium concerning the implementation of next-generation sequencing (NGS) in public health practice. METHODS: In May 2019, Belgian public health and healthcare professionals were invited to complete an online survey containing eight main topics including background questions, general attitude towards pathogen genomics for public health practice and main concerns, genomic literacy, current and planned NGS activities, place of NGS in diagnostic microbiology pathways, data sharing obstacles, end-user requirements, and key drivers for the implementation of NGS. Descriptive statistics were used to report on the frequency distribution of multiple choice responses whereas thematic analysis was used to analyze free text responses. A multivariable logistic regression model was constructed to identify important predictors for a positive attitude towards the implementation of pathogen genomics in public health practice. RESULTS: 146 out of the 753 invited public health professionals completed the survey. 63% of respondents indicated that public health agencies should be using genomics to understand and control infectious diseases. Having a high level of expertise in the field of pathogen genomics was the strongest predictor of a positive attitude (OR = 4.04, 95% CI = 1.11 – 17.23). A significantly higher proportion of data providers indicated to have followed training in the field of pathogen genomics compared to data end-users (p < 0.001). Overall, 79% of participants expressed interest in receiving further training. Main concerns were related to the cost of sequencing technologies, data sharing, data integration, interdisciplinary working, and bioinformatics expertise. CONCLUSIONS: Belgian health professionals expressed favorable views about implementation of pathogen genomics in their work activities related to infectious disease surveillance and control. They expressed the need for suitable training initiatives to strengthen their competences in the field. Their perception of the utility and feasibility of pathogen genomics for public health purposes will be a key driver for its further implementation.

Sequence information from viruses, bacteria, and other infectious organisms can be used to identify a pathogen and its specific characteristics, and compare its genetic relatedness to other pathogens [1] . Advances in sequencing technologies, especially the shift to next-generation sequencing (NGS), have made it possible to analyze pathogen genomes in much greater detail. Compared to Sanger sequencing, NGS technologies allow a faster and cheaper way to sequence larger lengths of nucleotides. As such, NGS makes microbial pathogen whole-genome sequencing (WGS) accessible in high throughput within a matter of days [1] . During the last decade, NGS has expanded beyond the research settings and is being rapidly applied into routine practice for public health and food safety [1] [2] [3] [4] [5] [6] .

In public health, integrating pathogen genomics with epidemiology provides many opportunities for improving the population-level risk assessment and management of infectious diseases [1] [2] [3] [4] [5] [6] [7] [8] . The main applications of WGS include (1) retrospective (or near real-time) comparisons of pathogens' relatedness to test epidemiological transmission hypotheses of suspected outbreaks (i.e. outbreak investigations); (2) WGS-based prospective surveillance by monitoring of cases generating alerts when clusters of pathogens with similar genomes are identified in a limited geographical area or time period or when virulent clones emerge (outbreak detection by control-oriented surveillance); and (3) cross-sectional genomic epidemiology surveys to monitor long-term changes in epidemiology over larger geographic and population scales to inform prevention strategies (strategy-oriented surveillance) [9] . The main added value of implementing WGS during surveillance activities or outbreak investigations is inherent in the higher resolution of the WGS output itself, leading to an increased sensitivity and specificity to identify transmission clusters compared to conventional subtyping methods [6] . As such, there are numerous success stories of outbreak investigations applying WGS that were able to identify to the source of infection and implement targeted control measures to stop further spread, saving resources at the health protection and local authority level [10] [11] [12] [13] [14] [15] [16] [17] . Other concrete examples of the utility of WGS for national surveillance and local infection control include the guidance of vaccination strategies [18] [19] [20] [21] and antibiotic stewardship [22, 23] . Besides transforming the public health approach to infectious diseases monitoring, analysis of pathogen genomics can advance the accuracy of infection diagnostics and guide the treatment of individual patients [4, [24] [25] [26] [27] [28] [29] . For several pathogens, NGS is able to replace current time-consuming and/or laborintensive conventional methods with a single, all-in-one diagnostic test [30] [31] [32] [33] .

Public health professionals play a key role in protecting the population against communicable disease threats. This requires them to give effective responses in a limited time frame, supported by adequate information resulting from applying the most appropriate tools adapted to the specific public health threat scenario. Infectious disease surveillance systems build upon the cooperation between: clinicians, who are at the frontline through identification of infected patients; microbiologists, who are involved in testing specimens; molecular biologists, who study organisms at the molecular level; bioinformaticians, who develop computational approaches/algorithms to analyze genomic data; epidemiologists, who use the data to understand patterns in disease occurrence at the population level; infection control practitioners, who are responsible for local prevention and control of infectious diseases in the community; hospital hygienists, who are involved in the prevention and control of healthcare-associated infections; food safety inspectors, who monitor food products; etc. The activities of these public health experts operating at different levels in the information cycle will be impacted by the introduction of pathogen genomics as they are all connected to each other. This ranges from microbiologists adapting their laboratory workflows to epidemiologists rethinking their current data analysis approaches.

Typically, new laboratory technologies are adopted by data providers first, while data end-users might not be familiar enough with the new methods to effectively translate the output data into public health actions. Expertise with pathogen genomics and its applications for public health practice might also differ between those in charge of national surveillance of infectious diseases and those involved in local infection control and patient management, as well as between different fields (i.e. human, animal, food, and the environment) within the One Health spectrum [34, 35] .

Differences in perceptions and needs between these different profiles should be taken into account before we can build a strategy that engages all the stakeholders in an effective collaboration. The key to success in translating pathogen genomics into public health practice is to demonstrate an added value by better addressing the needs and expectations of the whole range of public health experts. An effective exchange of expertise across disciplines (e.g., clinicians, microbiologists, epidemiologists, and bioinformaticians) is key for enabling the smooth implementation of NGS into routine public health activities. If such coordination of joint efforts cannot be accomplished, the technology shift, which is currently ongoing, might not realize its full potential [5, 8] .

Previous surveys in the field of public health genomics focused on: human genomics [36] [37] [38] ; specific aspects such as proficiency testing [39] , the design of WGS clinical reports [39] or data sharing [40] ; or specific target groups such as National Microbiology Focal Points [41] or food safety laboratories [42] . In this study, by organizing an online survey, we aimed to perform a wide landscape analysis of all potentially involved stakeholders in order to appraise the level of genomic literacy and to gather the opinions of public health experts and allied professionals working in the field of infectious diseases in Belgium concerning the implementation of NGS in routine public health activities, in terms of its utility, feasibility, implementation, and translation into actionable results for public health decision making.

An electronic questionnaire survey (see Additional file 1) was developed for this study using LimeSurvey (Version 2.71.1) [43] for the collection of relevant information from public health professionals working in the field of infectious diseases in Belgium. For the purposes of this study, a 'public health professional in the field of infectious diseases' was defined as a person with professional expertise in the field of infectious diseases and who directly or indirectly contributes to the population-level management of infectious diseases. To provide a complete picture of all involved stakeholders, the survey aimed to reach different subgroups based on professional qualification (i.e. microbiologists, molecular biologists, bioinformaticians, epidemiologists, clinicians, clinical biologists, infection control practitioners, and hospital hygienists), employing institution (i.e. governmental, private, hospital, and university), health field (i.e. human, animal, food, and environment), expertise in pathogens (i.e. bacteria, viruses, parasites, fungi, and yeasts), and level of action (i.e. national surveillance and local infection control). To identify all actors in the field of public health activities for infectious diseases, an overview was made of existing surveillance systems (i.e. data sources) in Belgium (see Additional file 2). The set of questions was compiled based on the literature, including several review articles [1-3, 5, 7, 24-26, 44, 45] . Existing items from previous survey questionnaires [27, [36] [37] [38] [39] [40] [41] [42] 46] ) were used and adapted when relevant. Most of the existing questionnaires from which some questions were adapted to be used for this survey were not validated, except for Chow-White et al. 2017 as mentioned in the respective publication [37] . The construction of the survey was discussed during several feedback rounds within a multidisciplinary team including epidemiologists, microbiologists, and molecular biologists. As a result, the survey instrument was vetted by subject matter experts. The questionnaire eventually contained eight main topics comprising background questions, general attitude towards pathogen genomics for public health practice and main concerns, genomic literacy, current and planned NGS activities, place of NGS in the diagnostic hierarchy of microbiology, data sharing obstacles, end-user requirements, and key drivers for the implementation of NGS. Based on a filter question where participants indicated their level of familiarity with pathogen genomics, the respondents were redirected to different sets of questions with different levels of technicity and detail. The filter question gave access to a reduced version of the questionnaire for those participants judging themselves as not at all familiar with pathogen genomics. The responses were mainly collected as single/multiple options from a set of pre-defined answers, but also included the optional entry of free text. These qualitative open questions were included to add context to the quantitative responses. The survey tool was pre-tested by three researchers not directly involved in the development phase to ensure the acceptability and clarity of the questionnaire.

Participants were contacted individually by an email invitation containing a personal token to complete the survey. No monetary or other incentive was offered. The participant information statement at the beginning of the survey informed the respondents about the objective and design of the study and their rights before participation to the survey, and explained that responses are anonymized and will be kept confidential. The approval from an Ethical Committee was not considered necessary due to national regulations (legislation 4 April 2014), as this study was not medical in nature and as participants were not subject to any actions and/or rules of conduct. The survey was available online during a two months' period during which three reminders were sent to those who had not yet responded. The first invitations were sent on the 6th of May 2019 and the survey remained active until the 1st of July 2019. Participants were invited to send any questions, feedback or comments for the survey to the organizers. Only completed questionnaires were used for analysis.

Descriptive statistics were reported by analyzing categorical response frequencies. Differences in viewpoints between the stakeholders were described using subgroup analyses and compared using a Fisher's exact test. Subgroups were compiled on the basis of the level of action (national vs. local), the position in the information cycle (data providers vs. data end-users), and the level of expertise in the field of pathogen genomics. The level of action was considered national when the main affiliation of the respondent concerned a national institute involved in national public health activities, whereas the local level included professionals who mainly operate at the community, hospital, or university level. Subgroups based on the position in the information cycle were defined as data providers, defined here as experts in wet and dry lab procedures and (potentially) generating NGS data (including microbiologists, molecular biologists, clinical biologists, and bioinformaticians), and data endusers defined here as using NGS data to improve their activities and implementing infection control measures (including epidemiologists, local infection control practitioners, hospital hygienists, and clinicians). The level of expertise was categorized as high, middle or low, and was based on respondents' self-reported familiarity with pathogen genomics, training level, and current use of NGS. Multiple logistic regression was performed to identify predictors of a positive attitude towards the implementation of pathogen genomics from a public health perspective. Enthusiasm about public health agencies using genomics to understand and control infectious diseases was defined directly through a question with multiple options, each containing a clear statement (see Additional file 1). For the purpose of this analysis, the question asking about their enthusiasm originally consisting of multiple categories was collapsed into two levels: very enthusiastic versus all others. The following predictor variables were initially tested in the model: level of action; position in the information cycle; level of expertise; current use of NGS; institution; age group; years of professional experience; and position in their institution. Model building involved a univariate analysis to select variables to be included in the multivariable model based on a χ2-test (cut-off, P = 0.25), and variable selection from the multivariable model using backward stepwise regression based on the Akaike Information Criterion (AIC). Adjusted odds ratios (ORs) and 95% confidence intervals (CIs) were calculated. Quantitative analyses were performed using R software (R Studio version 1.0.153) [47] . Answers to open-ended survey questions were summarized and analyzed using Nvivo qualitative data analysis software (Nvivo Version 12) [48] . This was done by identifying themes (codes) within the data, which were derived both deductively and inductively. Following the thematic analysis framework, the text was compared and contrasted with the identified codes. The qualitative findings were summarized as a mind map linking the identified major and minor themes and a word cloud visualizing the word frequency from the qualitative responses. Simultaneously, quotes were selected for the sake of illustration.

Out of the 753 invited participants, 465 did not respond at all, 142 partially filled in the survey, and a total of 146 participants delivered a completed survey which represents an overall survey response rate of 19% (Fig. 1 ). From these, 135 participants continued after the filter question and delivered answers to all questions (116 subject were redirected to a technical version of the survey and 19 subjects to a basic version, based on the filter question). The data from the 11 participants who preferred to quit after the filter question were only used to describe the background characteristics of the study population. The 142 subjects who partially filled in the survey were dropped completely from the analysis. Full responses to all questions as they appeared in the questionnaire are provided as an appendix to this report (see Additional file 3).

Background characteristics of the 146 participants are presented in Table 1 . The majority of respondents had their main affiliation in the public sector (53%), followed by hospitals (including university hospitals) (36%), private sector (8%), and university (3%). The public sector was primarily represented by Sciensano (Belgian Institute for Health), comprising 42% of all survey participants (61/146). 53% of the respondents indicated that they had more than 10 years of professional experience within the field of infectious diseases. The reported roles of respondents within their institutions included: microbiologists/molecular biologists/bioinformaticians/clinical biologists (45%); epidemiologists (21%); clinicians (13%); hospital hygienists/infection control practitioners (10%); and policy makers (3%).

The 146 survey respondents were asked to describe their level of familiarity with sequencing technologies and pathogen genomics using following classification: 'Very -I am involved in the generation and/or use of NGS data' (22%), 'Somewhat -I have a general sense of the applications of NGS' (58%), or 'Not at all -I don't know anything about NGS and its applications' (21%). Of those participants answering 'very familiar', most of them (88%; 28/32) indicated that they mainly used NGS in the context of WGS. Of those 'not at all familiar', 11 preferred to quit the survey and 19 continued the survey to answer some general questions, leaving a total of 135 participants for the remainder of the survey (Fig. 1) . Subgroup analysis showed differences in familiarity with pathogen genomics between data providers and endusers (Fig. 2 ). Data providers indicated significantly more frequently that they were 'very familiar' compared to data end-users (p < 0.001).

The majority of respondents (63%; 85/135) indicated that they were very enthusiastic (i.e. 'we should be using genomics now') about public health agencies using genomics to understand and control infectious diseases, 30% (40/135) did not have an opinion or did not know enough of the topic to be able to give an opinion, and 7% (10/135) indicated that they did not see clear applications and/or an added value for public health. Subgroup analysis pointed out differences in enthusiasm according to the level of expertise in the field of pathogen genomics ( Fig. 3 ). Important predictors, as identified by the best fitting model, of a positive attitude related to the implementation of pathogen genomics from a public health perspective were the level of expertise, the level of action, and the position in the information cycle ( Table 2 ). Participants classified as having a high level of expertise based on their self-reported familiarity with the topic, their training level, and/or the current use of NGS were significantly more likely to be enthusiastic about the implementation of pathogen genomics in a public health context compared to their peers with a low expertise (adjusted OR = 4.04, 95% CI = 1.11 -17.23). Further, public health professionals operating at the national level were more often 'very enthusiastic' about the implementation of pathogen genomics (71%) compared to those at the local level (53%). Similarly, data providers were more often 'very enthusiastic' (76%) compared to data end-users (50%). 

A large majority of respondents considered the following public health activities as likely to be most impacted by pathogen genomics in the next five years: identifying an outbreak (clusters of related isolates) (78%; 105/135), nosocomial and food/waterborne outbreak investigations (76%; 103/135), and monitoring the spread of antimicrobial resistance (71%; 96/135). In contrast, only 44% (60/ 135) of respondents thought that pathogen genomics would have a major impact on making a diagnosis and selecting an appropriate treatment (individual patient management). Other public health activities that will benefit from the implementation of pathogen genomics mentioned by the participants are presented in Table 3 .

The most frequent concerns among participants being 'very' or 'somewhat' familiar with NGS technologies and pathogen genomics (n=116) regarding feasibility of its routine use for public health purposes, were the cost of sequencing technologies and the existing barriers to timely and open sharing of pathogen sequence data and accompanying metadata ( Table 4 ). All participants exclusively working with respiratory infections (e.g. influenza) and/or vaccine-preventable diseases (e.g. measles) (n=7) were very concerned about the cost, whereas this was only true for 38% of participants exclusively working with invasive bacterial diseases (e.g. Neisseria meningitidis), food-and waterborne diseases (e.g. Salmonella), and/or healthcareassociated infections (e.g. Clostridium difficile) (n=21). Further, other concerns shared by a large proportion of the participants were interdisciplinary cooperation, integration of pathogen sequence data with contextual data, access to bioinformatics expertise, and availability of typing schemes and databases. Participants indicating to be 'not at all' familiar with pathogen genomics were mainly concerned about the cost of the sequencing technologies (see full responses in Additional file 3). Other concerns provided by the participants as free text are presented in Table 3 .

Two-thirds of the participants (88/135) indicated that they had followed training in the fields of genomics/genetics/ molecular biology/bioinformatics. There were marked differences by position in the information cycle: 56% (38/ 68) of data end-users indicated that they had never followed any training in the field, whereas this was stated by only 13% (9/67) of data providers (p < 0.001). Further breakdown of training experience by professional category is shown in Fig. 4 . The main reasons for not taking a training/course in this field (yet) were the lack of available and/or suitable trainings (40%; 19/47) and the lack of time (30%; 14/47). Other reasons indicated as free text are presented in Table 3 . The vast majority of participants (79%, 106/135) indicated that they felt the need and/or would be interested in following (additional) courses/training/workshops covering a topic related to pathogen genomics.

Overall, 36% (42/116) participants being 'very' or 'somewhat' familiar with NGS technologies and pathogen genomics indicated that they are currently using or generating NGS data for at least one pathogen. Differences between professional groups are presented in Fig. 5 . Among the microbiologists, those from a National Reference Centre (NRC) were more likely to be currently using NGS (12/18, i.e. 67%) compared to those from other laboratories (1/7, i.e. 14%), however this difference was not significant (p=0.71). From the public health professionals exclusively involved in human infectious disease activities, 30% (21/70) were currently using NGS technologies, whereas this was the case for 44% (11/25) of those exclusively involved in the food, animal or environmental sector (p=0.23).

Looking forward, 44% (51/116) of participants indicated that they were planning to use or generate NGS data for any (additional) pathogen(s) within three years. Details on the specified pathogens can be found in the appendix (see Additional file 3). Reasons provided by participants indicating that they did not plan to implement pathogen genomics were mainly related to the cost and the lack of expertise.

Participants being 'very' or 'somewhat' familiar with NGS technologies and pathogen genomics (n=116) were asked to assign a score from 1 to 5 to the different criteria based on their increasing relative importance to decide whether or not NGS should be implemented for a particular pathogen (Fig. 6 ). Clinical and/or public health significance of the pathogen were scored as the most important drivers. The different subgroups scored the different criteria similarly (see Additional file 3). Comments provided by the participants to provide context to their scores are presented in Table 3 .

Centralization of sequencing and bioinformatics at NRCs organized per pathogen or per group of pathogens was most often (34%; 40/116) selected by respondents being 'very' or 'somewhat' familiar with pathogen genomics as the preferred WGS provision model in the Belgian context. Excluding participants working at NRCs slightly lowered this proportion to 29 out of 98 (i.e., 30%). There were no marked differences according to the level of action of the participants (Fig. 7) . Illustrative quotes for the need for centralization are presented in Table 3 . Public health activities, other than those provided within the survey, that will benefit from the implementation of pathogen genomics Environmental monitoring "drinking water quality" "air quality, home environmental quality"

Metagenomics "metagenomics for patients with no identified cause of illness using conventional methods" "identification and characterization of new strains" "insights in dysbiosis" "microbiome analysis"

Other "discovery of a causal relation between a pathogen and a clinical disease (e.g. cancer)" "vaccine development" "phage therapy" "early diagnostics of diseases due to slow growing pathogens" "international tracking" "monitoring of antiviral resistance"

Concerns, other than those provided within the survey, related to the implementation of pathogen genomics for public health practice

Contextual data "harmonization of epidemiological datamost of the epidemiological data is very 'messy' or inconsistent, which makes systematic integration and surveillance unfeasible" "data collection is already limited so newer technologies will not automatically improve this process but be redundant if the basics are not met"

"how to interpret the result at clinical level" "[…] they need to have a basic understanding (education) it order to understand and see cost/benefit of the whole picture" "appropriate training of personnel for execution and interpretation" "interpretation across sectors" "multidisciplinary knowledge"

Ethics "[…] healthcare workers integrity concerns" "in the HIV field, the phylogenetic analyses of virus permit to have an hindsight in paths of transmissionit is a very tricky topic in ethical and potentially legal aspects"

Other "does the identification prove that the pathogen poses a risk?" "the fear that some actors in the field will try to abuse their power and monopolize this new technologyto be really valuable to patient management and public health it is required to offer access to all laboratories" "high inter-laboratory variability" "[…] standardization and facilities for data sharing need to be improved" "the perceived utility and feasibility of pathogen genomics by public health practitioners is the biggest bottleneck of allall the other concerns listed above can be tackled given the drive within the field to solve them in the first place"

Reasons, other than those provided within the survey, for not taking a training/course in the field of pathogen genomics "lack of training adapted to public health needs" "not applicable for a clinician" "not my priority" "not relevant for my practice"

"depends on the evolution in phenotypic typing" "[…] the main driver the pressure by ECDC rather than a real need for public health […] the first and main driver should be clinical significance: improve quality of care for the patient" "for bacteria, NGS will never fully replace classical methods for resistance testing, but would offer important complementary data" "cost-effectiveness (e.g. replacing multiple tests): not particularly true for viruses, but obvious for bacteria"

Centralization "[…] should be overall coordinated and controlled by the federal public health authority" "[…] in any scenario it will be important that sequence data are brought together in one databank for surveillance purposes" Table 3 .

Major themes identified within the qualitative data are utility (applications), feasibility (including capacity building, multi-disciplinary working, contextual data, costs, data sharing, ethics, timeliness, wet and dry lab), One Health context, and routine implementation (including organization and translation into action). A mind map linking the identified major and minor themes is presented in Fig. 8 . A full list of identified themes and the coded text is available in the appendix (see Additional file 4), as well as a word cloud constructed based on the free text responses (see Additional file 5).

This survey sought the opinion of Belgian public health professionals working in the field of infectious diseases concerning the implementation of pathogen genomics in public health activities. To successfully translate pathogen genomics into public health practice, the needs and expectations of the different stakeholders should be taken into account. Other questionnaire surveys related to knowledge and attitudes towards public health "the bureaucracy involved in the transmission of data" "the structure of public health in Belgium will not help sharing data" "the required technical infrastructure"

Priority to publication "it is really a pity that priority to publication is an obstacle in the scientific world as it functions now"

One Health "A better collaboration between the veterinary and human side might increase the use of NGS on the veterinary side" "Monitoring the emergence and spread of zoonotic pathogens has been impacted negatively, by the introduction of WGS at the human side only" genomics in specific health expert categories have been published [27, 36-39, 41, 42, 46, 49] . However, to the best of our knowledge this survey is the first that aimed to perform a wide landscape analysis of all potentially involved stakeholders. Therefore, a strength of the current study is that it took into account a wide range of stakeholders with diverse backgrounds (epidemiologists, microbiologists, bioinformaticians, clinicians, infection control practitioners, etc.), health domains (human, food, environmental, etc.), pathogen expertise (bacteria, viruses, parasites, fungi, etc.), activity sectors (public, private, university, hospital, etc.), work positions (employee and lower/middle/high management), and degree of familiarity with genomics. Besides seeking the general attitude of the participants towards the implementation of pathogen genomics in their professional activities and investigating the current and future use, this explorative study was able to touch upon multiple key topics, such as genomic literacy, data sharing obstacles, place of NGS in the diagnostic hierarchy of microbiology, and enduser requirements. Familiarity with sequencing technologies and pathogen genomics varied between the different professional groups, with data providers being more familiar than data end-users. As shown before, one of the largest barriers to acceptability from the public health unit is the capacity to understand and use the data [50] . Possibly, there is a positive association between genomic literacy Criteria could be assigned a score from 1 to 5, or participants could indicate the 'I don't know' option. The boxplots show the median score and the interquartile range (grey boxes). The following criteria were included (top to bottom): clinical and/or public health significance, priority with respect to preventing the spread of antimicrobial resistance, local/national/international policy surveillance priorities or obligations, importance of prevention and control programs (e.g. vaccination), utility of WGS for diagnostics and/or treatment decisions (individual patient care), utility of increased resolution to infer relatedness that would not be obtained via conventional methods, availability of high-quality/complete/standardized epidemiological and/or clinical data to provide context to the WGS results, possibility to link genomic data from different sources (food-animalhuman-environment), cost-effectiveness (e.g. replacing multiple tests), time-saving compared to conventional testing methods, impact on outcomes for patients and populations (translation into actionable results), availability of WGS typing schemes and reference databases (e.g. for antimicrobial resistance), availability of validated (quality-controlled) WGS workflows (both wet and dry laboratory), availability of expertise to generate, analyze and interpret WGS data, and availability of the appropriate infrastructure (sequence technology, high-performance computing, data storage, etc.). Having a high level of expertise, was the strongest predictor for a positive attitude, as was also shown in other surveys [51] [52] [53] . Epidemiologists and infection control practitioners should be informed about the benefits and limitations of NGS technologies in order to contribute in identifying tangible field application in public health, allowing the use of WGS output to appropriately guide public health actions [38, 51] . Another important challenge related to the interpretation of WGS data is the capacity to interpret signals, and thereby separating noise from public health events that require specific actions. Consequently, integrating genomics into infection control and surveillance is critically linked to human resource development [8, 24] . In the survey, the main reasons stated for not training in the field of genomics were lack of time or access to suitable trainings "…adapted to public health needs". However, the participants of this survey generally expressed a positive attitude towards following (additional) training courses, or workshops in pathogen genomics. Educational workshops should be applied to a public health context and bring together the expertise of microbiologists, molecular experts, bioinformaticians, epidemiologists, infection control practitioners, and clinicians. The development of a new discipline called 'genomic epidemiology' integrating information on epidemiological and pathogen sequence characteristics by public health microbiologists, epidemiologists, and risk managers was recommended in the expert opinion on WGS for public health surveillance by the European Centre for Disease Prevention and Control (ECDC) in 2016 [8] . ECDC has initiated public health genomics training workshops that bring together experts with epidemiology, microbiology and pathogen genomics backgrounds from European Union (EU) member states with interest in implementing the technology in surveillance and outbreak investigations. Besides, the zoonotic origin of many clinically relevant pathogens and antimicrobial resistance determinants stresses the importance of a cross-sectoral One Health approach. The implementation of WGS should be synchronized and integrated between the human health and veterinary sectors [9] allowing a better monitoring of the emergence and spread of zoonotic pathogens and antimicrobial resistance-related threats. Lack of financial resources was often indicated as a principal reason for not using or planning to use WGS by the respondents of this survey, which was also reported by the European surveys conducted by ECDC [41] and the European Food Safety Authority (EFSA) Fig. 8 Mind map linking the major and minor themes identified in the qualitative responses, Belgium, 2019. Codes were identified within the data deductively (i.e. themes that are expected and have been chosen in advance) and inductively (i.e. themes that are derived through analysis). During the thematic analysis the qualitative data from the survey was compared and contrasted with the identified codes. As such, the derived codes were assigned to the relevant text. Next, the codes (plain boxes) were merged into categories (colored boxes). The following categories were identified: routine implementation (orange), One-Health context (yellow), and feasibility (blue) [42] . Operational costs will be influenced by the processes used in current laboratory practice and differs between viruses and bacteria. Whereas drug susceptibility testing and epidemiological typing are commonly performed for bacteria, this is often not the case for viruses detected in the routine laboratory [54] . Therefore, cost-effectiveness of NGS for many bacteria potentially follows from the replacement of conventional characterization methods, whereas for viruses NGS is considered as a tool providing additional complementary information without replacement of the existing methods. Further, an important consideration is the added value of NGS for routine diagnostics. As long as NGS is more expensive than the conventional methods and when there is no direct benefit for the individual patient, it will not be used in routine. Then the fields of application for surveillance purposes should be clearly defined to be able to justify the additional financial resources needed to perform WGS beside the diagnostic activities.

To translate pathogen sequence data into truly useful and actionable information, it needs to be integrated with other types of information (i.e. clinical and epidemiological data). In Belgium, most data end-users were concerned about the challenges encountered with the integration of pathogen sequence data with clinical and epidemiological data. Indeed, the public health usability of any kind of lab results, including WGS data, is highly dependent on the cross-linkage with contextual epidemiological and clinical information [8, 55, 56] . Data integration is often hampered by the incomplete and/or unstandardized nature of the contextual data [57] . The ongoing digitalization of health data such as laboratory and clinical records may represent an opportunity to review and upgrade traditional data collection processes for communicable disease surveillance.

According to World Health Organization's (WHO) 2016 guidance on managing ethical issues in outbreaks [58] , rapid data sharing is crucial during an unfolding health emergency. This suggests that pathogen sequence data should be rapidly and openly shared at the start of an outbreak, in many cases before scientific publication. However, many barriers for data sharing remain including authorship/attribution for publications, results dissemination, ethical considerations, data ownership, database access agreements, etc. [59] . In our survey, practical barriers (lack of data standardization, poor data quality, missing metadata, etc.) seemed to be the major obstacles in Belgium for sharing pathogen sequence data and associated metadata for public health purposes. Participants mainly mentioned the lack of a central database and clear guidelines. This reflects a lack of information on the effective data sharing through EU-wide genomic surveillance and cross-border outbreak analysis systems managed by ECDC and EFSA in support of the member states [9, 60, 61] . Finally, 27% of participants considered the priority to publication as a major bottleneck for sharing pathogen sequence data. Publication priority is linked to the importance of guaranteeing reputational returns to research efforts [40, 62] . The challenge here is to find a balanced arrangement that allows data sharing in real time and the acknowledgement of research work by giving to researchers who have been involved in data generation the possibility to use and publish their own results in priority. As the use of NGS shifts from research to routine laboratory practices, this data sharing barrier will slowly be alleviated.

Regarding expertise and availability of personnel, wet and dry lab experts were more concerned about the analysis of pathogen sequence data than the sequencing itself. As was mentioned in a review article of Aarestrup et al. and documented in a recent European survey by Revez et al., the most important limiting factor in many countries is the lack of access to bioinformatics expertise, especially when used as part of frontline diagnostics [44] or national public health reference laboratory service [41] .

Another point of discussion is the potential impact of NGS on the diagnostic microbiology pathway. Traditionally, frontline clinical laboratories perform standard identification, antimicrobial susceptible testing and occasionally typing. Isolates may then be referred to reference laboratories based on the need (e.g. diagnostic confirmation) or for surveillance purposes. These reference laboratories perform confirmation testing and advanced characterization. NGS was first implemented at the level of academic or reference laboratories, because of the need for investments, operational costs, and requirements for expertise [24] while having limited added value for individual patient care. Samples must be multiplexed (batching) for cost-effectiveness, which is easier to achieve in large reference laboratories with high volume of sample throughput [26, 45] . However, processing delays may be present when samples are shipped to a reference center. These processing delays may result in longer turnaround times rendering this centralized approach inappropriate to support a fast response when needed. The reduced costs of sequencing facilitated the introduction of NGS technology to frontline clinical laboratories. This shift towards a decentralized use may reduce turnaround times, empower hospital-based microbiology, and strengthen local infection control efforts [24] . This decentralized capacity will allow the inclusion of these data in the surveillance network coordinated by the epidemiologists what will compensate the reduced referral of isolates to reference centers. Consequently, the implementation of NGS in routine labs is an important driver to reconsider the future role of NRCs. Molecular typing for public health surveillance is undergoing a stepwise transition to NGS [41] . Current and future NGS activities represented in this national survey were mainly in the context of food-and waterborne outbreak detections and investigations, reflecting the priority for these diseases across Europe and beyond [63, 64] . Several criteria should be considered in the process of integrating WGS in a routine laboratory setting [11] in order to know in which situations and for which pathogens it is worthwhile to use NGS. Identifying a set of key drivers that cover all aspects related to the implementation of NGS (utility and feasibility) can help to guide prioritization of pathogens and to efficiently allocate resources. Clinical and/or public health significance of the pathogen was scored as the most important driver during the implementation of pathogen genomics in routine public health activities, followed by availability of expertise to generate, analyze and interpret WGS data, and priority of the pathogen with respect to preventing the spread of antimicrobial resistance.

Qualitative responses revealed the opinion of several participants that the assessment of the added value of new technologies for individual patient care is paramount. If pathogen genomics is routinely used to guide patient management (diagnosis and/or treatment options), the pathogen sequence data gathered for diagnostic purposes can be accumulated for public health activities [65] . If there is no added value for routine diagnosis, the cost of WGS will have to be covered by limited public health budgets.

As a limitation, the relatively low response rate induced a potential volunteer bias as those public health experts being more interested and/or experienced in the field could be more likely to participate in the survey. Yet, 21% of the participants indicated that they were 'not at all' familiar with sequencing technologies and pathogen genomics. Further, we noticed a possible underrepresentation of the food, animal and environmental field in comparison to the human field, as well as a low number of bioinformaticians in the survey. In addition, public health professionals from the Belgian Institute for Health (Sciensano) might be overrepresented. The majority of microbiologists participating in the survey are based in a NRC, emphasizing surveillance activities and hence less weight to routine diagnostics. Given this potential imbalance, it is important to take into account the distribution of profiles within the study population while interpreting the results. However, it is difficult to ascertain the true underlying distribution of the different professional groups within the target population. Another limitation of the study is that the specific terminology used in the questions may not have been uniformly understood or consistently interpreted by stakeholders with different professional backgrounds [39] .

Public health professionals working in the field of infectious diseases in Belgium were in general enthusiastic about public health agencies implementing pathogen genomics for the surveillance and control of infectious diseases. However, introducing genomic methods into public health practice is inevitably linked to the decrease in cost, the introduction in routine activities of frontline clinical labs, the identification of field applications in public health, and the necessary development of new competencies. The results of the survey confirm the need to increase genomic literacy by offering dedicated training opportunities among public health professionals, especially for the data end-users including epidemiologists, clinicians, and infection control practitioners, enabling them to critically assess the utility and feasibility of implementing pathogen genomics in their work activities. As such, those at the forefront (i.e. end-users) may act as "honest brokers" responsible for evaluating the added value of genomic application. In the end, the main driver for the advancement of pathogen genomics in public health practice depends on the added value of this information for the different clinical and public health needs. Further, inter-disciplinary (between epidemiologists, microbiologists and bioinformaticians) and intersectoral (One Health context) collaboration should be improved in the future to pool expertise and to ensure an integrated and cohesive system for the management of infectious diseases. In terms of feasibility, respondents in this survey were mainly concerned, like their peers in similar European surveys, about data integration, data sharing, and the cost of sequencing technologies. Overall, this survey helps to better understand the perceived utility and feasibility of pathogen genomics according to public health professionals and can inform further guidance to facilitate its implementation in Belgium. Future challenges can be anticipated by performing a similar survey among public health experts based in a country that already progressed further in the process of implementing pathogen genomics within their public health surveillance system.

Supplementary information accompanies this paper at https://doi.org/10. 1186/s12889-020-09428-4.

Additional file 1. "Questionnaire". Description of data: "List of questions included in the online survey".

Additional file 2. "Selection of target groups for the survey". Description of data: "An overview of existing surveillance systems to identify all public health professionals who (would potentially) generate or use NGS data for the surveillance of infectious diseases based in different institutes and organizations in Belgium." Additional file 3. "Full responses to questionnaire". Description of data: "Full responses to all questions included in the survey".

Transforming bacterial disease surveillance and investigation using whole-genome sequence to probe the trace

Integrating Advanced Molecular Technologies into Public Health

Next-generation sequencing technologies and their application to the study and control of bacterial infections

Next Generation Sequencing of Infectious Pathogens

Integrating Genome-based Informatics to Modernize Global Disease Monitoring, Information Sharing, and Response

Status and potential of bacterial genomics for public health practice: a scoping review

From molecular to genomic epidemiology: transforming surveillance and control of infectious diseases

Expert opinion on whole genome sequencing for public health surveillance strategy to harness whole genome sequencing to strengthen EU outbreak investigations and public health surveillance. Stocholm: European Centre for Disease Prevention and Control

European Centre for Disease Prevention and Control. ECDC strategic framework for the integration of molecular and genomic typing into European surveillance and multi-country outbreak investigations

Multistate Outbreak of Salmonella Anatum Infections Linked to Imported Hot Peppers -United States

Investigation using whole genome sequencing of a prolonged restaurant outbreak of Salmonella Typhimurium linked to the building drainage system

Whole Genome Sequencing in Real-Time Investigation and Management of a Pseudomonas aeruginosa Outbreak on a Neonatal Intensive Care Unit

Disease Outbreak Caused by Endemic Strain of Legionella pneumophila

Rapid draft sequencing and real-time nanopore sequencing in a hospital outbreak of Salmonella

A Large Community Outbreak of Legionnaires' Disease Associated With a Cooling Tower

Two listeria outbreaks caused by smoked fish consumption-using whole-genome sequencing for outbreak investigations

A multi-country Salmonella Enteritidis phage type 14b outbreak associated with eggs from a German producer: 'near realtime'application of whole genome sequencing and food chain investigations

Whole Genome Sequence Analysis of Salmonella Typhi Isolated in Thailand before and after the Introduction of a National Immunization Program

Genomic epidemiology of age-associated meningococcal lineages in national surveillance: an observational cohort study

Genomic analysis of isolates from the United Kingdom 2012 pertussis outbreak reveals that vaccine antigen genes are unusually fast evolving

A world without bacterial meningitis: how genomic epidemiology can inform vaccination strategy

Emergent and evolving antimicrobial resistance cassettes in community-associated fusidic acid and meticillin-resistant Staphylococcus aureus

Clonal variation in high-and low-level phenotypic and genotypic mupirocin resistance of MRSA isolates in south-east London

Practical issues in implementing whole-genome-sequencing in routine diagnostic microbiology

Infection control in the new age of genomic epidemiology

From Theory to Practice: Translating Whole-Genome Sequencing (WGS) into the Clinic

Whole genome sequencing in clinical and public health microbiology

High throughput genomic and proteomic technologies in the fight against infectious diseases

The potential of whole genome NGS for infectious disease diagnosis

Rapid, comprehensive, and affordable mycobacterial diagnosis with wholegenome sequencing: a prospective study

Transforming clinical microbiology with bacterial genome sequencing

Routine Whole-Genome Sequencing for Outbreak Investigations of Staphylococcus aureus in a

Utility of Whole-Genome Sequencing of Escherichia coli O157 for Outbreak Detection and Epidemiological Surveillance

The challenges of implementing an integrated One Health surveillance system in Australia

The One Health Approach-Why Is It So Important

Needs Assessment for Research Use of High-Throughput Sequencing at a Large Academic Medical Center

Knowledge, attitudes, and values among physicians working with clinical genomics: a survey of medical oncologists

European survey on knowledge and attitudes of public health professionals on public health genomics: Pilot Study

Evidence-based design and evaluation of a whole genome sequencing clinical report for the reference microbiology laboratory

How ownership rights over microorganisms affect infectious disease control and innovation: A root-cause analysis of barriers to data sharing as experienced by key stakeholders

Survey on the Use of Whole-Genome Sequencing for Infectious Diseases Surveillance: Rapid Expansion of European National Capacities

Outcome of EC/EFSA questionnaire (2016) on use of Whole Genome Sequencing (WGS) for food-and waterborne pathogens isolated from animals, food, feed and related environmental samples in EU/EFTA countries

LimeSurvey: An Open Source survey tool. Hamburg: LimeSurvey Project

Sharing Data for Global Infectious Disease Surveillance and Outbreak Detection

Considerations in centralizing whole genome sequencing for microbiology in a public health setting

Proficiency testing for bacterial whole genome sequencing: an enduser survey of current capabilities, requirements and priorities

R: A language and environment for statistical computing

NVivo (Version 12)

Monitoring the use of whole-genome sequencing in infectious disease surveillance in Europe

Incorporating Whole-Genome Sequencing into Public Health Surveillance: Lessons from Prospective Sequencing of Salmonella Typhimurium in Australia

Are public health professionals prepared for public health genomics? A crosssectional survey in Italy

Public Health Genomics knowledge and attitudes: A survey of public health educators in the United States

US health educators' likelihood of adopting genomic competencies into health promotion

Routine Use of Microbial Whole Genome Sequencing in Diagnostic and Public Health Microbiology

Next-Generation" Surveillance: An Epidemiologists' Perspective on the Use of Molecular Information in Food Safety and Animal Health Decision-Making

Significance of whole genome sequencing for surveillance, source attribution and microbial risk assessment of foodborne pathogens

Towards an integrated food safety surveillance system: a simulation study to explore the potential of combining genomic and epidemiological metadata

Guidance for managing ethical issues in infectious disease outbreaks. World Health Organization

World Health Organization. WHO R&D Blueprint meeting on pathogen genetic sequence data (GSD) sharing in the context of public health emergencies

European Centre for Disease Prevention and Control and European Food Safety Authority. Multi-country outbreak of Listeria monocytogenes clonal complex 8 infections linked to consumption of cold-smoked fish products -4

European Centre for Disease Prevention and Control and European Food Safety Authority. Collection and analysis of whole genome sequencing data from food-borne pathogens and other relevant microorganisms isolated from human, animal, food, feed and food/feed environmental samples in the joint ECDC-EFSA molecular typing database

Data Sharing in Genomics -Re-shaping Scientific Practice

Impact of food and water-borne diseases on European population health

World Health Organization. WHO estimates of the global burden of foodborne diseases

Real-Time Analysis and Visualization of Pathogen Sequence Data

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

We would like to thank all study participants who took the time to complete the survey and provided valuable insights to reach to objectives of our study. These include the scientists from the Belgian Institute for Health (Sciensano) and the Federal Agency for the Safety of the Food Chain (FASFC) working in infectious disease departments; physicians and infection control practitioners of the regional infectious disease control teams from the three regions in Belgium; microbiologists from National Reference Centers (NRCs) and from sentinel laboratories; members from the Belgian Society of Infection Specialists and Clinical Microbiologists (BVIKM), the Belgian Antibiotic Policy Coordination Committee (BAPCOC), the Belgian Infection Control Society (BICS), and the Belgian Society for Food Microbiology (BSFM); clinicians, clinical biologists and hospital hygienists participating in sentinel surveillance networks; and public health experts within the ministry of health. We also would like to thank Jérome Ambroise, Jimmy Van Den Eynden, and Boudewijn Catry for pre-testing the survey, and Vera Cantaert, Yves Dupont, Chloé Wyndham-Thomas, and Karl Mertens for their contributions in recruiting participants. 

This research was supported by the .Be READY project financed by Sciensano.

The raw data analyzed during the current study are available from the corresponding author on reasonable request.

The first page of the questionnaire explained the purpose of the research, the measures taken to protect respondents' confidentiality and the voluntary nature of participation. Questionnaire respondents were asked to tick 'agree' at the start of the questionnaire to indicate that they consented to take part in the study and were willing to complete an anonymized questionnaire. Ethics approval was deemed unnecessary according to national regulations (law of 4 April 2014; http://www.ejustice.just.fgov.be/mopdf/2014/05/16_1. pdf#Page97), as participation was anonymous and no medical data were processed.

Not applicable.

The authors declare that they have no competing interests.