key: cord-292199-pl4d19w2
authors: Tapia, Felipe; Laske, Tanja; Wasik, Milena A.; Rammhold, Markus; Genzel, Yvonne; Reichl, Udo
title: Production of Defective Interfering Particles of Influenza A Virus in Parallel Continuous Cultures at Two Residence Times—Insights From qPCR Measurements and Viral Dynamics Modeling
date: 2019-10-18
journal: Front Bioeng Biotechnol
DOI: 10.3389/fbioe.2019.00275
sha: 
doc_id: 292199
cord_uid: pl4d19w2

Defective interfering particles (DIPs) are a natural byproduct of influenza A virus (IAV) replication. DIPs interfere with the propagation and spread of infectious standard virus (STV), reduce virus yields by competing for viral and cellular resources, and induce antiviral responses. These properties open exciting possibilities for the development of DIP-based antivirals. Exploring options for cell culture-based DIP production, we have established a fully continuous cultivation process, where one bioreactor is used to grow cells that are fed to two bioreactors operated in parallel for virus production. This system allows head-to-head comparisons of STV and DIP replication dynamics over extended time periods. Cultivations were performed at two residence times (RT, 22 and 36 h) using MDCK suspension cells grown in a fully defined medium. For infection, we used a virus seed generated by reverse genetics containing STVs and a known DIP carrying a deletion in segment 1 (delS1(1)). Four days post infection, DIPs achieved maximum concentrations of 7.0·10(9) virions/mL and 8.4·10(9) virions/mL for RTs of 22 and 36 h, respectively. Furthermore, oscillations in virus titers with two to three maxima were found for DIP accumulation at 36 and 22 h RT, respectively. To complement the study, a basic mathematical model using simple kinetics and a reasonable number of parameters to describe DIP-propagation in continuous cultures was established. Upon fitting the model individually to each of the two data sets, oscillations in the viral dynamics and the cell population dynamics were described well. Modeling suggests that both STV inactivation and virus degradation have to be taken into account to achieve good agreement of simulations and experimental data for longer RTs. Together, the high DIP titers obtained, and the successful simulation of the experimental data showed that the combination of continuous bioreactors and mathematical models can enable studies regarding DIP dynamics over extended time periods and allow large scale manufacturing of DIP-based antivirals.

Defective interfering particles (DIPs) are a natural byproduct of influenza A virus (IAV) replication. DIPs interfere with the propagation and spread of infectious standard virus (STV), reduce virus yields by competing for viral and cellular resources, and induce antiviral responses. These properties open exciting possibilities for the development of DIP-based antivirals. Exploring options for cell culture-based DIP production, we have established a fully continuous cultivation process, where one bioreactor is used to grow cells that are fed to two bioreactors operated in parallel for virus production. This system allows head-to-head comparisons of STV and DIP replication dynamics over extended time periods. Cultivations were performed at two residence times (RT, 22 and 36 h) using MDCK suspension cells grown in a fully defined medium. For infection, we used a virus seed generated by reverse genetics containing STVs and a known DIP carrying a deletion in segment 1 (delS1(1)). Four days post infection, DIPs achieved maximum concentrations of 7.0·10 9 virions/mL and 8.4·10 9 virions/mL for RTs of 22 and 36 h, respectively. Furthermore, oscillations in virus titers with two to three maxima were found for DIP accumulation at 36 and 22 h RT, respectively. To complement the study, a basic mathematical model using simple kinetics and a reasonable number of parameters to describe DIP-propagation in continuous cultures was established. Upon fitting the model individually to each of the two data sets, oscillations in the viral dynamics and the cell population dynamics were described well. Modeling suggests that both STV inactivation and virus degradation have to be taken into account to achieve good agreement of simulations and experimental data for longer RTs. Together, the high DIP titers obtained, and the successful simulation of the experimental data showed that the combination of continuous bioreactors and mathematical models can enable studies regarding DIP dynamics over extended time periods and allow large scale manufacturing of DIP-based antivirals.

Viruses are a major threat to human health and significant efforts have been made over the last century to prevent and treat viral diseases. A huge success was the development of potent, safe and affordable viral human and veterinary vaccines using eggand cell-based production systems (Aubrit et al., 2015; Genzel, 2015; Barrett et al., 2017; Volz and Sutter, 2017) . In addition, novel approaches toward vaccination are under development, i.e., DNA and RNA vaccines (Kutzler and Weiner, 2008; De Gregorio and Rappuoli, 2014; Ahmed et al., 2017) . In addition, for various viruses such as HIV, IAV, or herpes virus, potent antivirals are available for treatment [e.g., for influenza virus (Samson et al., 2013; Simonsen et al., 2018) ]. Despite this, significant challenges remain. On the one hand, humans are constantly challenged by new viruses including Zika virus, MERS-coronavirus, or Ebola virus. On the other hand, most viruses change rapidly in the face of selective pressure and emergence of antiviral drug resistance is of major concern [e.g., for influenza virus (Samson et al., 2013; Lackenby et al., 2018; Shin and Seong, 2019) ]. These challenges can only partly be addressed by existing technologies, since the development of new vaccines, the adaptation of existing manufacturing processes, and the identification of new antiviral targets are time consuming and costly processes. They involve complex decisions regarding the selection of efficient production systems, potency and safety aspects, and comprehensive clinical trials. Moreover, conventional antiviral measures may be too slow to save lives in case of a rapidly spreading virus.

An unconventional option to prevent virus spreading and cure infectious diseases is the use of viruses themselves. This concerns especially defective interfering particles (DIPs)defective viruses, which suppress the spread of their intact, replication competent counterparts, reducing infectious virus yields by up to five orders of magnitude (e.g., Akkina et al., 1984; Frensing et al., 2014) . DIPs were already identified in the early fifties by studies of von Magnus (von Magnus, 1951) , who performed undiluted serial passages of IAV. DIPs are characterized by deletions in the viral genome preventing the synthesis of a protein essential for viral spread (Nayak et al., 1985; Dimmock and Easton, 2015; Frensing, 2015) . For replication, DIPs rely on the presence of homologous helper virus, further referred to as standard virus (STV), that supplies the missing viral protein(s) in trans. Interestingly, the presence of DIPs has been demonstrated for almost every virus studied (Huang and Baltimore, 1977) making DIPs a viable option to prevent and/or treat a larger number of viral diseases.

While initial studies suggested that DIPs suppress STV replication and may thus have the potential to protect against viral disease, it was not until the late eighties that researchers started to systematically exploit this approach (Dimmock et al., 1986) . It was Dimmock and colleagues (Dimmock et al., 2008) who demonstrated that the use of molecular cloning technologies enables the generation of DIPs that have the potential to protect animals from IAV infection. They also showed that the DIP isolate named DI244, from Influenza A/Puerto Rico/8/34 (PR8; H1N1), which contains a single deletion in segment 1 (S1; coding for PB2), is suitable to both therapeutically and prophylactically protect animals from a lethal challenge by the 2009 pandemic IAV and, potentially, other respiratory viruses (Duhaut and Dimmock, 2003; Easton et al., 2011; Scott et al., 2011; Dimmock et al., 2012; Dimmock and Easton, 2014) . They showed that production of the DI244 antiviral candidate can be realized in eggs followed by an ultraviolet (UV) irradiation process to destroy STV infectivity (Dimmock et al., 2008) . More recently, an in vitro and in vivo antiviral effect was demonstrated for a combination of three defective interfering genes of IAV for avian and seasonal influenza using a dual-functional peptide vector (Zhao et al., 2018) .

Despite the increasing interest in the potential use of DIPs as antiviral agents, relatively little is known regarding their spread and accumulation in cell populations. This also applies to large scale manufacturing of DIPs in biopharmaceutical industry where fertilized chicken eggs or animal cell culture technologies could be considered for efficient large scale DIP production. While eggs have been successfully used for the production of DIPs in relatively small amounts (Dimmock and Marriott, 2006; Dimmock et al., 2008) , cell culture-based technologies have been less explored and have several additional advantages for large scale DIP manufacturing. Firstly, animal cells are ideal for in-depth investigation of intracellular DIP replication, their release and cell-to-cell spreading under controlled and welldefined cultivation conditions in bioreactors over an extended time period. Secondly, cells could be specifically designed for DIP generation (Ozawa et al., 2011; Bdeir et al., 2019; Yamagata et al., 2019) using plasmids for reverse genetics (Hoffmann et al., 2000) , which would allow to overcome the need of any infectious helper virus for DIP replication. Such DIP preparations, in contrast to egg-based production systems, would not be contaminated with STV and would not need UV inactivation for use as antivirals (Dimmock et al., 2008) . Finally, there are various quantitative assays available for detailed characterization of the dynamics of virus titers and DIP copy numbers. Together with the use of specific staining methods and flow cytometry for monitoring the progress of infection in cells (Frensing et al., 2014 Swick et al., 2014) , mathematical models for DIP and STV replication can be established to describe their basic dynamics in cell culture Akpinar et al., 2016a,b; Laske et al., 2016; Liao et al., 2016) .

In this study, following the general ideas described by Frensing et al. (2013) , we investigated DIP production in a continuous cultivation system. Frensing et al. demonstrated that continuous influenza virus production in a cascade of two stirred tank bioreactors showed oscillations in virus and cell concentrations due to the presence of DIPs. In contrast to their approach using only two vessels, we used one bioreactor for continuous cell production (cell bioreactor or CB) feeding two bioreactors for virus propagation (virus bioreactor 1 or VB1; virus bioreactor 2 or VB2) operated in parallel to allow for headto-head comparisons of virus seeds, media, cell lines, or changes in cultivation parameters under conditions as close to each other as possible. As a starting point, the impact of residence time (RT, 22 and 36 h) on DIP and STV dynamics was investigated. With regard to the establishment of manufacturing processes for DIP production, a MDCK suspension cell line growing in a fully defined medium was used (Lohr et al., 2010) . Virus seeds containing known amounts of DIPs and STV were generated using a reverse genetics approach (Hoffmann et al., 2000) . Cultivations were performed over a period of 20 days at two RTs to allow for at least two oscillations in STV and DIP replication dynamics . For process monitoring and model development, cell concentrations, infectious and noninfectious virus titers, as well as extracellular copy numbers of S1 for both STV, i.e., full-length (FL) S1, and a known form of DIP, delS1(1), were determined. Based on the newly available quantitative data obtained for DIP and STV concentrations, the mathematical model developed by Frensing et al. (2013) was extended. After fitting, the basic process dynamics for both RTs were described well by the simulations. In particular, these simulations capture the oscillations in process variables, e.g., virus titers. In addition, the model predicts the dynamics of cell subpopulations (uninfected, DIP-only infected, STV-only infected, and co-infected cells).

The canine cell line MDCK.SUS2 (through contact with Prof. Klaus Scharfenberg, University of Applied Sciences Emden-Leer, Germany) was cultivated in chemically defined Smif8 medium (Gibco, Thermo Fischer Scientific, USA), supplemented with glutamine, and pyruvate (both 4 mM final concentration, Sigma, USA). MDCK.SUS2 cells were grown in shake flasks and passaged as described before (Lohr et al., 2010) .

Influenza A/Puerto Rico/8/34 virus seed containing DIPs with a deletion in S1, i.e., delS1(1), was generated by reverse genetics using an 8+1 plasmid-system (Hoffmann et al., 2000; Duhaut and Dimmock, 2003) . This virus seed will be referred to as A/PR/8/34-delS1(1). Therefore, S1 RNA was isolated from influenza A/Puerto Rico/8/34 (National Institute for Biological Standards and Control (NIBSC), No. 06/114) and the respective cDNA was cloned into the pHW2000 vector provided by Erich Hoffmann and Robert G. Webster from St. Jude Children's Research Hospital (Memphis, TN, USA) (Hoffmann et al., 2000) , resulting in the plasmid pHW-S1. The plasmid carrying the defective S1 sequence pHW-A/PR/8/34-delS1(1), previously described by Dimmock et al. (2008) , was obtained by cloning the respective sequence into the pHW2000 vector. In addition, pHW plasmids carrying FL segments 2-8 were used (also provided by Erich Hoffmann and Robert G. Webster).

One day before transfection, 5·10 5 HEK-293T cells were seeded into 35 mm dishes. Prior to infection, cells were washed with PBS and 3 mL Opti-MEM (Gibco) were added. Transfection was performed simultaneously with all nine plasmids, 280 ng each, using Lipofectamine LTX & PLUS Reagent (Life Technologies) according to the manufacturer's instructions (5 µL Lipofectamine LTX per dish). To increase the amount of virus particles, 5·10 5 adherent MDCK cells were added 7 h post-transfection. After 24 h at 37 • C and 5% CO 2 , cells were washed with PBS and medium was replaced with DMEM (Gibco) containing 5 Units/mL trypsin (Gibco, #27250-018, sterile-filtered stock solution prepared in PBS with 500 U/mL and stored at −20 • C). Subsequently, the cells were incubated at 37 • C for additional 72 h. As a result, a virus seed containing A/PR/8/34-delS1(1) and STV, with a TCID 50 titer of 5.6·10 5 virions/mL and an HA titer of 1.91 log 10 (HA Units/100 µL) was obtained. Note, that segment-specific reverse transcription-quantitative PCR (qPCR) to determine A/PR/8/34-delS1(1) copy numbers in virus seeds is biased since it is contaminated with the plasmid carrying the DI S1 sequence, pHW-A/PR/8/34-delS1(1). For low multiplicity of infection (MOI) cultivations in continuous cultures, this is not relevant as plasmids are out-diluted (see below).

In a next step, the virus seed for infection of suspension MDCK cells in bioreactors was generated. Therefore, the A/PR/8/34-delS1(1) virus seed was passaged once in suspension MDCK.SUS2 cells with an MOI of 0.1. The virus was harvested 40 h post infection (p.i.), clarified by centrifugation (1,000 g) and the supernatant was aliquoted. The resulting virus bank had an HA titer of 2.36 log 10 (HA Units/100 µL), a TCID 50 titer of 6.76·10 7 virions/mL, a FL S1 content of 9.7·10 9 copies/mL, and a DI S1 (A/PR/8/34-delS1(1)) content of 2.9·10 8 copies/mL. Additionally, virus seeds were probed for remaining plasmids after reverse genetic preparation by qPCR, which could bias reverse transcription-qPCR data of the FL and DI S1 measurements. Quantitative PCR data showed, that initial plasmid contamination was 17.6% for A/PR/8/34-delS1(1) and 0.8% for FL S1. However, from zero h p.i. on the plasmid contamination was not detectable any longer, since the virus preparation was diluted due to the low MOI applied for infection (MOI 0.1). All experiments were performed in laboratories with a biological safety level 2 (BSL 2) certification following the respective safety regulations.

A continuous bioreactor system consisting of three stirred tank bioreactors (STR, Dasgip) was used (Figure 1 ). The first 1.5 L STR (with head space capacity for 1700 mL working volume) was used for cell propagation (CB), and the other two 0.5 L STR were run in parallel and used for virus propagation (VB1 and VB2). After inoculation with MDCK.SUS2 cells at 1.4·10 6 viable cells/mL, the CB was operated in batch mode the first 73 h in 1700 mL working volume (wv). Simultaneously, VB1 and VB2 were inoculated with 1.2·10 6 viable cells/mL and grown in batch mode in 320 mL wv and 520 mL wv, respectively. Working volumes were chosen to achieve RTs of 22 and 36 h in VB1 and VB2, respectively, using the flow rates (F) described in Figure 1 (RT = wv/F). The choice of 22 h RT was motivated by similar experiments performed previously by our group . The 36 h RT was selected based on scouting experiments performed in shake flasks and preliminary mathematical simulations (not shown). The CB was maintained at 1700 mL wv. Cultivations parameters were 37 • C, pH 7.1, and a stirring speed of 130 rpm. Aeration was controlled to 30% dissolved oxygen partial pressure by pulsed addition with a mixture of air, oxygen and nitrogen through a dip tube. For infection, the DIP-containing virus seed (A/PR/8/34-delS1(1)) was added to the VB1 and VB2 at an MOI of 0.1 based on the viable cell count and the TCID 50 titer of the virus seed at 50 h of culture. Additionally, the virus inoculum was supplemented with 1:100 ratio of trypsin (volume to culture volume). To avoid a fast wash-out of the virus seed, continuous mode was initiated at 23.4 h p.i. with the flow rates depicted in Figure 1 . During the run, trypsin (0.5 Units/L) was present in the feed medium of the virus bioreactors. Feed media of all three reactors were provided in 5 L bottles chilled at 0-4 • C; only the feed medium of the cell bioreactor had to be refilled during the run-time. Samples were taken twice a day from VB1 and VB2 and once a day from CB. About every 12 h, virus harvests reservoirs were stored at−20 • C until further analysis. The experiment was terminated 20 days p.i. The average cell concentration input for VB1 and VB2 was 1.13·10 6 cells/mL as determined from the average viable cell count in CB with respect to STR working volumes and feeding rates. RTs were determined from the average volume and the average flow rate at the outlet of both STR over the infection phase.

Viable cell concentrations were determined using a ViCellXR (Beckman Coulter) and virus production was monitored by a hemagglutination (HA) assay (Kalbfuss et al., 2008 ) and a TCID 50 assay (Genzel and Reichl, 2007) . The maximum standard deviation of the HA assay was ± 0.15 log 10 (HA Units/100 µL) and the dilution error of the TCID 50 assay was ± 0.3 log 10 (Genzel et al., 2014) .

Furthermore, we determined the concentration of total virus particles C V in the supernatant based on the HA values using the following equation, C V = C Ery · 10 (log 10 HAU/100 µL) ,

where C Ery denotes the concentration of chicken erythrocyte solution added to the assay (2 × 10 7 cells/mL).

To analyze viral genomes, bioreactor samples were centrifuged for 5 min at 300 g and viral RNA was isolated from supernatants using the NucleoSpin RNA Virus kit (Macherey-Nagel) according to the manufacturer's instructions. Reverse transcription of isolated RNA to cDNA and segment-specific amplification of IAV genomes was performed as described previously (Frensing et al., 2014) . Reverse transcription-PCR products were directly analyzed on a 1% agarose gel using electrophoresis (see Data Sheet 1; Figure S4 ).

Transcription-qPCR for A/PR/8/34-delS1(1) and FL S1 Quantification

Absolute viral RNA (vRNA) copy numbers were determined as described previously (Wasik et al., 2018) . In brief, 10-fold series dilutions of the corresponding vRNA reference standards and RNA samples were reverse transcribed with the tagged primer Seg-1-tagRT-for (ATTTAGGTGACACTATAGAAGCGAGC-GAAAGCAGGTCAATTATATTC). Subsequently, a qPCR was performed using the Rotor-Gene SYBR Green PCR Kit (Qiagen) following the manufacturer's recommendations and the primer pairs realtime-rev (GGAATCCCCTCAGTCTTC) and vRNA-tagRealtime-for (ATTTAGGTGACACTATAGAAGCG) for quantification of A/PR/8/34-delS1(1) and the primer pairs FL1-realtime-rev (CATTTCATCCTAAGTGCTGG) and vRNA-tagRealtime-for for quantification of FL S1. Viral RNA copy numbers were calculated based on the vRNA reference standards with linear regression. The lowest concentrations, which allowed quantification, were 2.2·10 6 copies/mL for A/PR/8/34-delS1(1) and 3.8·10 6 copies/mL for FL S1, respectively (Wasik et al., 2018) . The relative standard deviation for determining copy numbers by qPCR was 23 and 27% for A/PR/8/34-delS1(1) and FL S1, respectively. Quantification of contaminating plasmids was performed by dilution series of the corresponding plasmid as described above, but without the reverse transcription step. The plasmid pHW-S1 was quantified with the primer pair FL1-realtime-rev and pHW-f (CTCACTATAGGGAGACCC). The plasmid pHW-A/PR/8/34-delS1(1) was quantified with the primer pair realtime-rev and pHW-f.

Since number of genome copies do not directly translate into numbers of virus particles, we adjusted the qPCR measurements of A/PR/8/34-delS1(1) and FL S1. For this, we assumed that the sum of A/PR/8/34-delS1(1)-containing virions and the FL S1-containing virions denotes the maximum number of virions present in a sample, which should equal the concentration of total virus particles C V . Based on C V , we calculated the concentration of virions that contain either A/PR/8/34-delS1(1) or FL S1 using Equations (2) and (3), respectively.

Furthermore, a differentiation between infectious FL S1containing virions (V S ) and non-infectious FL S1-containing virions (V d ) is made. Since we know the number of V S , i.e., the TCID 50 titer, we can easily determine the number of noninfectious FL S1-containing virions by solving Equation (3) for V d .

Based on quantitative data available from reverse transcription-qPCR for S1 encoding PB2 of IAV that was established recently by our group, the segregated mathematical model describing this continuous virus production system established by Frensing et al. (2013) was modified. The extended model version describes explicitly the dynamics of replication-incompetent virions (DIPs) containing a deletion in S1 (V ddi ) as described above (A/PR/8/34-delS1(1), see Materials and Methods) in addition to noninfectious virions (V d ) and infectious virions (V s ) containing the FL S1. As another modification, the infection of uninfected target cells (T) is considered separately for V s and V ddi to account FIGURE 1 | Overview of the bioreactor setup for parallel continuous influenza A virus propagation in two vessels. MDCK suspension cells were grown in a cell bioreactor (CB) feeding two virus production vessels (VB1 and VB2) operated at a residence time of 22 and 36 h, respectively. At time of infection, the suspension MDCK cell-adapted virus seed containing A/PR/8/34-delS1(1) and FL standard virus (STV) was added to VB1 and VB2 at a multiplicity of infection of 0.1. Subsequently, cells were constantly fed into both virus bioreactors (F, feeding rate). Trypsin was added to the fresh medium reservoir of VB1 and VB2. All green components refer to CB, all red components to the VBs; CB and VBs are connected via the purple tubing.

for DIP entry with subsequent DIP replication in case of a co-infection.

Where µ denotes the specific cell growth rate, and kvi and kvidi are the specific virus infection rates for infectious STVs and DIPs, respectively. The last term in Equation (4) accounts for the continuous feed of cells with concentration T in at dilution rate D, which was set to adjust the two different RTs for both virus reactors (see Table 1 ). With respect to the average concentration of cells observed in CB, we choose T in to be independent of time (data not shown). Ideal mixing is assumed for all vessels. The population of infected cells is subdivided into cells infected with infectious STVs (I s ), DIPs (I d ), and both (I c ).

The first term in Equations (5) and (6) accounts for the infection of target cells by infectious STVs or DIPs, respectively. Furthermore, the co-infection of I s and I d by DIPs and infectious STVs, respectively, yields co-infected cells I c in Equation (7). Antiviral mechanisms, such as the interferon-mediated innate immune response, and virus-induced cell death can be triggered by the presence of intracellular viral RNAs. In our experiments, the uptake of a high number of DIPs (10 3 -10 4 DIPs per cell) results in a high number of intracellular viral RNAs, comparable to levels reached during a conventional infection (e.g., Frensing et al., 2014) . Therefore, and in contrast to Frensing et al. (2013) we assume that DIP-only infected cells (I d ) do not continue to grow, but shut-off essential pathways for cell division, similar to the other infected cell populations I s and I c and, thus, die due to virus-induced apoptosis with the specific rate kcdv. Note, that Cane and colleagues have shown that DIP-only infected MDCK cells can continue to grow and give rise to DIP-infected daughter cells (Cane et al., 1987) . However, the experimental conditions applied in their study, i.e., the use of UV-irradiated virus seed, passaging of cells in a virus-free culture and a culture time of 5-10 days between passages, cannot be compared to the cultivation conditions of our system. The dynamics of infectious STVs (V s ), DIPs (V ddi ), and noninfectious virions containing a FL S1 (V d ) are described as

Similar to Frensing et al. (2013) , we assume that STV-infected cells (I s ) produce infectious STVs (V s ) with the specific rate µvi and also have the potential to release DIPs (V ddi ) with the specific rate µvddi S . Although in our analysis µvddi S is close to zero (see Table 1 ), the latter should not be ignored to allow for de novo generation of DIPs in case a DIP-free virus seed would be used for the infection of bioreactors. Co-infected cells release mainly DIPs containing the deletion in S1 (V ddi ) with the specific rate µvddi C . In addition, both STV-infected and co-infected cells release non-infectious virus particles (V d ) with rates µvd S and µvd C , respectively. Furthermore, we assume that STVs are taken up by uninfected cells and DIPonly infected cells, while DIPs are either infecting uninfected cells or cells already infected by infectious STVs. Finally, we assume that STVs can lose their infectivity with the specific inactivation rate kdvit contributing to the population of noninfectious virions (V d ), while both V ddi and V d deteriorate with the specific lysis rate kdvt. In contrast to the previous model , we neglected superinfection of I s and I c by STVs as well as superinfection of I d and I c by DIPs. To investigate the time course of DIP formation based on reverse transcription-qPCR measurements, the following DIP to STV ratio was determined from experimental data:

where V ddi represent the reverse transcription-qPCR measurement of delS1(1) and V s the infectious virions with FL S1, respectively. In addition, to describe overall cell growth dynamics, the concentration of all cells (Cells total ) in the virus bioreactor was estimated.

Cells total = T + I s + I d + I c

Taken together, the model comprises seven ordinary differential equations. The set of ten parameters ( Table 1) was determined by minimizing the least-squares prediction error of the state variables V s , V ddi , V d and Cells total , for which the error of each variable was weighted with its maximum measurement value. Model equations were solved numerically using the CVODE routine from SUNDIALS (Cohen and Hindmarsh, 1996) on a Linux-based system. Model files and experimental data were handled within the Systems Biology Toolbox 2 (Schmidt and Jirstrand, 2006) for MATLAB (version 8.0.0.783 R2012b). Parameter values were estimated using the global stochastic optimization algorithm fSSm (Egea et al., 2007) . Initial values were selected based on previous parameters determined for IAV replication in animal cells (e.g., Frensing et al., 2013) . The coefficient of variation of parameters was determined using COPASI (Hoops et al., 2006) .

In order to reduce the risk of batch-to-batch variations for controlled experiments under different cultivation regimes, we established a parallel continuous production process for IAV propagated in MDCK suspension cells. In the set-up implemented, one cell bioreactor was used to feed two virus vessels (Figure 1) . As a starting point, we investigated the impact of RT (22 and 36 h) on the accumulation of DIPs and their impact on viral titers over a period of 20 days. Based on quantitative information available from qPCR and the mathematical model established, it is possible to describe the dynamics of the various cell populations as well as virus populations, i.e., infectious STVs, non-infectious STVs and replication-incompetent DIPs, and the DIP to STV ratio for both cultivation conditions.

The mathematical model used in the present study is loosely based on a previously published model with modifications as explained in section Materials and Methods. We fitted the parameters of the model to the two sets of experimental data and determined their coefficient of variation (CoV) using Copasi (Table 1) . For RT 22 h, low CoV (≤ 13%) were reached for parameter estimates of the specific growth rates for the different viral subpopulations V ddi and V S , V d , which are released by either co-infected cells I c (µvddi C ) or by STV-infected cells I S (µvi, µvd S ), respectively. Similarly, the CoV of estimates for µvddi C , µvi and µvd S for RT 36 h were ≤25%.

The specific STV infection rate kvi for RT 22 h as well as the specific DIP infection rate kvidi, and the specific apoptosis rate kcdv for both RT 22 and 36 h were estimated with higher CoV values (25% < CoV < 100%). Interestingly, the specific infection rate of STVs kvi for RT 36 h was estimated with a CoV of 15%.

The remaining parameters were estimated with CoV > 100%. In particular, the specific de novo generation rate of DIPs µvddi S had a very high CoV in both experimental scenarios. Since DIPs are present in the seed virus, de novo generation could also be excluded from modeling assumptions and viral dynamics would still show oscillations due to the amplification of DIPs introduced at infection. In contrast, if a DIP-free virus seed would be used to start infection, the oscillating viral dynamics could only be reproduced if de novo generation is accounted for. Thus, we decided to keep this parameter to propose a model that covers more general cases.

The specific production rate of non-infectious FL S1containing virions µvd C could also be neglected, since these particles are most likely released only from STV-infected cells, which is supported by the reasonable CoV values for the specific V d production rate (µvd S ) in both RT 22 and 36 h experiments. In addition, the high CoV values for estimates of the specific virus inactivation and lysis rates (kdvit, kvdt) indicated that these mechanisms can probably be neglected, which we also analyzed in more detail with respect to the different RTs (see section Model reduction).

Overall, key parameter values estimated in this study, such as specific STV infection rate kvi, virus release rates, apoptosis rate kcdv and virus degradation rates, were in the same order of magnitude as determined previously for IAV replication models proposed for adherent MDCK cells (Möhler et al., 2005; Schulze-Horsel et al., 2009; Heldt et al., 2013) .

At first, MDCK suspension cells were seeded and grown in batch mode simultaneously in all three bioreactors CB, VB1 and VB2 (Figure 1) . CB was set to a working volume of 1700 mL and cells were grown in batch mode until a cell concentration of 2.97·10 6 cells/mL (viability 96.7 %) was reached. The infected vessels VB1 and VB2 had a working volume of 320 mL and 520 mL, respectively. VB1 and VB2 were seeded at a similar concentration, however, they reached 1.8·10 6 cells/mL and 1.4·10 6 cells/mL at time of infection, respectively. The infection of VB1 and VB2 took place at 50 h of culture at MOI of 0.1 and left in batch mode for another 23.4 h before initiating the continuous mode (to avoid virus washout). The VB1 and VB2 vessels were operated at an RT of 22 and 36 h, respectively. Those RTs were adjusted using a constant feed of 12 mL/h of cell broth from the CB and of 5.8 mL/h fresh medium into the virus bioreactors. Furthermore (to maintain wv), 17.8 mL/h were harvested from each VBs. The average concentration of target cells transferred from the CB to both VBs T in was 1.13·10 6 cells/mL. Upon parameter estimation, we simulated the cell population dynamics in the virus vessels, which showed oscillations for uninfected target cells and the various infected cell populations for both RT 22 and RT 36 h (Figure 2) .

Although the total cell concentration in VBs remained stable with an average of 1.12·10 6 cells/mL (standard deviation ± 0.30·10 6 cells/mL) for RT 22 and 1.17·10 6 cells/mL (standard deviation ± 0.22·10 6 cells/mL) for RT 36 h, a tendency toward cyclic behavior was observed (Figures 2A,B) . This is linked to the simulated dynamics of the various cell populations caused by virus propagation. As expected, addition of the virus seed causes a fast increase of STV-only infected cells, followed by a strong drop in their concentration and a simultaneous increase of the co-infected cell population through superinfection by DIPs (Figures 2C,D) . The co-infected cell population reaches its maxima at ∼2 days p.i. and 4 days p.i., for RT 22 and 36 h, respectively. Since co-infected cells release mainly DIPs, uninfected target cells fed into the VBs will be infected by DIP only. While the DIP-only infected cell population reaches a peak concentration at ∼8 days p.i. (RT 22 h) and 10 days p.i. (RT 36 h), the population of co-infected cells undergoes virusinduced apoptosis and ceases to a minimum (Figures 2C,D) . However, the number of co-infected cells rises again quickly, since previously DIP-only infected cells are now superinfected by STVs produced by the small sub-population of STV-only infected cells. This behavior is repeated for another 1 to 1.5 cycles within the cultivation time. Thereby, all subpopulations of infected cells reach their peak concentrations repeatedly, which are similar in both VBs and, thus, seem independent of the RT.

Overall, the variation in the measured cell concentrations in the VBs did not follow the oscillating trend described for similar experiments by Frensing et al. (2013) using the avian AGE1.CR cell line infected with IAV (A/Puerto Rico/8/34, MOI 0.025) for a RT of 25 h. Indeed, there are qualitative and quantitative discrepancies between model simulation and measurement of the total cell concentrations. On the one hand, counting of MDCK suspension cells required the addition of trypsin for dissociation of cell aggregates, which occurred occasionally and increased the risk of outliers in cell concentration measurements. On the other hand, our model is not as well-informed on the dynamics of the various infected cell subpopulations since measurements focused on viral dynamics (see following section Viral Dynamics). To better resolve this issue, follow-up studies are planned to investigate in detail the dynamics of the various cell populations using flow cytometry. Ideally, this would not only involve the conventional monitoring of infected cells using IAV-specific antibodies , but the use of fluorescence markers for specific intracellular labeling of DI RNAs, which are currently not available, but under development and will allow to distinguish co-infected from STV-only infected cells.

The reverse transcription-qPCR measurements that enabled monitoring of both the FL S1 and DI S1 (A/PR/8/34-delS1(1)) copy numbers together with the concentrations of the total number of virus particles (HA titer) and TCID 50 titer (Figures 3,  4) , allowed discrimination of the various virus subpopulations.

Using these values, we calculated the concentration of virions containing either FL or DI S1 based on the qPCR measurement given in "copies/mL" to "virions/mL" (see Equations 2 and 3).

Overall, viral titers of FL and DI S1-containing virions showed the same trend for the two RTs tested over the first 10 days of culture (Figure 3) . Maximum concentrations of FL S1-containing virions with 4.0·10 9 virions/mL and 5.6·10 9 virions/mL were reached at ∼1 day p.i. for RT of 22 and 36 h, respectively (Figures 3A,B) . For RT 22 h, titers slowly decreased to about 10 7 virions/mL at ∼10 days p.i. For the higher RT, the decrease in titers of FL S1 virions was delayed compared to RT 22 and reached its minimum of about 10 8 virions/mL at ∼11 days p.i. At that time, the VB with RT 22 h already reached its second peak, followed by a decrease in titers leading to a second minimum at about 16 days p.i. The second minimum for RT 36 h was reached once more about 2 days later. The concentrations of DI S1-containing virions showed an initial delay in cycles of about 4 days compared to their corresponding FL counterparts and reached their first maxima with 7.0·10 9 virions/mL (5 days p.i.) and 8.4·10 9 virions/mL (5 days p.i.) for RT 22 and 36 h, respectively (Figures 3C,D) . The cyclic trend observed in both data sets is described clearly by the model fits. Note, that some quantitative discrepancies between data and model simulation remain, such as underestimation of the FL S1-containing virus titers for various time points (Figures 3A,B) . Although, measured and simulated virus titers show some discrepancies for these individual runs, simulations are mainly within the error range of the assays for HA (about ± 0.15 log) and TCID 50 (about ± 0.3 log). Regarding the error for the number of virions containing either FL or DI S1, it has to be considered that those are derived from both qPCR measurements (relative standard deviation of about 25%) and from HA titers (Equations 2 and 3) . Nevertheless, further investigations (e.g., next-generation deep sequencing) should be performed to elucidate those discrepancies in more detail.

Time courses for infectious virions V s measured by the TCID 50 assay and for the sum of all viral subpopulations determined by the HA assay (V s + V d + V ddi ) also showed pronounced oscillations (Figure 4) . Furthermore, the HA data indicate a trend for an overall decrease in the amplitude of titers toward later cultivation time points for both RTs (Figures 4C,D) . The TCID 50 titers reached their maxima with the initial peaks, while the following peak titers were lower. However, no overall decrease in peak infectious titers was observed (Figures 4A,B) .

Maximum TCID 50 titers were achieved around 3 days p.i. with 5.6·10 7 virions/mL and 2.4·10 8 virions/mL for RT 22 and 36 h, respectively. Most likely, the higher infectious titer for the longer RT of 36 h was related to the reduced wash-out (lower dilution rate) compared to RT 22 h. In total, three cycles were observed for the short RT with a second and a third peak of ∼3·10 6 virions/mL at 12 and 18 days p.i., respectively (Figure 4A) . A similar behavior was observed for RT 36 h, however, only about 2.5 cycles were achieved during the cultivation time ( Figure 4B) . While the TCID 50 dynamics are captured well both quantitatively and qualitatively, simulated and measured HA values deviate to a certain extent (but within the assay error range) for data points after about 10 days p.i. (Figures 4C,D) . In particular, the decreasing trend of peak HA titers is not reproduced by the model (also in case the system is simulated for 90 days p.i., Data Sheet 1; Figure S1 ). Whether the decreasing trend of peak HA titers is an individual characteristic of these particular runs or if the model simulations still lie within the biological variation of these experiments needs to be addressed when more experiments become available. Since the overall goal of this study was to establish and fit a basic model with a minimum number of parameters and simple kinetics, we decided to keep the model structure for now. Likely, also more detailed studies regarding the dynamics of the individual cell populations will allow further improvement of the model (see discussion on Cellular dynamics).

As expected, oscillations were also observed in the dynamics of the DIP to STV ratios (Figure 5) . In both cultivations, the ratio reached a maximum of about 10 5 at ∼7 days p.i. These maxima are similar for both RTs and correlate with the lowest TCID 50 titer. We may hypothesize that one infectious STV per 10 5 DIPs is a critical ratio at which DIPs cause self-interference and start to hamper overall virus replication significantly. The impact of too high DIP to STV ratios and related self-interference is supported by a modeling study of our group (Laske et al., 2016) . As a consequence of self-interference, DIP concentrations decrease, reaching a minimum around 11 days p.i., and numbers of infectious STVs are rising again, initiating a new cycle (see also Figures 3, 4) . It would be interesting to test whether this critical ratio can be reproduced in other experiments of continuous two-stage cultivations.

After fitting the present model ("Model 1") to both data sets, we tested if it could still describe the data if certain parameters were removed. First, we set the parameter for inactivation of V s (kdvit) and the lysis rate of virions (kvdt) to zero and re-fitted the model ("Model 2"). For the data set of RT 22 h, the goodness of fit was similar to the full model (Model 1), both visually ( Figure 6 ) and quantitatively as based on the objective function values ( Table 2) . This was expected, since both parameters, kdvit and kvdt, were already close to zero in Model 1. For the second data set with RT 36 h, the re-fitting with Model 2 resulted in a noticeable increase of the objective function value (Table 3 ). In addition, Model 2 was unable to describe the data qualitatively. In particular, the number of cycles in the viral dynamics could not be reproduced any more (Figure 7) . Most likely this points to an important feature of cultivations with long RTs, for which degradation and inactivation processes have to be taken explicitly into account to adequately describe the data. In contrast, in cultivations with short RTs (higher dilution rates), the overall impact of the washout of virions on viral dynamics was probably higher than that of inactivation and degradation processes.

Next, we tested whether it is essential to account for separate specific rates of infection, for either STV (kvi) or DIP infection (kvidi). For this, we used Model 1 and defined one joint infection rate (kvi in "Model 3"). Upon fitting Model 3 to the data of RT 22 h, the overall dynamics were still described well. However, the model overestimated the TCID 50 titer while underestimating the number of FL and DI S1-containing virions as well as the overall number of virions produced (Figure 6) . We observed a similar effect for the RT 36 h data set, combined with a lower number of cycles compared to the fit with Model 1 (Figure 7) . This suggests that two separate infection rates are needed to achieve good agreement with experimental data. Although, visually, goodness of fit with Model 1 in both data sets seems better than that of Model 3, the objective function value has decreased only by 6% or by 19% compared to that of Model 1, for the RT 22 h ( Table 2 ) and RT 36 h ( Table 3) , respectively. At a first glance, this decrease in the objective function value seems counterintuitive, however, since Model 3 still has a very good agreement with a majority of measurements for some of the state variables, e.g., DIP concentration (Figure 7D) , the objective function value might be comparable to that of Model 1. While fitting oscillating data sets, we experienced that the objective function value can be misleading for some parameter regimes and that, for instance, optimizers may also yield "a good quantitative fit" by a straight line through the mean of the experimental data.

Finally, we also tested a fourth version of the model, which consisted of a combination of Model 2 and Model 3, i.e., neglecting virus degradation processes and using a joint infection rate, simultaneously. In case of RT 22 h, the Model 4 followed the same dynamics as Model 3 (Figure 6) . This was expected, since the analysis of Model 2 already showed that degradation processes are not highly relevant for RT 22 h. Thus, Model 3 and Model 4 are mechanistically identical, which also leads to similar parametrizations of these two models ( Table 2) . For RT 36 h, the dynamics of Model 4 were similar to Model 2, showing fewer cycles due to exclusion of virus inactivation and degradation processes (Figure 7) . In addition, Model 4 showed quantitative deviations similar to those of Model 3. Together, this underlines the importance of virus inactivation and degradation processes as well as the separation of DIP and STV infection rates for RT 36 h, which have to be taken into account to capture the experimental data. Most likely the difference in kvi and kvidi is related to the underlying mass action kinetics of the model. Since the DIP concentration is, on average, about two orders of magnitude higher than the STV concentration, the model estimates a lower specific DIP infection rate to yield an adequate amount of DIPonly and co-infected cells, and a high DIP titer in the supernatant. Whether this has any biological background still needs to be addressed experimentally.

Ideally, models including parametrization should allow the prediction of viral dynamics for different RT, e.g., to perform model-based process optimization. However, due to some mechanisms that seem dependent on the RT (explained above) none of the current model-parameter-combinations was able to predict viral dynamics for the other RT and vice versa (see also Data Sheet 1; Figures S2, S3) . Accordingly, we think that the model might still lack certain aspects or kinetics and therefore has room for further model extensions. For instance, including the eclipse phase, i.e., the time delay between virus infection and release of viral progeny, or taking into account the accumulation of other DI RNAs, except for A/PR/8/34-delS1(1), might help to further improve model fits and enable predictions (see Data Sheet 1; Figure S4 ).

In the present study, we introduce a two-stage continuous bioreactor setup for head-to-head comparison of IAV DIP production under different culture conditions. For infection, we used a virus seed generated by reverse genetics, which contained a known DIP, A/PR/8/34-delS1(1), which enabled the monitoring of DI and FL virus replication based on qPCR measurements. We observed oscillations in viral titers, where the frequency was depending on the RT. I.e., an increase in the RT from 22 to 36 h caused a shift in cycles of about 2 days. PCR analysis of IAV segments 1-3 revealed that changes in the RT might also result in the accumulation of different DIP subpopulations in long-term cultures. The mathematical model established allowed to describe the time courses of the various viral and cellular subpopulations. Comparison of model fits to the two data sets obtained suggests that for the longer RT of 36 h, inactivation of infectious STVs and degradation of virions has to be taken into account. Interestingly, the goodness of fit was also affected by the additional assumption that DIPs and STVs infect cells at different rates. Still, we observed some discrepancies between model and experimental data and found that the predictive power of the model needs improvement. This may be related to the fact that the model is still not fully informed, e.g., regarding the dynamics on the different infected cell subpopulations and the de novo synthesis and impact of other DIPs except for A/PR/8/34-delS1(1). In addition, the model might be extended further by accounting for the eclipse phase of virus release. The use of reporter viruses and specific probes for DI RNA staining may help to elucidate those mechanisms in more detail. For parameter estimation, we have used the data set of only one parallel run and are, therefore, unable to evaluate goodness of fit with respect to the biological variation of these cultivations. This will be addressed in the future, when more cultivations performed at similar experimental conditions become available.

In summary, the continuous cultivation system established is an excellent tool for detailed studies regarding DIP replication in animal cells. Based on the high DIP concentrations obtained it also qualifies as a system for production of DIPs for animal trials and influenza antiviral therapy.

All datasets generated for this study are included in the manuscript/Supplementary Files.

FT, TL, MW, MR, YG, and UR contributed conception and design of the study. FT performed the experiments. TL, MR, and UR performed the mathematical analysis. UR wrote the first drafts of the manuscript. FT, TL, MW, YG, and UR wrote sections of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version. 

Technologies for Making New Vaccines

Mechanism of interference by defective-interfering particles of influenza virus: differential reduction of intracellular synthesis of specific polymerase proteins

Spatial-temporal patterns of viral amplification and interference initiated by a single infected cell

High-throughput single-cell kinetics of virus infections in the presence of defective interfering particles

Cell substrates for the production of viral vaccines

Vero cell technology for rapid development of inactivated whole virus vaccines for emerging viral diseases

A system for production of defective interfering particles in the absence of infectious influenza A virus

Intracellular stability of the interfering activity of a defective interfering influenza virus in the absence of virus multiplication

CVODE, a stiff/nonstiff ODE solver in C

From empiricism to rational design: a personal perspective of the evolution of vaccine development

Cloned defective interfering influenza RNA and a possible pan-specific treatment of respiratory virus diseases

Protection of mice from lethal influenza: evidence that defective interfering virus modulates the immune response and not virus multiplication

Cloned defective interfering influenza virus protects ferrets from pandemic 2009 influenza a virus and allows protective immunity to be established

Defective interfering influenza virus RNAs: time to reevaluate their clinical potential as broad-spectrum antivirals?

In vivo antiviral activity: defective interfering virus protects better against virulent Influenza A virus than avirulent virus

Influenza virus protecting RNA: an effective prophylactic and therapeutic antiviral

Defective influenza A virus generated entirely from plasmids: its RNA is expressed in infected mouse lung and modulates disease

A novel broad-spectrum treatment for respiratory virus infections: influenza-based defective interfering virus provides protection against pneumovirus infection in vivo

Scatter search for chemical and bio-process optimization

Defective interfering viruses and their impact on vaccines and viral vectors

Continuous influenza virus production in cell culture shows a periodic accumulation of defective interfering particles

Influenza virus intracellular replication dynamics, release kinetics, and particle morphology during propagation in MDCK cells

Impact of defective interfering particles on virus replication and antiviral host response in cell culture-based influenza vaccine production

Designing cell lines for viral vaccine production: where do we stand?

Vaccine production -state of the art and future needs in upstream processing

Vaccine production: upstream processing with adherent or suspension cell lines

Multiscale modeling of influenza A virus infection supports the development of direct-acting antivirals

A DNA transfection system for generation of influenza A virus from eight plasmids

COPASI-a COmplex PAthway SImulator

Defective Interfering Animal Viruses

Monitoring influenza virus content in vaccine production: precise assays for the quantitation of hemagglutination and neuraminidase activity

DNA vaccines: ready for prime time?

Global update on the susceptibility of human influenza viruses to neuraminidase inhibitors and status of novel antivirals

Modeling the intracellular replication of influenza A virus in the presence of defective interfering RNAs

(In)validating experimentally derived knowledge about influenza A defective interfering particles

A new MDCK suspension line cultivated in a fully defined medium in stirred-tank and wave bioreactor

Mathematical model of influenza a virus production in large-scale microcarrier culture

Defectiveinterfering (DI) RNAs of influenza viruses: origin, structure, expression, and interference

Replication-incompetent influenza A viruses that stably express a foreign gene

Influenza virus resistance to neuraminidase inhibitors

Systems Biology Toolbox for MATLAB: a computational platform for research in systems biology

Infection dynamics and virus-induced apoptosis in cell culture-based influenza vaccine production-Flow cytometry and mathematical modeling

Defective interfering influenza A virus protects in vivo against disease caused by a heterologous influenza B virus

Novel antiviral drug discovery strategies to tackle drug-resistant mutants of influenza virus strains

A review of the 1918 herald pandemic wave: importance for contemporary pandemic response strategies

Visualizing infection spread: dualcolor fluorescent reporting of virus-host interactions

Chapter five -modified vaccinia virus ankara: history, value in basic research, and current perspectives for vaccine development

Propagation of the PR8 strain of influenza A virus in chick embryos. III. Properties of the incomplete virus produced in serial passages of undiluted virus

Cell culture-based production of defective interfering particles for influenza antiviral therapy

Generation of a purely clonal defective interfering influenza virus

Dual-functional peptide with defective interfering genes effectively protects mice against avian and seasonal influenza

The authors would like to thank Nancy Wynserski for excellent technical assistance.

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fbioe. 2019.00275/full#supplementary-material