key: cord-0022176-8ll3mnci authors: van der Zanden, Tjitske M.; Mooij, Miriam G.; Vet, Nienke J.; Neubert, Antje; Rascher, Wolfgang; Lagler, Florian B.; Male, Christoph; Grytli, Helene; Halvorsen, Thomas; de Hoog, Matthijs; de Wildt, Saskia N. title: Benefit‐Risk Assessment of Off‐Label Drug Use in Children: The Bravo Framework date: 2021-07-29 journal: Clin Pharmacol Ther DOI: 10.1002/cpt.2336 sha: 119f8e29c5f49de57a8e94ca23685ba98d6eb02f doc_id: 22176 cord_uid: 8ll3mnci A drug is granted a license for use after a thorough assessment of risks and benefits based on high‐quality scientific proof of its efficacy and safety. Many drugs that are relevant to children are not licensed for use in this population implying that a thorough assessment of risks and benefits in the pediatric population has not been made at all, implying a negative risk‐benefit balance in children, or implying insufficient information to establish the risk‐benefit balance. Use of drugs without positive assessment of risks and benefits exposes children to potential lack of efficacy, unknown toxicity, and harm. To aid guideline committees and individual prescribers, we here present a tutorial of the Benefit and Risk Assessment for Off‐label use (BRAvO) decision framework. This pragmatic framework offers a structured assessment of benefits and risks of off‐label drug use, including a clinical pharmacological based approach to age‐appropriate dose selection. As proof of concept and to illustrate the practical use, we have applied the framework to assess benefits and risks of off‐label use of ondansetron for gastroenteritis‐induced nausea and vomiting. The framework could also guide decisions on off‐label use in other special populations (e.g., pregnant women, elderly, obese, or critically ill patients) where off‐label drug use is frequent, thereby contributing to effective and safe pharmacotherapy. Many drugs that are relevant to children are not licensed for use in children. Consequently, off-label use is frequent in the field of pediatrics, with great variation in reported percentages depending on methodology used and population studied up to 60% (mean 38%) of all hospital prescriptions in children 0-18 years according to a recent EU report 1 and confirmed by recent systematic reviews by Balan 2 and Allen. 3 Off-label use is defined as the prescription of drugs for indications, age groups, dosages, formulations, or routes of administration different from those that have been formally approved by relevant authorities and subsequently listed in the summary of product characteristics (SmPC) or Product Information Leaflet. [4] [5] [6] [7] [8] The European Medicines Agency (EMA) concludes that off-label and unlicensed use of medicines in children leads to an increased incidence and severity of adverse drug reactions (ADRs). 9 A study in adult patients showed that off-label use without strong scientific evidence, defined as at least one randomized controlled trial of good quality, was associated with a > 50% increase in adverse events compared to on-label use. In contrast, off-label use with strong scientific evidence showed a similar risk for adverse events as on-label use. 10 The EMA report also concluded that lack of proper labeling and the consequent lack of dosing recommendations lead to medication errors, including dosing errors: a scenario EMA labeled "evidence of harm." 9 Thus, off-label use of drugs exposes children to potential lack of efficacy, unknown toxicity, and therefore harm. 11 Although offlabel use is neither illegal nor inappropriate nor experimental in most cases, 6, 12 it is often done in absence of a thorough analysis of benefits and risks. Notably, appropriate dose selection is often missing. This leads to an incomplete assessment of benefits and risks, potentially overestimating the benefits and underestimating the risks. It has been said that off-label prescription is in fact a clinical trial, with only one patient enrolled and a unknown outcome. The European Academy of Pediatrics and the European society for Developmental Perinatal and Pediatric Pharmacology recommends in a recent joint position statement 13 that off-label prescribing for children is considered to be rational and clinically appropriate if the benefits outweigh the risks. However, specific guidance on how to assess the benefits and risks of off-label use is lacking. The applicability of the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology 14 used in evidence based medicine to assess benefits and risks of an intervention is limited as the GRADE methodology does not sufficiently address important topics from regulatory science. 15 Critical missing topics include appropriate dose selection, assessment of suitable drug formulation availability, and safety. 16, 17 Particular attention to dose selection is needed, as the age-specific changes in pharmacokinetics (PKs) and pharmacodynamics (PDs) could significantly impact the dose required to reach the target exposure. 18 To overcome the inherent challenges of off-label prescribing in children, we developed a practical framework for healthcare professionals and guideline working groups: Benefit and Risk Assessment for Off-label use (BRAvO). This framework describes whether and how to perform a benefit-risk analysis for off-label pediatric prescribing, including dose selection to ultimately optimize drug efficacy and safety. In this tutorial we present the framework and demonstrate its practical application through an example: offlabel use of ondansetron for gastroenteritis-induced nausea and vomiting. To structure the of Benefits and Risks Assessment for Off-label use (BRAvO) and to balance decisions on pediatric off-label use, we propose a strategy based on the decision making guide "Problem, Objectives, Alternatives, Consequences, Trade-offs, Uncertainty, Risk attitudes, and Linked decisions" (PrOACT-URL). 19 This framework has a generic, qualitative decision making approach, that can be used to structure balanced decisions of any kind: whether deciding on the purchase of a good drug or the use of a drug. Within this framework, balancing the benefits against risks of a decision is a matter of systematically identifying and comparing the favorable and unfavorable effects following the eight steps of the framework. The EMA Benefit-Risk Methodology Review project has adjusted the PrOACT-URL framework for the assessment of benefits and risks of drugs. 20, 21 Here, we have adopted the EMA framework and added descriptions specifically aimed at the assessment of the benefits and risks of pediatric off-label use for individual drugs (Table S1 ). In addition, we transformed the description to a set of key questions ( Table 1) . Answering these questions assures a structured approach to identify the benefits and risks related to efficacy, safety, and dose of the intended off-label use. Last, we added additional guidance on potential information sources to assist in answering these key questions ( Table 1) . As a proof of concept, the BRAvO framework was applied in collaboration with the Dutch Pediatric Formulary (DPF) 22 to demonstrate the assessments of benefits and risks of ondansetron for gastroenteritis-induced nausea and vomiting in the pediatric population. A prerequisite for the use of off-label drugs in children, is that there should be a specific and unmet medical need. An unmet medical need for off-label use is defined as having a medical condition that requires drug treatment for which no licensed drugs are available, or for which treatment with licensed drugs is suboptimal or not suitable (i.e., the off-label drug treatment is the best treatment option for the child). 5,23-25 Importantly, the medical need for offlabel use is by no means limited to treatment of life-threatening or severe conditions, as suggested by Dooms et al., 25 as in pediatrics, also many common, mild diseases lack licensed treatment options. The unmet medical need is established by assessing the intended off-label use ("the problem"), in comparison with alternative treatment options, both licensed and off-label ("the alternatives"). 3 The prerequisite to compare other licensed treatment options does not entail that a drug should only be used off-label when other licensed treatment options have failed or licensed options are unavailable. It only ensures that all treatment options are given due consideration. Without a clear unmet medical need, the off-label use should be rejected. Because the alternatives are considered as part of the medical need, we chose to bring the selection of alternatives forward as part of defining and framing the problem, whereas the original PrOACT-URL adds the alternatives in step three, after establishing the objectives. The PrOACT-URL framework is aimed at balancing alternative options by predefined criteria to ultimately select the best choice. The EMA also uses the PrOACT-URL to compare alternatives: high-dose vs. low-dose, or active drug vs. comparator. BRAvO differs as it is solely used to ascertain the medical need, to systematically identify, and to balance the benefits and risks of a single drug for off-label use in the pediatric population. It is not aimed to provide a choice of one drug over the other. In addition, this step investigates if benefit-risk assessments of the intended off-label use, including age-appropriate dosing recommendations, are already available as part of peer-reviewed clinical guidelines or referenced drug handbooks. Only when the unmet medical need is evident and such guidelines are lacking, individual physicians should proceed to the next steps of the framework ( Figure 1 ). Ondansetron is increasingly used at emergency departments for gastroenteritis-induced nausea and vomiting in children, but without a proper evaluation of risks and benefits. Physicians requested the addition of this indication to the DPF. Current standard of care for gastroenteritis-induced nausea and vomiting is supportive care with oral rehydration. 26 Oral rehydration is not always well-tolerated leading to dehydration and consequently to hospitalization for oral rehydration by means of a feeding tube or intravenous rehydration. Pharmacological treatment options for children with severe nausea and vomiting caused by gastroenteritis are limited as metoclopramide and domperidone are no longer recommended for this indication due to serious extrapyramidal side effects. 27, 28 Other anti-emetic drugs, such as aprepitant, fosaprepitant, or granisetron, are also not licensed for this indication and are far less studied for gastroenteritis-induced nausea and vomiting in the pediatric population. Pharmacological intervention to prevent dehydration and hospital admission is needed. The European Society for Paediatric Gastroenterology Hepatology and Nutrition (ESPGHAN) guideline of 2014 concluded that ondansetron may be effective in young children with vomiting related to acute gastroenteritis, but safety had not been established. They also concluded that the use of other anti-emetics was not supported by evidence. 30 The Dutch General practitioners' guideline of 2016 recommends against the use of any medication, due to the lack of good qualitative and sufficient evidence. 26 A search on PubMed in 2019 reveals that new literature has been published after the publication of the ESPHGAN and general practitioners' guidelines, whereas an updated assessment of risks and benefits is not available; hence it is concluded that proceeding to the next steps of the framework is indicated. The objectives specify the information that is needed to make an informed decision. The BRAvO framework has established three information domains with key questions that need to be answered ( Table 1) . What is known about the intended use in other populations?. To start, it should be verified if the drug of interest is already used in adults or other pediatric age groups for the same or similar indications. When confirmative, the similarities and differences -If evidence is weak, why are benefits assumed and risks assumed to be acceptable the intended pediatric population? Risk tolerance -Has the benefit-risk assessment been made/approved by a multidisciplinary team? -What is the opinion of multidisciplinary team on results of the benefit-risk analysis? -To what extent are the team members biased or do they have conflicts of interest? -What other considerations are taken into account? -How does the risk-tolerance of team members affect the balance? Linked decisions -Is the decision consistent with similar previous decisions or future decisions on the same topic? -Is explicit informed consent from parents and patient required? -Have the expected benefits and risks, the literature assessed, the considerations and conclusions with respect to the benefit-risk ratio been documented and archived for future retrieval? -Consider publication to allow other healthcare professionals to learn from the assessment BRAvO, benefit-risk assessment for off-label use; MEB, Medicines Evaluation Board; PD, pharmacodynamic; PK, pharmacokinetic; SmPC, summary of product characteristics. TUTORIAL between these populations should be investigated. Topics of interest are similarities or differences in disease progression (pathophysiology, natural course of the disease, and maturity of target organs), in response to drug intervention (i.e., maturity of receptors and enzyme systems), and in the exposure-response relationship. If these aspects are sufficiently similar, effectiveness in children may be assumed based on adult data or other pediatric age groups. 31, 32 If the drug is used for a different indication, the assumed mechanism of action should be considered to verify if efficacy is plausible. Finally, whether a drug is already used in other populations or not, original literature on the efficacy of the use in the intended population should be reviewed. Importantly, one should question whether an observed lack of efficacy in clinical trials can be explained by inappropriate dosing (see The right dose). Preferably, efficacy is evaluated based on predefined outcome criteria and cutoffs. Studies show that off-label drug use is associated with an increased frequency and severity of adverse events 7, 9, [33] [34] [35] [36] Therefore, evidence for potential harm of the drug used in a pediatric population at the selected dose should be searched and assessed. The relationship between dose and adverse events should be considered. Risks are not limited to the toxic properties of the drug, as risks may also be associated with the context in which the drug is used, for example, use in emergency situations, and under close monitoring in a clinic or in an outpatient setting. In addition, risks or adverse events can be prevented or minimized by taking precautionary measures: laboratory or diagnostic assessments, including therapeutic drug monitoring, (pharmacological) supportive care, development of stopping rules, or measures to identify adverse events at an early stage. The risks that remain after installment of precautionary measures are referred to as residual risks. The residual risks should be acceptable. Again, also safety is preferably evaluated based on predefined criteria for unacceptable risk and cutoffs. The right dose is the dose that leads to optimal efficacy and has no unacceptable dose-related toxicity. Knowledge on the doseexposure-response relationship can aid in establishing a rational dose for the intended off-label use. First, it should be established if the clinical response is related to a target concentration of the drug or to PD parameters. Second, the dose needed to reach this target should be investigated. Third, toxic plasma concentrations and the dose that results in toxic concentrations should be explored. Comparing PK parameters of the intended population with those of a well-established population enables critical appraisal of dose-exposure relationship in different populations. Furthermore, knowledge on target concentrations and PK parameters in the target population can be used to estimate an appropriate dose ormore refined-to simulate dosing regimens using PK modeling software. Special attention should be given to the formulation of the drug: can the right dose in each age group be attained with available formulations or are proper age-appropriate formulations lacking? Furthermore, these formulations should not be contraindicated as a result of toxic excipients. When a drug is already licensed in a pediatric population and extrapolation of efficacy is feasible based on mechanism of action, the dose determination step of the BRAvO framework can be skipped as the appropriate dose is readily available. However, when a dose is not readily available due attention should be given to this step to assure that appropriate selection to attain efficacy and to prevent toxicity in the intended population is achieved. The general objectives for efficacy, safety, and selection of the right dose apply to assess the off-label use of ondansetron in gastroenteritisinduced nausea and vomiting. The consequences provide a detailed and referenced summary of the information that is gathered to meet the objectives. Furthermore, it specifies the benefits and risks resulting from the objectives. Selected outcome criteria were improved rehydration and prevention of hospitalization. No cutoffs were defined. Ondansetron is used in children with CINV or postoperative nausea and vomiting (PONV). 29 Ondansetron is not licensed to treat gastroenteritis-induced nausea and vomiting in any age group. Use in adults is only currently investigated based on promising results in pediatric studies. Ondansetron is a selective 5-HT3-receptor antagonist, which blocks serotonin, both peripherally on vagal nerve terminals and centrally in the chemoreceptor trigger zone. 37 The vomiting reflex that occurs after cytostatic drugs or radiotherapy is probably caused by the release of serotonin. By blocking 5HT3 receptors in the gastrointestinal tract, and the central and peripheral nervous systems, ondansetron counteracts this vomiting reflex. The exact mechanism of action in PONV is unknown, but may be based on a similar principle. 38 Rotavirus also stimulates the release of serotonin (5-HT), 39 so it is likely that blocking 5HT3 receptors in the gastrointestinal tract also counteracts the vomiting reflex in gastroenteritis. Therefore, extrapolation of data, including dose, in CINV and PONV is possible. Three meta analyses (Fedorowicz et [40] [41] [42] The overall conclusion based on these meta-analyses is that the effect of ondansetron on the cessation of vomiting is limited, but treatment with ondansetron compared with placebo reduced the risk of failure of oral rehydration therapy, increased the intake of oral rehydration solution in 1 hour and 4 hours, reduced the risk of hospitalization, and reduced the need for intravenous rehydration. Ondansetron can improve the efficacy of oral rehydration therapy. An observational retrospective study by Freedman using real-world data concludes that the preventive effect on hospital admission and use for i.v. rehydration is limited. 43 This may be caused by suboptimal implementation of the use of ondansetron in the bundle of care delivered in the emergency department. 44 Selected outcome criterion was a better safety profile than metoclopramide and domperidone. The 5-HT3 receptors are also involved in cardiovascular regulation thus playing a role in alteration of the QT interval. 45 Ondansetron is cleared hepatically. The safety profile of ondansetron in the pediatric population is wellestablished for use in CINV or PONV and is similar to that observed in adults. 29 The SmPC reports the following side effects: very common (> 10%): headache. Serotonin syndrome in children has been reported after accidental oral overdoses of ondansetron (estimated excess intake of 4 mg/kg) in young children of age from 12 months to 2 years. 29 Case reports by Nathan and McKenzie describe prolongation of the QT interval leading to heart rhythm disturbances in children with a congenital long QT interval syndrome. [45] [46] [47] Trivedi et al. confirms the occurrence of QT-prolongation in children after a dose of ondansetron. 48 A case report by Brenner 45 describes two fatal cases after use of ondansetron: one child with congenital cardiomyopathy and one previously healthy child in who hyponatremia and hypopotassemia as a result of gastroenteritis in addition to the use of ondansetron were suspected to cause the proarrhythmic state. A study by Hagborn indicates that ondansetron reduced diarrhea episodes, 49 which is in contrast to the SmPC that indicates diarrhea as a rare side effect. 29 Gener reports a case on malignant hyperthermia related to ondansetron. 50 Ondansetron causes QT interval prolongation which is dose dependent, doses > 32 mg/dose are more likely to cause QT prolongation. 29 The case reports on congenital QTc prolongation describe the adverse effects of ondansetron on the QTc interval to occur after a second dose. Use of ondansetron is not recommended in patients with a congenital prolonged long QT syndrome or in children with cardiomyopathy, or when combined with other drugs that prolong the QT interval. The risk for an unrecognized pre-existing QT prolongation can be mitigated by performing an electrocardiogram (ECG) prior to treatment. Especially in patients with comedication with effect on QT prolongation or for patients with acute cardiac arrest in their family history, an ECG should be performed prior to the start of treatment. Use in moderate to severe hepatic impairment is contraindicated. 29 The occurrence of severe dermal reactions cannot be mitigated by preventive measures. A pediatric dose has been established by the license for PONV and CINV. Extrapolation of efficacy and dose based on data in PONV and CINV is considered feasible. Nonetheless, as part of this tutorial, we illustrate the assessment of the dose for ondansetron. Ondansetron is cleared by the liver, rather than by renal excretion. Oral availability is ~ 60%. 51 Adults A phase I study in adults has shown that anti-emetic efficacy was seen at all dose levels (0.04-0.48 mg/kg) with no significant differences in efficacy between dose levels. In addition, no dose limiting toxicity was observed. The number and intensity of adverse events, of which headache was the most common, appeared to increase at the 0.48 mg/kg dose level. 52 Plasma concentrations for efficacy were not established. 51 The appropriate dose for children ≥ 1-6 months is 0.1 mg/kg/ dose, with a maximum of 8 mg/dose. For children ≥6 months, the 0.15 mg/kg/dose should be used. 53 Spahr Schopfer et al. conclude that a dose of 0.1 mg/kg in children 3-12 years old results in PK parameters of ondansetron predictable and similar to those in adults. 54 65 Administering the recommended ondansetron dose of 0.1 mg/kg would imply an ethanol dose of 0.075 mg/ kg/dose, which is considered safe to use. Furthermore, the syrup contains < 1 mmol sodium 23 mg per 5 mL of syrup, which is essentially "sodium-free." Ondansetron improves success of oral rehydration therapy and prevents hospitalization. 42 Appropriate dose selection is possible. Infants up to 3 months of age have a greater risk for toxicity as exposure to ondansetron may be increased due to reduced clearance in this population. 53 At the same time, when correcting based on reduced clearance only, these children are at risk for underexposure due to the higher Vd. Dose-dependent prolongation of the QT interval may occur especially in children with congenital long QT interval syndrome. Prolongation of the QT interval is dose dependent. 29 Use of ondansetron has a limited effect on cessation of vomiting. 42 The trade-offs subsequently assess the balance between treatment risks and benefits. It constitutes an explicit judgment about the favorable and unfavorable effects. The risk-benefit assessment is considered positive when the benefits are clinically relevant and the residual risks are acceptable. If the risks outweigh the benefits (i.e., evidence suggests that the off-label use is ineffective or unsafe (high residual risk)), the (off-label) drug should not be used ( Figure 1 ). It should be noticed that the risk-benefit balance may only be positive for part of the population of interest or when certain conditions are met. In addition, in light of the identified risks and benefits, one should reconsider the alternative drugs: are they still considered unsuitable? The assessment has been reviewed by the multidisciplinary editorial board of the DPF consisting of pediatricians, pharmacists, and clinical pharmacologists. The multidisciplinary board discussed if pre-emptive ECG testing is indicated for use in gastroenteritis. Daily practice is quite pragmatic: parents are asked for their family history of cardiac events and comedications. If negative, ondansetron is prescribed without ECG. Metoclopramide and domperidone are contraindicated due to the high risk of extrapyramidal symptoms, especially in infants. Hence, domperidone and metoclopramide are still considered to be unsuitable. Ondansetron is considered a safer alternative. The benefits only outweigh the risks when oral rehydration therapy alone is insufficient and the child is at risk of dehydration. Ondansetron should not be used to treat nausea and vomiting symptoms without (imminent) dehydration. The uncertainty reports on the level of evidence and indicates the extent to which one can be confident that the off-label use will do more good than harm. The assessment should review the quality of the studies, the consistency of results across studies, and the fit with the population of interest ("directness"). Many advocate that use of an off-label drug is only justified when based on high quality evidence. 6, 25, [66] [67] [68] [69] However, high-quality evidence for pediatric use is scarce, and off-label use without highquality evidence cannot be avoided without seriously limiting treatment options for children, with potential dire consequences. The level of evidence provides information on the quality (or certainty) of the reported study, and hence to what extent one can be confident that the study results are accurate and can be extrapolated. Within this hierarchy, expert opinions and case reports or case series carry a greater uncertainty about the validity and reliability of the study results compared with meta-analyses and randomized controlled trials. A study with a low level of evidence does not mean that the study results are incorrect or overestimated. 70 However, results from such reports should be used with caution as the study results may be challenged by emerging new evidence. It is a common misconception that low level of evidence cannot be used to substantiate strong recommendations. 22 The GRADE 71 has addressed this limitation by adding the direction and strength of a recommendation based on available evidence. This strategy has enabled the appreciation of results with low level of evidence leading to strong recommendations. The applicability of evidence-based medicine complemented with GRADE methodology to assess the benefits and risks of off-label drug use is, however, not sufficient, because evidence-based medicine is primarily aimed at appraising efficacy and safety studies. It does not address how maturation of PK properties, like Vd, renal clearance, and metabolism affect drug exposure and thus efficacy. A correct age-appropriate dose is needed to be able to achieve efficacy. In the absence of clinical efficacy studies, PK data can be used to extrapolate exposure and clinical efficacy from adult to pediatric patients and between pediatric patients of different ages. 72 Furthermore, PK data can be used for physiologically-based PK (PBPK) modeling and simulation, which combines drug-specific properties and physiological properties to model drug disposition and drug action to derive optimal dosing regimens. A recent study by Gastine et al., confirms the need to properly assess and appraise PK/PD studies and proposes a strategy to assess the quality of evidence from PK studies similar to our proposal. 73 Last, clinical experience with the drug should be taken into account. Some drugs are hardly studied, but have been used off-label for many years in clinical practice. In our framework, we propose a grading system based on the principles of evidence-based medicine, extended to include and appreciate pediatric PK studies and clinical experience ( Table 3) . Finally, this step should identify the critical questions that remain unanswered and if the risk-benefit balance ("the trade off ") is affected by any source of the uncertainty. Uncertainty can therefore be considered a risk as well. There are no critical questions that remain unanswered. Malignant hyperthermia is reported in a single case study. 50 However, a board member has serious doubts on the validity and directness of the diagnosis malignant hyperthermia. The authors of the case report suggest that malignant hyperthermia can be plausible based on animal studies. 50 No clinical studies were found linking ondansetron to malignant hyperthermia. This is confirmed by a query among anesthesiologists. The risk tolerance refers to the attitudes and expert opinions of healthcare professionals toward the risk-benefit assessment and how it may influence the outcome of the assessment. As available scientific evidence is complemented with consensus and clinical experience, it is imperative that expert opinions are explicit. Furthermore, attitudes toward the risk-benefit balance, biased opinions, and conflicts of interest should be transparent. The assessment of risk-tolerance is preferably carried out in a multidisciplinary setting to reflect a deeper understanding and reflection on the risk-benefit assessment. It is suggested by the EMA that patients' attitudes toward the assessment of benefits and risks should be taken into consideration in the risk-tolerance step. We are aware that parents' views on the acceptability of risks may differ from the view of a professional. This is accounted for in the linked decisions step. The assessment has been reviewed by the DPF's editorial board. The board concluded that in cases where prolonged nausea, vomiting, and diarrhea leads to (risk of) dehydration, drug treatment can be considered to prevent hospital admission and to improve the success rate of oral rehydration. Vomiting and diarrhea are uncomfortable symptoms for both the child and parent, but do not need treatment in general. Editorial board members do not have conflicts of interest (as author of any of the papers included or as consultant to pharmaceutical industry). Some board members are familiar with using ondansetron for gastroenteritis. QT prolongation is rare and not conceived as a frequent or serious problem in children in daily practice and is sufficiently covered by-pragmatically-assessing family history on cardiac events and other risk factors. Serious side effects are not observed. This may bias their opinion favoring the use of ondansetron. There is a relevant medical need to treat children in whom oral rehydration alone is not successful, in both university hospitals and regular pediatric clinics. The outcome of the risk-benefit assessment could impact future decisions. At the same time, one should reflect on the consistency of this decision with previous similar decisions. Furthermore, the outcome of the risk-benefit assessment could trigger subsequent decisions and recommended actions. Although professionals may conclude that, in general, the benefits outweigh the risks, parents may come to a different conclusion when informed about the benefits and risks and applying these to their child. The American Academy of Pediatrics has a policy statement on off-label use of drugs in children, which recommends that parents and patients need to be informed about benefits and risks of the proposed drug treatment, irrespective of the label of use. 6 If the off-label use is based on sound medical evidence, no additional informed consent beyond what is routinely used in therapeutic decision making is needed. 6, 68, 74 Other experts in the field suggest that the regular clinical care consent procedure should be followed when off-label use is supported by high quality evidence. In absence of high-quality evidence, however, written informed consent should be obtained. 69, 75 Importantly, an overview on the levels of evidence for off-label pediatric use is not available. This prerequisite would imply that pediatricians should obtain written informed consent for the majority of their prescriptions, bearing in mind the rates of off-label drug use ranging from 60% of all hospital prescriptions. 1, 36 In addition, explaining off-label use to parents without causing undue anxiety is challenging. [76] [77] [78] Although time constraints and compromising the physicianpatient relationship may be considered insufficient arguments for not obtaining consent, not informing patients may also compromise adherence and faith. We believe that seeking a written informed consent for every prescription is not warranted and not feasible. Therefore, we propose to exempt physicians from seeking written informed consent in cases where the prescription is based on a positive benefit-risk balance as established in the context of an authoritative guideline or a formulary. If a positive risk-benefit assessment only applies to an individual patient or a small group of patients, the use should be considered as being experimental and the informed decision of parents and patient should be documented explicitly in the patient file, still without the need to document a formal written informed consent. It is highly recommended that professionals contribute to the reporting of information on off-label drug use to avoid duplication of efforts. The benefit-risk assessment should be documented and preferably published for retrieval by peers, for example, as original case reports or as part of a treatment guideline, dosage handbooks, or pediatric drug formularies. In addition, professionals should be stimulated to structurally collect outcomes of off-label use in terms of efficacy and safety, in the electronic health record or disease-specific registries. Next, these data should be become publically available (e.g., preferably in scientific publications). These publications can then serve as a basis of more formal efficacy and safety studies or can guide healthcare professionals in later decisions on off-label use. 4, 79 Special attention should be given to the reporting of adverse events that have not been identified as part of the benefit-risk analyses, particularly to national pharmacovigilance agencies. 7, 12, 25 The assessment has been made for a general pediatric population (not for a single patient) The outcome has been published on the DPF website. As such, an explicit informed consent is not needed. However, parents and patients should be informed about the use and side effects, as the use in gastroenteritis is not covered by the patient leaflet. According to the Dutch Law, prescribers should report adverse events to the national pharmacovigilance center. We have transformed the objectives of BRAvO to a set of key questions. Answering these questions identifies the benefits and risks related to efficacy, safety, and dose of the intended off-label use. To answer these questions, many ready-to-use information sources are available, of which we present examples in the template as well as below. Most national medicines' evaluation boards or centralized evaluation boards, like the EMA, publish authorized product information on their website. Every SmPC has the same content structure: chapters 4.1 and 4.2 providing information on licensed indications and dosing; chapter 4.4 addressing special warnings and precautions, chapter 4.8 listing the side effects; and chapter 5.2 providing information on PK properties of the drug. Every section contains a subsection on special populations. Even when a drug is not licensed for use in the pediatric population, the SmPC or the US Food and Drug Administration (FDA) approved Product Information Leaflet may contain valuable information on PKs and safety. Public databases like PubMed and EMBASE or Drugbank can be searched to retrieve available scientific information on efficacy, safety, and dose in the pediatric population. Using Medical Subject Headings (MeSH) terms for drug name and indication of interest is recommended, as well as using the following MeSH qualifiers "administration and dosage," "pharmacokinetics," "therapeutic use," and "adverse effects". Using the predefined filters on age is helpful in retrieving studies in the age groups of interest. Alternatively, a key-word search can be added for drugs that do not have a MeSH term or to verify if no recent papers are missed. Benefit-risk assessments for the intended off-label use may be readily available as part of a peer-reviewed evidence-based clinical guideline or a referenced drug handbook. Although the benefit-risk analyses of these information sources usually do not address all critical elements of a full benefit-risk analyses, as proposed by the BRAvO framework, such as age-appropriate dose selection and availability of suitable formulations, the multidisciplinary setting and peer-review process are likely to reflect a deeper understanding and reflection on the evidence than what would be feasible for individual healthcare professionals. 68 Despite the limitations, we suggest accepting peer-reviewed evidence-based guidelines as benefit-risk assessments to accept off-label use in the intended population. At the same time, we call for critical evaluation of the proposed drug doses and the availability of a suitable formulation. However, we strongly recommend guideline committees to utilize the BRAvO framework to better guide decisions on the off-label use of drugs. Modeling and simulation may be helpful to determine the appropriate dose when a target range is available. At this time, user friendly platforms for physicians/guideline committees are lacking, but pragmatic approaches are emerging like simulations using published PK and PBPK models. 80, 81 The application of such simulations is very helpful in determining an efficacious yet non-toxic dose, but requires a thorough understanding and experience in using these software applications. DISCUSSION We here present the BRAvO decision framework and its application to guide decisions on pediatric off-label drug use. To our knowledge, this is the first hands-on tool to be used in a clinical setting by healthcare professionals and guideline committees that systematically assesses the benefits and risks of pediatric off-label use. PrOACT-URL as the framework of choice: strengths and limitations There are many tools for the assessment of benefits and risks of drug use, 82 but these tools are mostly used by regulatory agencies or drug manufacturers. They are not specifically developed for use by healthcare professionals and are challenging to use on a day-to-day basis. Mt-Isa et al., in 2014, reviewed and appraised available methodologies to assess the benefits and risks of drugs. 82 They distinguished among qualitative and quantitative frameworks, metrics, estimation techniques, and utility survey techniques. Based on this review, we decided a qualitative method would best fit our needs as the other methods have complex scoring systems and are difficult to use for nontrained professionals. Mt-Isa considers the PrOACT-URL 19 and the BRAT framework 83 the most viable descriptive qualitative frameworks. As the PrOACT-URL framework is also explored by the EMA 20 as a comprehensive approach to assess benefits and risks of drugs that apply for licensing, we selected this framework as the basis for benefit-risk assessment for pediatric off-label drug use. BRAvO does not mandate strict criteria for favorable and unfavorable effects in order to adopt or reject the off-label use, neither does it score or weigh the different attributes, like quantitative analysis methods do. The conclusions on the balance and acceptance of benefits and risks are thus subjective. A standardized scoring system would objectify the outcome of the assessment but would also compromise the ease of use. As the framework ensures a structured and documented approach, the decision process will be transparent and verifiable. Furthermore, it is important to be aware that a benefit-risk assessment is a dynamic and continuous process. As new insights emerge, the benefit-risk balance may shift substantially, potentially leading to different conclusions. The proposed framework assures a structured analysis of the assessment of benefits and risks of pediatric off-label use, which is an important improvement. However, this analysis strongly relies on availability of pediatric studies on the proposed off-label use. In many cases, this evidence is lacking, which hampers a proper assessment. This also hampers a strict definition of outcome criteria and cutoff values for efficacy and safety beforehand. Limited evidence is likely to prevent attainment of these criteria. Yet, also in these cases, the structured approach will presumably lead to better informed decisions, as factors affecting the decision are made explicit. Furthermore, application of the framework leads to awareness of the uncertainties of a decision. The complexity of the assessment of efficacy, safety, and dose determination, especially when extrapolation of data is required, may limit the application of the framework by individual physicians or pharmacists. The use of the proposed framework requires a thorough understanding of clinical pharmacological principles. As such, a full assessment of benefits and risks is a time-consuming process. We therefore strongly recommend to join forces in the process of assessing the benefits and risks of off-label drug use and to disseminate the results in the context of a (national) pediatric formulary. Furthermore, BRAvO is not a systematic review, leading to a complete and up-to-date assessment of available literature. It is aimed at systematically identifying risks and benefits to assist in making the best decision on the off-label use. We believe our framework can also be used to guide decisions on (off-label) drug use in other special populations not specifically described in the SmPC, such as pregnant women, elderly patients, critically ill patients, or patients with other conditions. Similar to off-label use in children, a thorough assessment of benefits and risks is often lacking in these populations. In addition, by adding treatment options and comparing the general objectives for different drugs, the BRAvO framework could also be used to decide on different treatment options, for example, to select drugs that should be included in a formulary. The DPF (www.kinde rform ulari um.nl) was launched in 2008 in the Netherlands to provide best-evidence dosing recommendations for off-label drug use in children. The development of the DPF is described in detail in the "Development of a Pediatric Formulary for the Netherlands." 22 The BRAvO was developed to improve and standardize the methodology of assessing risks and benefits of off-label drug use in children, and to replace the current implicit risk-benefit assessment of the DPF by a more systematic and transferable approach. This is deemed necessary after Germany (www. kinde rform ulari um.de), Austria (www.kinde rmedi ka.at), and Norway (www.koble.info) have joined the DPF initiative to create equivalent national pediatric formularies. [84] [85] [86] It will enable international work-sharing to create new monographs and to revise and update existing ones. The conclusions with respect to dosing, efficacy, and safety of the BRAvO's and relevant references will be disseminated through these respective websites. We plan to construct an open-access library to collect and publish complete BRAvO assessments for retrieval by peers and where individuals or working groups outside of the DPF initiative will be able to upload and share their assessments (www.bravo libra ry.com). Supplementary information accompanies this paper on the Clinical Pharmacology & Therapeutics website (www.cpt-journal.com). The BRAvO framework has been developed by Dutch Knowledge Center Pharmacotherapy for Children, which is funded by a government grant by the Dutch Ministry of Health. Study on the off-label use of medicinal products in the European Union. www.ec.europa.com Two decades of off-label prescribing in children: a literature review Off-label medication use in children, more common than we think: a systematic review of the literature Ten common questions (and their answers) about off-label drug use BAP Position statement: off-label prescribing of psychotropic medication to children and adolescents Off-label use of drugs in children scien tific -guide line/guide line-good-pharm acovi gilan ce-pract ices-annex -i-defin ition s-rev-4_en Defining off-label and unlicensed use of medicines for children: results of a Delphi survey Evidence of harm from off-label or unlicensed medicines in children Association of off-label drug use and adverse drug events in an adult population Computerized provider order entry and patient safety Uses of drugs not described in the package insert (off-label uses) Off-label use of medicines in neonates, infants, children, and adolescents: a joint policy statement by the European Academy of Paediatrics and the European society for Developmental Perinatal and Pediatric Pharmacology GRADE: an emerging consensus on rating quality of evidence and strength of recommendations EMA Regulatory science to 2025 -Strategic reflection Issues impacting therapeutic outcomes in pediatric patients: an overview. Curr Pediatric drug formulations: a review of challenges and progress Developmental changes in pharmacokinetics and pharmacodynamics Smart Choices: A Practical Guide to Making Better Decisions Benefit-risk Methodology Project Work Package 2 Report: applicability of current tools and processes for regulatory benefit-risk assessment The Benefit-risk methodology project documents currently available on EMA Developing a pediatric formulary for the Netherlands Good practice in prescribing and managing medicines and devices. General Medical Council (2013) Off-label use of medicines: the need for good practice guidelines NHG-Behandelrichtlijn Misselijkheid en Braken door gastro-enteritis Restrictions on the use of domperidone-containing medicines European Society for Pediatric Gastroenterology, Hepatology, and Nutrition/European Society for Pediatric Infectious Diseases evidence-based guidelines for the management of acute gastroenteritis in children in Europe: update Extrapolation of adult data and other data in pediatric drug-development programs Reflection paper on the use of extrapolation in the development of medicines for paediatrics Unlicensed and off-label drug use in children: implications for safety Adverse drug reactions and off-label and unlicensed medicines in children: a prospective cohort study of unplanned admissions to a paediatric hospital Off-label and unlicensed medicine use and adverse drug reactions in children: a narrative review of the literature Pediatric off-label and unlicensed drug use and its implications Pediatric and Neonatal Dosage Handbook Rotavirus stimulates release of serotonin (5-HT) from human enterochromaffin cells and activates brain structures involved in nausea and vomiting Antiemetics for reducing vomiting related to acute gastroenteritis in children and adolescents Systematic review with meta-analysis: ondansetron for vomiting in children with acute gastroenteritis Antiemetics in children with acute gastroenteritis: a metaanalysis Impact of increasing ondansetron use on clinical outcomes in children with gastroenteritis Ondansetron for acute gastroenteritis: a failure of knowledge translation Fatal cardiac arrest in 2 children: possible role of ondansetron Implications of anesthesia in children with long QT syndrome Ventricular tachycardia after ondansetron administration in a child with undiagnosed long QT syndrome Effect of ondansetron on QT interval in patients cared for in the PICU Ondansetron treatment reduces rotavirus symptoms -a randomized double-blinded placebo-controlled trial Administration of ondansetron is associated with lethal outcome Ondansetron clinical pharmacokinetics Phase I and other dose-ranging studies of ondansetron Population pharmacokinetics of intravenous ondansetron in oncology and surgical patients aged 1-48 months Pharmacokinetics of intravenous ondansetron in healthy children undergoing ear, nose, and throat surgery The doseresponse relationship of ondansetron in preventing postoperative emesis in pediatric patients undergoing ambulatory surgery Ondansetron dose response curve in high-risk pediatric patients Prophylactic antiemetics in children undergoing tonsillectomy: high-dose vs low-dose ondansetron Prophylactic ondansetron in prevention of postoperative nausea and vomiting following pediatric strabismus surgery: a dose-response study A randomized controlled trial of the antiemetic effect of three doses of ondansetron after strabismus surgery in children Ondansetron in the prophylaxis of postoperative vomiting: a meta-analysis Ondansetron: a review of its use as an antiemetic in children Prophylaxis of postoperative vomiting in children undergoing tonsillectomy: a systematic review and meta-analysis Dexamethasone, ondansetron, and their combination and postoperative nausea and vomiting in children undergoing strabismus surgery: a meta-analysis of randomized controlled trials Koninklijke Nederlandsche Maatschappij ter bevording der Pharmacie (KNMP). Kennisbank. Den Haag Information for the package leaflet regarding ethanol used as an excipient in medicinal products for human use Designing a strategy to promote safe, innovative offlabel use of medications Regulating off-label drug use-rethinking the role of the FDA Going off-label without venturing off-course: evidence and ethical off-label prescribing Off-label use of medicines: consensus recommendations for evaluating appropriateness Randomized, controlled trials, observational studies, and the hierarchy of research designs Grading quality of evidence and strength of recommendations Guideline on the role of pharmacokinetics in the development of medicinal products in the paediatric population Grading and Assessment of Pharmacokinetic-Pharmacodynamic Studies) a critical appraisal system for antimicrobial PKPD studies -development and application in pediatric antibiotic studies Informed consent and shared decisionmaking: a requirement to disclose to patients off-label prescriptions Sources of information used when prescribing for children, a survey of hospital based pediatricians Working hard to do harm Off-label, offlimits? Parental awareness and attitudes towards off-label use in paediatrics Public awareness and views on unlicensed use of medicines in children A New framework to implement modelinformed dosing in clinical guidelines: Piperacillin and Amikacin as proof of concept Chloroquine dosing recommendations for pediatric COVID-19 supported by modeling and simulation Balancing benefit and risk of medicines: a systematic review and classification of available methodologies Development of a framework for enhancing the transparency, reproducibility and communication of the benefit-risk balance of medicines KiDSafe -Verbesserung der Arzneimitteltherapiesicherheit bei Kindern und Jugendlichen AT -Informationsplattform für Kinderarzneimittel für Österreich The Norwegian Medicines Manual for Health Personnel. Kunnskapsbasert oppslagsverk om barns legemidler (KOBLE).