key: cord-0690970-x4wsnpwc authors: Berlow, Yosef A.; Zandvakili, Amin; Philip, Noah S. title: Low Frequency Right-Sided and High Frequency Left-Sided Repetitive Transcranial Magnetic Stimulation for Depression: The Evidence of Equivalence date: 2020-10-13 journal: Brain Stimul DOI: 10.1016/j.brs.2020.10.005 sha: 319d400ad163687079d7fff0fb3bb45e80ab5852 doc_id: 690970 cord_uid: x4wsnpwc nan In their recent letter, Miron and colleagues make a cohesive and robust argument for reappraising the role of low frequency (1 Hz), right-sided repetitive transcranial magnetic stimulation (LFR-TMS) for the treatment of depression, highlighting its many potential advantages over high frequency (≥ 5 Hz) left-sided stimulation (HFL-TMS); these advantages included the ability to use less expensive devices, tolerability, and better safety profile (1) . Such devices may also be better suited to the COVID-19 world where the need for at-home stimulation must carry greater weight. The relative advantages of LFR-TMS become even more critical if it can be shown that this approach has comparable efficacy as HFL-TMS. Consistent with this narrative, multiple studies comparing the efficacy between LFR-TMS and HFL-TMS for depression have failed to detect differences in these approaches, including a meta-analysis of 12 studies (n=361) (2) , and a recent large randomized controlled trial (n=300) (3) . While the failure to detect differences using null hypothesis significance testing in these studies is insufficient to establish that LFR-TMS is as efficacious as HFL-TMS, formal equivalence testing of this same data can provide quantitative evidence for the absence of a clinically meaningful difference between these treatment approaches. The aim of this study was to perform equivalence testing of the pooled efficacy outcomes from LFR-TMS and HFL-TMS treatments for depression using the currently available evidence. Randomized controlled trials of LFR-TMS and HFL-TMS for patients with major depressive episodes were identified through PubMed following the methods described by Cao et al. (2) , but extending to June 21, 2020 and defining low frequency stimulation as less than 5 Hz. Treatment response was defined as a 50% reduction in depression Pooled odds ratios for response and remission rates were calculated using the Mantel-Haenszel (MH) fixed effect method as implemented in the 'meta' package from R (4). Heterogeneity was estimated using the DerSimonian-Laird estimator for tau 2 . Odds ratios (OR) and the corresponding confidence intervals (CI) were converted to effect sizes (Cohen's d) and standard error (SE) estimates using the conversion procedures for meta-analysis provided by Chinn (5), where d=ln(OR)*(√3/π). Equivalence testing for meta-analysis was completed using the two one-sided test (TOST) for meta-analysis in the R 'TOSTER' library with alpha (α) set at 0.05 (6) . The equivalence margin was set at d=0.25, following the work and rationale of Steinert et al. (7) for equivalence testing in meta-analysis of depression treatments. Using the conversion formula noted above (5), this equivalence margin corresponds with OR values between 0.636-1.574. Additional analyses were performed using alternative study selection to assess the robustness of these findings. Ninety percent confidence intervals corresponding to 1-2α are presented to illustrate equivalence testing using the TOST (6). Twelve randomized controlled trials were included in the analysis with a total of 627 subjects with major depressive episodes treated with either LFR-TMS (n=320) or HFL-TMS (n=307). Overall, 47% percent (292/627) of these subjects were classified as This study provides statistical evidence of the equivalence of LFR-TMS and HFL-TMS efficacy when used to treat major depressive episodes. As illustrated by the confidence intervals in Figure 1 , neither the individual studies nor the pooled estimates comparing LFR-TMS and HFL-TMS demonstrated that either approach has superior efficacy for treating depressive episodes (p>0.1). These findings confirm previous meta-analyses of LFR-TMS and HFL-TMS outcomes that were unable to detect differences with these two stimulation protocols (2) and suggest there is no statistical evidence that these stimulation protocols differ in efficacy. However, many of these previous studies have been underpowered to demonstrate meaningful equivalence and none have applied the methods of equivalency testing. The current study works to overcome these limitations by combining the statistical power of meta-analysis along with the logic of equivalence testing to define equivalent efficacy outcomes of these two TMS protocols using a conservative margin established for depression treatments (7) . If a true difference between LFR-TMS and HFL-TMS response and remission rates existed larger than the tested equivalency margin (d=0.25), the current results of significant equivalence would be surprising (p<0.05). A difference in efficacy outcomes between LFR-TMS and HFL-TMS protocols may still exist, however, this analysis suggests the difference would be small and unlikely to be clinically meaningful. While the evidence base for HFL-TMS has been well established compared to LFR-TMS, the current finding that these two stimulation protocols have equivalent efficacy provides further support of the need for additional studies to re-evaluate the role of LFR-TMS in the treatment of depression. J o u r n a l P r e -p r o o f The role of low-frequency repetitive transcranial magnetic stimulation in major depression: A call to increase the evidence base Response and Remission Rates Following High-Frequency vs Repetitive Transcranial Magnetic Stimulation (rTMS) Over Right DLPFC for Treating Major Depressive Disorder (MDD): A Meta-Analysis of Randomized A pragmatic randomized controlled trial exploring the relationship between pulse number and response to repetitive transcranial magnetic stimulation treatment in depression meta: An R package for meta-analysis. R news A simple method for converting an odds ratio to effect size for use in meta-analysis Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses Psychodynamic Therapy: As Efficacious as Other Empirically Supported Treatments? A Meta-Analysis Testing Equivalence of Outcomes Augmentative repetitive Transcranial Magnetic Stimulation (rTMS) in the acute treatment of poor responder depressed patients: a comparison study between high and low frequency stimulation Efficacy of repetitive transcranial magnetic stimulation with quetiapine in treating bipolar II depression: a randomized, double-blinded, control study A symptomspecific analysis of the effect of high-frequency left or low-frequency right transcranial magnetic stimulation over the dorsolateral prefrontal cortex in major depression We wish to confirm that there are no known conflicts of interest associated with this publication and there has been no significant financial support for this work that could have influenced its outcome.We confirm that the manuscript has been read and approved by all named authors and that there are no other persons who satisfied the criteria for authorship but are not listed. We further confirm that the order of authors listed in the manuscript has been approved by all of us.We confirm that we have given due consideration to the protection of intellectual property associated with this work and that there are no impediments to publication, including the timing of publication, with respect to intellectual property. In so doing we confirm that we have followed the regulations of our institutions concerning intellectual property.We understand that the Corresponding Author is the sole contact for the Editorial process (including Editorial Manager and direct communications with the office). He/she is responsible for communicating with the other authors about progress, submissions of revisions and final approval of proofs. We confirm that we have provided a current, correct email address which is accessible by the Corresponding Author and which has been configured to accept email from yosef_berlow@brown.edu.Signed by all authors as follows:________________________________ Yosef A Berlow, MD, PhD