key: cord-0960080-w7e0j5px authors: Sun, Xin; Li, Ling; Liu, Yanmei; Wang, Wen; Yao, Minghong; Tan, Jing; Ren, Yan; Deng, Ke; Ma, Yu; Wang, Yuning; Chen, Jin; Huang, Wei; Xia, Qing; Li, Youping; Shang, Hongcai title: Assessing Clinical Effects of Traditional Chinese Medicine Interventions: Moving Beyond Randomized Controlled Trials date: 2021-09-07 journal: Front Pharmacol DOI: 10.3389/fphar.2021.713071 sha: e4b2a18cab6d22d91b52be8206bf735cf87a24bd doc_id: 960080 cord_uid: w7e0j5px nan Traditional Chinese medicine (TCM) is a feature of Chinese civilization and has made significant contributions to development of the Chinese. Nowadays, TCM has attracted extensive attentions across the country and the support for TCM has become part of the national strategy (Anonymous, 2019; Anonymous, 2021) . A fundamental policy of China is that equal importance is attached to TCM and western medicine. In the treatment of diseases, for instance the fight against COVID-19, TCM and western medicine are often used in an integrated medicine approach (Chan et al., 2020; Du et al., 2020; Ren et al., 2020) , in which the strengths of TCM with modern medicine (western medicine) are combined to improve clinical effects of healthcare interventions (Wang and Xu, 1997; Anonymous, 2015) . In particular, the unique features of TCM-holism and treatment based on syndrome identification-are demonstrated in combination with practice of western medicine. Over the past decades, this practice pattern received wide acceptance in the Chinese healthcare system and the unique roles of TCM in the diseases prevention and treatment, for example acupuncture for migraine prophylaxis (Zhao et al., 2017) and stress urinary incontinence treatment (Liu et al., 2017) , are increasingly recognized by the international community (Anonymous, 2020) . However, TCM interventions are a highly complex system. The prescription of TCM interventions is usually individualized that is based on four theoretical foundations, including the combination of syndrome and disease for diagnosis, dynamic evolution of disease syndromes, treatment based on syndrome identification, and the integrated principle-method-recipe-medicines approach. Under these theoretical framework, dynamic changes of syndromes would require changes in prescription (Shi et al., 2021) . The emergence of evidence-based medicine brings new ideas and methods-such as randomized controlled trials (RCTs) and systematic reviews-to the generation of evidence on clinical effects (Djulbegovic and Guyatt, 2017; Tian et al., 2021) . However, clear differences in theoretical bases and underlying philosophies between TCM and western medicine inevitably presents significant challenges in assessing clinical effects of TCM interventions. The development of clinical research methodologies that specifically address clinical effects of TCM is vital to the innovation and thriving of TCM and represents a key strategy for TCM modernization (Wang and Huang, 2019) . In this article, we discussed potential strategies, proposed an integrated approach that may effectively address challenges, and reported our practices in the application of the integrated approach for establishing clinical effects of postapproval Chinese patent medicines. Evidence-based medicine framework usually treats classical RCTs (i.e., explanatory RCTs) as the gold standard, and combines other research methods (e.g., cohort studies) to develop a hierarchy of evidence (Centre for Evidence-Based Medicine, 2011). However, due to complexity of TCM interventions and its differences from western medicine, it is unlikely that RCTs can fully reflect features of TCM interventions. In the past decades, efforts from the methodology community were mainly centered on therapeutic efficacy; this focus may result that other equally important questions such as effectiveness or safety in real-world clinical setting are less attended. Additionally, this research pattern-intensive focus on classical RCT-often has limitations in integrating complex theories and practical features of TCM interventions. The resulting findings may not reflect the nature of TCM interventions. Therefore, an enhanced approach is strongly desirable. In addressing complexities of TCM interventions, one strategy is standardization of important diagnosis and treatment factors that have potential impacts on the estimates of treatment effects of TCM interventions. In view of the complexities of TCM interventions and challenges of standardizing TCM features (e.g., syndromes), a progressive standardization strategy may be applied when assessing clinical effects of TCM interventions, that is, first achieve standardization of those fully or largely standardizable factors, then partially standardizable factors. For example, the assessment of clinical effects of TCM interventions may be based on three different disease diagnoses models, including disease diagnosis using western medicine theory, diagnosis using TCM-based syndrome differentiation, or a combination of both (Anonymous, 2015) . While the first is often standardized, the complexity of TCM interventions may not be fully represented. Diagnosis of diseases purely based on TCM theory is often variable and less standardized. In such case, a diagnosis may be made primarily based on western medicine, and the addition of disease differentiation using TCM theory may strengthen the feature of TCM interventions. The other strategy is the development of innovative methods, in addition to explanatory RCTs, to embrace the complexities of TCM interventions, since standardization is unlikely applicable to all cases or scenarios of TCM interventions. In addressing the diversity of TCM interventions, it is necessary to build a problemoriented methodology approach that encompasses all relevant research questions about TCM interventions and addresses research needs at different stages or phases. Acupuncture and Chinese patent medicines are commonly used therapeutic modalities in integrative medicine. They are highly standardizable and widely recognized interventions both in China and abroad. However, even for such therapeutic modalities, the applicable methodologies for assessing their treatment effects still differ with those for western medicine. The key question about acupuncture and Chinese patent medicine is how their evidence contains features of TCM while treatment effects are reliably assessed. Although classical RCTs carry strong interval validity, they are never enough largely due to its restrictions in study factors (e.g., setting, population and interventions) and the resulting limitations to reflect TCM features. The last two decades have witnessed the rise of practice-based research, whereby realworld data generated from routine practice are primarily used for research (Sherman et al., 2016; Sun et al., 2018) . This feature particularly fits for the characteristics of acupuncture and Chinese patent medicines, in which practical variations are allowed while standardization is feasible. However, such studies are often observational in nature and are subject to bias. In addressing the limitations of the current approaches, we propose an integrated methodological approach for assessing clinical effects of acupuncture and Chinese patent medicines (eRCT-pRCT-RCDOS-REGOS, 4R, Figure 1) . Explanatory trials and studies at real-world practice setting are merged through a stepwise manner, and research questions at different stages-e.g., efficacy versus effectiveness-are addressed. In the two extremes between explanatory trials and observational studies with routinely collected data, the TCM features are increasingly involved. Consequently, all these four research methods, in a collective manner, contribute to reliable and comprehensive assessment of clinical effects of acupuncture and Chinese patent medicines. Within this integrated methodological approach, explanatory randomized controlled trials (eRCTs) may be used at early stage to establish efficacy of acupuncture and Chinese patent medicine. Although rigorous in design and having relatively low risk of bias, it may contain fewer features of TCM. Once the efficacy is established, research at real-world practice setting-that allows more flexible inclusion of study population and interventions-would be conducted. Pragmatic randomized controlled trials (pRCTs) represent an important vehicle to establish effectiveness of acupuncture and Chinese patent medicines in the real-world settings. This method integrates more features of TCM interventions, and combines advantages of explanatory trials (e.g., randomization), and such, it may be an ideal option for assessing clinical effectiveness of TCM interventions (Zuidgeest et al., 2017; Shi et al., 2021) . Observational studies using routinely collected data (RCDOS) or observational studies using patient registry data (REGOS) are two research approaches alternative to pRCTs that may be used for assessing clinical effects of acupuncture and Chinese patent medicines. Despite their significant strengths in collection of real-world practice data, these two approaches often suffer from serious limitations due to the nature of observational designs. Nevertheless, they may offer irreplicable advantages in assessing syndrome-driven treatment heterogeneity, understanding changes of treatment pattern, assessing real-world safety particularly those rare adverse reactions, exploring component effect in case of complex interventions, investigating interactions between western medicine and TCM, and predicting clinical effects of individual patients. Across all these methods, one critical issue is how to infuse the theory and features of TCM into methodological components. Despite relatively high degree of standardization when using acupuncture and Chinese patent medicine, objective complex factors continue to present challenges in assessing clinical effects, including outcome measurements that are applicable to TCM features (Wang and Huang, 2019; Zhang et al., 2021) , effect estimation in rare event setting (Greenland et al., 2016) , study designs involving patient preferences (Angell, 1984; Rücker, 1989; Cameron et al., 2018) , repeated measures in TCM setting (Albert, 1999; Twisk, 2004; Goetgeluk and Vansteelandt, 2008; Wang et al., 2012) , causal inference of treatment effects in complex design and data settings (Zigler and Dominici, 2014; Koch et al., 2020) , and decomposition of effects in complex intervention setting. Continuing efforts are warranted to address these issues. Post-approval Chinese patent medicines are often faced with important evidence gaps. Because the approval of Chinese patent medicines usually relies on traditional clinical trials, the resulting findings are often subject to restrictions in study designs. Therefore, post-approval studies of Chinese patent medicines are critical. Such studies usually aim to establish clinical effects in the context of TCM theory, whereby TCM features are increasingly present. These may include effectiveness, long-term effects, safety and heterogeneity in effects among subpopulations with varying characteristics (e.g., differential syndromes). In the past years, efforts have been made to apply the proposed approach for assessing postapproval Chinese patent medicines among selected diseases, for which TCM interventions may have special advantages (Figure 2) . For example, stroke is characterized by high morbidity, disability, mortality, recurrence and economic burden (Virani et al., 2020) . Although treatments with western medicine, such as intravenous thrombolysis and mechanical thrombectomy, have clear effect on patients with acute ischemic stroke, limited treatment options are available for patients with ischemic stroke in recovery and sequelae stages (Powers et al., 2018) . Early evidence suggested efficacy of Chinese patent medicines on the lowering of FIGURE 1 | Integrated approach for assessing clinical effects of traditional Chinese medicine (i.e., 4R approach). Notes: eRCT, explanatory randomized controlled trial; pRCT, pragmatic randomized controlled trial; RCDOS, observational studies using routinely collected data; REGOS, observational studies using patient registry data; IT, information technology; AI, artificial intelligence. Frontiers in Pharmacology | www.frontiersin.org September 2021 | Volume 12 | Article 713071 stroke complications and improvement of stroke sequelae Liang et al., 2018; Liu et al., 2018) . However, there continues to be major evidence gaps, including effectiveness and safety and differential effects by varying TCM features among patients in realworld clinical setting. In our efforts to address these evidence needs, we have developed two stroke-specific databases, including one multicenter strokespecific registry database from TCM hospitals and one nationwide stroke-specific routinely collected healthcare database from western medicine hospitals. We initially applied data processing technologies and common data model to standardize the data. We then applied the integrated approach to undertake studies addressing a series of research questions about clinical effects of Chinese patent medicines, including investigation of disease burden and treatment patterns of stroke using cross-sectional design; understanding types of Chinese medicine syndromes and regional distribution of acute cerebral hemorrhage and acute cerebral infarction, using model-based multidimensional clustering analysis; assessment of effectiveness and safety of Chinese patent medicines (e.g., TCM injection on top of routine thrombolysis treatment) among patients at stroke sequelae, using retrospective cohort study design and casual model; and development of a model for predicting individual treatment effects among patients with Chinese patent medicines treatments, based on machine learning methods. In another example, effective treatments of non-small cell lung cancer (NSCLC) usually include surgery, chemotherapy, radiotherapy, molecular targeting and immunotherapy (Postmus et al., 2017) . However, drug resistance and adverse reactions are two major limitations of these treatment options, which, in return, seriously compromise quality of life of patients (Chinese Medical Association, 2020) . TCM may have advantages in alleviating adverse reactions caused by typical western medicine and raising patient immunity, thus improving quality of life, and potentially prolonging survival (Li et al., 2019; Yang et al., 2020) . Nevertheless, evidence is lacking. In the efforts to address this important evidence gap, we established a multicenter postoperative NSCLC patient registry, whereby we applied the integrated approach to address issues about clinical effects of Chinese patent medicines for cancer patients. These included a multi-center pRCT that compared Zhongliuping 3 formula versus usual care to examine its effects on clinical symptoms and quality of life in NSCLC patients after surgery, in which multiple data sources were collected; a multi-center pRCT that compared Shenlingcao oral liquid versus usual care among NSCLC patients after receiving surgery to confirm its effect on quality of life and alleviation of serious adverse reactions caused by chemotherapy; and a cohort study using data from multicenter pRCTs to analyze long-term effectiveness, safety and heterogeneity in effects among different syndromes. In this paper, we proposed an integrated approach (i.e., 4R approach) that combines the strengths of classical RCTs and practice-based research, and infuses TCM theories and features into key study characteristics. Through this approach, the challenges may be effectively addressed in assessing clinical effects of TCM interventions. We also provided practical examples about the use of integrated approaches for assessing clinical effects of post-approval Chinese patent medicines in stroke and lung cancer patients. However, this approach has not been widely tested, and more applications are warranted. We FIGURE 2 | Use of the integrated approach for assessing clinical effects of post-approval Chinese patent medicines. Notes: NSCLC, non-small cell lung cancer; pRCT, pragmatic randomized controlled trial; REGOS, observational studies using patient registry data; RCDOS, observational studies using routinely collected data. Frontiers in Pharmacology | www.frontiersin.org September 2021 | Volume 12 | Article 713071 are hopeful that the integrated approach may be further enhanced through wider efforts and become an accepted model in assessing clinical effects of TCM interventions. XS and HS contributed conception of the study. XS, LL, and LY wrote sections of the manuscript. All authors contributed to the manuscript revision and approved the submitted version. Longitudinal Data Analysis (Repeated Measures) in Clinical Trials Patients' Preferences in Randomized Clinical Trials Integrative Medicine of Chinese Medical Doctor Association, Evidence-Based Medicine Committee of the Chinese Society of Integrative Medicine. Guide to Clinical Research Methods in Traditional Chinese Medicine and Integrative Chinese and Western Medicine The State Council of the People's Republic of China. Notice of the General Office of the China State Council on the Development of a Number of Policies and Measures to Accelerate the Characteristics of Chinese Medicine OCEBM Levels of Evidence Working Group. The Oxford Levels of Evidence 2 COVID-19: An Update on the Epidemiological, Clinical, Preventive and Therapeutic Evidence and Guidelines of Integrative Chinese-western Medicine for the Management of 2019 Novel Coronavirus Disease Chinese Medical Association Guidelines for Clinical Diagnosis and Treatment of Lung Cancer Progress in Evidence-Based Medicine: A Quarter century on Traditional Chinese Medicine: An Effective Treatment for 2019 Novel Coronavirus Pneumonia (NCP). Chin Conditional Generalized Estimating Equations for the Analysis of Clustered and Longitudinal Data Sparse Data Bias: A Problem Hiding in plain Sight Variable Selection and Estimation in Causal Inference Using Bayesian Spike and Slab Priors Kangai Injection Combined with Platinum-Based Chemotherapy for the Treatment of Stage III/ IV Non-Small Cell Lung Cancer: A Meta-Analysis and Systematic Review Ginkgo Biloba Extract Improved Cognitive and Neurological Functions of Acute Ischaemic Stroke: A Randomised Controlled Trial The Effect of Naoxintong Capsule in the Treatment of Patients with Cerebral Infarction and Carotid Atherosclerosis: A Systematic Review and Meta-Analysis of Randomized Trials. Evid. Based Complement Comparative Efficacy of Chinese Herbal Injections for Treating Acute Cerebral Infarction: A Network Meta-Analysis of Randomized Controlled Trials Effect of Electroacupuncture on Urinary Leakage Among Women with Stress Urinary Incontinence: A Randomized Clinical Trial Early and Locally Advanced Non-Small-Cell Lung Cancer (NSCLC): ESMO Clinical Practice Guidelines for Diagnosis, Treatment and Follow-Up Guidelines for the Early Management of Patients with Acute Ischemic Stroke: A Guideline for Healthcare Professionals from the American Heart Association/American Stroke Association Traditional Chinese Medicine for COVID-19 Treatment A Two-Stage Trial Design for Testing Treatment, Self-Selection and Treatment Preference Effects Real-World Evidence -What Is it and what Can it Tell Us Statistical Methods in Pragmatic Randomized Controlled Trials (Ⅰ): Addressing Non-Compliance Real World Evidence: Experience and Lessons from China Evidence-Based Traditional Chinese Medicine Research: Two Decades of Development, its Impact, and Breakthrough Longitudinal Data Analysis. A Comparison between Generalized Estimating Equations and Random Coefficient Analysis Frontiers in Pharmacology | www.frontiersin.org Heart Disease and Stroke Statistics-2020 Update: A Report from the Exploration of the Concept and Scope of Integrated Traditional and Western Medicine Penalized Generalized Estimating Equations for High-Dimensional Longitudinal Data Analysis Taking a Broad and Long-Term View to Establish China Center for Evidence Based Traditional Chinese Medicine (CCEBTCM) Efficacy of Traditional Chinese Medicine Combined with Chemotherapy in Patients with Non-Small Cell Lung Cancer (NSCLC): a Meta-Analysis of Randomized Clinical Trials Overview of the Development of Core Outcome Set for Clinical Trials and Related Key Issues in the Field of Traditional Chinese Medicine The Long-Term Effect of Acupuncture for Migraine Prophylaxis: a Randomized Clinical Trial Uncertainty in Propensity Score Estimation: Bayesian Methods for Variable Selection and Model Averaged Causal Effects Series: Pragmatic Trials and Real World Evidence: Paper 1. Introduction The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.Publisher's Note: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.Copyright © 2021 Sun, Li, Liu, Wang, Yao, Tan, Ren, Deng, Ma, Wang, Chen, Huang, Xia, Li and Shang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.