key: cord-0954974-aw9xqn65 authors: Tailby, Chris; Collins, Alana J.; Vaughan, David N.; Abbott, David F.; O’Shea, Marie; Helmstaedter, Christoph; Jackson, Graeme D. title: Teleneuropsychology in the time of COVID-19: the experience of the Australian Epilepsy Project date: 2020-10-16 journal: Seizure DOI: 10.1016/j.seizure.2020.10.005 sha: f3df72a37c576624e3917a85e8ac9f4929605928 doc_id: 954974 cord_uid: aw9xqn65 PURPOSE: Traditional neuropsychological testing carries elevated COVID-19 risk for both examinee and examiner. Here we describe how the pilot study of the Australian Epilepsy Project (AEP) has transitioned to tele-neuropsychology (teleNP), enabling continued safe operations during the pandemic. METHODS: The AEP includes adults (age 18-60) with a first unprovoked seizure, new diagnosis of epilepsy or drug resistant focal epilepsy. Shortly after launching the study, COVID-related restrictions necessitated adaptation to teleNP, including delivery of verbal tasks via videoconference; visual stimulus delivery via document camera; use of web-hosted, computerised assessment; substitution of oral versions for written tests; online delivery of questionnaires; and discontinuation of telehealth incompatible tasks. RESULTS: To date, we have completed 24 teleNP assessments: 18 remotely (participant in own home) and six on-site (participant using equipment at research facility). Five face-to-face assessments were conducted prior to the transition to teleNP. Eight of 408 tests administered via teleNP (1.9%) have been invalidated, for a variety of reasons (technical, procedural, environmental). Data confirm typical patterns of epilepsy-related deficits (p < .05) affecting processing speed, executive function, language and memory. Questionnaire responses indicate elevated rates of patients at high risk of mood (34%) and anxiety disorder (38%). CONCLUSION: Research teleNP assessments reveal a typical pattern of impairments in epilepsy. A range of issues must be considered when introducing teleNP, such as technical and administrative set up, test selection and delivery, and cohort suitability. TeleNP enables large-scale neuropsychological research during periods of social distancing (and beyond), and offers an opportunity to expand the reach and breadth of neuropsychological services. datasets. While our emphasis is on research-based data collection via teleNP, we also touch upon issues relevant to the clinical application of TeleNP in epilepsy. The Australian Epilepsy Project (AEP) is a large-scale clinical research project shortlisted for funding by the Medical Research Future Fund of the Australian Government. The vision of the AEP is to develop predictive epilepsy-specific decision support tools for use by clinicians. Machine learning / artificial intelligence (AI) methods will be applied to prospectively acquired neuropsychological, genetics and advanced imaging data obtained from 8,000+ adults living with epilepsy, to predict their epilepsy-related two-year outcomes ( Figure 1 ). Sharing of deidentified datasets will further maximise breakthrough opportunities in research. We have commented elsewhere [5] on the role of machine learning/AI in the analysis of such datasets, and in the health sector more broadly, and do not consider this issue further here. The AEP commenced a pilot study in February of 2020 to evaluate recruitment feasibility and participant tolerability of the protocols for collection of neuropsychological and imaging data. The first case of COVID-19 was reported in Australia in late January 2020, and a State of Emergency was declared in Victoria in mid-March, around six weeks into AEP recruitment. Despite the introduction of Government-mandated COVID-related restrictions, the AEP pilot study has been able to continue by switching to the use of TeleNP for all participants. Prior to the arrival of COVID-19 in Australia, the AEP Pilot Study relied almost exclusively on face-to-face interactions for its data collection and analysis activities. The institutional and governmental response to COVID-19 in Australia demanded a re-evaluation and adjustment to each of these activities to ensure the safety of all persons involved, while preserving the scientific integrity and health care objectives. All our activities accord with guidance from  MRI: MRI is performed in-person, at research-dedicated scanners. All participants are screened for COVID-19 symptoms or risk factors before they attend the premises. On-site, physical distancing strategies, appropriate personal protective equipment use, and cleaning procedures are all applied according to up-dated research facility protocols. Images are transmitted electronically to the hospital radiology departments for standard reporting and clinical use. This approach eliminates the need for participants to physically attend hospital premises for clinical scans and reduces the burden on hospital radiology at a time of increased strain on the hospital system. While genetics and epilepsy follow-up (e.g. seizure diaries, medications, psychological and quality of life questionnaires, adverse events, health economic data) are not collected in the AEP Pilot Study, in the full project genetic samples will be obtained by blood-draw at a local community pathology provider (typically at the same time as routine clinical blood tests), and epilepsy follow-up will occur via smart device app/web survey and telephone call. Reporting  Data analysis and transfer is performed by research staff accessing secure server platforms remotely via encrypted network connections, enabling this work to be safely performed from home. Key team decision making activities are supported via teleconferencing. The most substantive protocol changes have involved the transition to collecting all neuropsychological data via TeleNP. Traditional, face-to-face neuropsychological testing carries elevated COVID-19 risk, both for participants and the neuropsychologist, and is clearly unacceptable from both a community safety and occupational health viewpoint. The examiner and examinee may spend several hours in close proximity, passing materials back and forth (e.g. stimulus materials, response forms), usually in a small enclosed room for privacy. Further, the examinee must also travel to the physical premises for the assessment, which can necessitate additional interpersonal interactions (e.g. public transport, waiting areas). The neuropsychological measures used in our TeleNP protocol are listed in Table 1 . These measures were selected for their evidence base in epilepsy (as acquired through traditional, face-to-face assessments), and their compatibility with TeleNP administration. The experience gained from the AEP Pilot Study will be used to further empirically refine instrument selection. Test of Premorbid Functioning [6] : an estimate of premorbid intellect based on irregular word reading, used here both as a measure of intellect, and due to the elevated incidence of reading disorders in epilepsy [7, 8] . WASI-II FSIQ 2 (Matrix Reasoning, Vocabulary) [9] *: a short form intelligence measure with excellent psychometric properties. Oral Symbol Digit Modalities Test [10] : the SDMT is a sensitive measure of processing speed and, in its written form, has been used widely in epilepsy trials [11] . Oral Trail Making Test [12] : a measure of divided attention and speed, sensitive (in its original written form) to dysfunction in epilepsy [11, 13] . Reverse Digit Span [14] *: a measure of working memory, sensitive to dysfunction in epilepsy [13] . Verbal Fluency [15] *: letter and category based verbal fluency are sensitive markers of dysfunction in epilepsy, both in focal epilepsy [16] and as an effect of antiseizure medications [13] , and also useful as a predictor of cognitive risk from surgery [17] . Boston Naming Test [18] *: a measure of confrontation naming, sensitive to lateralised dysfunction in focal epilepsy [19, 20] , and also useful as a predictor of cognitive risk from surgery [21] . Rey Auditory Verbal Learning Test (learning and delayed recall trials)*: a word list learning task sensitive to memory dysfunction across a range of epilepsy syndromes [22] , to lateralisation in temporal lobe epilepsy [19, 23] , and predictive of post-operative cognitive outcome [24] . [26] , it has been used widely in other neurological conditions and is sensitive to frontal and temporal lobe dysfunction [27] . We include the following measures from the CANTAB:  Spatial Working Memory: a measure of spatial working memory; shown to predict postoperative psychological outcomes in epilepsy [28] .  Rapid Visual Information Processing: a measure of information processing speed and sustained attention; computerised assessment of sustained attention has been recommended for large scale epilepsy research [29] . While numerous different measures of non-verbal memory have been used in epilepsy there is no broadly agreed upon, recommended measure [23, [30] [31] [32] . Arbitrary associate learning has been shown to be a sensitive marker of mesial temporal lobe function in temporal lobe epilepsy [23, [33] [34] [35] . The paired associate learning subtest of the CANTAB has been shown to be a sensitive marker of pathology in the mesial temporal region in other forms of neurological disease targeting the mesial temporal lobe [36] . [39] *: a widely used mood screening tool developed specifically for epilepsy, validated against psychiatric interview determined clinical diagnosis [39] . Generalised Anxiety Disorder 7-item scale (GAD7) [40] *: a brief generalised anxiety screening tool that has been validated in epilepsy against psychiatric interview determined clinical diagnosis [41] [42] [43] . Epilepsy Anxiety Survey Instrument (EASI) [43] : an anxiety screening tool designed specifically for use in epilepsy, validated against psychiatric interview determined clinical diagnosis. In our pre-COVID face-to-face protocol we had been administering EpiTrack [13] and the Reaction Time task from the CANTAB. The trail making test (TMT), inhibition task and maze task within EpiTrack cannot be administered via telehealth, and the Reaction Time task is not available via CANTAB Connect (indeed the variability in the hardware possessed by participants would almost certainly preclude accurate measurement of reaction times in any home delivered, web based platform). We include the oral version of the TMT in our telehealth protocol, as a measure comparable to the written TMT [44] . We have also trialled various versions of the Stroop task (Victoria Stroop [45] , Dodrill Stroop [11] ), to use as a measure of inhibition, but have ultimately abandoned it due to insensitivity (Victoria version) and difficulty presenting the stimuli appropriately via videoconference (Dodrill version). The potential benefits of TeleNP have long been recognised, including convenience, user satisfaction, potential cost-reductions and improved access (geographic; availability of interpreter services [46] ). Nonetheless, the neuropsychological community has not uniformly embraced the adoption of TeleNP necessitated by the emergence of COVID-19. One of the most obvious concerns relates to whether TeleNP departs sufficiently from standardised faceto-face administration to invalidate test results and interpretation. There is accumulating evidence that telehealth delivered neuropsychological assessments can yield reliable and valid evaluations [47] [48] [49] . Since the emergence of COVID-19, a number of journal articles [4, [50] [51] [52] and statements from professional bodies have provided guidelines and experiencebased recommendations regarding the use of TeleNP (via position papers [53] , webinars and online resources; see, for instance, the Australian Psychological Society The best TeleNP evidence concerns the use of tasks that are predominantly verbal in nature [47] . This encompasses the majority of measures we have selected for use (Table 1) , and includes measures such as paragraph and word list learning tasks [54] [55] [56] [57] , verbal span/working memory tasks (such as digit span) [54] [55] [56] [57] , verbal fluency tasks [54] [55] [56] [57] [58] , and measures of crystallized intelligence (e.g. measures of word reading and vocabulary [57] [58] [59] [60] ). There is also evidence for tasks that rely upon verbal responses to visually presented stimuli, such as visual confrontation naming [54, 55] and visuoperceptual reasoning tasks (e.g. WAIS J o u r n a l P r e -p r o o f Matrix Reasoning [57, 58] ). While supported by good evidence, it is worth noting that purely verbal tasks do not guarantee immunity to issues when administered via telehealth. Transient interruptions of the connection can interfere, especially with 'one shot' (e.g. digit span) or timed tasks (e.g. oral versions of SDMT and TMT). Our experience to date has been that poor connections are often apparent from the outset, and in many instances can be remedied simply by re-establishing the call or asking other users on the network to minimise their own network usage (e.g. streaming). We have had one participant whose computer microphone proved to be faulty but were able to proceed by using a concurrent telephone call accompanying the computer's video feed without appreciable lag (a solution, incidentally, that we have employed in clinical practice also). Another participant was unable to establish a videoconference link from home, despite repeated attempts, and ultimately completed their teleNP assessment onsite. More difficult to administer are tasks that require physical interaction with stimuli provided by the examiner (e.g. paper forms, three dimensional blocks). While there is some evidence for administration of such tasks via TeleNP (e.g. Grooved Pegboard [57] ; written version of the Symbol Digit Modalities Test [57, 61] , Complex Figure Copy and Recall Tests [62] , Clock Drawing Test [47, 48, 62] ) we have ultimately elected not to include them for a variety of reasons (impracticalities of providing materials to participants: Grooved Pegboard; poor sensitivity and reliability: Rey Complex Figure [31] ; suitable oral version available: SDMT). In other instances, we opted to retain the conceptual element of a traditional pen-and-paper task, but change the mode of delivery and response (e.g. using the oral versions of the Trail Making Test and Symbol Digit Modalities Test [44, 57, 61, 63, 64] ), though we note that this likely alters what the task is actually measuring (e.g. pen-and-paper versus oral Trail Making Test [44] ). TeleNP is not without its challenges. Familiarity with the required technology -on the part of both the examinee and clinician -can influence the degree of engagement with, and the flow and ease of, the interaction. Indeed, we have found it essential to factor in ~15 minutes of initial set up time at the beginning of appointments to ensure participants are able to log onto the videoconference call and that their technology is functioning appropriately (assisting them via phone as necessary). A single neuropsychologist administered the TeleNP assessments for our protocol, with this individual completing multiple supervised practice administrations prior to commencing participant data collection (and reviewing the aforementioned TeleNP webinars provided by the Australian Psychological Association and the International Neuropsychological Society once these were available). These practice sessions were essential to ensuring familiarity with the testing technology and practicalities of administration via telehealth. We have also developed a set of Standard Operating Procedures for telehealth to facilitate the training of new staff as the project expands. The suitability of TeleNP for specific patient groups is an important issue, such as paediatric populations, people with intellectual disability or severe cognitive compromise, and linguistically and culturally diverse groups. Indeed, many of these concerns are also relevant to traditional face-to-face consultations. This complexity has not yet been fully addressed by the field and remains a critical challenge to the broad application of clinical TeleNP. However, the acquisition of uniform test data for machine-learning analysis is a narrower problem, where these issues are partly avoided through assessment of a necessarily more targeted cohort in which TeleNP administration is appropriate. Access to technology is another issue of concern, since not all individuals possess the hardware required to support videoconference-based TeleNP. The use of technology at a J o u r n a l P r e -p r o o f local facility (e.g. GP clinic or research site) can increase availability and address issues of social equity, while simultaneously ensuring the quality of technology and connectivity [47, 48] . Indeed, the majority of evidence for telehealth administration comes from studies where examinees are tested via technology at a local research facility [47] . We have made this approach available to participants, in order to improve participant access to the study (we offer free parking for participants who are able to travel to the facility by car and offer taxi vouchers for those who require transport). To date, roughly 20% of participants have o Quiet, distraction free room in which to complete the TeleNP assessment  Emailed a link to a set of electronically-hosted surveys tapping elements of psychosocial functioning germane to epilepsy (e.g. Neurological Disorders Depression in Epilepsy [39] ; Patient Health Questionnaire GAD-7 [40] ; Epilepsy Anxiety Survey Instrument [43] ; QoLiE-31 [65] ; Liverpool Adverse Events Profile [66] [67] [68] ; ABNAS [69] ). The surveys are hosted on a REDCap [37, 38] database server at our institution.  Emailed a telehealth information sheet, along with text describing an 'agreement to telehealth' whereby participant and researcher agree that they will not "record, reproduce, publish or make copies of the materials used during the neuropsychology telehealth session" [70] . Participants are advised that their TeleNP session cannot proceed until they confirm acceptance of this agreement.  Explains what will happen in the event of lost connection (attempt to reconnect; if unable to, will call mobile phone; if no contact within 10 minutes, session considered aborted and will be rescheduled)  Confirms the participant's current location and obtains additional contact information in event of emergency (e.g. seizure). We explain that in the event of a seizure, if we cannot reach one of the contacts provided, or if we feel a more urgent response is appropriate, that we will call an ambulance. This information is summarised in a teleNP information sheet provided to all participants in advance of their session. We are yet to have a participant experience a seizure during testing.  Re-iterates terms of agreement to participate in telehealth (e.g. participant will not record or reproduce any materials) Neuropsychological testing is administered via the following methods [47,50,53,54,58,70- handle any unanticipated problems that might arise and also to monitor behaviour during the testing. For each task, the neuropsychologist records observations of anything that might invalidate a test (e.g. temporary connection loss; distraction). All data is recorded on response forms coding using a random six digit participant identification code, and then transcribed onto a secure central database (REDCap). Table 2 summarises the data for each cognitive task. Performance is considered for the sample as a whole (overall mean z-score, SD, n and result of one sample t-test/Wilcoxon signed rank test [relative to a mean/median z-score = 0, one-sided test], and percentage of cases performing >1.5 SDs below expectation), and also separately for each method of administration: teleNP-at home, teleNP-onsite, face-to-face (n for each method of administration, result of a one-way ANOVA/Kruskall-Wallis test). The ANOVA/Kruskall-Wallis tests indicate that no cognitive test shows a significant effect of administration method (p>.05, albeit with small group sizes). Collapsed across administration method, one sample t-tests/Wilcoxon signed rank tests confirm a pattern of impairments typical of those seen in epilepsy, with significant (p<0.05) reductions in processing speed (oral SDMT), executive function (oral TMT B, COWAT), language (BNT, Animal fluency) and anterograde memory (RAVLT measures). Trends (p<0.08) were also apparent for sustained rapid information processing (CANTAB RVP) and working memory (DSB, CANTAB SWM). Screening of mood and anxiety also confirmed a relatively high proportion of individuals at risk for these disorders: 10 of 29 participants (34%) were at high risk of mood disorder based on the NDDIE [total score > 15, see reference 39]; and between 8 and 11 (28% and 38%) were at high risk of anxiety disorder based on the brEASI [total score > 7, see reference 43] and GAD7 [total score > 7, see reference 42], respectively.  Anterograde memory: the most common cognitive complaint in epilepsy [74] ; the majority of focal epilepsies affect the temporal lobe [75] .  Executive functions/fluid intelligence: sensitive to ASM effects [13] ; the frontal lobes are frequently involved in focal [75] and genetic [76] epilepsies.  Crystallized intelligence: considered less susceptible to ASM effects [77] ; can be affected by age of epilepsy onset [78] ; provides a measure of cognitive reserve [79] .  Mood: frequently disturbed in people with epilepsy [80] .  Adverse treatment side effects J o u r n a l P r e -p r o o f Such screening assessments cannot replace comprehensive assessments and may miss subtle problems for some individuals. However, unlike other existing tools that have been developed for dementia screening, the tools would be validated for epilepsy, be age and education adjusted, address functions most often affected during the course of epilepsy and its treatment, and be useable for the remote assessment of patients unable to attend face-toface assessment or who would otherwise be lost to follow-up. Ultimately this kind of approach will facilitate large-scale collection of data that would not otherwise be practical using traditional methods. The impetus to move towards telehealth stimulated by COVID-19 should be viewed as an opportunity to expand the reach and breadth of neuropsychology [47, 54] . The clinical neuropsychologist's role in an epilepsy surgery program extends beyond psychometric documentation. The delivery of counselling, psychoeducation, advocacy, and psychotherapy via telehealth has a solid evidence base [82] , including in epilepsy specific contexts [83] [84] [85] [86] , and is encouraged in recent set of epilepsy-specific consensus recommendations [87] . Speaking from the local perspective, within the Department of Clinical Neuropsychology at Austin Health we already employ telehealth (telephone, videoconferencing using the Coviu platform) routinely in the pre-and post-surgical counselling of patients [88] . Anecdotally, a number of our patients have commented that they feel more comfortable in their home These anecdotal benefits are substantiated by our recent experience in Germany using phone or videoconference telemedicine in the counselling of people with epilepsy during the COVID pandemic [89] . Overall 82% of the 239 adult epilepsy patients participating in the audit were satisfied with their telemedicine experience, with high rates of satisfaction especially for time, comprehensibility, and opportunity to get answers to current questions. The participants J o u r n a l P r e -p r o o f considered immediate convenience and shortfall of travel expenses as advantages of telemedicine. Approximately three quarters of participants reported that they would appreciate the opportunity for future telemedical counselling, but at the same consider telemedicine as an add-on service rather than a permanent substitute to visits onsite. COVID-19 has abruptly and dramatically changed the way that society functions, including the operation of the health and medical research sector. Our experience shows that it is possible to continue to perform evidence-based, epilepsy-related neuropsychological research while at the same time fully supporting public health strategies aimed at containing and mitigating the effects of COVID-19. In the event that sustaining such policies into the medium or longerterm is necessary, the strategies adopted by the AEP have positioned it to continue to grow and expand, with no impact on the feasibility, integrity or safety of the project. Indeed, this model of telehealth-based operations provides a template for the healthcare of tomorrow, while decreasing the burden on traditional hospital systems. The challenges posed by COVID-19 are immense, and we must respond swiftly and creatively, where possible converting the adversity of the present into opportunities for the future. Smartphone data reveal which Americans are social distancing (and not) Where Have All the Heart Attacks Gone? The New York Times Concern as heart attack and stroke patients delay seeking help. The Guardian Inter Organizational Practice Committee Recommendations/Guidance for Teleneuropsychology in Response to the COVID-19 Pandemic Artificial intelligence for clinical decision support in neurology Test of premorbid functioning. UK version (TOPF UK). UK: Pearson Corporation Associations of dyslexia with epilepsy, handedness, and gender Reading difficulty is associated with failure to lateralize temporooccipital function Manual for the Wechsler abbreviated intelligence scale (WASI) Comparability, reliability, and practice effects on alternate forms of the Digit Symbol Substitution and Symbol Digit Modalities tests A neuropsychological battery for epilepsy Army individual test battery. Manual of Directions and Scoring EpiTrack: tracking cognitive side effects of medication on attention and executive functions in patients with epilepsy WAIS-IV Technical and Interpretive Manual Controlled oral word association test. Multilingual Aphasia Examination Verbal fluency in focal epilepsy: a systematic review and meta-analysis Predictors of decline in verbal fluency after frontal lobe epilepsy surgery Differential neuropsychological test sensitivity to left temporal lobe epilepsy Sensitivity and specificity of memory and naming tests for identifying left temporal-lobe epilepsy Visual confrontation naming outcome after standard left anterior temporal lobectomy with sparing versus resection of the superior temporal gyrus: a randomized prospective clinical trial Should cognition be screened in new-onset epilepsies? A study in 247 untreated patients Verbal memory in mesial temporal lobe epilepsy: beyond material specificity Predicting memory decline following epilepsy surgery: a multivariate approach Cambridge Cognition Computerized neuropsychological testing in epilepsy: overview of available tools A compendium of neuropsychological tests: administration, norms and commentary Frontal lobe dysfunction as a predictor of depression and anxiety following temporal lobe epilepsy surgery Cognitive and behavioural assessments in clinical trials: what type of measure? Common data elements in epilepsy research: development and implementation of the NINDS epilepsy CDE project The use of figural reproduction tests as measures of nonverbal memory in epilepsy surgery candidates Use of the Brief Visuospatial Memory Test-Revised (BVMT-R) in neuropsychological evaluation of epilepsy surgery candidates Lateralization of Verbal Memory and Unilateral Hippocampal Sclerosis -Evidence of Task-Specific Effects Impaired verbal associative learning after resection of left perirhinal cortex Verbal memory in left temporal lobe epilepsy: Evidence for task-related localization Paired associate performance in the early detection of DAT Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support The REDCap consortium: Building an international community of software platform partners Rapid detection of major depression in epilepsy: a multicentre study A brief measure for assessing generalized anxiety disorder: the GAD-7 Validation of the generalized anxiety disorder-7 in people with epilepsy: a MEPSY study Rapid detection of generalized anxiety disorder and major depression in epilepsy: validation of the GAD-7 as a complementary tool to the NDDI-E in a French sample Design and validation of two measures to detect anxiety disorders in epilepsy: The Epilepsy Anxiety Survey Instrument and its brief counterpart The oral trail making test: effects of age and concurrent validity Aging and response inhibition: Normative data for the Victoria Stroop Test A narrative review of the evidence regarding the use of telemedicine to deliver video-interpreting during dementia assessments for older people Neuropsychological test administration by videoconference: a systematic review and meta-analysis Initial practice recommendations for teleneuropsychology Validity of teleneuropsychological assessment in older patients with cognitive disorders The Inter Organizational Practice Committee. Recommendations/Guidance for Teleneuropsychology (TeleNP) in Response to the COVID-19 Pandemic Emory university telehealth neuropsychology development and implementation in response to the COVID-19 pandemic Validity of teleneuropsychology for older adults in response to COVID-19: A systematic and critical review British Psychological Society D of N. Division of Neuropsychology Professional Standards Unit Guidelines to colleagues on the use of Tele-neuropsychology 2020 Teleneuropsychology: Evidence for video teleconference-based neuropsychological assessment Cognitive assessment using face-to-face and videoconferencing methods The feasibility of videoconferencing for neuropsychological assessments of rural youth experiencing early psychosis Neuropsychological assessment and telemedicine: a preliminary study examining the reliability of neuropsychology services performed via telecommunication Feasibility of neuropsychological testing of older adults via videoconference: implications for assessing the capacity for independent living The consistency of neuropsychological assessments performed via telecommunication and face to face Validation of a Novel Telehealth Administration Protocol for the NIH Toolbox-Cognition Battery Remote cognitive assessments for patients with multiple sclerosis: a feasibility study Video teleconference administration of the repeatable battery for the assessment of neuropsychological status Remote neuropsychological assessment in rural American Indians with and without cognitive impairment Symbol digit modalities test: a valid clinical trial endpoint for measuring cognition in multiple sclerosis Development and cross-cultural translations of a 31-item quality of life in epilepsy inventory Development of a patient-based symptom check list to quantify adverse effects in persons receiving antiepileptic drugs Initial development, reliability and validity of a patient-based adverse drug event scale The Liverpool adverse drug events profile The A-B neuropsychological assessment schedule (ABNAS): the further refinement of a patient-based scale of patient-perceived cognitive functioning Pearson telepractice no objection letter 2020 A comparison of intellectual assessments over video conferencing and in-person for individuals with ID: preliminary data Best practices for remote psychological assessment via telehealth technologies Current standards of neuropsychological assessment in epilepsy surgery centers across Europe Memory complaints in epilepsy: an accurate reflection of memory impairment or an indicator of poor adjustment? A review of the literature Is the underlying cause of epilepsy a major prognostic factor for recurrence? Genetics advances in autosomal dominant focal epilepsies: focus on DEPDC5 Evaluating the mediating role of executive functions for antiepileptic drugs' effects on IQ in children and adolescents with epilepsy Predicting cognitive impairment in epilepsy: Findings from the bozeman epilepsy consortium Chronic epilepsy and cognition: a longitudinal study in temporal lobe epilepsy Depression in epilepsy: prevalence, clinical semiology, pathogenic mechanisms, and treatment International League Against Epilepsy. Neuropsycholoigcal assessments for epilepsy surgery during COVID-19 Restrictions n Videoconferencing psychotherapy: A systematic review Effects of an epilepsy-specific Internet intervention (Emyna) on depression: Results of the ENCODE randomized controlled trial Telephonic review for outpatients with epilepsy-a prospective randomized, parallel group study A comparison of epilepsy patients in a traditional ambulatory clinic and a telemedicine clinic Feasibility of epilepsy follow-up care through telemedicine: A pilot study on the patient's perspective Keeping people with epilepsy safe during the Covid-19 pandemic Patient readmission and support utilization following anterior temporal lobectomy Counseling of people with epilepsy via telemedicine: Experiences at a German tertiary epilepsy center during the COVID-19 pandemic Christoph Helmstaedter has received grants from the EU, travel support by Desitin, honoraries for talks, counselling, and advisory boards by GW pharmaceuticals, Eisai, UCB pharma, and Precisis, as well as license fees by EISAI, UCB pharma and Precisis. The remaining authors have no conflicts of interest.