key: cord-290961-wbdfcaup authors: Khan, Dr Shahrukh; Saultry, Ms Bridey; Adams, Dr Scott; Kouzani, Dr Abbas Z.; Decker, Ms Kelly; Digby, Dr Robin; Bucknall, Alfred Deakin Professor Tracey title: Comparative accuracy testing of non-contact infrared thermometers and temporal artery thermometers in an adult hospital setting date: 2020-10-02 journal: Am J Infect Control DOI: 10.1016/j.ajic.2020.09.012 sha: doc_id: 290961 cord_uid: wbdfcaup BACKGROUND: NCIT are non-invasive devices for fever screening in children. However, evidence of their accuracy for fever screening in adults is lacking. This study aimed to compare the accuracy of non-contact infrared thermometers (NCIT) with temporal artery thermometers (TAT) in an adult hospital. METHODS: A prospective observational study was conducted on a convenience sample of non-infectious inpatients in two Australian hospitals. NCIT and TAT devices were used to collect body temperature recordings. Participant characteristics included age, gender, skin colour, highest temperature and antipyretic medications recorded in last 24-hours. RESULTS: In 265 patients, a mean difference of ±0.26°C was recorded between the NCIT (36.64°C) and the reference TAT (36.90°C) temperature devices. Bland-Altman analysis showed that NCIT and TAT temperatures were closely aligned at temperatures <37.5°C, but not at temperatures >37.5°C. NCIT had low sensitivity (16.13%) at temperatures ≥37.5°C. An AUROC score of 0.67 (SD 0.05) demonstrated poor accuracy of the NCIT device at temperatures ≥37.5°C. CONCLUSION: This is the first study to compare accuracy of NCIT thermometers to TAT in adult patients. Although mass fever screening is currently underway using NCIT, these results indicate that the NCIT may not be the most accurate device for fever mass screening during a pandemic. Body temperature is a vital sign that is regularly measured to assess the status of a patients' health, facilitate diagnosis and target treatments in a hospital setting. Normal body temperatures range from 36.5°C to 37.5°C 1 . Upward deviation from this range reflects a fever and may require treatment. Healthcare professionals must use the most accurate and precise measurement devices available to reproduce stable results reflecting core body temperature. The gold standard method of determining core body temperature measures blood temperature 2, 3 . Other invasive methods measure core body temperature at various sites including the oesophagus, the nasopharynx or the urinary bladder 4, 5 . Although these methods provide accurate representation of core body temperature, their invasive nature limits their application in a wide range of patients during outbreak or pandemic situations such as COVID-19. Thus, new technological tools that avoid contact and prevent the transmission and spread of viruses are emerging. The World Health Organisation (WHO) instigated public health measures including body temperature screening for rapid identification of potential Coronavirus cases and infection prevention 6, 7 . Not surprisingly, a quick, non-contact, reliable, cost-efficient and easy to use approach for temperature assessment is a pressing need for screening individuals in the current COVID-19 era. One potential method is an indirect estimate of core temperature measurement using Non-Contact Infrared Thermometers (NCITs). The NCIT is a non-contact, rapid and portable body temperature measuring tool. Measurements are taken from the frontal bone or the temporal artery. The NCIT does not require sterilisation between individuals, therefore making it a strong contender for massscreening in pandemic situations. The NCITs have been used in a wide-range of settings where the temperature of an object needs to be measured without touching it. They infer temperature by capturing the thermal radiation emitted from a focussed spot, concentrating it onto a sensing element, and converting it to an electronic signal. This signal is then digitally processed, and the temperature value is presented to the user. The conversion between thermal radiations to an electrical signal was originally described by Macedonio Melloni in the early 1800s through the discovery of the thermopile. Since Melloni's original discovery, vast improvements in fabrication and measurement processes have enabled modern devices to provide highly accurate and precise non-contact temperature measurement capabilities in a handheld unit. However, similar to many other thermometers, these devices are highly reliant on correct operator use in order to obtain accurate results. A key consideration is the distance-to-spot ratio, as the size of the area measured is directly related to the distance to the operator. Therefore, the medical use of the NCITs always recommends a specific distance between the device and the point being measured to ensure accurate results. If this distance is not fulfilled, it is impossible to guarantee that the measurements reported from the device are actual readings from the required location. Insufficient evidence exist that compares the measurement accuracy and precision of the NCITs with gold standard core temperature measurement devices in adults. Most studies conducted to date, determine the accuracy and reliability of the NCITs in children, and these studies have reported conflicting results. In children, a 0.2-0.4°C mean difference in body temperatures at or above 37.5°C was reported between the NCIT temperature when measured at forehead as compared to the core temperature measurements conducted using Temporal Artery Thermometers (TATs) 8, 9 . Also in paediatric populations, studies have compared the NCITs with alternate devices including axillary digital thermometers 8-10 , tympanic artery thermometers 8, 11, 12 , and rectal thermometers 12 . Thus, in the current pandemic, this degree of error could result in inappropriate referrals for treatment, undetected infection transmissions across healthcare organisations and associated impacts on patient safety and clinical decisionmaking. Studies comparing the correlation and differences in body temperature measured using the NCITs and other temperature measurement methods in adults are scarce. Thus, it is necessary to collect scientific evidence using robust research methods on the accuracy of the NCITs when used in adult populations. Therefore, this study compared the accuracy of the NCIT with the TAT in hospitalised adults. Characteristics of the patients' age, gender, skin colour, anti-pyretic medication use and highest temperature in the last 24 hours are assessed to determine their influence on body temperature measurement. A prospective observational study design was used to determine the accuracy of temperature measurement of the NCIT in relation to the TAT. This study was administered at two metropolitan hospitals in Melbourne, Australia. The first, a tertiary hospital that has approximately 500 beds and provides comprehensive healthcare services in the state of Victoria, Australia. It has the busiest emergency and trauma centre in Australia, one of the largest intensive care units in Australia, and provides 14 statewide services. The second hospital has approximately 140 beds and provides state-wide rehabilitation services including brain injury rehabilitation, neurological rehabilitation, spinal rehabilitation, aged care, and care for amputee patients. The study used a convenience-sampling method for recruitment of participants. All hospitals' inpatients were invited to participate in this study. A Registered Nurse explained the study aims and requirements of participation prior to obtaining verbal consent and data collection. Patients aged 16 years and older who were willing to have their temperature taken were eligible to participate. Patients in COVID-19 infection screening clinics, the emergency department, hospital in the home, radiology, outpatients and wards with diagnosed COVID-19 cases were excluded. Patients in isolation for any other reason were also excluded. Sample size was calculated using the Australian Bureau of Statistics sample size estimator 14 . Using Tay et al.'s study as a reference (N=430 participants, 7.9% fever reports), a sample size of 265 participants, were required at a prevalence rate of 5% febrile cases in metropolitan hospitals' patients, and a standard error of 0.01 15 . Two temperature measuring devices were used. The NCIT (Cocoon-NC9900) is a non-contact battery operated temperature measurement device that records body temperature or ambient temperature. It has a built-in infrared laser pointer, and records temperature in two different units (Celsius and Fahrenheit). NCIT is a factory-calibrated instrument that automatically calibrates in first 15 seconds when the device is switched on for use. The TAT (Exergen TAT 5000) also uses infrared technology to record temperature. Temperature is measured by gently moving the TAT across the forehead, and includes a momentary touch of the probe to the neck area behind the ear lobe, to account for any cooling of the forehead as a result of diaphoresis. The temperature of the skin surface (over the temporal artery) is measured used Arterial Heat Balance Technology (AHB™). The TAT takes rapid sequential readings at up to 1000 measurements per second, and reports the highest temperature detected (peak) during the measurement course. The calibration of the TAT is established by automation process through which the TAT instrument automatically self-calibrates each time the instrument is turned on. The biomedical engineering team at the tertiary hospital conducts performance testing annually using the manufacturer instructions to assess calibration of the instrument. The demographic variables recorded were age, gender and skin colour. These variables were recorded on a case report form for each individual. The temperature using both devices was also recorded for each individual and information from the patient's electronic medical record: highest temperature in last 24 hours, and antipyretic medications taken in last 24 hours. Prior to data collection, the Nurse Manager or Resource Nurse identified any patients or areas who were infectious to exclude them from the study. Following patient consent, body temperatures were taken using the standard TAT and the NCIT on the forehead. The registered nurse taking the temperature followed the manufacturer's instructions for the use of TAT and NCIT. She reviewed the manufacturer's instructions and was observed to follow the correct technique prior to commencing the data collection. Personal protection equipment of masks and gloves were worn by the data collector. The temperature evaluation was performed during the hours of 8:00 AM to 6:00 PM for a period of four days. The STATA statistical software package (Version 16) was used for statistical analysis 16 . For all tests, the level of significance was set at 0.05. Frequency distributions and mean (standard deviations) were calculated for characteristics of age, gender, skin colour, highest temperature and the anti-pyretic medication used in the last 24 hours, and body temperature recordings using the two devices. An independent sample t-test was used to calculate the mean difference between the body temperature recordings of the TAT and the NCIT. Box plots were constructed to determine the differences in NCIT body temperature amongst TAT fever and non-fever groups. Bland Altman analysis was plotted, with mean difference of the TAT and the NCIT on the y-axis and the TAT temperatures on the x-axis. A bivariate analysis using the chi-square test was performed to determine the association between the patients' characteristics and body temperature measurements. The Area Under the Receiver Operating Characteristics (AUROC) was calculated. For this study AUROC estimated the accuracy of NCIT ability to separate febrile and non-febrile patients. An AUROC value of 1 indicates the tool is strong; whereas an area of 0.5 or less indicates that the test fails to differentiate. Sensitivity and specificity score calculations were made to test the capability of NCIT to correctly identify patients with fever and without fever, respectively. Strict confidentiality of information relating to patients was maintained to protect patient identity, and to ensure no disclosure of private information. The data collected for this study was stored on a password protected RedCap database in a secure server with access available only the investigator team. The study was approved as an evaluation project as it did not meet the trigger for the ethical review as stated in the National Health and Medical Research Council Ethical Considerations in Quality Assurance and Evaluation (2014) 13 . The manuscript was reviewed by the Executive Director for Nursing Services and approved for publication. Two hundred and sixty-five patients, aged 16 years and older were enrolled in this study. Table 1 shows the characteristics of participants. The mean age of participants was 58.77 years (SD 5.04). Almost 51% participants in this survey were 60 years and older and the rest 49% participants were equally distributed amongst age groups of <30 years, 30-40 years, 40-50 years and 60-70 years respectively. There were 18.86% participants of 70-78 years, 15.84% of 80-90 years and 3.39% of 90+ years. Over 59% of the sampled population were males. More than 91% of the participants had light skin colour. The mean highest temperature measured using the reference TAT in the last 24 hours was 36.98°C (SD 0.12). Almost 66% of participants had taken an anti-pyretic medication in last 24 hours, the majority had taken a mean dose of 1gm of paracetamol. Table 2 shows the comparison between the NCIT and the TAT mean temperatures and mean differences. The mean temperature measured using the TAT and the NCIT were 36.98°C and 36.64°C, respectively. Temperatures recorded using the NCIT (0.26, p<0.001) had a significant mean difference as compared to the reference temperature using the TAT. Table 2 . Mean temperature and mean temperature differences found using the TAT, the NCIT Mean A Bland-Altman analysis compared the NCIT with the reference TAT device ( Figure 2 ). The margin of error was narrow. The average mean difference (bias) for comparison the NCIT measurements were closely clustered to that of the TAT body temperatures. The difference between the NCIT and the TAT was more dispersed at temperatures above 37.5°C (0.50, 95% Confidence Interval 0.5-1.0). However, this result should be interpreted with caution due to low numbers of febrile cases (TAT febrile group n=31; NCIT febrile group n=7) found in the studied cohort. NCITs are increasingly used for mass temperature screening due to its non-contact, rapid processing and hygiene maintenance attributes. Yet there is little evidence analysing the accuracy of the NCIT for use in adults. To address this gap, this study compared the accuracy of the NCIT to the TAT, a non -invasive infrared thermometer widely used in hospitals. Four key findings were found in this research. First, the NCIT's mean body temperature measurement (36.64°C) was in agreement with that of the TAT's (36.90°C). A mean difference of ±0.26°C was recorded between the NCIT and the reference TAT. Second, the Bland-Altman analysis showed that temperatures measured using the NCIT and the TAT were closely aligned at temperatures below 37.5°C but at temperatures >37.5°C, the mean differences widened considerably. Third, an AUROC score of 0.67 (SD 0.05) demonstrates poor accuracy of the NCIT device at temperatures ≥37.5°C. Fourth, patient characteristics were associated with significant mean differences in temperature. Paediatric studies have suggested that the NCIT is an accurate and reliable device based on its sensitivity and specificity scores, and lower mean difference when compared to alternate temperature measuring devices 13, 17 18 . The differences in diagnostic accuracy in ours and previous studies may result from differing patient characteristics, device attributes and environmental factors (e.g. ambient temperature). Strict attention to the standard operating procedures based on user guidelines is required to be followed for accurate measurement of temperature using NCIT devices 19 . If standard operating procedures are not adhered to and incorrectly executed, then non-accurate results may occur 19 . In our study, the same RN collected the temperatures and strictly attended to the standard operating procedures for each patient measured. Other studies Patient characteristics of gender and skin colour were significantly associated with the mean difference in temperatures. Higher mean temperature differences for females compared to males is consistent with the literature that reports females have greater thermal responses to exogenous and endogenous heat load/loss. A larger ratio of body surface to body mass, greater subcutaneous fat, and lower exercise capacity are factors that influence female temperature regulation 20 . Hormonal modulation during the menstrual cycle may also modify thermoregulation in women 20 . In the current study, participants with light skin colour had a higher mean difference in body temperature as compared to participants with medium and dark skin colour. To the authors' knowledge, this is the first study that has compared the temperature differences based on skin colour. There is a level of subjectivity deciding on skin tone so we chose to group into two groups. However there were small numbers in the sample so the results must be interpreted cautiously. Other factors, not analysed in this study, may also influence body temperature discrepancies between the NCIT and the TAT. These factors include patient-and environmental-related factors. We did not attempt to determine some patient-related factors such as skin thickness, blood flow under the skin, metabolic rate, cardiac output, hormonal levels. Other patient characteristics, such as forehead perspiration 13 and anti-pyretic medication taken, may influence the NCIT measurements. Other environmental factors that could lead to false readings includes sub-optimal training of operators, inappropriate positioning of the thermometer, and uncontrolled temperature within the rooms. The ambient temperature of each ward was not recorded in this study. However, pre-operational training by the research nurses in regards to the device use and device cleaning, were undertaken to follow the device manufacturer instructions. This is the first study to compare accuracy of NCIT to a reference device TAT in adult hospitalised patients. Although mass fever screening is currently underway using NCIT, these results indicate that the NCIT may not be the safest device for mass fever screening in adults if used in isolation during a pandemic. It should be noted that fever screening is often conducted in less controlled conditions than those presented in this study, which may result in further decreased accuracy than our findings. Additional research is required to compare its accuracy and precision to other invasive and non-invasive core body temperature testing methods. Hypothermia: prevention and management in adults having surgery. NICE clinical guideline Simplified and highly accurate core temperature measurements Core body temperature measurement: a comparison of axilla, tympanic membrane and pulmonary artery blood temperature Accuracy of digital tympanic, oral, axillary, and rectal thermometers compared with standard rectal mercury thermometers Comparison of esophageal, rectal, axillary, bladder, tympanic, and pulmonary artery temperatures in children Novel Coronavirus ( 2019-nCoV). 2020. World Health Organization COVID-19): Information and advice about coronavirus (COVID-19) -symptoms, travel and what to do to reduce the risk of infection Department of Health and Human Services Victoria Clinical accuracy of tympanic thermometer and noncontact infrared skin thermometer in pediatric practice: an alternative for axillary digital thermometer Use of noncontact infrared thermography to measure temperature in children in a triage room Digital Axillary and Non-Contact Infrared Thermometers for Children Comparison of infrared tympanic thermometer with non-contact infrared thermometer. / Temassz kzlötesi termometre ile timpanik kzlötesi termometre karslastrmas Accuracy of tympanic and infrared skin thermometers in children Sample size calculator Comparison of Infrared Thermal Detection Systems for mass fever screening in a tropical healthcare setting Performance of non-contact infrared thermometer for detecting febrile children in hospital and ambulatory settings Kaciuba-Uscilko H and Grucza R. Gender differences in thermoregulation To the authors' knowledge, this is the first study that determined the accuracy of the NCIT in comparison to the TAT in adult inpatient hospital wards. The study followed strict protocol and infection control guidelines. There were several limitations for this study. First, a convenience sampling method was used for recruitment of participants in two hospitals.Although this is a simple, cost effective and easy to use method, the sample recruited using this method may not representative of the population. Second, repeated measures were not recorded to check precision of the NCIT. Third, the number of febrile cases (≥37.5°C) were limited to 31(11.7%) cases only. The NCIT is a fast, non-invasive, non-touch, hygienic device. NCIT temperature device training is required to increase the accuracy of the measurements.However, variable levels of accuracy in paediatric and adult populations highlighted the need for further research, particularly to validate the use in adults. In this instance, a larger sample size, use of a random sampling method, and repeated measurement of temperatures using NCIT and multiple reference devices is required. Furthermore, the response of NCIT devices to patient and environment factors such as patient physical characteristics, physical exercise and variable ambient temperatures needs further study. Given the low sensitivity for temperatures over 37.5°C it may be preferable to use a direct temperature measurement device for temperatures greater than 37.5°C to check accuracy in health care settings. Nurses frequently have various temperature measurement options to use in clinical settings, this article offers a comparison of two different types that both indirectly rely on skin temperature measurement. This study provides health professionals with information on the reliability of the NCIT and cautions them about the low sensitivity for temperatures over 37.5°C.