key: cord-0878171-j6vh0e05
authors: Balamurugan, Vigneshkumar; Balamurugan, Vinothkumar; Chen, Jia
title: Importance of ozone precursors information in modelling urban surface ozone variability using machine learning algorithm
date: 2022-04-05
journal: Sci Rep
DOI: 10.1038/s41598-022-09619-6
sha: e0e8e2aaecc396ad1079127917ba7eb52a5cd842
doc_id: 878171
cord_uid: j6vh0e05

Surface ozone (O[Formula: see text] ) is primarily formed through complex photo-chemical reactions in the atmosphere, which are non-linearly dependent on precursors. Even though, there have been many recent studies exploring the potential of machine learning (ML) in modeling surface ozone, the inclusion of limited available ozone precursors information has received little attention. The ML algorithm with in-situ NO information and meteorology explains 87% (R[Formula: see text] = 0.87) of the ozone variability over Munich, a German metropolitan area, which is 15% higher than a ML algorithm that considers only meteorology. The ML algorithm trained for the urban measurement station in Munich can also explain the ozone variability of the other three stations in the same city, with R[Formula: see text] = 0.88, 0.91, 0.63. While the same model robustly explains the ozone variability of two other German cities’ (Berlin and Hamburg) measurement stations, with R[Formula: see text] ranges from 0.72 to 0.84, giving confidence to use the ML algorithm trained for one location to other locations with sparse ozone measurements. The inclusion of satellite O[Formula: see text] precursors information has little effect on the ML model’s performance.

www.nature.com/scientificreports/ are trained using a wide range of meteorological variables, many of which drive photo-chemical processes [30] [31] [32] [33] [34] [35] [36] . The variability of surface ozone is well explained by the ML algorithm with meteorological information alone [37] [38] [39] . Temperature is identified as a key factor in explaining ozone variability in the ML model 40 . Temperature is also a driver of biogenic VOC emissions (a precursor to O 3 ) in addition to being a driver of photo-chemical processes 7, 8 . In the NO X saturated regime, ozone production is directly proportional to VOC emission (and thus to temperature), but in the NO X limited regime, ozone dependency on VOC shifts to NO X 41 . Given that many urban areas are currently in a NO X saturated regime, it is reasonable to expect that ML algorithm trained solely on meteorology will be able to explain ozone variability. After transitioning to a NO X limited regime, the ML algorithm trained solely on meteorology may fail to reproduce the surface ozone variability. Previous studies have also shown that the ozone response to temperature has been decreasing in recent years, as urban regions are transitioning to NO X limited regime 42, 43 . However, only a few studies have focused on the inclusion of precursor information into the ML model 33, 34, 36 .

In-situ VOC and O 3 measurements are too scarce when compared to NO X measurements, and all are even scarcer in rural areas. Satellite data are becoming an indispensable tool for analyzing urban and rural air quality due to their increasing spatial resolution and spatial coverage, but they are column retrievals. Since stratospheric ozone is highly variable, total column ozone retrievals from satellites are unsuitable for studying surface ozone. Satellites, on the other hand, retrieve the ozone precursors (NO 2 and HCHO (formaldehyde)), which can be used to study the surface ozone chemistry [44] [45] [46] . Because HCHO is an intermediate gas-product of VOC oxidation, it can be used as a proxy for VOC emissions. As CTMs resolve the physical-chemical processes, whereas ML algorithms do not, a hybrid modelling approach that incorporates the CTM prediction as a predictor variable into the ML model may improve the performance 47 . To this end, the objectives of this study are formulated as follows: 1) investigate the importance of limited available (in-situ and satellite) ozone precursor information and coarse CTM ozone simulations in modeling urban surface ozone variability using ML algorithm; and 2) investigate the potential of ML model's transfer-ability; how well the ML algorithm trained for one location explains ozone variability in other locations. The ultimate goal of these two objectives is to provide us confidence in modeling the surface ozone variability of locations with sparse or no ozone measurements and filling the data gap.

This study focuses on Munich, a southern German metropolitan area where air pollutants are currently measured at five different locations. Given the long-term availability of all pollutants data, we chose an urban measurement station (Lothstrasse) to train and test the ML model, which continuously measured O 3 , NO 2 , NO, and CO from 2001 to 2017. In our study, we also used data (2003 to 2017) from other three stations in Munich (Johanneskirchen-suburban, Allach-suburban, and Stachus-urban) to assess the transfer-ability of the ML model. We also tested the ML model's transfer-ability using data (2015 to 2019) from measurement stations in other German cities, including Berlin (Neukollen-urban, Wedding-urban, and Buch-suburban) and Hamburg (Bramfeld-suburban, Neugraben-suburban, and Sternschanze-urban). The geographical locations of three German metropolitan areas (Munich, Berlin and Hamburg) and its monitoring stations considered in this study are shown in Fig. S1 .

Meteorological variables (temperature, boundary layer height, relative humidity, wind speed and wind direction) are obtained from the ERA 5 reanalysis dataset, with spatial and temporal resolutions of 0.25° and 1 h, respectively 48 . Surface ozone simulations of CAMS (Copernicus Atmosphere Monitoring Service) global reanalysis dataset (EAC4) are also obtained from CAMS data store, which has a spatial resolution of 0.75° and a temporal resolution of 3 h.

The tropospheric column NO 2 and HCHO data from the NASA Aura satellite's OMI (ozone monitoring instrument) are also used 49 . OMI data has a spatial resolution of 13 * 24 km and a daily temporal resolution. The OMI local overpass occurs between 1 p.m. and 2 p.m. OMI data are available beginning in October of 2004. We filtered the OMI data before using it to include only data with no processing errors, less than 10% snow or ice cover, a solar zenith angle of less than 80° for NO 2 (70° for HCHO), and a cloud radiance fraction of less than 0.5. At the end, we only had 689 days of OMI data out of 4809 days (October, 2004 to December, 2017) for "Lothstrasse" station.

The Extreme Gradient Boosting (XGBoost) algorithm, a supervised learning-gradient boosting tree-based ML algorithm 50 , is used in this study to model surface ozone concentrations. Since our objective is to investigate the importance of precursor information in surface ozone modeling using ML, the ML algorithm we choose should be more interpretable. A tree-based ML algorithm, such as XGBoost, is more interpretable than neural networks, which are typically black box systems, and also achieves higher interpretability than simple linear regression algorithms (high-bias algorithm) 51 . We train the XGBoost ML algorithm with different predictor categories or combinations of predictor categories (Table 1) , and then compare its performance in terms of correlation (R 2 ) and root mean square error (RMSE). The predictor categories are broadly classified into meteorology (temperature, relative humidity, boundary layer height, wind speed and wind direction), in-situ ozone precursors (NO, NO 2 and CO), satellite ozone precursors (column NO 2 and HCHO) and CTM simulations (CAMS model surface O 3 ). Additionally, we consider two more predictors (day of the week and season), which we include in the meteorology category. The hyper-parameters of the XGBoost algorithm (such as the number of gradient boosted trees, learning rate, and maximum depth of a tree, etc.) are tested using grid search function (https:// scikit-learn. org/ stable/ modul es/ gener ated/ sklea rn. model_ selec tion. GridS earch CV. html) and, we find that XGBoost algorithm is not sensitive to hyper-parameters in this study. Therefore, the hyper-parameters were set to their default values (https:// xgboo st. readt hedocs. io/ en/ latest/ param eter. html). We also discuss the predictor variable (feature) importance in the ML model using the results derived from sklearn python library's "feature_importance" function, which calculates feature importance by taking the average gain across all splits (https:// scikit-learn. org/ stable/ auto_ examp les/ ensem ble/ plot_ gradi ent_ boost ing_ regre ssion. html). For this study, we focus on the afternoon 

Munich, all in-situ measurements, meteorological variables and CAMS data are available for 5375 days from 2001 to 2017. We divided the 5375 days of measurements into two parts: first 3800 days (70%) for training, and remaining 1575 days (30%) for testing the ML predictions. The k-fold cross validation (CV) is used to evaluate the performance of the ML model for different dataset combinations for training and testing. Here we choose k as 10, i.e., 5375 days of data split into 10 parts. To avoid spurious correlation between training and test datasets, we adopted a block sampling approach 52 . The first nine parts are used to train the ML algorithm, and the final one is used to test the ML model; this process is repeated ten times for the remaining combinations. The mean of R 2 derived from the k(10)-fold cross validation is then computed. The ML algorithm that was trained solely on meteorology ("ML_met") explains 77 percent of the variance (R 2 = 0.77) in measured O 3 , with RMSE of 16 µ g m −3 (Fig. 1a) . The mean R 2 of k(10)-fold CV is 0.77. Wind speed and wind direction have a low importance in the fitted model when compared to other meteorological variables (relative humidity, boundary layer height, and temperature) (Fig. S2 ). In addition, including the day of the week and season in the training dataset ("ML_ met_ds") improves the ML model's performance (R 2 = 0.81, RMSE = 14.6 µ g m −3 and mean R 2 of k(10)-fold CV = 0.80) (Fig. 1b) . This performance improvement could be attributed to the pronounced seasonal cycle of ozone and weekday-weekend differences. The ozone reaches its maximum in summer and minimum in winter, and due to being in a NO X saturated regime, weekend ozone levels are higher than the weekdays 13 . The ML algorithm trained solely with CAMS ("ML_cams") or in-situ precursors ("ML_insitu") show poor performance in all terms when compared to ML algorithm trained with the meteorology category alone ("ML_met_ds") ( Fig. 1c,d) .

The ML algorithm trained with meteorology and in-situ precursors category ("ML_met_ds_insitu") performs better than "ML_met_ds", with R 2 and RMSE are about 0.87 and 12 µ g m −3 , respectively (Fig. 1e) . The scatter of predicted O 3 by "ML_met_ds" is largely reduced in "ML_met_ds_insitu", resulting in a lower RMSE. The mean R 2 of k(10)-fold CV is 0.88, which is a 15% increase over "ML_met". The important feature in "ML_met_ds_insitu" is derived to be in-situ NO measurements, followed by boundary layer height, temperature, and relative humidity. The improvement in performance from "ML_met_ds_insitu" is thus due to the inclusion of NO measurements in the model. The addition of CAMS O 3 simulations with meteorology and in-situ precursors ("ML_met_ds_insitu_ cams") further improves the model performance (R 2 = 0.89, RMSE = 10.9 µ g m −3 and mean R 2 of k(10)-fold CV = 0.9), which is slightly higher than that of "ML_met_ds_insitu" (Fig. 1f) , with CAMS O 3 simulations being the most important feature (Fig. S2) . The feature importance calculated using the permutation approach (https:// chris tophm. github. io/ inter preta ble-ml-book/ featu re-impor tance. html) and SHAP values (https:// chris tophm. github. io/ inter preta ble-ml-book/ shap. html) agree with the feature importance calculated using each feature's gain. For example, Fig. S3 shows the feature importance calculated based on permutation and SHAP values for the case "ML_met_ds_insitu". We also performed a similar analysis using Random Forest ML algorithm with a split of 5375 dataset into 70%/30% (training/testing) (Table S1) . When compared to "ML_met_ds" in RF model simulations, the performance of "ML_met_ds_insitu" is improved (in all terms). This supports our earlier findings that including in-situ precursor information is not redundant when modeling surface ozone with ML model. Fig. 2 . The performance of each ML simulation with fewer days case (689 days) at lothstrasee station is shown in the last three columns. www.nature.com/scientificreports/ For 689 days between 2001 and 2017, all in-situ and satellite ozone precursors information, meteorological variables and CAMS data are available. Similarly, we use the first 70% of data (480 days) for training and remaining 30% (209 days) for testing the model. Also, we performed the k(10)-fold CV for 689 days of dataset. The performance of the ML algorithm trained with meteorology and satellite precursors ("ML_met_ds_satellite") is, however, equal to the performance of the ML algorithm trained with meteorology alone (Fig. 2a-c) . This implies that including satellite ozone precursor data had less effect on model performance. In terms of mean R 2 of k(10)fold CV, the ML algorithm with meteorology, satellite precursors, and the CAMS category provides slightly better results. However, it is poor than that of the ML algorithm trained with meteorology, in-situ precursors, and the CAMS category. The performance difference between ML model with a high (5375) and low (698) number of days is marginal. In all cases, the performance of the ML model with fewer days (698 days) is slightly worse than the performance of the ML model with 5375 days for training and testing (Fig. 2a-c) . To see how the availability of training dataset affects performance, we train and test the "ML_met_ds_insitu" for varying percentages of data for the 5375 days case (Fig. S4) . The difference between different dataset combinations for training and testing is also marginal; the 80%/20% (training/testing) dataset performs slightly better than the 20%/80% dataset (lower RMSE by 1.5 µ g m −3 and higher R 2 by 0.03). However, in this case, 20% of data equates to nearly three years of data, which may be sufficient to capture all ozone variability by ML model. www.nature.com/scientificreports/ We investigated the sensitivity of each predictor variable in the ML model. This is done by excluding the particular predictor variable from the "ML_met_ds_insitu" (Table S2 ). Temperature is the important feature fitted in model. When temperature is excluded from "ML_met_ds_insitu", the RMSE increases by 1.9 µ g m −3 and the R 2 decreases by 0.04 compared to all variables included in "ML_met_ds_insitu". Furthermore, at each case, when variable such as season, relative humidity, wind direction, boundary layer height, and in-situ NO is excluded, RMSE increases and R 2 decreases. There are no changes in RMSE and R 2 when the day of the week or wind speed is removed. When in-situ NO 2 or CO is removed, the RMSE decreases in comparison to "ML_met_ds_insitu", indicating that the model is over-fitted when these variables are included. Therefore, we train the ML algorithm only with season, relative humidity, temperature, wind direction, boundary layer height and in-situ NO variables ("ML_s_rh_t_wd_blh_no"), which show slightly better performance in-terms of RMSE decreases by 0.4 µ g m −3 compared to "ML_met_ds_insitu". Figure S5 depicts a time series plot of ground-truth vs modeled surface ozone concentrations, demonstrating the ML model's superior performance in modeling complex ozone variability ranging from daily to seasonal variation. ML model's transfer-ability. First, we use the "ML_met_ds" trained for "Lothstrasse" station (5375 days) to predict the ozone concentrations of other three stations in Munich, two (Johanneskirchen, Allach) of which are sub-urban and remaining one (Stachus) is urban station. When compared to ground-truth, the performance of "ML_met_ds" for two sub-urban station is better (R 2 = 0.86, 0.81 and RMSE = 12.6, 15.1 µ g m −3 ) than for the urban station (R 2 = 0.5 and RMSE = 20.3 µ g m −3 ) (Fig. S6) . The predictions are better in all terms when we use "ML_s_rh_t_wd_blh_no", compared to "ML_met_ds", indicating that including precursor information plays an important role in explaining ozone variability of other locations (Fig. 3) . These findings also imply that ML algorithm trained on long-term data for urban stations are transferable not only to other urban stations, but also to sub-urban stations, which have different emission scenarios, such as low NO X . It could be because a machine learning algorithm trained on long-term data from urban stations can learn ozone variability for various emission scenarios (e.g., low emission activities such as public holidays, weekend, etc.). When including CAMS with "ML_s_rh_t_wd_blh_no" ("ML_s_rh_t_wd_blh_no_cams"), ML model show slightly better performance (Fig. S7) .

Similarly, we use the "ML_met_ds", "ML_s_rh_t_wd_blh_no" and "ML_s_rh_t_wd_blh_no_cams" trained for "Lothstrasse" station to predict the ozone concentration of two major German cities (3 stations for each city) (Figs. 3, S6, S7) . Here, as well, the performance of "ML_s_rh_t_wd_blh_no" is better than "ML_met_ds" in all terms, with R 2 ranges from 0.72 to 0.84 and RMSE ranges from 13.1 to 17.2 µ g m −3 . When using "ML_s_rh_t_ wd_blh_no_cams", the performance is slightly better than "ML_s_rh_t_wd_blh_no" in terms of R 2 and RMSE. We also performed a ML simulation for the days that have OMI data for all nine stations in Munich, Berlin and Hamburg (Tables S3-S5 ). In all cases, "ML_met_ds_satellite" trained for "Lothstrasse" station performs slightly better than "ML_met_ds" in predicting the ozone concentrations of other locations.

In this study, the potential of a machine learning algorithm in simulating urban surface ozone has been demonstrated. As ozone is primarily produced by complex photo-chemical reactions in the atmosphere, the performance of the ML algorithm with meteorology information alone is promising; however, including the precursor emission (NO X ), particularly NO concentration, information further enhance the ML model's performance in predicting the surface ozone. It could be because NO is an important scavenger of O 3 in the urban environment. Due to the scarcity of measurements, we did not use another important insitu ozone precursor (VOC) information in this study, but instead used satellite column HCHO information in the ML model. The addition of a satellite ozone precursor (column NO 2 , HCHO) information as a new feature has little effect on the ML model performance. This could be because satellite column NO 2 and HCHO retrievals are less sensitive to surface emissions. Furthermore, the coarser resolution of satellite retrievals might limit its applicability. This study also reveals that ML algorithm, with O 3 , meteorology and precursor information (NO), trained for one location can be used to suitably model the surface ozone concentrations of different locations with sparse ozone measurements. However, the performance of ML model vary by location because other factors also influence ozone production. Therefore, we advocate for additional research that focuses on specific campaigns that measure all other factors (such as VOC emissions and aerosol load) influencing ozone formation and use an ML model to simulate the ozone variability of other locations. 

Air quality in europe 2021

Urban population exposure to air pollution in Europe over the last decades

The acute health effects of ozone and PM 2.5 on daily cardiovascular disease mortality: A multi-center time series study in China

Numerical modeling of ozone damage to plants and its effects on atmospheric CO 2 in China

Introduction to Atmospheric Chemistry

Fundamentals of Atmospheric Modeling

On the observed response of ozone to NO x and VOC reactivity reductions in San Joaquin Valley California 1995-present

On the temperature dependence of organic reactivity, nitrogen oxides, ozone production, and the impact of emission controls in

The sensitivity of ozone to nitrogen oxides and hydrocarbons in regional ozone episodes

The relation between ozone, NOx and hydrocarbons in urban and polluted rural environments

Impact of OA on the temperature dependence of PM 2.5 in the Los Angeles Basin

Volatile chemical products emerging as largest petrochemical source of urban organic emissions

Tropospheric NO 2 and O 3 response to COVID-19 lockdown restrictions at the national and urban scales in Germany

Secondary pm decreases significantly less than no 2 emission reductions during covid lockdown in germany

The use of ambient air quality modeling to estimate individual and population exposure for human health research: A case study of ozone in the Northern Georgia Region of the United States

Ambient air pollution exposure estimation for the global burden of disease 2013

One-year simulation of ozone and particulate matter in china using WRF/CMAG modeling system

Simulation of the interannual variations of tropospheric ozone over China: Roles of variations in meteorological parameters and anthropogenic emissions

Seasonal and spatial variability of surface ozone over China: Contributions from background and domestic pollution

Simulations over South Asia using the weather research and forecasting model with chemistry (WRF-CHEM): Chemistry evaluation and initial results

Effects of spatial resolution on WRF v3. 8.1 simulated meteorology over the central Himalaya

WRF-CHEM simulated surface ozone over south Asia during the pre-monsoon: Effects of emission inventories and chemical mechanisms

AQ-bench: A benchmark dataset for machine learning on global air quality metrics

A novel framework for spatio-temporal prediction of environmental data using deep learning

A convolutional neural network for spatial downscaling of satellite-based solar-induced chlorophyll fluorescence (SIFnet)

Predicting fine-scale daily NO 2 for 2005-2016 incorporating OMI satellite data across Switzerland

Estimation of surface NO 2 concentrations over Germany from TROPOMI satellite observations using a machine learning method

Satellite-based estimates of daily NO 2 exposure in China using hybrid random forest and spatiotemporal kriging model

Prediction of air quality in Shenzhen based on neural network algorithm

Machine learning-based prediction of air quality

Development of air quality monitoring (AQM) models using different machine learning approaches

Estimating ground-level ozone concentrations in eastern China using satellite-based precursors

A comparison of machine learning methods to forecast tropospheric ozone levels in Delhi

Exploring the potential of machine learning for simulations of urban ozone variability

Spatiotemporal prediction of daily ambient ozone levels across China using random forest for human exposure assessment

A hybrid model for spatially and temporally resolved ozone exposures in the continental United States

Ozone in China: Spatial distribution and leading meteorological factors controlling O 3 in 16 Chinese cities

Understanding the impact of meteorology on ozone in 334 cities of China

Increased ozone pollution alongside reduced nitrogen dioxide concentrations during Vienna's first COVID-19 lockdown: Significance for air quality management

Impact of meteorological factors on ozone concentrations modelled by time series analysis and multivariate statistical methods

Temperature and recent trends in the chemistry of continental surface ozone

Temperature dependence of tropospheric ozone under NO x reductions over Germany

The role of temperature and NO x in ozone trends in the Los Angeles basin

Evaluating a space-based indicator of surface ozone-NO x -VOC sensitivity over midlatitude source regions and application to decadal trends

Spatial and temporal changes of the ozone sensitivity in China based on satellite and ground-based observations

Inferring changes in summertime surface ozone-NO x -VOC chemistry over us urban areas from two decades of satellite and ground-based observations

A novel CMAG-CNN hybrid model to forecast hourly surface-ozone concentrations 14 days in advance

The ERA5 global reanalysis

The ozone monitoring instrument

Xgboost: A scalable tree boosting system

From local explanations to global understanding with explainable AI for trees

Can deep learning beat numerical weather prediction

Vigneshkumar. B. and Vinothkumar. B. conceived the idea of the study and performed the modelling work. J.C. supervised the work. Vigneshkumar. B. wrote the manuscript. J.C. and Vinothkumar. B. reviewed and edited the manuscript.

Open Access funding enabled and organized by Projekt DEAL.

The authors declare no competing interests.

The online version contains supplementary material available at https:// doi. org/ 10. 1038/ s41598-022-09619-6.Correspondence and requests for materials should be addressed to V.B. or J.C.Reprints and permissions information is available at www.nature.com/reprints.Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.