key: cord-0759821-5zqr9wgi
authors: Cheng, Fengmin; Jin, Yanjun; Chien, Ching-Wen; Xiong, Lei; Chuang, Yen-Ching
title: A Hybrid MADM Model for Newly Graduated Nurse's Competence Evaluation and Improvement
date: 2021-03-08
journal: J Healthc Eng
DOI: 10.1155/2021/6658538
sha: 8bd6a4d231eb56877aaf5e52023af3ff34a005d6
doc_id: 759821
cord_uid: 5zqr9wgi

Nursing departments in hospitals must evaluate the practical competency of newly graduated nurses and assist them to increase their competence. Competency assessments often consider multiple qualitative attributes and use expert knowledge as the basis for decision-making. This study proposes a hybrid multiple attribute decision-making (MADM) model that determines practical competency of the newly graduated nurse as an evaluation framework. A causal influence-network diagram (CIND) and influential weights are obtained from nursing experts' clinical experience using the decision-making trial and evaluation laboratory (DEMATEL)-based analytical network process analysis (DANP). The MOORA-AS method is then used to evaluate the ability expectation ratio-gap for newly graduated nurses in practice. The CIND is used to allow each newly graduated nurse to reduce the performance ratio-gaps between the current level and the aspirational level from a systematic perspective. The empirical data applies to a third-class and a first-class hospital in China. The results show that the proposed hybrid MADM model has reliable results and allows nursing department decision-makers/managers to easily evaluate and systematically improve competencies for newly graduated nurses.

e 2019 Coronavirus (COVID-19) pandemic has had a devastating impact on a global scale on the public health, the economy, the labor market, and other aspects of personal and social life [1] . During global health emergencies, nurses constitute the largest professional group for the provision of first-line healthcare [2, 3] . e clinical nursing and management abilities of nurses are key to identifying, isolating, and managing COVID-19 patients and to providing support for non-COVID-19 patients [3, 4] . 2020 has been named the International Year of the Nurse and Midwife by World Health Organization (WHO) [5] .

Resignations among nurses are increasingly common [6] . is fact is worrying because high turnover rates lead to a shortage of nurses and reduce the quality of care, which can lead to adverse patient outcomes [7, 8] . However, more than 20% of all newly graduated nurses leave their jobs within one year, which exacerbates the shortage of nurses [7] . 27 .6% of all newly graduated nurses in the United States left their jobs in 2019 [9] . Some studies list the factors that influence the intention of newly graduated nurses to leave their jobs, including working environment, clinical ability and support level, effective leadership, team cohesion, job satisfaction, job stress and coping with self-efficacy, rewards and recognition, and professional development opportunities [7, 10, 11] . Poor ability is one of the main reasons for intended and actual resignations among newly graduated nurses [11, 12] . From the outbreak of Severe Acute Respiratory Syndrome (SARS) in 2003 until the global epidemic involving COVID-19 2019, the increase in the risk of nosocomial infection, the change in nursing requirements, and the increased difficulty of the job increase the willingness of new graduates to leave their profession.

In many cases, newly graduated nurses have insufficient knowledge and experience to supplement their expected job responsibilities, and their knowledge and experience are insufficient to follow practice [13, 14] . is occurs because the profession cannot fully identify and integrate nursing competencies and instill them in the early practice for newly graduated nurses [7] . Practical projects and processes that allow newly graduated nurses to progress have been extensively studied [15] [16] [17] . However, the level of competency for newly graduated nurses after graduation that meets the needs in practice is unclear [18] , so nursing management faces new challenges.

One study systematically reviewed the assessment of clinical nursing competence and found that the definition of competence is vague and lacks the reliability and validity of systematic measurement tools or strategies [19] . In terms of evaluating competency, studies use multiple attribute decision-making (MADM) methods to evaluate personnel, for selection and for improvement. Chen et al. [20] used the analytical hierarchy process (AHP) to evaluate human resources performance in the logistics market. De Moura and Sobral [21] used the elimination and choice translating reality (ELECTRE) method to classify the competency of employees in a call center. Some MADM methods use interdependence relation perspective, such as the decision-making trial and evaluation laboratory (DEMATEL) [22] , the analytical network process analysis (ANP) [23, 24] , and the DEMATEL-based analytical network process analysis (DANP) [25] . MADM methods are used for decision-making processes to evaluate personnel, but no studies evaluate the ability of new nurses.

is study develops a hybrid MADM model. e DMATEL method is used to confirm the interaction between attributes and to determine the causal relationship. e results are visualized using a plot, called a causal influence-network diagram (CIND). e influence weights of interdependence between attributes are then derived using the DANP method. e MOORA-AS method is used to evaluate the practical competency of three newly graduated nurses and to determine the attribute of the largest aspirated ratio-gap. e CIND is then used to decrease the maximum aspirated ratio-gap for each newly graduated nurse, and the improvement strategy is based on the system perspective. e hybrid MADM model makes the following contributions to this field of study:

(i) e CIND visualizes the influential relationship structure within attributes and identifies the key factors among abilities from a systematic perspective in the real world. (ii) e CIND is used as an improvement tool with a systematic perspective to allow nursing department decision-makers/managers to propose causal improvement suggestions that correspond to each newly graduated nurse's competency. is improvement strategy also avoids the problem of "treating the head when the head aches and treating the foot when the foot hurts" [26] .

(iii) e concept of an aspiration level is used to prevent "choosing good apples from rotten apples," which is a feature of the original MOORA method [27] .

e MADM methodology for this study allows nursing researchers to apply various MADM methods to future nursing-related management decision-making problems. e nursing departments of a third-class and first-class hospital in China are used as an empirical case. e results show that the model allows nursing department decision-makers/managers to propose appropriate strategies and improvements to prepare newly graduated nurses for practice. e remainder of this paper is divided into five sections. Section 2 details the competency framework for a newly graduated nurse and the use of MADM models to evaluate the competence of personnel and the background of the MADM methods for the proposed model. Section 3 presents the hybrid MADM model and its corresponding approaches. Section 4 describes the computational process for the empirical case using the proposed model. Section 5 discusses the results of Section 4. Finally, the conclusion is presented in Section 6.

Evaluating the competence of a newly graduated nurse is a personnel assessment problem that involves MADM. It often involves intangible factors and is based on the practical experience of domain-experts. e competency framework for a newly graduated nurse is firstly described. e current use of MADM models for personnel assessment is also discussed. e MADM methods for the proposed hybrid MADM model are then detailed.

Practice readiness refers to the comfort level of new graduates in assuming the professional duties of nurses (professional abilities) [28] . It also refers to thinking like a nurse (professional ability) [29] . e ability index system of a newly graduated nurse is based on the results of the conceptual analysis methods of Mirza et al. [30] . is study uses several databases (CINAHL, PubMed, EBM, and ProQuest) and adopts Rodgers' evolutionary method of conceptual analysis to combine the results of these databases into a conceptual model for the practical preparation of newly graduated nurses. A newly graduated nurse who is preparing to become a qualified nurse must demonstrate cognitive capability (C 1 ), clinical capability (C 2 ), and professional capability (C 3 ) as main competency characteristics. ese competencies are the abilities that a newly graduated nurses needs before undertaking professional duties. Nurses must also be able to cope with new and unfamiliar nursing situations so they must evaluate and improve existing abilities. ese cognitive, clinical, and professional capabilities contribute to a newly graduated nurse's sense of self-efficacy and a sense of practice readiness [31] . ese three main capabilities are described in detail in Table 1 .

In the past few decades, the MADM methods have been widely applied to evaluate and improve personnel competency. Studies that use expert knowledge as a decision-making basis can be roughly divided into three categories: (1) crisp MADM methods, (2) uncertain MADM methods, and (3) other advanced hybrid methods.

Crisp MADM methods. is category of research establishes the function of a decision-making model (i.e., selection or improvement) and uses different decision-making viewpoints, such as preference relationship or influence relationship, so it is a crisp MADM model. For example, Chen et al. [20] used the AHP method to evaluate human resources performance in the logistics market. De Moura and Sobral [21] used the ELECTRE method to classify the competency of employees in a call center. El-Santawy and Ahmed [42] addressed the personnel selection problem using the SDV-MOORA method. e basis of these MADM models is independent relationships, which is inconsistent with the actual situation. Studies regard interdependence as the premise for modeling. Ishizaka and Pereira [23] described a management system that uses MADM analysis and visualization technology, including ANP and PROM-ETHEE methods. Kucukaltan et al. [24] developed a decision model to identify and prioritize key factors in the logistics industry using a balanced scorecard (BSC) and ANP methods. Aksakal and Daǧdeviren [22] developed an integrated approach for personnel selection using DEMATEL and ANP methods. is type of studies establishes the functions of the decision-making model and does not consider the fuzziness of human semantic expression.

Uncertain MADM methods. ese consider various ambiguous phenomena and extend the decision-making function using crisp MADM models for the fuzzy expression of human semantics. ese are termed fuzzy MADM models. Skrzypek and Dąbrowski [43] used the fuzzy AHP approach to organize an effective team from a group of employees. Karabasevic et al. [44] proposed an uncertain personnel selection framework using SWARA and ARAS methods. Gilan et al. [45] used an interval type-2 fuzzy set for selection of personnel in construction companies using a hierarchy of competency. Wu and Wang [46] combined a cross-entropy and neutrosophic set for the selection of middle-level managers. Canós et al. [47] used fuzzy set methods for personnel selection by evaluating competencies.

is type of studies takes into account the ambiguity of human semantic expression, so the decision model uses an independent relationship perspective.

Other advanced hybrid methods. ese studies solve complex decision-making problems using a combination of methods, including mathematical methods, soft computing, and machine learning methods. e models are also called advanced hybrid decision-making models. Patel and Jha [48] Cognitive capability (C 1 )

Competence (C 11 ) Newly graduated nurses know how to use nursing knowledge in particular contexts or situations [32, 33] Effective clinical and moral reasoning (C 12 )

Newly graduated nurses should exhibit critical thinking and problemsolving skills to make effective clinical judgments in different clinical situations, and they should also be expected to use nursing procedures to plan and evaluate effective nursing measures for patients. Moral reasoning plays a role in the formulation of professional practice. [28, 29, [34] [35] [36] Situational awareness (C 13 ) Newly graduated nurses should be able to determine their limitations in different clinical situations and seek help when needed. is cognitive ability of situational awareness is crucial to providing safe nursing. [34, 37] Clinical capability (C 2 )

Psychomotor skills (C 21 ) Newly graduated nurses must have the necessary mental skills to be psychologically prepared for practical nursing work [28, 29, 35, 38] Clinical assessment (C 22 )

Clinical evaluation is an important skill that reflects clinical ability, including analyzing a patient's condition, detecting changes in a patient's condition, predicting problems, and identifying a patient's needs [29, 36, 39] Care delivery and coordination (C 23 )

Soft skills to provide patient care and coordinate and cooperate with colleagues in the workplace, such as effective interpersonal communication, teamwork, and time management, are also basic requirements for providing effective patient care [28, 36, 38, 40] Professional capability (C 3 ) Development of professional identity (C 31 ) e development of the professional identity of newly graduated nurses allows them to fulfil the multiple roles of professional nurses, such as administration, clinical and nursing research [28, 37] Self-esteem, self-worth, and self-efficacy (C 32 ) Newly graduated nurses should have self-esteem, self-worth, and the ability to operate independently and be responsible for their nursing practices. e individual's belief in their readiness for practice is also an important element of the various capabilities.

[ [35] [36] [37] 41] Ethical practice (C 33 ) Newly graduated nurses must also have a moral and ethical code that is based on moral reasoning components (cognitive abilities). [29] Journal of Healthcare Engineering 3 used an artificial neural network (ANN) to evaluate and predict the work behavior of employees at construction projects. Ahmed et al. [49] used a fuzzy inference system (FIS) to evaluate employee performance. Hanna et al. [50] proposed a general mathematical formula to reliably weigh the capabilities of different project managers in the construction industry. Bohlouli et al. [51] developed a competency evaluation model as a human resource management expert system using mathematical methods. For this type of study, mathematical methods can only process quantitative data. Data mining then requires a large amount of survey data.

e decision-making trial and evaluation laboratory (DEMATEL) is a structural analysis technique that was developed by Battelle Memorial Institute to solve complex structural problems of society in the real world [52, 53] .

e results for the DEMATEL method allow decision-makers to understand the contextual and interdependent relationships between elements in the system effectively [54] . Lee et al. [55] extended its application value and further proposed a new weight analysis method, which is based on the concept and calculation of the ANP method [56] , namely, the DEMATEL-based ANP or DANP method.

e DANP method provides the causal influence-network diagram (CIND) and influence weight from a systematic perspective. Now it is used for various decision-making problems, such as cloud service applications [57] , workload stress problems [58] , and design of public open space [59] .

MOORA began as an evaluation method that is stable. It was developed by Brauers and Zavadskas [60] . is method combines two different analytical viewpoints: the ratio system and the reference point. e former represents the overall performance of an evaluation system, which allows decision-makers understand the performance of all alternatives. e latter represents the worst performance for attributes in the system. e system is stable in terms of performance ranking, so it is also used for supplier selection [61] , failure prioritization [62] , and financial services [63] . Liou et al. [64] further integrated the concept of an aspiration level to solve the defect of the reference point in the original MOORA method (i.e., picking a good apple from a group of rotten apples), which is the MOORA-AS method. e MOORA-AS method gives robust results in terms of solving the ranking and selecting alternatives but also reduces the performance ratio-gap for each attribute, so it is close to zero and reaches the aspiration level.

e proposed newly graduated nurse's competence framework (as shown in Table 1 ) is used to develop a hybrid MADM evaluation model, which uses the clinical experience of nursing experts (i.e., administrators, head nurses, and instructors of nurses), the interdependent relationship structure, and the weight between attributes in the real world. e modeling process for the proposed hybrid MADM model uses the DEMATEL, DANP, and MOORA-AS methods.

ere are three main modeling stages, as shown in Figure 1 . e first stage. e DEMATEL method is used to construct the interdependent relationship structure between attributes.

is stage derives the total influence matrix and the causal influence-network diagram (CIND) between attributes using the clinical experience of an expert group. e computing process for this method follows the following steps:

Step 1: constructing an initial influence relation matrix H using clinical nursing experience. Using the competency framework with n attributes, clinical nursing experts use the five-point response scale with language variables (as shown in Table 2 ) to respond in pairs to the initial influence relation degree between attributes to obtain a nonnegative initial influence relation matrix H � [h ij ] n×n , as shown in equation (2).

where k represents the number of clinical nursing experts and o k ij represents the initial influence relation matrix for the k-th expert.

Step 2: calculating the normalized influence relation matrix S. Before calculating each subsequent degree of influence for matrix H, the influence boundary/limited scope is defined and converted into the matrix S, as shown in equations (2) and (3).

where the values in matrix S are between 0 and 1 and the maximum sum of a row or a column is always equal to 1.

Step 3: exporting the total influence relation matrix A.

Under the condition of matrix S, the influence relation degree (direct and indirect) between attributes is continuously calculated using the Markov chain process. If lim Ω⟶∞ S Ω � [0] n×n , the total influence relation matrix is obtained, as shown in equation (4).

where I is an n × n identity matrix.

Step 4: creating the causal influence-network diagram (CIND).

Using matrix A, four different influence indices are created for each attribute. e equations are shown as (5)- (8) , and their corresponding explanations are as follows:

Given influence:

Received influence:

Prominence:

Relation:

e "given influence (p i )" is the total influence degree of the i-th attribute on other attributes; otherwise, the "received influence (y i )" is the total influence degree of the i-th attribute due to other attributes. "Prominence (p i + y i )" is the total strength of the given and received influence for the i-th attribute in a clinical nursing environment. "Relation (p i − y i )" describes the properties of the main influence of the i-th attribute in the clinical nursing environment. If the value ofp i − y i is positive, then the i-th attribute affects other attributes. If the value is negative, the i-th attribute is influenced by other attributes. A causal influence-network diagram (CIND) is created using "prominence (p i + y i )" and "relation (p i − y i )." e second stage: the DANP method is used to derive the influential weight using the interdependent relationship structure between attributes. e DANP method is used to derive the influential weights from the results for the total influence relation matrix A using the DEMATEL method. If the capability framework is hierarchical, matrix A has two levels: the matrix with attribute level A C and aspect level A D . e computing process for this method follows the following steps:

Step 1: transferring the unweighted supermatrix A Φ * C from the total influence relation matrix A C . e proportion and transposition of influence relations at different aspect levels mean that this conforms to the ANP method calculation process. e normalized total influence relation matrix A Φ C , which is also known as unweighted supermatrix A Φ * C , is shown in 

Gain influencetial weights (IWs) Obtaining the score of reference ratio-gap point for each newly graduated nurse Figure 1 : e three main stages of the hybrid MADM model. 

where A Φ C represents the normalized influence relation ratio for matrix A C within the aspect A D , superscript Γ is the transpose, n represents the number of attributes, and m represents the number of aspects.

For this step, the normalization action is explained using the submatrix A 11 ΦC in the matrix A Φ C as the sample, as shown in equation (10) 

where c 11 i � m 1 j�1 a 11 C ij , i � 1, 2, . . . , m 1 .

Step 2: constructing a weighted supermatrix U using different influence ratio perspectives. e unweighted supermatrix A Φ * C only converts numerical values into the proportional form and does not consider the difference in influence proportion between aspects (i.e., the proportion of each aspect is equal). In this step, the total influence relation matrix A D is the coefficient (i.e., transposed and normalized matrix A Φ * D ) to adjust the matrix A Φ * C , so the final influence weight is closer to reality. In terms of ideas and methods. It also addresses the defects of the weighted super-matrix for the original ANP method. e equations are

where d i � m j�1 a Di j ij , i � 1, 2, . . . , m.

Step 3: calculating the influential weights.

e weighted supermatrix U is multiplied by itself several times to become a steady-state supermatrix using the Markov chain concept and calculation. e limited supermatrix ϖ is then obtained, as shown in

e third stage: the MOORA-AS method is used to calculate the performance ratio-gaps on competencies for newly graduated nurses. e MOORA-AS method is used to calculate the total competency performance ratio-gap and the ratio-gap for each attribute for newly graduated nurses. e steps for this method are as follows:

Step 1: Establishing a performance matrix for newly graduated nurses. e performance matrix R uses the evaluation framework (as shown in Table 1 ), whereby clinical nursing supervisors or managers use an 11-point scale (0 is the worst; 10 is the best) to evaluate the ability of newly graduated nurses, and the ability of each new nurse is calculated using the average method. e performance matrix R is defined in R � r eq u×n , e ∈ 1, 2, . . . , u { }, j ∈ 1, 2, . . . , n { },

where u represents the number of newly graduated nurses and n represents the number of attributes.

Step 2: normalizing the performance matrix using the aspiration level.

In MADM decision-making problems, the scale for each attribute often lies within a known range, from the maximum value to the minimum value of the scale. When an aspiration level is used, the maximum value for the scale becomes the aspirated solution (i.e., r aspired q ). However, the minimum value is the worst solution (i.e., r worst q ).

e normalized matrix is shown in

where r Φ eq represents the performance gap ratio between 0 and 1.

Step 3: building the score for the ratio-gap system for each newly graduated nurse. e ratio-gap system for newly graduated nurses reflects the overall gap between current performance and aspirational level. e lower the value, the higher the ranking for the new nurse in terms of all new nurse candidates. e calculation is shown as

where ϖ q represents the influential weights, as calculated using the DANP method.

Step 4 : Calculating the score for the reference ratio-gap point for each newly graduated nurse. e reference point for newly graduated nurses is the worst attribute (the maximum ratio-gap), so this is the maximum ratio-gap for ability, as shown in F e � max q ϖ q × r Φ eq |q � 1, 2, . . . , n , ∀e.

A third-class and first-class official hospital in China are used to illustrate the use of the hybrid proposed MADM model to evaluate the ability and determine the improvements in newly graduated nurses.

Collection. e case involves a third-class and a first-class hospital that offer medical treatment, scientific research, teaching, and prevention. In terms of medical disciplines, the case hospital has 14 provincial specialized disease centers in the region (there are 20 centers in the region) and 23 key medical disciplines (orthopedics, digestive medicine, and cardiovascular medicine).

ere are 1,924 beds in the case hospital and an Journal of Healthcare Engineering 7 average of 110,000 hospitalizations each year. In the 2019 self-assessed statistical report, the number of outpatients was over 2.7 million, and the number of discharged patients was about 108,000. e number of medical disciplines and the population in the region mean that the case hospital is one of the major hospitals in the region. Every year, the hospital employs approximately 150 new nurses. Every month, the hospital gives a series of standardized training courses to track the training and assessment results for new nurses. ere is also a series of assessment standards for clinical practice. ese measures allow new nurses to integrate into clinical nursing work as soon as possible and provide better nursing services for hospitalized patients. e evaluation of competency includes quantitative indicators and nonquantitative indicators; therefore, in addition to the existing clinical quantitative index evaluation system, the decision-making model for competency allows nursing departments to systematically evaluate the ability of new nurses and to propose improvement strategies, which is the most important management problem in hospitals at present.

is study proposes a hybrid MADM model that uses the newly graduated nurse competency framework (as shown in Table 1 ) from a past study and MADM methods. For this study, data was collected from 15 clinical nursing experts (2 nursing administrators, 6 head nurses, and 7 nursing instructors). In terms of clinical nursing experience, one expert had more than 2 to 3 years, 1 expert had more than 4 to 5 years, 3 experts had more than 5 to 10 years, and 10 experts had more than 10 years. ese head nurses or nurse instructors are nurses with much professional and clinical experience in nursing. ey are also aware of the relationship between the abilities that newly graduated nurses should possess and these abilities. ree newly graduated nurses with less than 3 years of employment are the evaluation objects.

Attributes Using the DEMATEL Method. Based on the practical experience of 15 clinical nursing experts, an initialization influence relationship matrix was established, as shown in Table 3 . e quality of this matrix is very important because it affects the results for the structure of a causal relationship and the weight, as well as subsequent evaluation and improvement strategies that are proposed as a consequence. Using the concept of a confidence level and a 15-fold cross-validation process, the average variance consistency for the initialization matrix is between 0.043 (i.e., 4.3%) and 0.011 (i.e., 1.1%), with an average of 0.019 (i.e., 1.9%, less than 5%). e significant confidence level is 98.1% (i.e., greater than 95%), so the experience of this group of clinical nursing experts is consistent, and the subsequent results are very stable, as shown in Table 4 . e initialization matrix H describes the total influence relationship degree between attributes using equations (2) to (4) , which is the total influence relationship matrix A, as shown in Table 5 .

Finally, the total influence relationship matrix A uses (5) to (8) to calculate the total "given influence (p i )" and "received influence (y i )" for each attribute and the "prominence (p i + y i )" and "relation (p i − y i ),"as shown in Table 6 .

A causal influence-network diagram (CIND) allows nursing department decision-makers/managers to understand the interaction between all aspects and attributes for newly graduated nurses by identifying the influence structure between "prominence (p i + y i )" and "relation (p i − y i ),"as shown in Figure 2 . In Figure 2 , in terms of aspect level, "cognitive capability (C 1 )" is the basis for the other two abilities ("professional capability (C 3 )" and "clinical capability (C 2 )"). Only when a newly graduated nurse has a clear understanding and judgment of situations and surrounding things in the clinical environment, are the advantages, disadvantages, and limitations obvious, and only then can professional values, beliefs, and goals be defined. is develops a strong internal driving force to continuously work to achieve goals. Under the influence of this internal drive, nurses study hard and improve their self-competence, professional ability, and clinical ability. "Effective clinical and moral reasoning (C 12 )," "psychomotor skills (C 21 )," and "development of professional identity (C 31 )" are the most critical attributes at the corresponding levels.

e total influence relation matrixAdescribes the influence weight for each attribute using (9) to (13) , which also shows the importance of each attribute to the overall ability of newly graduated nurses, as shown in Table 7 . In terms of weight, an improvement in "clinical capability (C 2 )" is the premise for newly graduated nurses to be better qualified for clinical nursing work. If there is a rapid improvement in clinical ability, newly graduated nurses can continuously improve their ability to observe and discover problems and their prospective analysis ability, so newly graduated nurses can learn to make correct clinical judgments and decisions and address existing or potential clinical problems. In the process of clinical nursing practice, clinical ability is the most important of these three competencies at aspect level.

ree newly graduated nurses were assessed by clinical nursing experts using the newly graduated nurse's ability assessment framework (as shown in Table 1 ) and an 11-point scale (the worst is 0 points; the best is 10 points) to derive an original performance score using the average method. e original performance score uses equations (14) to (17) for the MOORA-AS method to calculate the performance ratio-gaps for the overall ability of the three newly graduated nurses. e results are shown in Table 8 . ese results show that "newly graduated nurse B" has the smallest ratio-gap with the aspirational level, so this is the best of the three newly graduated nurses.

Based on these results, the improvement strategies and the causal relationship are further explained and the original MOORA and MOORA-AS methods are compared.

Improvement strategies for newly graduated nurses are formulated using the results for the reference ratio-gap ratio (Table 8) , the CIND (Figure 2 ), and the weight (Table 7) . e results for newly graduated nurse A are shown in Figure 3 . "Cognitive capability (C 1 )" is the worst attribute (i.e., ratio-gap � 0. 082) at the aspect level, and it is also the most main influence source for the entire capability framework (relation is ranked first). Further analysis at the attribute level shows that "effective clinical and moral reasoning (C 12 )" has the maximum ratio-gap (i.e., 0.084). It is also the main influence source.

Using these results, the nursing department decisionmakers/managers might propose appropriate training courses or alternatives to improve "effective clinical and moral reasoning (C 12 )." When "effective clinical and moral reasoning (C 12 )" is improved, the overall ability of newly graduated nurse A will improve. is study shows that the quality of standardized training for nurses after graduation is important. Standardized training for nurses uses the basic stages of the growth for new graduated nurses and remains crucial for a nurse's professional development. It is a process that promotes the formation of professional ethics, cultivation of clinical thinking mode, and standardization and improvement of nursing practice for new nurses.

To improve the performance of newly graduated nurse A in terms of the C 12 criteria, a systematic symptom care course for each symptom is necessary: overview; nursing evaluation; nursing measures and case analysis. Newly graduated nurse A must attain basic theoretical knowledge and skills for psychological care, health education, and other humanistic care knowledge. Newly graduated nurse A must understand the internal relationship between symptoms and Note. e values of the MOORA-AS method are weighted and are calculated using equations (14) to (17) .

disease for symptom analysis, make correct clinical judgments, and better guide clinical practice.

Methods. Table 9 shows the difference between different methods for the same performance data. e ranking for the reference ratio-gap point is different. e ranking for the original MOORA method is newly graduated nurse A ≻ newly graduated nurse B ≻ newly graduated nurse C, but for the MOORA-AS method, the ranking is newly graduated nurse B ≻ newly graduated nurse A ≻ newly graduated nurse C. Using the original MOORA method, the attribute ratiogap has a large number of zero scores or perfect scores for newly graduated nurse B and newly graduated nurse C, who are the best and worst cases, respectively. Many ratiogaps � 0 points (i.e., C 1 , C 11 , C 12 , C 13 , C 21 , C 22 , C 32 , C 33 ) for newly graduated nurse B, and many proportion-gaps � 1 point (i.e., C 1 , C 11 , C 12 , C 13 , C 2 , C 21 , C 22 , C 23 , C 32 , C 33 ) for newly graduated nurse C. is is because the original MOORA method uses relative concepts for ranking, but MOORA-AS uses absolute concepts (i.e., aspiration level) for ranking. e MOORA-AS method gives a more robust ranking for nursing department decision-makers/managers, especially if the measurement scale is known.

Professional nurses play a key role in the fight against COVID-19 infection. e shortage of professional nurses has been a problem for the medical system and hospitals because of the high turnover rate for newly graduated nurses. is study proposes a decision-making model to allow nursing department decision-makers/managers to improve the competence of newly graduated nurses and to decrease the ability gaps between newly qualified and professional nurses. A hybrid MADM model is proposed, which uses an evaluation framework that is based on findings for the competency characteristics of new graduate nurses from previous studies, combined with the MADM method, which is based on the system perspective. An empirical study of the hybrid MADM model uses data from a third-class and a first-class hospital in China, including the modeling process, result analysis, and improvement strategy. e highlights of each stage are as follows:

(1) e competency framework for this study describes the competency that is required for a newly graduated nurse before entering a new nursing position and the ability to cope with new and unfamiliar nursing situations by evaluating and improving existing competencies. is competency framework is based on the results of previous studies of competency problems involving recent graduates. e problem is a MADM problem and is the subject of few studies.

(2) e results for the CIND show that cognitive capability (C 1 ) is a critical factor for the other two abilities: professional capability (C 3 ) and clinical capability (C 2 ). is is because the cognitive capability is improved. e professional capability and clinical capability are also improved to a certain extent. Effective clinical and moral reasoning (C 12 ), psychomotor skills (C 21 ), and development of professional identity (C 31 ) are the most critical attributes at the corresponding levels. (3) e results for influential weight show that an improvement in clinical capability (C 2 ) is related to newly graduated nurses being better qualified for clinical nursing work, so newly graduated nurses make correct clinical judgments and decisions and finally address the current and potential clinical problems of patients correctly. For the process of clinical nursing practice, the weight for clinical ability is the most important of these three competencies in terms of aspect level. (4) In terms of a systematic improvement strategy for newly graduated nurse A, nursing department decision-makers/managers could propose appropriate training courses or programs to improve effective clinical and moral reasoning (C 12 ) because this attribute has the maximum ratio-gap and is also a critical factor. If an improvement is achieved, other abilities will also be improved. (5) e results for the original MOORA and MOORA-AS methods show that the MOORA-AS method addresses the problem of ranking and is better than the original MOORA method for MADM problems because an absolute concept (i.e., aspiration level) gives more stable results than a relative concept.

is research model allows hospitals to evaluate the ability of newly graduated nurses and to propose improvement strategies from a systematic viewpoint. e nursing department can combine practical training courses to create bespoke training courses for each newly graduated nurse. e results of this study are limited to the experience for a single hospital because different hospitals may have different weights and performance scores for newly graduated nurses. is study does not consider the uncertainty (i.e., fuzzy phenomenon) between competencies in the clinical nursing environment. Future research models might use various other theories and methods (such as intuitionistic fuzzy theory [65] , 2-tuple linguistic model [66] , and a gray system [67] ) to establish decision-making models that have more technical and practical value for newly graduated nurses.

e data used to support the findings of this study are included in the article.

e authors declare no conflicts of interest.

COVID-19 crisis: skills that are paramount to build into nursing programs for future global health crisis

Oncology nursing during a pandemic: critical reflections in the context of COVID-19

Covid-19: risk factors for severe disease and death

e experiences of primary healthcare nurses during the COVID-19 pandemic in Australia

Year of the Nurse and the Midwife

A nursing shortage -a prospect of global and local policies

New graduate nurses' self-assessed competencies: an integrative review

Nurse staffing and patient outcomes: strengths and limitations of the evidence to inform policy and practice. A review and discussion paper based on evidence reviewed for the national institute for health and care excellence safe staffing guideline development

NSI National Health Care Retention & RN Staffing Report

Promoting retention of nurses

New graduate nurses' clinical competence, clinical stress, and intention to leave: a longitudinal study in Taiwan

Turnover intention in new graduate nurses: a multivariate analysis

Responsible but unprepared: experiences of newly educated nurses in hospital care

Novice nurses' experiences of unpreparedness at the beginning of the work

A review of graduate nurse transition programs in Australia

Transition shock: the initial stage of role adaptation for newly graduated registered nurses

Workforce integration of new graduate nurses: evaluation of a health human resources employment policy

Ready for what? An exploration of the meaning of new graduate nurses' readiness for practice

Clinical competence assessment in nursing: a systematic review of the literature

An empirical study on low-carbon: human resources performance evaluation

Evaluation skills with support of multicriteria modeling

An integrated approach for personel selection with DEMATEL and ANP methods

Portraying an employee performance management system based on multi-criteria decision analysis and visual techniques

A decision support model for identification and prioritization of key performance indicators in the logistics industry

A data-driven MADM model for personnel selection and improvement

Reform of Chinese universities in the context of sustainable development: teacher evaluation and improvement based on hybrid multiple criteria decision-making model

Identification of key factors in consumers' adoption behavior of intelligent medical terminals based on a hybrid modified MADM model for product improvement

Readiness for practice: the senior practicum experience

inking like a Nurse and Perceived Readiness for Professional Practice: A Mixed Methods Study

Practice readiness of new nursing graduates: a concept analysis

Self-efficacy in Changing Societies

e assessment of clinical skills/competence/ performance

Effects of abductive reasoning training on hypothesis generation abilities of first and second year baccalaureate nursing students

New graduate registered nurses' knowledge of patient safety and practice: a literature review

e consistency of clinical nursing education with employer expectations: perceptions of registered nurses in Montana

Registered nurses' perceptions of new nursing graduates' clinical competence: a systematic integrative review

Ready, set, practice: a study of generational differences and their impact on senior baccalaureate nursing student perceived readiness to practice

Preparedness to practice as perceived by the graduate nurse

Newly graduated nurses' perception of competence and possible predictors: a cross-sectional survey

Are new nurses work ready -the impact of preceptorship. An integrative systematic review

Perceived Readiness for Practice of Senior Baccalaureate Nursing Students

Personnel training selection problem based on SDV-MOORA

Selection of employees in the metal industry based on competences, on the example of a designer position

e framework for the selection of personnel based on the SWARA and ARAS methods under uncertainties

Computing with words for hierarchical competency based selection of personnel in construction companies

Cross-entropy measures of multivalued neutrosophic sets and its application in selecting middle-level manager

Soft computing methods for personnel selection based on the valuation of competences

Evaluation of construction projects based on the safe work behavior of co-employees through a neural network model

Employee performance evaluation: a fuzzy approach

Modeling project manager competency: an integrated mathematical approach

Competence assessment as an expert system for human resource management: a mathematical approach

World Problems, an Invitation to Further ought within the Framework of DEMATEL, Battelle Institute

D-DEMATEL: a new method to identify critical success factors in emergency management

Using novel MCDM methods based on Fama-French three-factor model for probing the stock selection

Decision Making with Dependence and Feedback: e Analytic Network Process: e Organization and Prioritization of Complexity

Use of hybrid MCDM model in evaluation for cloud service application improvement

An application of DEMATEL-ANP and PROMETHEE II approach for air traffic controllers' workload stress problem: a case of Mactan Civil Aviation Authority of the Philippines

Public open space development for elderly people by using the DANP-V model to establish continuous improvement strategies towards a sustainable and healthy aging society

e MOORA method and its application to privatization in a transition economy

An integrated fuzzy MOORA method and FMEA technique for sustainable supplier selection considering quantity discounts and supplier's risk

An extended FMEA approach based on the Z-MOORA and fuzzy BWM for prioritization of failures

Interval type 2-based hybrid fuzzy evaluation of financial services in E7 economies with DEMATEL-ANP and MOORA methods

Data-driven hybrid multiple attribute decision-making model for green supplier evaluation and performance improvement

Green supplier selection in steel industry with intuitionistic fuzzy Taxonomy method

Pythagorean 2-tuple linguistic aggregation operators in multiple attribute decision making

Algorithms for probabilistic uncertain linguistic multiple attribute group decision making based on the GRA and CRITIC method: application to location planning of electric vehicle charging stations

Acknowledgments e authors are very grateful to the nursing experts in the case hospital for assisting with the questionnaire survey. 

Fengmin Cheng and Yanjun Jin contributed equally to this study.