I.INTRODUCTION

Multi-criteria decision-making (MCDM) can be described as a set of approaches to help in complex decision-making problems. MCDM approaches provide heuristics to determine the best course of action to achieve long-term goals. The motivation toward developing MCDM approaches is to eliminate the limitations of traditional techniques based on single-criterion decisions. Alternatively, MCDM is effective while multiple criteria need to be considered to choose among alternatives. While handling healthcare issues, the success of healthcare decisions lies in comprehensively understanding the choices and considering the future implications to select the best option possible. MCDM helps analyze healthcare issues from various perspectives. MCDM approaches include three parts such as data processing, evaluating the outcomes and selection, and planning. Data processing leads to identifying the healthcare issues, and evaluation helps assess each solution’s performance for healthcare management. Planning and design help in setting the goals of healthcare solutions and exploring the relationship structure among multiple criteria. It is challenging for healthcare decision makers with various complex choices due to the ad-hoc decision-making process, which may raise concerns about transparency and comprehensiveness. In such situations, multi-criteria decision analysis (MCDA) can be a promising tool to appraise multiple aspects of unrelated and conflicting information for healthcare decision-making. The healthcare system is responsible for healthy societies and individuals and taking care of their health and diagnosis of disease. Determining the correct diagnosis is crucial to achieving the objective of a sound healthcare system. Proper diagnosis is based on a blend of information about the patient, which can be selected based on the diagnosis established.

Machine learning is used to understand data and find a pattern. The patterns used to understand various health situations are based on the input data. Machine learning utilizes mathematical models to train and learn data through learning algorithms. Machine learning methods can be classified into different types, such as supervised, unsupervised, and reinforcement learning. To obtain solutions for healthcare problems, supervised learning is suitable to determine the relationships in patient’s data (input) and defined outcome (output).

There is a huge potential and contribution of machine learning brings to healthcare. Machine learning has the ability to provide an effective approach to healthcare processes. Correct diagnosis is important in healthcare, but getting the proper diagnosis on time is also equally important. Different sensing technologies now enabled to monitor a patient around the clock by measuring and transmitting the information. The information collected by these sensors could be more helpful for medical practitioners in its raw form, but the huge datasets can be processed through machine learning algorithms to generate patterns. For example, machine learning algorithms can detect heart anomalies more accurately based on large datasets. Outcomes obtained from machine learning algorithms can assist doctors. Machine learning and artificial intelligence techniques can save healthcare professionals time, and it has proven that they can forecast health-related issues. Although MCDM has been used in operational research for a long time, recently, it has increased interest while including machine learning techniques in the traditional numerical models.

The rest of the paper is organized as follows. Section II describes the methodology for the review process and search strategy and selection of relevant research work. Section III explores the literature review with salient features and future direction. Section IV demonstrates the analysis of the literature review. The conclusion and future work drawn from the entire discussion are presented in section V.

II.METHODOLOGY

The review of the research topic is aimed to explore the related methods and studies used for healthcare systems using MCDM and machine learning and to analyze their strength and weaknesses. It also aims to provide improved awareness of new developments and challenges in the healthcare system. During the evaluation process, the research papers were identified and examined using machine learning techniques currently in use for MCDM. Figure 1 depicts all phases of the review, and it breaks down the entire review process into several components.

Fig. 1. Methodology for a review process.

Numerous online journal databases, such as Scopus, IEEE, Science Direct, Web of Science, ACM Digital Library, SpringerLink, and Google Scholar, are utilized to conduct reviews. The terms “MCDM,” “Healthcare,” and “machine learning techniques” are searched in the document’s titles. After gathering enough literature, the documents were refined, emphasizing what to include and what to leave out. The relevant documents that could provide discretionary knowledge of the research domain are included. The papers not focused on enhancing the robustness of machine learning techniques, not having abstracts, and not having significance to our research objective are excluded (Table I).

Table I. Selection criteria for journal databases

Selection criteriaJournal database
Inclusion of the documentPeer-reviewed journals, research papers and articles, including accepted manuscripts, reputed conference papers, and review papers, also without any time frame constraints
Exclusion of the documentWhen searching non-English documents, documents with missing abstracts at the time of the study and generic and irrelevant documents are excluded; also, documents that are not peer-reviewed are excluded

III.LITERATURE REVIEW

The healthcare decision process is considered to be a low, transparent process. To make a complex decision, the decision process should be able to identify the best alternatives and decision criteria must be weighted and scored for all other options. In [1], the author describes the MCDA framework to identify, approve, and provide guidelines for healthcare solutions. However, various challenges still need to be resolved, such as the selection of appropriate MCDA techniques and quantifying the impact of uncertainty while making a complex decision.

Decision-making in healthcare also involves appraising existing pieces of evidence, societal values, and ethical considerations. MCDA is a supporting tool which can break down a complex problem into multiple components to support decision-making in healthcare. However, author [2] believes that health technology assessment through which data are collected has not fully emerged. Hence, there is a need to merge MCDA and health technology assessment to support informed healthcare decision-making.

While treating patients in hospitals, they serve by considering the urgency and importance of the treatment they desire, an elective admission system that can be established based on evaluating the admission priority. In [3], authors proposed a hybrid MCDM model which integrates a weighted system of evaluating criteria and a fuzzy method to assess the various alternatives. The authors claimed that the proposed model was effective to receive the useful insights for hospital management. Advanced machine learning can be applied to prioritize alternatives and the importance of weights in the future research.

In [4], the issues of selecting the appropriate machine learning algorithm were discussed. Even the process of algorithm selection could utilize MCDM. The author proposed a fuzzy analytical hierarchical approach to the order of preference to the appropriate solutions. A matrix is formed based on the pairwise comparison by taking decision makers judgment and later, it is aggregated and normalized. It is claimed that MCDM techniques help select the best supervised machine learning algorithms.

Study [5] presented an overview of practical insights of MCDA methods and their applications in healthcare. Healthcare applications are based on different aspects such as diagnosis, treatment, resource allocation, and health technology assessment. Each of these healthcare sector segments requires decision-making based on different criteria. MCDA can help in structured and justified analysis for decision makers and stakeholders to make final decisions. Decision-making in the military environment [6] is difficult due to insufficient resources. It is more important to make appropriate decisions for the military healthcare system under different constraints, risks, and situations. In such environment, MCDM may assist with systematic, consistent, and powerful decision-making approaches. Military personnel need to maintain their good health status. MCDM is promising with machine learning techniques to take decisions.

Multifaceted data analysis is required to diagnose and predict tumor grading and cancer detection. The data are collected from multiple sources such as clinical treatments, medical images, and pathology as well. However, processing and classifying the huge clinical data for prediction modeling still need more efficient approaches. In [7], a multi-criterion decision-making-based classifier framework is proposed with experimentation on two clinical datasets. Experimental results claim to be superior predictive performance. However, deciding the importance of various features still needs improvement. COVID-19 has taught us the importance of sudden desires for frontline healthcare services—the study of prioritizing the wastes and various dimensions contributing to these wastes. Analysis [8] uses MCDM to extract and prioritize lean wastes within healthcare.

Machine learning algorithms extensively used for identifying COVID-19 through its various symptoms, such as cough types. In [9], author uses different cough datasets and applies machine learning algorithms to classify them as COVID-19 or non-COVID-19. They also used MCDM to select the best model through an ensemble the technologies. Feature reduction is done through recursive feature elimination under different estimators. However, the study can be extended by using cross-institutional datasets and involving more symptoms. In [10], author advocates using MCDM in healthcare surgical management. It can help medical practitioners understand causative factors and prioritization for effective decision-making during surgery.

Healthcare sector is keen to improve healthcare services by implementing the latest technological development. In [11], the author investigates various organizational hindrances that can impact the adoption of advanced healthcare technologies. The study highlighted some significant barrier that belongs to effect category. These barriers such as lack of vision from the top management, scarcity of skilled professionals, and the organization organogram are considered critical ones. Identified barriers can help decision makers to make policies for adopting the latest technologies in the health sector.

Waste management and treatment in healthcare entities have become a major issue. It is difficult to select the best option to dispose of healthcare waste. Hence, choosing the best waste disposal method can be considered a complex MCDM problem. In [12], the proposed study complex proportional assessment is done through the proposed entropy measure Pythagorean fuzzy set. However, waste disposal policies also depend on governmental policies, technological innovations, and their effective execution.

During COVID-19, we have seen that proper decisions regarding prevention strategies, and drug and vaccine development helped a lot in combating the disease. Study [13] states that MCDM helps in controlling the COVID-19 patients in terms of the comprehensive analysis of criteria used for precise diagnosing according to guidelines. In the study, future direction is provided to include the fuzzy Delphi method for unifying criteria and MCDM approach for prioritizing alternatives to provide a unique ranking solution.

In [14], different MCDA methods are discussed and the categories of the methods mentioned as outranking methods, value-based methods, and reference level methods. It is also found in the study that hybrid approaches are widely used in healthcare decision-making problems. The selection of MCDA methods depends on the nature and complexity of the healthcare problem. The research study further can be extended to explore the link between the decision-making problem and selected MCDA method.

In [15], the combination of spatial models and machine learning techniques for demonstrating the application of MCDA in healthcare has been discussed. The study investigates the risk factors and quantifies it for disease such as malaria and dengue. Authors claim to minimize the subjective bias while taking decision to quantify the risk. They also claimed that ensemble learning approach. However, there is a need to further explore to couple geographic information systems (GIS) and machine learning to build a robust model. In [16], a framework is proposed to improve the accessibility to healthcare facilities specifically for testing and vaccination sites during the COVID-19 pandemic. To uncover the barriers and their impact on healthcare access, MCDA approach is used. MCDA can also be used to plan preventive measures for future outbreaks of such pandemics. MCDM can be applied to analyze complex decisions to provide appropriate solution.

Treating patient with breast cancer [17] has a better chance of survival if they are diagnosed early. Various supervised machine learning methods and MCDM techniques, which include preference ranking methods, are the reasons for optimism to diagnose breast cancer. However, among multiple supervised learning methods, it is required to select the most efficient method. Due to involvement of fuzziness and ambiguity associated with qualitative decision-making, fuzzy MCDM. However, author [18] presents a critique review of fuzzy methods. In the study, it is found that fuzzy MCDM methods are computationally complex and heavy to obtain clear advantages of fuzzy methods.

Mobile healthcare improves access to health resources for ordinary consumers and even at low cost and conveniently. In [19], a method is developed to examine consumer’s adoption of mobile healthcare. Key factors which affect consumer adoption of mobile healthcare are mentioned as product image, social norms, and consumer trust. However, the data collected for analysis involve a limited number of experts in mobile healthcare.

Electronic health record (EHR) technology is the great innovation and need for the hour; however, its implementation is very slow. EHR ensures [20] quality healthcare services by automating procedures with individual health records for sustained development. MCDM model can solve various real-life situations. However, there is a need to further explore the relative weights and their effect on EHR while implementing multiple criteria models.

In [21], authors proposed MCDM approaches based on machine learning algorithms and colliding with evidential reasoning approach. The proposed framework is based on the selection of machine learning algorithm with highest predictive accuracy and connect it with optimization model to minimize the difference between assessment derived and the predicted results. Authors claimed that the proposed method is used to generate accurate and explanatory decisions and to diagnose thyroid nodules. However, proposed method can be explored to diagnose other diseases also.

In [22], various classification techniques such as k-means, logistic regression, and naive Bayes are combined and tested by MCDM to build an ensemble classifier. To diagnose the sleep disorders, sleep scoring is important since it can quantify the quality of sleep. Quality index of sleep helps in identifying the abnormalities in patient. However, the proposed method requires to be tested with electroencephalogram (EEG) data such as epilepsy for further research.

In [23], decision-making model is proposed for supplier selection for hospital. Proposed model utilizes MCDM which aims to select the best supplier. Two specific MCDM methods, that is, best worst method (BWM) and decision-making trial and evaluation laboratory (DEMATEL), are used to determine criteria weights. Aggregated criteria weights are used to rank the suppliers. The proposed method can be extended for other verticals used in healthcare such as medical waste management and renewable energy selection.

Various situations in healthcare field occur where multiple criteria play a role to take decisions. These situations [24] may be life threatening or situations in which decisions taken are responsible for reducing health inequalities. In such situations, decision makers need to consider multiple criteria simultaneously. While considering multiple criteria for decision-making in the medical field, priority setting of decision through establishing the weights of these criteria is also important. However, MCDA should not be considered as formulaic or technocratic approach, but it should be considered as assistance in policy making.

Now a days, internet of things (IoT)-based healthcare system plays a vital role in connecting the devices to enable IoT data analytics which could give better insights and results. Various information can be collected through IoT devices like pulse rate, temperature, and oxygen level utilized for decision-making through machine learning techniques. MCDM methods such as technique for order preference by similarity to ideal solution (TOPSIS) and weighted product model (WPM) help in decision-making as well as in generating informative diagnostic reports. MCDM can be used to develop an expert system which might be more efficient while making any decision for diagnosing and treatment.

Handling decision-making problems can improve the efficiency of hospital management. The proposed error analysis method [25] with hesitant fuzzy linguistic information might be helpful in hospital decision support systems. When choosing the best multi-speciality hospital for surgery, the analytic hierarchy process [26] is used to help obtain the best hospital from the optimal list of hospitals.

To assess the service efficiency of the hospitals, plithogenic MCDM is applied [27], and it can efficiently classify the possible substitute. TOPSIS is also used [28] to determine the ranking of hospitals and helps in disaster preparedness. Machine learning techniques integrated with MCDM [29] can effectively conduct inventory analysis. In an emergency like COVID-19, many health systems worldwide are leading to collapse. To deal with such emergency challenges with many aspects of fuzzy MCDA [30], machine learning can be a great help. Breast cancer patients, if diagnosed early [31], have a better chance of survival. Machine learning and MCDM methods can provide a robust solution in diagnosing breast cancer. The judgments’ accuracy will enhance with the employment of two or more MCDM techniques [32]. Further study can combine the fuzzy analytic hierarchy process (FAHP) method with other decision-making techniques and compare the outcomes.

An ensemble-based MCDM technique used for COVID-19 detection in cough specimens. A focus on the difficulty of choosing the optimal classification model [33] when various evaluation factors are considered, and there is diversity in these criteria.

IV.ANALYSIS OF LITERATURE REVIEWED

From Tables II & III, based on different application areas used for MCDA in healthcare, a Pi-chart has been drawn. It shows that the MCDM approach is highly used for healthcare general decision-making for various issues. These issues are related to daily administration issues. Similarly, during COVID-19 it was highly recognizing method to solve various problems such as availability of resources or it may be to decide the urgency and priority of cases. The other areas to use MCDA are cancer detection, surgery decision, thyroid, and sleep disorder management. Another important area in policy management for healthcare institution is also attracting MCDA (Fig. 2).

Fig. 2. Different application areas of MCDA in healthcare.

Table II. Salient features and future direction from existing work

Referred paperSalient featureTechniques/method usedApplication area/diseaseChallengesGaps identifiedFuture research direction
[1]MCDA framework and identification of potential areas to use MCDAMCDA approach to develop decision support systemHealthcare decision-makingImprove the efficiency under the optimal decisionsEvaluation and assessment of numerous criteriaMethods for weighing and scoring various decision criteria
[2]Making resource `allocation decisions using MCDAUses MCDA evidence matrixHealthcare reimbursement processScoring each criterion of MCDAAppraising the available evidenceMerging MCDA and HTA (health technology assessment)
[3]Combines the fuzzy VIKOR method and the 2-tuple DEMATEL methodologyHybrid multi-criteria decision-making modelElective admission control of patientAssessment of qualitative and quantitative criteriaDistinguishing between the important and urgent decisionWeighted score for alternatives might be promising
[4]Selecting the appropriate machine learning algorithmFuzzy analytical hierarchical processTo prioritize the suitable options in order ofUtilizing fuzzy method with analytical hierarchical processAnalytical hierarchical process is not sufficientEnsemble methods could be more effective
[5]Provides practical insights of MCDA methodsCase study approach is usedDiagnosis, treatment, and resource allocationDecision-making on different criteriaHealth technology assessmentSelection of suitable MCDA method
[6]Decision-making in military healthcarePerformance matrix for each criterionDecision-making for military personnelInsufficient resourcesNumeral expressions indicating the relative weight of the criteriaImprove the efficiency of whole process
[7]Feasibility study of MCDA decision-makingFusion of multi-modality feature and multi-classifier modelPrediction of tumor grading and cancer detectionClassify the huge clinical dataSelect an appropriate classifier for prediction modelingDeciding the importance of various features
[8]Contribution in healthcare management processesFuzzy analytical hierarchy process approachUsing a lean approach to healthcareEfficient delivery of healthcare productsPrioritizing the lean wasteImprovement in fuzzy AHP process
[9]Evaluating the effectiveness of the machine learning approaches for classificationEnsemble method for MCDMCough classification for COVID-19Consider performance evaluation metricSelection of best performance modelUse of cross-institutional datasets
[10]Understanding causative factors for decision-makingTotal interpretive structural modeling methodologySurgical managementEffective decision-makingLow level of transparency in surgeryStudy may be extended by taking more assumptions
[11]Highlighting three causal factors of organizational hindrancesHealthcare 4.0 adoptionHealthcare policy managementOrganizational hindrances to adopt technologiesCause–effect relationship of the barriersEnvironmental, social, and other factors may be considered
[12]Complex proportional assessment of MCDM techniquePythagorean fuzzy entropy measure techniqueHealthcare waste treatmentTreatment of healthcare wasteHandling disparate qualitative and quantitative featuresTechnology innovation and their effective execution may be explored
[13]Review of medical treatment of COVID-19Review analysis for MCDA methodsCOVID-19 diagnosisComplex decision-makingMultidisciplinary research, i.e., MCDA and COVID-19Mitigate the shortcomings of weighting technique
[14]Explore the applications of MCDA in healthcareLiterature review/case study approachHealthcare managementProcessing relevant literature among the huge oneAssessing the importance of hybrid methodExplore specific MCDA method for specific problem
[15]Fusion of spatial data model and MCDA in healthcareEnsemble machine learning methodsInfectious disease outbreaksMinimizing the subjective bias to quantify risk factorQuantifying risk factors for diseaseCoupling of machine learning and GIS can be explored
[16]Measuring access to healthcare facilitiesLeast cost path (LCP) analysisCOVID-19Uncovering the barriers and their effect on healthcare accessComplex interaction between different factorsExploration of MCDA for future outbreaks
[17]Early diagnosing of breast cancerMCDA and supervised learningBreast cancer screeningTimely diagnosing the patientSelection of most efficient supervised learning methodExploring the fusion of MCDA and supervised learning
[18]Critique review of fuzzy methodsFuzzy methods for MCDMCOVID-19 pandemicTaking deep vision of fuzzy methodsReducing the computational complexity of fuzzy methodsNeeds a deep investigation on fuzzy methods
[19]Level of consumer adoption for mobile healthcareHybrid MCDM methodsMobile healthcareIdentify MCDM methods and hybridizationIdentification of key factor of consumer adoption of mobile healthcareWide range of datasets can be utilized for further investigation
[20]Emphasizing automation procedure in healthcare servicesHybrid MCDM modelsManagement of electronic health recordFinding influential weights for criteriaPerformance measuring of automated procedureExploring for improvement in EHR implementation
[21]Optimization model for ML algorithm and evidential reasoningMachine learning and evidential reasoning approachDiagnosis of thyroid nodulesData-driven decision-makingLearning of criterion weightsProposed method can be explored for other diseases
[22]Ensemble models for MCDAEEG signal analysisDiagnosing sleep disorderFormation of ensemble modelEarly diagnosis of sleep disordersMethod can be tested for different kinds of EEG signal
[23]Investigation for a hospital’s supplier selection issueDEMATEL, BWMSupplier decision-making in healthcareWeight aggregation, modification of EDASAverage solution to select supplierExploration for waste management, renewable energy selection, etc.
[24]Decision-making for life-threatening situationMulti-criteria approach to priority settingDecision-making in critical health situationsSelection of rational method for priority settingPriority setting of decisionComparison of various MCDA methods for priority setting must be done

Table III. Summary of different application areas in the review

Reference numberApplication area/diseaseCount
[9,13,15,16,18]COVID-19/infectious disease5
[16,14,20],Healthcare general management/decision8
[10,24]Surgical management2
[23]Healthcare supply chain decision1
[7,17]Cancer detection/decision2
[21,22]Thyroid/sleep disorder2
[8,1012,19]Policy management/decision4

From Table IV, based on different machine learning techniques/approaches used for MCDA in healthcare, a bar chart has been drawn. It shows that supervised machine learning methods are being preferred for MCDM in healthcare. Similarly, hybrid methods, ensemble methods, and fuzzy methods are also equally used, and the objective of this fusion of methods is to improve the accuracy of decisions (Fig. 3).

Fig. 3. Machine learning algorithms used for MCDA in healthcare.

Table IV. Machine learning techniques used in MCDA for healthcare

Reference numberMachine learning techniques/methodsCount
[3,19,20]Hybrid MCDM3
[4,8,18]Fuzzy analytical hierarchical process3
[9,15,22]Ensemble method3
[2,21]Evidence matrix2
[5,13,14]Case study approach3
[7,17,23,24]Supervised learning method4
[10,11]Causative factors analysis2
[1,6,12,16]Other algorithms4

V.CONCLUSION AND FUTURE DIRECTIONS

This study aimed to highlight the significance of MCDA in the healthcare sector, while selecting machine learning methods to resolve different issues. To emphasize the significance of considering and picking the appropriate methods for different issues, we did literature review analysis for existing MCDA used in healthcare. Methods like machine learning to identify diseases and make diagnosis involve some crucial ethical considerations also. The usage of patient data may have an impact on patients’ confidentiality. Therefore, it is crucial to think about the situations in which machine learning could violate patients’ privacy and the potential exploitation of generated information about patients. Before beginning the study, it is crucial to get documented ethics approval and permission.

Machine learning models rely on historical data, whereas doctors rely on knowledge and experience. It is quite challenging for a machine to generate precise predictions based on fresh, untested data. A doctor’s expertise and experience are extremely useful for medical diagnosis because the practice of medicine is always changing due to new technology and societal issues. It is crucial to note that a doctor cannot be replaced by a machine, but that a machine can be an effective complement that can speed up diagnosis, shorten the duration of a therapy, ease the strain on medical staff, and save money on various resources.

This review’s main objective was to emphasize the importance of a complete MCDA in connection to machine learning evaluation. To confirm the feasibility of incorporating machine learning to enhance doctors’ diagnosis for various diseases specially heart disease and to ascertain the influence of various machine learning algorithms in healthcare, an experimental design may be employed in future