Inicio  /  Algorithms  /  Vol: 17 Par: 1 (2024)  /  Artículo
ARTÍCULO
TITULO

Frequent Errors in Modeling by Machine Learning: A Prototype Case of Predicting the Timely Evolution of COVID-19 Pandemic

Károly Héberger    

Resumen

Background: The development and application of machine learning (ML) methods have become so fast that almost nobody can follow their developments in every detail. It is no wonder that numerous errors and inconsistencies in their usage have also spread with a similar speed independently from the tasks: regression and classification. This work summarizes frequent errors committed by certain authors with the aim of helping scientists to avoid them. Methods: The principle of parsimony governs the train of thought. Fair method comparison can be completed with multicriteria decision-making techniques, preferably by the sum of ranking differences (SRD). Its coupling with analysis of variance (ANOVA) decomposes the effects of several factors. Earlier findings are summarized in a review-like manner: the abuse of the correlation coefficient and proper practices for model discrimination are also outlined. Results: Using an illustrative example, the correct practice and the methodology are summarized as guidelines for model discrimination, and for minimizing the prediction errors. The following factors are all prerequisites for successful modeling: proper data preprocessing, statistical tests, suitable performance parameters, appropriate degrees of freedom, fair comparison of models, and outlier detection, just to name a few. A checklist is provided in a tutorial manner on how to present ML modeling properly. The advocated practices are reviewed shortly in the discussion. Conclusions: Many of the errors can easily be filtered out with careful reviewing. Every authors? responsibility is to adhere to the rules of modeling and validation. A representative sampling of recent literature outlines correct practices and emphasizes that no error-free publication exists.

 Artículos similares

       
 
Chao Ou-Yang, Chandrawati Putri Wulandari, Mohammad Iqbal, Han-Cheng Wang and Chiehfeng Chen    
Today, patients generate a massive amount of health records through electronic health records (EHRs). Extracting usable knowledge of patients? pathological conditions or diagnoses is essential for the reasoning process in rule-based systems to support th... ver más
Revista: Applied Sciences

 
Chang Huang, Yun Chen, Shiqiang Zhang, Linyi Li, Kaifang Shi and Rui Liu    
Capturing the dynamics of a lake-water area using remotely sensed images has always been an essential task. Most of the fine spatial resolution data are unsuitable for this purpose because of their low temporal resolution and limited scene coverage. A Vi... ver más
Revista: Water

 
Saurabh Hukerikar,Christian Engelmann     Pág. 4 - 42
Reliability is a serious concern for future extreme-scale high-performance computing (HPC) systems. Projections based on the current generation of HPC systems and technology roadmaps suggest the prevalence of very high fault rates in future systems. The ... ver más

 
Daniel Victor Carbunaru,Roxana Monica Sasu,Sorin Ionut Burcea,Aurora Bell    
The Romanian National Meteorological Administration (NMA) radar network consists of five S-band and four C-band radars. Observation of convection in Romania through the Doppler radar network offered a new perspective in understanding the climatologic ris... ver más
Revista: Atmósfera

 
Roberto Montanhini Neto, Antonio Ostrensky     Pág. 97 - 102
Statistics is a key tool to validate the conclusions of scientific papers. However, errors in using this method, including the use of low power tests and inadequate analysis of the studies are still frequent. This research identified, through a census of... ver más