ARTÍCULO
TITULO

Methods to improve the accuracy of machine learning algorithms while reducing the dimensionality of the data set

A.V. Vorobyev    

Resumen

The limited availability of information collection is a factor hindering the application of high-performance machine learning algorithms. The development of methods to improve the accuracy of models while reducing the observation periods, can be an effective tool for prediction in understudied areas. The paper considers the relationship between the dimensionality of the data set and the predictive capabilities of machine learning models, and determines the impact of the number of observations on the accuracy and robustness of models built on ensemble algorithms and regularized regression algorithms. In the course of the experiments, the change in the weighted average absolute error with decreasing the dimensionality of the set was considered, and the algorithms most resistant to this factor were identified. The lower limit of use of ensemble algorithms for detection of regularities and construction of stable model, in regression tasks, in cases of non-linear dependence of target variable with predictors and under condition of absence of high impact of anomalies and noises in data was revealed. The effect of automated Bayesian hyperparameter optimization on model accuracy when the data set is reduced is considered. The models for which pre-optimization of hyperparameters, by means of wood-structured Parzen estimation, is the most preferable are determined.

 Artículos similares

       
 
Ping Huang and Yafeng Wu    
Airborne speech enhancement is always a major challenge for the security of airborne systems. Recently, multi-objective learning technology has become one of the mainstream methods of monaural speech enhancement. In this paper, we propose a novel multi-o... ver más
Revista: Aerospace

 
Yumei Zhang, Jie Zhang, Ye Li, Dan Yao, Yue Zhao, Yi Ai, Weijun Pan and Jiang Li    
Acoustic metamaterials (AMs) composed of periodic artificial structures have extraordinary sound wave manipulation capabilities compared with traditional acoustic materials, and they have attracted widespread research attention. The sound insulation perf... ver más
Revista: Acoustics

 
Yunfei Yang, Zhicheng Zhang, Jiapeng Zhao, Bin Zhang, Lei Zhang, Qi Hu and Jianglong Sun    
Resistance serves as a critical performance metric for ships. Swift and accurate resistance prediction can enhance ship design efficiency. Currently, methods for determining ship resistance encompass model tests, estimation techniques, and computational ... ver más

 
Pawel Lisowski and Michal A. Glinicki    
The wide use of multi-component cement of highly reduced Portland clinker factor is largely impeded by detrimental changes in the rheological properties of concrete mixes, a substantial reduction in the early rate of cement hardening, and sometimes the i... ver más
Revista: Applied Sciences

 
Shichen Fu, Zhenhua Yang, Yuan Ma, Zhenfeng Li, Le Xu and Huixing Zhou    
Detecting the factors affecting drivers? safe driving and taking early warning measures can effectively reduce the probability of automobile safety accidents and improve vehicle driving safety. Considering the two factors of driver fatigue and distractio... ver más
Revista: Applied Sciences