Inicio  /  Algorithms  /  Vol: 14 Par: 12 (2021)  /  Artículo
ARTÍCULO
TITULO

A Rule Extraction Technique Applied to Ensembles of Neural Networks, Random Forests, and Gradient-Boosted Trees

Guido Bologna    

Resumen

In machine learning, ensembles of models based on Multi-Layer Perceptrons (MLPs) or decision trees are considered successful models. However, explaining their responses is a complex problem that requires the creation of new methods of interpretation. A natural way to explain the classifications of the models is to transform them into propositional rules. In this work, we focus on random forests and gradient-boosted trees. Specifically, these models are converted into an ensemble of interpretable MLPs from which propositional rules are produced. The rule extraction method presented here allows one to precisely locate the discriminating hyperplanes that constitute the antecedents of the rules. In experiments based on eight classification problems, we compared our rule extraction technique to ?Skope-Rules? and other state-of-the-art techniques. Experiments were performed with ten-fold cross-validation trials, with propositional rules that were also generated from ensembles of interpretable MLPs. By evaluating the characteristics of the extracted rules in terms of complexity, fidelity, and accuracy, the results obtained showed that our rule extraction technique is competitive. To the best of our knowledge, this is one of the few works showing a rule extraction technique that has been applied to both ensembles of decision trees and neural networks.

 Artículos similares

       
 
Angelica Lo Duca, Andrea Marchetti, Manuela Moretti, Francesca Diana, Mafalda Toniazzi and Andrea D?Errico    
The Jewish community archive in Pisa owns a vast collection of documents and manuscripts that date back centuries. These documents contain valuable genealogical information, including birth, marriage, and death records. This paper aims to describe the pr... ver más
Revista: Informatics

 
Hao Sun, Yuejin Du and Qi Li    
Amid the incessant evolution of the Internet, an array of cybersecurity threats has surged at an unprecedented rate. A notable antagonist within this plethora of attacks is the SQL injection assault, a prevalent form of Internet attack that poses a signi... ver más
Revista: Applied Sciences

 
Ye Tian, Jiahang Zhang, Junyue Tang, Wei Xu, Weiwei Zhang, Lijun Tao, Shengyuan Jiang and Yanbin Sun    
To provide reliable input information for the load design and extraction of lunar soil water ice samples, it is necessary to study the water content distribution and water migration of simulated lunar soil water ice samples. On this basis, the temperatur... ver más
Revista: Aerospace

 
Anastasios Tzepkenlis, Nikos Grammalidis, Christos Kontopoulos, Vasiliki Charalampopoulou, Dimitra Kitsiou, Zoi Pataki, Anastasia Patera and Theodoros Nitis    
Nowadays, coastal areas are exposed to multiple hazards of increasing severity, such as coastal floods, erosion, subsidence due to a combination of natural and anthropogenic factors, including climate change and urbanisation. In order to cope with these ... ver más

 
Hongliang Liu, Nianxue Luo and Qiansheng Zhao    
China is one of the countries most affected by typhoon disasters. It is of great significance to study the mechanism of typhoon disasters and construct a typhoon disaster chain for emergency management and disaster reduction. The evolution process of typ... ver más