Inicio  /  Information  /  Vol: 7 Par: 1 (2016)  /  Artículo
ARTÍCULO
TITULO

A Feature Selection Method for Large-Scale Network Traffic Classification Based on Spark

Yong Wang    
Wenlong Ke and Xiaoling Tao    

Resumen

Currently, with the rapid increasing of data scales in network traffic classifications, how to select traffic features efficiently is becoming a big challenge. Although a number of traditional feature selection methods using the Hadoop-MapReduce framework have been proposed, the execution time was still unsatisfactory with numeral iterative computations during the processing. To address this issue, an efficient feature selection method for network traffic based on a new parallel computing framework called Spark is proposed in this paper. In our approach, the complete feature set is firstly preprocessed based on Fisher score, and a sequential forward search strategy is employed for subsets. The optimal feature subset is then selected using the continuous iterations of the Spark computing framework. The implementation demonstrates that, on the precondition of keeping the classification accuracy, our method reduces the time cost of modeling and classification, and improves the execution efficiency of feature selection significantly.

 Artículos similares

       
 
Vera Afreixo, Ana Helena Tavares, Vera Enes, Miguel Pinheiro, Leonor Rodrigues and Gabriela Moura    
In this work, we aimed to establish a stable and accurate procedure with which to perform feature selection in datasets with a much higher number of predictors than individuals, as in genome-wide association studies. Due to the instability of feature sel... ver más
Revista: Applied Sciences

 
Urszula Libal and Pawel Biernacki    
An automatic honey bee classification system based on audio signals for tracking the frequency of workers and drones entering and leaving a hive.
Revista: Applied Sciences

 
Marwah Abdulrazzaq Naser, Aso Ahmed Majeed, Muntadher Alsabah, Taha Raad Al-Shaikhli and Kawa M. Kaky    
Cardiovascular disease is the leading cause of global mortality and responsible for millions of deaths annually. The mortality rate and overall consequences of cardiac disease can be reduced with early disease detection. However, conventional diagnostic ... ver más
Revista: Algorithms

 
Mohammad Shokouhifar, Mohamad Hasanvand, Elaheh Moharamkhani and Frank Werner    
Heart disease is a global health concern of paramount importance, causing a significant number of fatalities and disabilities. Precise and timely diagnosis of heart disease is pivotal in preventing adverse outcomes and improving patient well-being, there... ver más
Revista: Algorithms

 
Zijia Zheng, Yizhu Jiang, Qiutong Zhang, Yanling Zhong and Lizheng Wang    
The timely monitoring of urban water bodies using unmanned aerial vehicle (UAV)-mounted remote sensing technology is crucial for urban water resource protection and management. Addressing the limitations of the use of satellite data in inferring the wate... ver más
Revista: Water