Inicio  /  Algorithms  /  Vol: 15 Par: 8 (2022)  /  Artículo
ARTÍCULO
TITULO

Building a Technology Recommender System Using Web Crawling and Natural Language Processing Technology

Nathalie Campos Macias    
Wilhelm Düggelin    
Yesim Ruf and Thomas Hanne    

Resumen

Finding, retrieving, and processing information on technology from the Internet can be a tedious task. This article investigates if technological concepts such as web crawling and natural language processing are suitable means for knowledge discovery from unstructured information and the development of a technology recommender system by developing a prototype of such a system. It also analyzes how well the resulting prototype performs in regard to effectivity and efficiency. The research strategy based on design science research consists of four stages: (1) Awareness generation; (2) suggestion of a solution considering the information retrieval process; (3) development of an artefact in the form of a Python computer program; and (4) evaluation of the prototype within the scope of a comparative experiment. The evaluation yields that the prototype is highly efficient in retrieving basic and rather random extractive text summaries from websites that include the desired search terms. However, the effectivity, measured by the quality of results is unsatisfactory due to the aforementioned random arrangement of extracted sentences within the resulting summaries. It is found that natural language processing and web crawling are indeed suitable technologies for such a program whilst the use of additional technology/concepts would add significant value for a potential user. Several areas for incremental improvement of the prototype are identified.

 Artículos similares

       
 
Qiankun Wang, Ke Zhu, Peiwen Guo, Jiaji Zhang and Zhihua Xiong    
Faced with the challenges of global climate change, zero-carbon buildings (ZCB) serve as a crucial means to achieve carbon peak and carbon neutrality goals, particularly in the development of tropical island regions. This study aims to establish a ZCB te... ver más
Revista: Applied Sciences

 
Padmanabhan Balasubramanian and Nikos E. Mastorakis    
Multiplication is a fundamental arithmetic operation in electronic processing units such as microprocessors and digital signal processors as it plays an important role in various computational tasks and applications. There exist many designs of synchrono... ver más

 
Hongguo Ren, Yujun Wang, Jing Zhang, Ziming Zheng and Qingqin Wang    
As the quality of life and the spiritual and cultural well-being of the inhabitants progress, the current rural infrastructure has challenges in adequately addressing the physical and psychological requirements of individuals. This work presents a method... ver más
Revista: Applied Sciences

 
Fenfang Li, Zhengzhang Zhao, Li Wang and Han Deng    
Sentence Boundary Disambiguation (SBD) is crucial for building datasets for tasks such as machine translation, syntactic analysis, and semantic analysis. Currently, most automatic sentence segmentation in Tibetan adopts the methods of rule-based and stat... ver más
Revista: Applied Sciences

 
Mohammed Saïd Kasttet, Abdelouahid Lyhyaoui, Douae Zbakh, Adil Aramja and Abderazzek Kachkari    
Recently, artificial intelligence and data science have witnessed dramatic progress and rapid growth, especially Automatic Speech Recognition (ASR) technology based on Hidden Markov Models (HMMs) and Deep Neural Networks (DNNs). Consequently, new end-to-... ver más
Revista: Aerospace