Inicio  /  Information  /  Vol: 14 Par: 4 (2023)  /  Artículo
ARTÍCULO
TITULO

Transformers in the Real World: A Survey on NLP Applications

Narendra Patwardhan    
Stefano Marrone and Carlo Sansone    

Resumen

The field of Natural Language Processing (NLP) has undergone a significant transformation with the introduction of Transformers. From the first introduction of this technology in 2017, the use of transformers has become widespread and has had a profound impact on the field of NLP. In this survey, we review the open-access and real-world applications of transformers in NLP, specifically focusing on those where text is the primary modality. Our goal is to provide a comprehensive overview of the current state-of-the-art in the use of transformers in NLP, highlight their strengths and limitations, and identify future directions for research. In this way, we aim to provide valuable insights for both researchers and practitioners in the field of NLP. In addition, we provide a detailed analysis of the various challenges faced in the implementation of transformers in real-world applications, including computational efficiency, interpretability, and ethical considerations. Moreover, we highlight the impact of transformers on the NLP community, including their influence on research and the development of new NLP models.

 Artículos similares

       
 
Leonardo Ranaldi, Federico Ranaldi, Francesca Fallucchi and Fabio Massimo Zanzotto    
Online users tend to hide their real identities by adopting different names on the Internet. On Facebook or LinkedIn, for example, people usually appear with their real names. On other standard websites, such as forums, people often use nicknames to prot... ver más
Revista: Information

 
Qiang He, Chao Fan, Guang Yang, Huiqi Li, Jiadong Li and Xiaogang Chen    
With the wide application of power electronic devices and nonlinear loads, the resulting inter-harmonic pollution is becoming more and more serious in the power system. As important equipment in power systems, transformers have always been the focus of r... ver más
Revista: Applied Sciences

 
Claudio Ferretti and Martina Saletta    
State-of-the-art neural networks build an internal model of the training data, tailored to a given classification task. The study of such a model is of interest, and therefore, research on explainable artificial intelligence (XAI) aims at investigating i... ver más
Revista: Algorithms

 
Brandon Cortés-Caicedo, Oscar Danilo Montoya and Andrés Arias-Londoño    
In this research paper, a combinatorial optimization approach is proposed for parameter estimation in single-phase transformers considering voltage and current measurements at the transformer terminals. This problem is represented through a nonlinear pro... ver más
Revista: Computers

 
Choongman Lee, Gyu-Jung Cho and Joorak Kim    
This paper presents a Scott transformer model to be applied in electromagnetic transients (EMT) programs, particularly in the absence of a detailed Scott transformer model for performing real-time simulations (RTS). Regarding a Scott transformer, a commo... ver más
Revista: Applied Sciences