Inicio  /  Applied Sciences  /  Vol: 11 Par: 24 (2021)  /  Artículo
ARTÍCULO
TITULO

Modular Dynamic Neural Network: A Continual Learning Architecture

Daniel Turner    
Pedro J. S. Cardoso and João M. F. Rodrigues    

Resumen

Learning to recognize a new object after having learned to recognize other objects may be a simple task for a human, but not for machines. The present go-to approaches for teaching a machine to recognize a set of objects are based on the use of deep neural networks (DNN). So, intuitively, the solution for teaching new objects on the fly to a machine should be DNN. The problem is that the trained DNN weights used to classify the initial set of objects are extremely fragile, meaning that any change to those weights can severely damage the capacity to perform the initial recognitions; this phenomenon is known as catastrophic forgetting (CF). This paper presents a new (DNN) continual learning (CL) architecture that can deal with CF, the modular dynamic neural network (MDNN). The presented architecture consists of two main components: (a) the ResNet50-based feature extraction component as the backbone; and (b) the modular dynamic classification component, which consists of multiple sub-networks and progressively builds itself up in a tree-like structure that rearranges itself as it learns over time in such a way that each sub-network can function independently. The main contribution of the paper is a new architecture that is strongly based on its modular dynamic training feature. This modular structure allows for new classes to be added while only altering specific sub-networks in such a way that previously known classes are not forgotten. Tests on the CORe50 dataset showed results above the state of the art for CL architectures.

 Artículos similares

       
 
Chiara Bedon and Filipe A. Santos    
For structural design purposes, human-induced loads on pedestrian systems can be described by several simplified (i.e., deterministic equivalent-force models) or more complex computational approaches. Among others, the Spring-Mass-Damper (SMD), Single De... ver más
Revista: Applied Sciences

 
Denis Kotarski, Petar Piljek, Marko Pranjic and Josip Kasac    
This paper presents a novel concept of a modular multirotor aerial robotic platform that can be used for specific profiles of heavy payload missions. A comprehensive mathematical model of the multirotor unmanned aerial vehicle (UAV) is presented, which i... ver más
Revista: Aerospace

 
Dongbo Liu and Li Chen    
The on-orbit operation of insertion and extraction of space robots is a technology essential to the assembly and maintenance in orbit, satellite fuel filling, failed satellite recovery, especially modular in-orbit assembly of micro-spacecraft. Therefore,... ver más
Revista: Aerospace

 
Faisal Mahmood, Seyed M. Hashemi and Hekmat Alighanbari    
Growing concerns over the CO2 footprint due the exponential demand of the aviation industry, along with the requirements for high aerodynamic performance, cost saving, and manoeuvrability during different phases of a flight, pave the path towards adaptab... ver más
Revista: Aerospace

 
Nianxin Ren, Yuekai Yu, Xiang Li and Jinping Ou    
For both the expansion of important islands/reefs and the development of marine resources in South China Sea, a modular integrated floating structure (MIFS) system with tidal self-adaptation dolphin-fender mooring (DFM) has been proposed. The DFM, couple... ver más