ARTÍCULO
TITULO

Application of multimodal approach for identifying similarities in multi-dimensional datasets with usage example

Olga Perl    
Ivan Perl    

Resumen

Increasingly, one can find research from various fields devoted to working with different formats of data, tasks, research perspectives or views on the object of research. Often these studies use the term "multimodal", which at the same time varies greatly from region to region. Thus, researchers from different subject areas are faced with the same task: choosing an approach and processing multimodal data. The problem with this task lies in the narrow area of applicability of the proposed solutions. Then the very concept of multimodality needs formalization. At the same time, it becomes necessary to allocate data structures to work with this concept. It is also important to describe the approaches for analyzing data in the selected data structures. This article proposes a definition of the concept of multimodal data, describes 4 structures for working with it, and also proposes the method for identifying the most similar multimodal objects. In addition, the given structures are illustrated by examples. The method for finding similar multimodal objects is supplemented with modification descriptions so that it can be applied to all 4 multimodal data structures. The article also demonstrates the application of the method on a general example with a description of data structures - the study of cities according to the characteristics of the population, climate and the number of universities. The example of the study is for illustrative purposes only, however, it can be used for further research after verification by appropriate specialists. The article provides methods for configuring the method and recommendations for working with them. Calculated object similarity (coherence power) is a way to define a multidimensional metric over a complex data structure. At the end of the article, directions for further research are given, which are already being carried out by the authors at the present time.

 Artículos similares

       
 
Kai Liu, Xiao Yu, Yongsen Xu, Yulei Xu, Yuan Yao, Nan Di, Yefei Wang, Hao Wang and Honghai Shen    
Diffractive optical elements (DOEs) are difficult to apply in natural scenes imaging covering the visible bandwidth-spectral due to their strong chromatic aberration and the decrease in diffraction efficiency. Advances in computational imaging make it po... ver más
Revista: Applied Sciences

 
Wei Wang, Ning Xu, Sina Dang, Xuefeng Hong and Jue Qu    
In MR (mixed reality) environments, visual searches are often used for search and localization missions. There are some problems with search and localization technologies, such as a limited field of view and information overload. They are unable to satis... ver más
Revista: Aerospace

 
Hanif Fakhrurroja,Carmadi Machbub,Ary Setijadi Prihatmanto,Ayu Purwarianti     Pág. pp. 44 - 67
This paper proposes a way to control home appliances using a multimodal interaction system such as speech, gestures, and smartphone applications. The sensor to capture speech, in the Indonesian language, and gestures from users are Kinect v2. Speech reco... ver más

 
Heungbae Gil, Kyoungbong Han, Junho Gong and Dooyong Cho    
In areas of civil engineering, the resilient friction base isolator (R-FBI) system has been used due to its enhanced isolation performance under seismic excitations. However, because nonlinear behavior of the R-FBI should be reflected in seismic design, ... ver más
Revista: Applied Sciences

 
Yanli Wang, Sabyasachee Mishra, Xin Ye, Linbo Li, Bing Wu     Pág. 2990 - 3002
Urban redevelopment is an important way for city evolution especially in metropolitans where the limitation of land resource becomes a bottleneck to farther development. However, redevelopment can bring a number of perturbations on transportation system,... ver más