Inicio  /  Applied Sciences  /  Vol: 14 Par: 3 (2024)  /  Artículo
ARTÍCULO
TITULO

Improving Time Study Methods Using Deep Learning-Based Action Segmentation Models

Mihael Gudlin    
Miro Hegedic    
Matija Golec and Davor Kolar    

Resumen

In the quest for industrial efficiency, human performance within manufacturing systems remains pivotal. Traditional time study methods, reliant on direct observation and manual video analysis, are increasingly inadequate, given technological advancements. This research explores the automation of time study methods by deploying deep learning models for action segmentation, scrutinizing the efficacy of various architectural strategies. A dataset, featuring nine work activities performed by four subjects on three product types, was collected from a real manufacturing assembly process. Our methodology hinged on a two-step video processing framework, capturing activities from two perspectives: overhead and hand-focused. Through experimentation with 27 distinctive models varying in viewpoint, feature extraction method, and the architecture of the segmentation model, we identified improvements in temporal segmentation precision measured with the F1@IoU metric. Our findings highlight the limitations of basic Transformer models in action segmentation tasks, due to their lack of inductive bias and the limitations of a smaller dataset scale. Conversely, the 1D CNN and biLSTM architectures demonstrated proficiency in temporal data modeling, advocating for architectural adaptability over mere scale. The results contribute to the field by underscoring the interplay between model architecture, feature extraction method, and viewpoint integration in refining time study methodologies.

 Artículos similares

       
 
Weihao Cao, Guangli Cheng, Bao Liu and Yangfan Cai    
The current time-domain solution methods for the wavefield equations of a single medium do not apply to the wavefield equations of shallow water seismic with a fluid?elastomer coupling. To solve this problem, based on the explicit central difference meth... ver más
Revista: Applied Sciences

 
Jessica S. Ortiz, Richard S. Pila, Joel A. Yupangui and Marco M. Rosales    
The teaching?learning process developed was based on the effective integration of the Hardware in the Loop (HIL) technique to control a brewing process. This required programming the autonomous control of the system and uploading it to a physical control... ver más
Revista: Applied Sciences

 
Shuling Zhao and Sishuo Zhao    
Due to the intensification of economic globalization and the impact of global warming, the development of methods to reduce shipping costs and reduce carbon emissions has become crucial. In this study, a multi-objective optimization algorithm was designe... ver más

 
MohammadHossein Reshadi, Wen Li, Wenjie Xu, Precious Omashor, Albert Dinh, Scott Dick, Yuntong She and Michael Lipsett    
Anomaly detection in data streams (and particularly time series) is today a vitally important task. Machine learning algorithms are a common design for achieving this goal. In particular, deep learning has, in the last decade, proven to be substantially ... ver más
Revista: Algorithms

 
Ivan Volaric and Victor Sucic    
One of the frequently used classes of sparse reconstruction algorithms is based on the iterative shrinkage/thresholding procedure, in which the thresholding parameter controls a trade-off between the algorithm?s accuracy and execution time. In order to a... ver más
Revista: Information