ARTÍCULO
TITULO

On a formal verification of machine learning systems

Dmitry Namiot    
Eugene Ilyushin    
Ivan Chizhov    

Resumen

The paper deals with the issues of formal verification of machine learning systems. With the growth of the introduction of systems based on machine learning in the so-called critical systems (systems with a very high cost of erroneous decisions and actions), the demand for  confirmation of the stability of such systems is growing. How will the built machine learning system perform on data that is different from the set on which it was trained? Is it possible to somehow verify or even prove that the behavior of the system, which was demonstrated on the initial dataset, will always remain so? There are different ways to try to do this. The article provides an overview of existing approaches to formal verification. All the considered approaches already have practical applications, but the main question that remains open is scaling. How applicable are these approaches to modern networks with millions and even billions of parameters?

 Artículos similares

       
 
Benedetto Intrigila, Giuseppe Della Penna, Andrea D?Ambrogio, Dario Campagna and Malina Grigore    
Requirements management is a key aspect in the development of software components, since complex systems are often subject to frequent updates due to continuously changing requirements. This is especially true in critical systems, i.e., systems whose fai... ver más
Revista: Computers

 
Tomasz Rak    
This study aims to identify the most effective input parameters for performance modelling of container-based web systems. We introduce a method using queueing Petri nets to model web system performance for containerized structures, leveraging prior measu... ver más
Revista: Applied Sciences

 
Tao Feng, Chengfan Liu, Xiang Gong and Ye Lu    
The integration of buses in industrial control systems, fueled by advancements such as the Internet of Things (IoT), has led to their widespread adoption, significantly enhancing operational efficiency. However, with the increasing interconnection of sys... ver más
Revista: Information

 
Maki Kihara and Satoshi Iriyama    
A new class of cryptosystems called verifiable encryption (VE) that facilitates the verification of two plaintexts without decryption was proposed in our previous paper. The main contributions of our previous study include the following. (1) Certain cryp... ver más
Revista: Information

 
Ekaterina Stroeva,Aleksey Tonkikh     Pág. 21 - 29
Among recent publications containing an overview and systematization of  algorithms for formal verification of neural networks, a classification of algorithms is  proposed which is based on three following properties: reachability, optimization... ver más