Tools for Implementing the Models and Algorithms for Processing Multimodal Data

The article discusses technologies and technical means that provide a human-oriented approach to software development, a better adaptation of human-machine interfaces to user needs, improved ergonomics of software products, etc. Measures are analyzed that contribute to the formation of fundamentally new opportunities for presenting and processing information about real-world objects with which a person interacts in production, educational and everyday activities in computer systems. The article is relevant in identifying modern models and algorithms for processing multimodal data in computer systems based on a survey of company employees and analysis of these models and algorithms to determine the advantages of using models and algorithms for processing multimodal data. Research methods are considered: comparative analysis; systematization; generalization; poll. An overview of multimodal data presentation models (muxel model, spatio-temporal connected model and multi-level ontological model) is offered, which allows for presentation of a digital double of the object under study. The means of combining to obtain the most informative way of describing a physical twin are considered. The results of the survey are studied, which noted: