Abstract:Introduction. In machine learning (ML) and artificial intelligence (AI) works, the emphasis is usually on the quality of classification or the accuracy of parameter estimation. If the focus is on performance, then it is also mainly about the performance of the model's training phase. However, with the proliferation of AI applications in real-world problems, the problem of ensuring high data processing performance with ready models becomes more important. By its nature, this problem is fundamentally different from the one of model training: the latter deals with intensive calculations and the former with simple calculations, but large flows of data (files) coming from the network or file system for processing. That is, the typical task of parallel processing with intensive input-output. Besides, in terms of application, the AI module that performs classification, evaluation, or other data processing is a "black box": the cost of developing and training the model, as well as the risks of failure, are too high to handle such tasks in a non-professional manner. Therefore, performance optimization primarily involves the selection and balancing of system parameters. Cloud systems with their flexibility, manageability and easy scaling are the ideal platforms for such tasks. Consider in more detail the task of investigating the factors which affect performance on a single, but notable, pattern recognition sample of a subset of ImageNet image collection [1] classified by the 50-layer deep learning neural network ResNet-50 [2]. The purpose of the paper is to experimentally investigate the factors that influence the performance of a ready-to-use neural network model application in GPU cloud systems of various architectures. Results. Overheads related to microservices and distributed architectures, memory, network, batch size, synchronous and asynchronous interactions are estimated. The complex nonlinear nature of the influence of the system parameters in various combinations is demonstrated.

AI Hardware Resource Monitoring in the Data Center Environment

AIBench: Towards Scalable and Comprehensive Datacenter AI Benchmarking

P F ] 1 3 A ug 2 01 9 HPC AI 500 : A Benchmark Suite for HPC AI Systems

AI Tax: The Hidden Cost of AI Data Center Applications

Monitoring Data Center Site Infrastructure Using AIOPS Architecture

AI-driven resource management strategies for cloud computing systems, services, and applications

Evaluating Emerging AI/ML Accelerators: IPU, RDU, and NVIDIA/AMD GPUs

Towards Automating the AI Operations Lifecycle

A Theoretical Framework for AI-driven data quality monitoring in high-volume data environments

The importance of resource awareness in artificial intelligence for healthcare

Neuromorphic hardware for sustainable AI data centers

3M-AI: A Multi-task and Multi-core Virtualization Framework for Multi-FPGA AI Systems in the Cloud

Factors of Performance for Application of AI Models in GPU Cloud

Empirical Measurements of AI Training Power Demand on a GPU-Accelerated Node

Optimizing Cloud Infrastructure for Real-time AI Processing: Challenges and Solutions

Optimizing Enterprise AI Adoption with Converged Infrastructure: The Role of NVIDIA AI Enterprise and VMware in Streamlining IT Stack and Enhancing Resource Allocation

AI augmented Edge and Fog computing: Trends and challenges

Artificial intelligence enterprise human resource management system based on FPGA high performance computer hardware

Towards A Comprehensive Assessment of AI's Environmental Impact

AI-Powered Employee Performance Evaluation Systems in HR Management

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems