Abstract:With the vigorous development of Internet technology, applications are increasingly migrating to the cloud. Cloud, a distributed network environment, has been widely extended to many fields such as digital finance, supply chain management, and biomedicine. In order to meet the needs of the rapid development of the modern biomedical industry, the biological cloud platform is an inevitable choice for the integration and analysis of medical information. It improves the work efficiency of the biological information system and also realizes reliable and credible intelligent processing of biological resources. Cloud services in bioinformatics are mainly for the processing of biological data, such as the analysis and processing of genes, the testing and detection of human tissues and organs, and the storage and transportation of vaccines. Biomedical companies form a data chain on the cloud, and they provide services and transfer data to each other to create composite services. Therefore, our motivation is to improve process efficiency of biological cloud services. Users' business requirements have become complicated and diversified, which puts forward higher requirements for service scheduling strategies in cloud computing platforms. In addition, deep reinforcement learning shows strong perception and continuous decision-making capabilities in automatic control problems, which provides a new idea and method for solving the service scheduling and resource allocation problems in the cloud computing field. Therefore, this paper designs a composite service scheduling model under the containers instance mode which hybrids reservation and on-demand. The containers in the cluster are divided into two instance modes: reservation and on-demand. A composite service is described as a three-level structure: a composite service consists of multiple services, and a service consists of multiple service instances, where the service instance is the minimum scheduling unit. In addition, an improved Deep Q-Network (DQN) algorithm is proposed and applied to the scheduling algorithm of composite services. The experimental results show that applying our improved DQN algorithm to the composite services scheduling problem in the container cloud environment can effectively reduce the completion time of the composite services. Meanwhile, the method improves Quality of Service (QoS) and resource utilization in the container cloud environment.

Multi-D3QN: A Multi-strategy Deep Reinforcement Learning for Service Composition in Cloud Manufacturing.

Logistics-involved QoS-aware service composition in cloud manufacturing with deep reinforcement learning

Scheduling of decentralized robot services in cloud manufacturing with deep reinforcement learning

Logistics-involved service composition in a dynamic cloud manufacturing environment: A DDPG-based approach

Distributed Real-Time Scheduling in Cloud Manufacturing by Deep Reinforcement Learning

Enterprise and service−level scheduling of robot production services in cloud manufacturing with deep reinforcement learning

A Multi-Agent Reinforcement Learning Approach to Dynamic Service Composition.

Sequence generation for multi-task scheduling in cloud manufacturing with deep reinforcement learning

Deep Reinforcement Learning-Based Multi-Task Scheduling in Cloud Manufacturing under Different Task Arrival Modes

Adaptive and Large-Scale Service Composition Based on Deep Reinforcement Learning

DeepMRA: an Efficient Microservices Resource Allocation Framework with Deep Reinforcement Learning in the Cloud

An improved deep reinforcement learning-based scheduling approach for dynamic task scheduling in cloud manufacturing

A Reinforcement Learning Based Approach For Multi-Projects Scheduling In Cloud Manufacturing

Resource Management in Cloud Based on Deep Reinforcement Learning

Solving task scheduling problems in cloud manufacturing via attention mechanism and deep reinforcement learning

A resource scheduling method for reliable and trusted distributed composite services in cloud environment based on deep reinforcement learning

Adaptive Disassembly Sequence Planning for VR Maintenance Training Via Deep Reinforcement Learning

Effective Service Composition Using Multi-Agent Reinforcement Learning.

Cloud–edge Collaboration Task Scheduling in Cloud Manufacturing: an Attention-Based Deep Reinforcement Learning Approach

Hybrid Task Scheduling in Cloud Manufacturing with Sparse-Reward Deep Reinforcement Learning

Efficient Multi-Objective Optimization on Dynamic Flexible Job Shop Scheduling Using Deep Reinforcement Learning Approach