Abstract:Recently, the craze of K-POP contents is promoting the development of Korea’s cultural and artistic industries. In particular, with the development of various K-POP contents, including dance, as well as the popularity of K-POP online due to the non-face-to-face social phenomenon of the Coronavirus Disease 2019 (COVID-19) era, interest in Korean dance and song has increased. Research on dance Artificial Intelligent (AI), such as artificial intelligence in a virtual environment, deepfake AI that transforms dancers into other people, and creative choreography AI that creates new dances by combining dance and music, is being actively conducted. Recently, the dance creative craze that creates new choreography is in the spotlight. Creative choreography AI technology requires the motions of various dancers to prepare a dance cover. This process causes problems, such as expensive input source datasets and the cost of switching to the target source to be used in the model. There is a problem in that different motions between various dance genres must be considered when converting. To solve this problem, it is necessary to promote creative choreography systems in a new direction while saving costs by enabling creative choreography without the use of expensive motion capture devices and minimizing the manpower of dancers according to consideration of various genres. This paper proposes a system in a virtual environment for automatically generating continuous K-POP creative choreography by deriving postures and gestures based on bidirectional long-short term memory (Bi-LSTM). K-POP dance videos and dance videos are collected in advance as input. Considering a dance video for defining a posture, users who want a choreography, a 3D dance character in the source movie, a new choreography is performed with Bi-LSTM and applied. For learning, considering creativity and popularity at the same time, the next motion is evaluated and selected with probability. If the proposed method is used, the effort for dataset collection can be reduced, and it is possible to provide an intensive AI research environment that generates creative choreography from various existing online dance videos.

Learning Choreographic Primitives Through A Bayesian Optimized Bi-Directional LSTM Model

Bidirectional long short-term memory networks and sparse hierarchical modeling for scalable educational learning of dance choreographies

Advanced Dance Choreography System Using Bidirectional LSTMs

Posture and sequence recognition for Bharatanatyam dance performances using machine learning approach

Implementation of a notation-based motion choreography system

Nrityantar: Pose oblivious Indian classical dance sequence classification system

DanceAnyWay: Synthesizing Beat-Guided 3D Dances with Randomized Temporal Contrastive Learning

DeepDance: Music-to-Dance Motion Choreography With Adversarial Learning

Pose Estimation-Assisted Dance Tracking System Based on Convolutional Neural Network

Bailando++: 3D Dance GPT With Choreographic Memory

Art to Smart: An Automated Bharatanatyam Dance Choreography

Improved Graph Convolutional Neural Network for Dance Tracking and Pose Estimation

Towards 3D Dance Motion Synthesis and Control

Unsupervised 3D Pose Estimation for Hierarchical Dance Video Recognition

Human Motion Prediction Based on a Multi-Scale Hypergraph for Intangible Cultural Heritage Dance Videos

Robust Dancer: Long-term 3D Dance Synthesis Using Unpaired Data

Learning Embodied Sound-Motion Mappings: Evaluating AI-Generated Dance Improvisation

Dance with Melody: An LSTM-autoencoder Approach to Music-oriented Dance Synthesis.

Choreographing the Digital Canvas: A Machine Learning Approach to Artistic Performance

Machine Interpretation of Ballet Dance: Alternating Wavelet Spatial and Channel Attention Based Learning Model