Abstract:Recently, the craze of K-POP contents is promoting the development of Korea’s cultural and artistic industries. In particular, with the development of various K-POP contents, including dance, as well as the popularity of K-POP online due to the non-face-to-face social phenomenon of the Coronavirus Disease 2019 (COVID-19) era, interest in Korean dance and song has increased. Research on dance Artificial Intelligent (AI), such as artificial intelligence in a virtual environment, deepfake AI that transforms dancers into other people, and creative choreography AI that creates new dances by combining dance and music, is being actively conducted. Recently, the dance creative craze that creates new choreography is in the spotlight. Creative choreography AI technology requires the motions of various dancers to prepare a dance cover. This process causes problems, such as expensive input source datasets and the cost of switching to the target source to be used in the model. There is a problem in that different motions between various dance genres must be considered when converting. To solve this problem, it is necessary to promote creative choreography systems in a new direction while saving costs by enabling creative choreography without the use of expensive motion capture devices and minimizing the manpower of dancers according to consideration of various genres. This paper proposes a system in a virtual environment for automatically generating continuous K-POP creative choreography by deriving postures and gestures based on bidirectional long-short term memory (Bi-LSTM). K-POP dance videos and dance videos are collected in advance as input. Considering a dance video for defining a posture, users who want a choreography, a 3D dance character in the source movie, a new choreography is performed with Bi-LSTM and applied. For learning, considering creativity and popularity at the same time, the next motion is evaluated and selected with probability. If the proposed method is used, the effort for dataset collection can be reduced, and it is possible to provide an intensive AI research environment that generates creative choreography from various existing online dance videos.

Beat Based Realistic Dance Video Generation using Deep Learning

Pose Estimation-Assisted Dance Tracking System Based on Convolutional Neural Network

The use of deep learning technology in dance movement generation

Dance Evaluation Based on Movement and Neural Network

DeepDance: Music-to-Dance Motion Choreography With Adversarial Learning

Dance Any Beat: Blending Beats with Visuals in Dance Video Generation

DanceAnyWay: Synthesizing Beat-Guided 3D Dances with Randomized Temporal Contrastive Learning

Learning to dance: A graph convolutional adversarial network to generate realistic dance motions from audio

Music2Dance: DanceNet for Music-Driven Dance Generation

Example-Based Automatic Music-Driven Conventional Dance Motion Synthesis

Advanced Dance Choreography System Using Bidirectional LSTMs

DanceIt: Music-Inspired Dancing Video Synthesis

Sensor based Dance Coherent Action Generation Model using Deep Learning Framework

Dynamic Recognition and Analysis of Gait Contour of Dance Movements Based on Generative Adversarial Networks

Music-oriented Dance Video Synthesis with Pose Perceptual Loss

Dance Dance Generation: Motion Transfer for Internet Videos

Art to Smart: An Automated Bharatanatyam Dance Choreography

Robust Dancer: Long-term 3D Dance Synthesis Using Unpaired Data

Music-to-Dance Generation with Optimal Transport