Abstract:In the field of music-driven, computer-assisted dance movement generation, traditional music movement adaptations and statistical mapping models have the following problems: Firstly, the dance sequences generated by the model are not powerful enough to fit the music itself. Secondly, the integrity of the dance movements produced is not sufficient. Thirdly, it is necessary to improve the suppleness and rationality of long-term dance sequences. Fourthly, traditional models cannot produce new dance movements. How to create smooth and complete dance gesture sequences after music is a problem that needs to be investigated in this paper. To address these problems, we design a deep learning dance generation algorithm to extract the association between sound and movement characteristics. During the feature extraction phase, rhythmic features extracted from music and audio beat features are used as musical features, and coordinates of the main points of human bones extracted from dance videos are used for training as movement characteristics. During the model building phase, the model's generator module is used to achieve a basic mapping of music and dance movements and to generate gentle dance gestures. The identification module is used to achieve consistency between dance and music. The self-encoder module is used to make the audio function more representative. Experimental results on the DeepFashion dataset show that the generated model can synthesize the new view of the target person in any human posture of a given posture, complete the transformation of different postures of the same person, and retain the external features and clothing textures of the target person. Using a whole-to-detail generation strategy can improve the final video composition. For the problem of incoherent character movements in video synthesis, we propose to optimize the character movements by using a generative adversarial network, specifically by inserting generated motion compensation frames into the incoherent movement sequences to improve the smoothness of the synthesized video.

Graph Convolutional GRU for Music-Oriented Dance Choreography Generation

ChoreoGraph: Music-conditioned Automatic Dance Choreography over a Style and Tempo Consistent Dynamic Graph

Learning to dance: A graph convolutional adversarial network to generate realistic dance motions from audio

Dance revolution: long-term dance genera-

ChoreoNet: Towards Music to Dance Synthesis with Choreographic Action Unit

Keyframe Control of Music-driven 3D Dance Generation

Generative Autoregressive Networks for 3D Dancing Move Synthesis From Music

Dance with Melody: An LSTM-autoencoder Approach to Music-oriented Dance Synthesis.

Improved Graph Convolutional Neural Network for Dance Tracking and Pose Estimation

Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learning

Pose Estimation-Assisted Dance Tracking System Based on Convolutional Neural Network

DeepDance: Music-to-Dance Motion Choreography With Adversarial Learning

Data-Driven Computer Choreography Based on Kinect and 3D Technology

Listen to Dance: Music-driven choreography generation using Autoregressive Encoder-Decoder Network

Bidirectional long short-term memory networks and sparse hierarchical modeling for scalable educational learning of dance choreographies

Music2Dance: DanceNet for Music-Driven Dance Generation

Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory

Music-to-Dance Generation with Optimal Transport

Bidirectional Autoregressive Diffusion Model for Dance Generation