Abstract:In the field of music-driven, computer-assisted dance movement generation, traditional music movement adaptations and statistical mapping models have the following problems: Firstly, the dance sequences generated by the model are not powerful enough to fit the music itself. Secondly, the integrity of the dance movements produced is not sufficient. Thirdly, it is necessary to improve the suppleness and rationality of long-term dance sequences. Fourthly, traditional models cannot produce new dance movements. How to create smooth and complete dance gesture sequences after music is a problem that needs to be investigated in this paper. To address these problems, we design a deep learning dance generation algorithm to extract the association between sound and movement characteristics. During the feature extraction phase, rhythmic features extracted from music and audio beat features are used as musical features, and coordinates of the main points of human bones extracted from dance videos are used for training as movement characteristics. During the model building phase, the model's generator module is used to achieve a basic mapping of music and dance movements and to generate gentle dance gestures. The identification module is used to achieve consistency between dance and music. The self-encoder module is used to make the audio function more representative. Experimental results on the DeepFashion dataset show that the generated model can synthesize the new view of the target person in any human posture of a given posture, complete the transformation of different postures of the same person, and retain the external features and clothing textures of the target person. Using a whole-to-detail generation strategy can improve the final video composition. For the problem of incoherent character movements in video synthesis, we propose to optimize the character movements by using a generative adversarial network, specifically by inserting generated motion compensation frames into the incoherent movement sequences to improve the smoothness of the synthesized video.

Music to Dance: Motion Generation Based on Multi-Feature Fusion Strategy.

Example-Based Automatic Music-Driven Conventional Dance Motion Synthesis

DeepDance: Music-to-Dance Motion Choreography With Adversarial Learning

Pose Estimation-Assisted Dance Tracking System Based on Convolutional Neural Network

Music2Dance: DanceNet for Music-Driven Dance Generation

Dancing to Music

DanceIt: Music-Inspired Dancing Video Synthesis

Dance Evaluation Based on Movement and Neural Network

Music-driven generative dance movement teaching game based on a multi-feature fusion strategy

The use of deep learning technology in dance movement generation

Dance Generation with Style Embedding: Learning and Transferring Latent Representations of Dance Styles

Dance Any Beat: Blending Beats with Visuals in Dance Video Generation

EnchantDance: Unveiling the Potential of Music-Driven Dance Movement

Exploring Multi-Modal Control in Music-Driven Dance Generation

Music-to-Dance Generation with Optimal Transport

Mining and Applying Composition Knowledge of Dance Moves for Style-Concentrated Dance Generation

Dance2MIDI: Dance-driven multi-instrument music generation

DiffDance: Cascaded Human Motion Diffusion Model for Dance Generation

Keyframe Control of Music-driven 3D Dance Generation