[Eicosanoids released in vitro by human alveolar macrophages from normal subjects and asthmatics].

M. Damon,C. Chavis,P. Godard,F. Michel,A. Crastes de Paulet

Abstract:Unstimulated alveolar macrophages incubated with arachidonic acid [1-14C] release both lipoxygenase and cyclooxygenase metabolites. The nature of these eicosanoids is dependent on the incubation time with the labeled arachidonic acid and on the pathological lung profile.

What problem does this paper attempt to address?

Learning a Deep Motion Interpolation Network for Human Skeleton Animations

Qiaorui Chen,Shuai Zhang,Yao Zheng

DOI: https://doi.org/10.1002/cav.2003

IF: 1.01

2021-01-01

Computer Animation and Virtual Worlds

Abstract:Motion interpolation technology produces transition motion frames between two discrete movements. It is wildly used in video games, virtual reality and augmented reality. In the fields of computer graphics and animations, our data-driven method generates transition motions of two arbitrary animations without additional control signals. In this work, we propose a novel carefully designed deep learning framework, named deep motion interpolation network (DMIN), to learn human movement habits from a real dataset and then to perform the interpolation function specific for human motions. It is a data-driven approach to capture overall rhythm of two given discrete movements and generate natural in-between motion frames. The sequence-by-sequence architecture allows completing all missing frames within single forward inference, which reduces computation time for interpolation. Experiments on human motion datasets show that our network achieves promising interpolation performance. The ablation study demonstrates the effectiveness of the carefully designed DMIN.(1)
Real-time Controllable Motion Transition for Characters.

Xiangjun Tang,He Wang,Bo Hu,Xu Gong,Ruifan Yi,Qilong Kou,Xiaogang Jin

DOI: https://doi.org/10.1145/3528223.3530090

IF: 6.2

2022-01-01

ACM Transactions on Graphics

Abstract:Real-time in-between motion generation is universally required in games and highly desirable in existing animation pipelines. Its core challenge lies in the need to satisfy three critical conditions simultaneously: quality, controllability and speed, which renders any methods that need offline computation (or post-processing) or cannot incorporate (often unpredictable) user control undesirable. To this end, we propose a new real-time transition method to address the aforementioned challenges. Our approach consists of two key components: motion manifold and conditional transitioning. The former learns the important low-level motion features and their dynamics; while the latter synthesizes transitions conditioned on a target frame and the desired transition duration. We first learn a motion manifold that explicitly models the intrinsic transition stochasticity in human motions via a multi-modal mapping mechanism. Then, during generation, we design a transition model which is essentially a sampling strategy to sample from the learned manifold, based on the target frame and the aimed transition duration. We validate our method on different datasets in tasks where no post-processing or offline computation is allowed. Through exhaustive evaluation and comparison, we show that our method is able to generate high-quality motions measured under multiple metrics. Our method is also robust under various target frames (with extreme cases).
Dynamic Future Net: Diversified Human Motion Generation

Wenheng Chen,He Wang,Yi Yuan,Tianjia Shao,Kun Zhou

DOI: https://doi.org/10.1145/3394171.3413669

2020-01-01

Abstract:Human motion modelling is crucial in many areas such as computergraphics, vision and virtual reality. Acquiring high-quality skele-tal motions is difficult due to the need for specialized equipmentand laborious manual post-posting, which necessitates maximiz-ing the use of existing data to synthesize new data. However, it is a challenge due to the intrinsic motion stochasticity of humanmotion dynamics, manifested in the short and long terms. In theshort term, there is strong randomness within a couple frames, e.g.one frame followed by multiple possible frames leading to differentmotion styles; while in the long term, there are non-deterministicaction transitions. In this paper, we present Dynamic Future Net,a new deep learning model where we explicitly focuses on the aforementioned motion stochasticity by constructing a generative model with non-trivial modelling capacity in temporal stochas-ticity. Given limited amounts of data, our model can generate a large number of high-quality motions with arbitrary duration, andvisually-convincing variations in both space and time. We evaluateour model on a wide range of motions and compare it with the state-of-the-art methods. Both qualitative and quantitative results show the superiority of our method, for its robustness, versatility and high-quality.
Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose Sequence

Yutong Chen,Yifan Zhan,Zhihang Zhong,Wei Wang,Xiao Sun,Yu Qiao,Yinqiang Zheng

2024-07-16

Abstract:Neural rendering techniques have significantly advanced 3D human body modeling. However, previous approaches often overlook dynamics induced by factors such as motion inertia, leading to challenges in scenarios like abrupt stops after rotation, where the pose remains static while the appearance changes. This limitation arises from reliance on a single pose as conditional input, resulting in ambiguity in mapping one pose to multiple appearances. In this study, we elucidate that variations in human appearance depend not only on the current frame's pose condition but also on past pose states. Therefore, we introduce Dyco, a novel method utilizing the delta pose sequence representation for non-rigid deformations and canonical space to effectively model temporal appearance variations. To prevent a decrease in the model's generalization ability to novel poses, we further propose low-dimensional global context to reduce unnecessary inter-body part dependencies and a quantization operation to mitigate overfitting of the delta pose sequence by the model. To validate the effectiveness of our approach, we collected a novel dataset named I3D-Human, with a focus on capturing temporal changes in clothing appearance under approximate poses. Through extensive experiments on both I3D-Human and existing datasets, our approach demonstrates superior qualitative and quantitative performance. In addition, our inertia-aware 3D human method can unprecedentedly simulate appearance changes caused by inertia at different velocities.

Computer Vision and Pattern Recognition
Towards Realistic 3D Human Motion Prediction with A Spatio-temporal Cross-transformer Approach

Hua Yu,Xuanzhe Fan,Yaqing Hou,Wenbin Pei,Hongwei Ge,Xin Yang,Dongsheng Zhou,Qiang Zhang,Mengjie Zhang

DOI: https://doi.org/10.1109/tcsvt.2023.3255186

IF: 5.859

2023-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Human motion prediction intends to predict how humans move given a historical sequence of 3D human motions. Recent transformer-based methods have attracted increasing attentions and demonstrated their promising performance in 3D human motion prediction. However, existing methods generally decompose the input of human motion information into spatial and temporal branches in a separate way and seldom consider their inherent coherence between the two branches, hence often failing to register the dynamic spatio-temporal information during the training process. Motivated by these issues, we propose a spatio-temporal cross-transformer network (STCT) for 3D human motion predictions. Specifically, we investigate various types of interaction methods (i.e., Concatenation Interaction, Msg token interaction, and Cross-transformer) to capture the coherence of the spatial and temporal branches. According to the obtained results, the proposed cross-transformer interaction method shows its superiority over other methods. Meanwhile, considering that most existing works treat the human body as a set of 3D human joint positions, the predicted human joints are proportionally less appropriate to the realistic human body due to unreasonable bone length and non-plausible poses as time progresses. We further resort to the bone constraints of human mesh to produce more realistic human motions. By fitting a parametric body model (i.e., SMPL-X model) to the predicted human joints, a reconstruction loss function is proposed to remedy the unreasonable bone length and pose errors. Comprehensive experiments on AMASS and Human3.6M datasets have demonstrated that our method achieves superior performance over compared methods.

engineering, electrical & electronic
An Apple a Day Does not Always Keep the Doctor Away…

F. Dedouit,G. Tournel,Anne Bécart Robert,P. Dutrieux,V. Hédouin,D. Gosset

DOI: https://doi.org/10.1111/j.1556-4029.2008.00859.x

2008-11-01

Journal of Forensic Sciences

Abstract:Abstract: The authors describe a case of suicide in the workplace. A 45‐year‐old man employed by a fruit and vegetable packing company was found dead in a room containing a modified atmosphere for the packaging of fruits and vegetables. The rescue team measured the carbon monoxide (CO) concentration of the ambient air with a digital CO tester and found a level higher than 600 particles per million. Analysis of an arterial blood sample taken with an airtight syringe revealed the absence of CO but high levels of carbon dioxide (CO2). Autopsy revealed no significant injury and police investigators found a handwritten note of intent, describing a recent personal crisis. The authors concluded that the cause of death was suicide by asphyxiation secondary to CO2 intoxication and notably oxygen (O2) depletion. This manner of suicide is rare and most cases previously described in the literature were accidental intoxications. To the best of our knowledge, this is the first case of suicide by CO2 intoxication and O2 depletion in a room with a modified atmosphere.
Motion Transition with Balance Control

许威威,潘志庚,葛云芳

DOI: https://doi.org/10.3969/j.issn.1006-8961.2002.09.007

2002-01-01

Journal of Image and Graphics

Abstract:Reusing Motion Capture data to instruct Virtual Human is an effective way to improve the reality of Human Animation. However, there are gaps between captured motion clips, and motion transition.is used to fill them. This paper presents novel method to meet the kinematic and dynamic constraints that should be satisfied during transition. An analytical IK algorithm is adopted to solve the position constraints and an additional constraint, Swivel angle constraint, is added to guarantee the continuity of solution. Since the algorithm only need to search the feasible rangle of Swivel angle, it improves the precision of the solution and the computation efficiency. This paper also presents a simplified way to simulate balancing during transiton.To meet the balancing requirement during the motion transition, balance pose is computed at key points of transition with a BFGS nonlinear constraint optimizing algorithm, displacement mapping is then built and added to original transition motion sequence.
Human Motion Transfer from Poses in the Wild

Jian Ren,Menglei Chai,Sergey Tulyakov,Chen Fang,Xiaohui Shen,Jianchao Yang

DOI: https://doi.org/10.48550/arXiv.2004.03142

2020-04-07

Abstract:In this paper, we tackle the problem of human motion transfer, where we synthesize novel motion video for a target person that imitates the movement from a reference video. It is a video-to-video translation task in which the estimated poses are used to bridge two domains. Despite substantial progress on the topic, there exist several problems with the previous methods. First, there is a domain gap between training and testing pose sequences--the model is tested on poses it has not seen during training, such as difficult dancing moves. Furthermore, pose detection errors are inevitable, making the job of the generator harder. Finally, generating realistic pixels from sparse poses is challenging in a single step. To address these challenges, we introduce a novel pose-to-video translation framework for generating high-quality videos that are temporally coherent even for in-the-wild pose sequences unseen during training. We propose a pose augmentation method to minimize the training-test gap, a unified paired and unpaired learning strategy to improve the robustness to detection errors, and two-stage network architecture to achieve superior texture quality. To further boost research on the topic, we build two human motion datasets. Finally, we show the superiority of our approach over the state-of-the-art studies through extensive experiments and evaluations on different datasets.

Computer Vision and Pattern Recognition
HUMOS: Human Motion Model Conditioned on Body Shape

Shashank Tripathi,Omid Taheri,Christoph Lassner,Michael J. Black,Daniel Holden,Carsten Stoll

2024-09-06

Abstract:Generating realistic human motion is essential for many computer vision and graphics applications. The wide variety of human body shapes and sizes greatly impacts how people move. However, most existing motion models ignore these differences, relying on a standardized, average body. This leads to uniform motion across different body types, where movements don't match their physical characteristics, limiting diversity. To solve this, we introduce a new approach to develop a generative motion model based on body shape. We show that it's possible to train this model using unpaired data by applying cycle consistency, intuitive physics, and stability constraints, which capture the relationship between identity and movement. The resulting model generates diverse, physically plausible, and dynamically stable human motions that are both quantitatively and qualitatively more realistic than current state-of-the-art methods. More details are available on our project page <a class="link-external link-https" href="https://CarstenEpic.github.io/humos/" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence
Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

Shenhao Zhu,Junming Leo Chen,Zuozhuo Dai,Qingkun Su,Yinghui Xu,Xun Cao,Yao Yao,Hao Zhu,Siyu Zhu

2024-06-01

Abstract:In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion guidance in curernt human generative techniques. The methodology utilizes the SMPL(Skinned Multi-Person Linear) model as the 3D human parametric model to establish a unified representation of body shape and pose. This facilitates the accurate capture of intricate human geometry and motion characteristics from source videos. Specifically, we incorporate rendered depth images, normal maps, and semantic maps obtained from SMPL sequences, alongside skeleton-based motion guidance, to enrich the conditions to the latent diffusion model with comprehensive 3D shape and detailed pose attributes. A multi-layer motion fusion module, integrating self-attention mechanisms, is employed to fuse the shape and motion latent representations in the spatial domain. By representing the 3D human parametric model as the motion guidance, we can perform parametric shape alignment of the human body between the reference image and the source video motion. Experimental evaluations conducted on benchmark datasets demonstrate the methodology's superior ability to generate high-quality human animations that accurately capture both pose and shape variations. Furthermore, our approach also exhibits superior generalization capabilities on the proposed in-the-wild dataset. Project page: <a class="link-external link-https" href="https://fudan-generative-vision.github.io/champ" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Human Motion Transfer With 3D Constraints and Detail Enhancement

Yang-Tian Sun,Qian-Cheng Fu,Yue-Ren Jiang,Zitao Liu,Yu-Kun Lai,Hongbo Fu,Lin Gao

DOI: https://doi.org/10.1109/tpami.2022.3201904

IF: 23.6

2023-03-11

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:We propose a new method for realistic human motion transfer using a generative adversarial network (GAN), which generates a motion video of a target character imitating actions of a source character, while maintaining high authenticity of the generated results. We tackle the problem by decoupling and recombining the posture information and appearance information of both the source and target characters. The innovation of our approach lies in the use of the projection of a reconstructed 3D human model as the condition of GAN to better maintain the structural integrity of transfer results in different poses. We further introduce a detail enhancement net to enhance the details of transfer results by exploiting the details in real source frames. Extensive experiments show that our approach yields better results both qualitatively and quantitatively than the state-of-the-art methods.

computer science, artificial intelligence,engineering, electrical & electronic
One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing

Yuzhu Ji,Chuanxia Zheng,Tat-Jen Cham

2024-12-09

Abstract:Human motion transfer aims at animating a static source image with a driving video. While recent advances in one-shot human motion transfer have led to significant improvement in results, it remains challenging for methods with 2D body landmarks, skeleton and semantic mask to accurately capture correspondences between source and driving poses due to the large variation in motion and articulation complexity. In addition, the accuracy and precision of DensePose degrade the image quality for neural-rendering-based methods. To address the limitations and by both considering the importance of appearance and geometry for motion transfer, in this work, we proposed a unified framework that combines multi-scale feature warping and neural texture mapping to recover better 2D appearance and 2.5D geometry, partly by exploiting the information from DensePose, yet adapting to its inherent limited accuracy. Our model takes advantage of multiple modalities by jointly training and fusing them, which allows it to robust neural texture features that cope with geometric errors as well as multi-scale dense motion flow that better preserves appearance. Experimental results with full and half-view body video datasets demonstrate that our model can generalize well and achieve competitive results, and that it is particularly effective in handling challenging cases such as those with substantial self-occlusions.

Computer Vision and Pattern Recognition
Human Motion Diffusion Model

Guy Tevet,Sigal Raab,Brian Gordon,Yonatan Shafir,Daniel Cohen-Or,Amit H. Bermano

DOI: https://doi.org/10.48550/arXiv.2209.14916

2022-09-29

Computer Vision and Pattern Recognition

Abstract:Natural and expressive human motion generation is the holy grail of computer animation. It is a challenging task, due to the diversity of possible motion, human perceptual sensitivity to it, and the difficulty of accurately describing it. Therefore, current generative solutions are either low-quality or limited in expressiveness. Diffusion models, which have already shown remarkable generative capabilities in other domains, are promising candidates for human motion due to their many-to-many nature, but they tend to be resource hungry and hard to control. In this paper, we introduce Motion Diffusion Model (MDM), a carefully adapted classifier-free diffusion-based generative model for the human motion domain. MDM is transformer-based, combining insights from motion generation literature. A notable design-choice is the prediction of the sample, rather than the noise, in each diffusion step. This facilitates the use of established geometric losses on the locations and velocities of the motion, such as the foot contact loss. As we demonstrate, MDM is a generic approach, enabling different modes of conditioning, and different generation tasks. We show that our model is trained with lightweight resources and yet achieves state-of-the-art results on leading benchmarks for text-to-motion and action-to-motion. https://guytevet.github.io/mdm-page/ .
Multi-Transmotion: Pre-trained Model for Human Motion Prediction

Yang Gao,Po-Chien Luan,Alexandre Alahi

2024-11-05

Abstract:The ability of intelligent systems to predict human behaviors is crucial, particularly in fields such as autonomous vehicle navigation and social robotics. However, the complexity of human motion have prevented the development of a standardized dataset for human motion prediction, thereby hindering the establishment of pre-trained models. In this paper, we address these limitations by integrating multiple datasets, encompassing both trajectory and 3D pose keypoints, to propose a pre-trained model for human motion prediction. We merge seven distinct datasets across varying modalities and standardize their formats. To facilitate multimodal pre-training, we introduce Multi-Transmotion, an innovative transformer-based model designed for cross-modality pre-training. Additionally, we present a novel masking strategy to capture rich representations. Our methodology demonstrates competitive performance across various datasets on several downstream tasks, including trajectory prediction in the NBA and JTA datasets, as well as pose prediction in the AMASS and 3DPW datasets. The code is publicly available: <a class="link-external link-https" href="https://github.com/vita-epfl/multi-transmotion" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Robotics
Post-Data Augmentation to Improve Deep Pose Estimation of Extreme and Wild Motions

Kohei Toyoda,Michinari Kono,Jun Rekimoto

DOI: https://doi.org/10.1109/vr.2019.8798221

2019-03-01

Abstract:Contributions of recent deep-neural-network (DNN) based techniques have been playing a significant role in human-computer interaction (HCI) and user interface (UI) domains. One of the commonly used DNNs is human pose estimation. This kind of technique is widely used for motion capturing of humans, and to generate or modify virtual avatars. However, in order to gain accuracy and to use such systems, large and precise datasets are required for the machine learning (ML) procedure. This can be especially difficult for extreme/wild motions such as acrobatic movements or motions in specific sports, which are difficult to estimate in typically provided training models. In addition, training may take a long duration, and will require a high-grade GPU for sufficient speed. To address these issues, we propose a method to improve the pose estimation accuracy for extreme/wild motions by using pre-trained models, i.e., without performing the training procedure by yourselves. We assume our method to encourage usage of these DNN techniques for users in application areas that are out of the ML field, and to help users without high-end computers to apply them for personal and end use cases.
KD-Former: Kinematic and dynamic coupled transformer network for 3D human motion prediction

Ju Dai,Hao Li,Rui Zeng,Junxuan Bai,Feng Zhou,Junjun Pan

DOI: https://doi.org/10.1016/j.patcog.2023.109806

IF: 8

2023-07-10

Pattern Recognition

Abstract:Recent studies have made remarkable progress on 3D human motion prediction by describing motion with kinematic knowledge. However, kinematics only considers the 3D positions or rotations of human skeletons, failing to reveal the physical characteristics of human motion. Motion dynamics reflects the forces between joints, explicitly encoding the skeleton topology, whereas rarely exploited in motion prediction. In this paper, we propose the K inematic and D ynamic coupled trans Former (KD-Former), which incorporates dynamics with kinematics, to learn powerful features for high-fidelity motion prediction. Specifically, We first formulate a reduced-order dynamic model of human body to calculate the forces of all joints. Then we construct a non-autoregressive encoder-decoder framework based on the transformer structure. The encoder involves a kinematic encoder and a dynamic encoder, which are respectively responsible for extracting the kinematic and dynamic features for given history sequences via a spatial transformer and a temporal transformer. Future query sequences are decoded in parallel in the decoder by leveraging the encoded kinematic and dynamic information of history sequences. Experiments on Human3.6M and CMU MoCap benchmarks verify the effectiveness and superiority of our method. Code will be available at: https://github.com/wslh852/KD-Former.git .

computer science, artificial intelligence,engineering, electrical & electronic
Physics-Guided Human Motion Capture with Pose Probability Modeling

Jingyi Ju,Buzhen Huang,Chen Zhu,Zhihao Li,Yangang Wang

2023-08-19

Abstract:Incorporating physics in human motion capture to avoid artifacts like floating, foot sliding, and ground penetration is a promising direction. Existing solutions always adopt kinematic results as reference motions, and the physics is treated as a post-processing module. However, due to the depth ambiguity, monocular motion capture inevitably suffers from noises, and the noisy reference often leads to failure for physics-based tracking. To address the obstacles, our key-idea is to employ physics as denoising guidance in the reverse diffusion process to reconstruct physically plausible human motion from a modeled pose probability distribution. Specifically, we first train a latent gaussian model that encodes the uncertainty of 2D-to-3D lifting to facilitate reverse diffusion. Then, a physics module is constructed to track the motion sampled from the distribution. The discrepancies between the tracked motion and image observation are used to provide explicit guidance for the reverse diffusion model to refine the motion. With several iterations, the physics-based tracking and kinematic denoising promote each other to generate a physically plausible human motion. Experimental results show that our method outperforms previous physics-based methods in both joint accuracy and success rate. More information can be found at \url{<a class="link-external link-https" href="https://github.com/Me-Ditto/Physics-Guided-Mocap" rel="external noopener nofollow">this https URL</a>}.

Computer Vision and Pattern Recognition
Morph: A Motion-free Physics Optimization Framework for Human Motion Generation

Zhuo Li,Mingshuang Luo,Ruibing Hou,Xin Zhao,Hao Liu,Hong Chang,Zimo Liu,Chen Li

2024-11-22

Abstract:Human motion generation plays a vital role in applications such as digital humans and humanoid robot control. However, most existing approaches disregard physics constraints, leading to the frequent production of physically implausible motions with pronounced artifacts such as floating and foot sliding. In this paper, we propose \textbf{Morph}, a \textbf{Mo}tion-f\textbf{r}ee \textbf{ph}ysics optimization framework, comprising a Motion Generator and a Motion Physics Refinement module, for enhancing physical plausibility without relying on costly real-world motion data. Specifically, the Motion Generator is responsible for providing large-scale synthetic motion data, while the Motion Physics Refinement Module utilizes these synthetic data to train a motion imitator within a physics simulator, enforcing physical constraints to project the noisy motions into a physically-plausible space. These physically refined motions, in turn, are used to fine-tune the Motion Generator, further enhancing its capability. Experiments on both text-to-motion and music-to-dance generation tasks demonstrate that our framework achieves state-of-the-art motion generation quality while improving physical plausibility drastically.

Computer Vision and Pattern Recognition
Optimal-State Dynamics Estimation for Physics-based Human Motion Capture from Videos

Cuong Le,Viktor Johansson,Manon Kok,Bastian Wandt

2024-10-10

Abstract:Human motion capture from monocular videos has made significant progress in recent years. However, modern approaches often produce temporal artifacts, e.g. in form of jittery motion and struggle to achieve smooth and physically plausible motions. Explicitly integrating physics, in form of internal forces and exterior torques, helps alleviating these artifacts. Current state-of-the-art approaches make use of an automatic PD controller to predict torques and reaction forces in order to re-simulate the input kinematics, i.e. the joint angles of a predefined skeleton. However, due to imperfect physical models, these methods often require simplifying assumptions and extensive preprocessing of the input kinematics to achieve good performance. To this end, we propose a novel method to selectively incorporate the physics models with the kinematics observations in an online setting, inspired by a neural Kalman-filtering approach. We develop a control loop as a meta-PD controller to predict internal joint torques and external reaction forces, followed by a physics-based motion simulation. A recurrent neural network is introduced to realize a Kalman filter that attentively balances the kinematics input and simulated motion, resulting in an optimal-state dynamics prediction. We show that this filtering step is crucial to provide an online supervision that helps balancing the shortcoming of the respective input motions, thus being important for not only capturing accurate global motion trajectories but also producing physically plausible human poses. The proposed approach excels in the physics-based human pose estimation task and demonstrates the physical plausibility of the predictive dynamics, compared to state of the art. The code is available on <a class="link-external link-https" href="https://github.com/cuongle1206/OSDCap" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition
HuMoR: 3D Human Motion Model for Robust Pose Estimation

Davis Rempe,Tolga Birdal,Aaron Hertzmann,Jimei Yang,Srinath Sridhar,Leonidas J. Guibas

DOI: https://doi.org/10.48550/arXiv.2105.04668

2021-08-18

Abstract:We introduce HuMoR: a 3D Human Motion Model for Robust Estimation of temporal pose and shape. Though substantial progress has been made in estimating 3D human motion and shape from dynamic observations, recovering plausible pose sequences in the presence of noise and occlusions remains a challenge. For this purpose, we propose an expressive generative model in the form of a conditional variational autoencoder, which learns a distribution of the change in pose at each step of a motion sequence. Furthermore, we introduce a flexible optimization-based approach that leverages HuMoR as a motion prior to robustly estimate plausible pose and shape from ambiguous observations. Through extensive evaluations, we demonstrate that our model generalizes to diverse motions and body shapes after training on a large motion capture dataset, and enables motion reconstruction from multiple input modalities including 3D keypoints and RGB(-D) videos.

Computer Vision and Pattern Recognition,Machine Learning

[Eicosanoids released in vitro by human alveolar macrophages from normal subjects and asthmatics].

Learning a Deep Motion Interpolation Network for Human Skeleton Animations

Real-time Controllable Motion Transition for Characters.

Dynamic Future Net: Diversified Human Motion Generation

Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose Sequence

Towards Realistic 3D Human Motion Prediction with A Spatio-temporal Cross-transformer Approach

An Apple a Day Does not Always Keep the Doctor Away…

Motion Transition with Balance Control

Human Motion Transfer from Poses in the Wild

HUMOS: Human Motion Model Conditioned on Body Shape

Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

Human Motion Transfer With 3D Constraints and Detail Enhancement

One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing

Human Motion Diffusion Model

Multi-Transmotion: Pre-trained Model for Human Motion Prediction

Post-Data Augmentation to Improve Deep Pose Estimation of Extreme and Wild Motions

KD-Former: Kinematic and dynamic coupled transformer network for 3D human motion prediction

Physics-Guided Human Motion Capture with Pose Probability Modeling

Morph: A Motion-free Physics Optimization Framework for Human Motion Generation

Optimal-State Dynamics Estimation for Physics-based Human Motion Capture from Videos

HuMoR: 3D Human Motion Model for Robust Pose Estimation