Role of NO in pyloric, antral, and duodenal motility and its interaction with other inhibitory mediators

H. Allescher,E. Daniel

DOI: https://doi.org/10.1007/BF02300376

1994-12-01

Digestive Diseases and Sciences

Abstract:

What problem does this paper attempt to address?

Adversarial learning for viewpoints invariant 3D human pose estimation.

Yimeng Li,Jun Xiao,Di Xie,Jian Shao,Jinlong Wang

DOI: https://doi.org/10.1016/j.jvcir.2018.11.021

IF: 2.887

2019-01-01

Journal of Visual Communication and Image Representation

Abstract:•We propose an adversarial learning framework, which can learn human pose latent from 3D annotated datasets to optimized the estimation of monocular images with only 2D annotations.•We add a viewpoints invariant module to automatically regulate observation viewpoints for generated 3D pose.•We achieved the state-of-art result on Human3.6M dataset and quantitatively improved the 2D pose estimation performance.
Weakly Supervised 2D Human Pose Transfer

Zheng Qian,Liu Yajie,Lin Zhizhao,Lischinski Dani,Cohen-Or Daniel,Huang Hui

DOI: https://doi.org/10.1007/s11432-021-3301-5

2021-01-01

Science China Information Sciences

Abstract:We present a novel method for pose transfer between two 2 D human skeletons. When the bone lengths and proportions between the two skeletons are significantly different, pose transfer becomes a challenging task, which cannot be accomplished by simply copying the joint positions or the bone directions.Our data-driven approach utilizes a deep neural network trained, in a weakly supervised fashion, to encode a skeleton into two separate latent codes, one representing its pose, and another representing the skeleton’s proportions(skeleton-ID). The network is given two skeletons, and learns to combine the pose of one with the skeleton-ID of the other. Lacking supervision on the poses, we develop a novel loss that qualitatively compares poses of different skeletons. We evaluate the performance of our method on a large set of poses.The advantages of avoiding supervision are demonstrated by showing transfer of extreme poses, as well as between uncommon skeleton proportions.
Global Adaptation Meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimation.

Wenhao Chai,Zhongyu Jiang,Jenq-Neng Hwang,Gaoang Wang

DOI: https://doi.org/10.1109/iccv51070.2023.01347

2023-01-01

Abstract:When applying a pre-trained 2D-to-3D human pose lifting model to a target unseen dataset, large performance degradation is commonly encountered due to domain shift issues. We observe that the degradation is caused by two factors: 1) the large distribution gap over global positions of poses between the source and target datasets due to variant camera parameters and settings, and 2) the deficient diversity of local structures of poses in training. To this end, we combine global adaptation and local generalization in PoseDA, a simple yet effective framework of unsupervised domain adaptation for 3D human pose estimation. Specifically, global adaptation aims to align global positions of poses from the source domain to the target domain with a proposed global position alignment (GPA) module. And local generalization is designed to enhance the diversity of 2D-3D pose mapping with a local pose augmentation (LPA) module. These modules bring significant performance improvement without introducing additional learnable parameters. In addition, we propose local pose augmentation (LPA) to enhance the diversity of 3D poses following an adversarial training scheme consisting of 1) a augmentation generator that generates the parameters of pre-defined pose transformations and 2) an anchor discriminator to ensure the reality and quality of the augmented data. Our approach can be applicable to almost all 2D-3D lifting models. PoseDA achieves 61.3 mm of MPJPE on MPI-INF-3DHP under a cross-dataset evaluation setup, improving upon the previous state-of-the-art method by 10.2%.
Unsupervised Domain Adaptation for 3D Human Pose Estimation

Xiheng Zhang,Yongkang Wong,Mohan S. Kankanhalli,Weidong Geng

DOI: https://doi.org/10.1145/3343031.3351052

2019-01-01

Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.
Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Network

Guoliang Hua,Hong Liu,Wenhao Li,Qian Zhang,Runwei Ding,Xin Xu

DOI: https://doi.org/10.1109/tmm.2022.3171102

IF: 7.3

2022-01-01

IEEE Transactions on Multimedia

Abstract:Although monocular 3D human pose estimation methods have made significant progress, it is far from being solved due to the inherent depth ambiguity. Instead, exploiting multi-view information is a practical way to achieve absolute 3D human pose estimation. In this paper, we propose a simple yet effective pipeline for weakly-supervised cross-view 3D human pose estimation. By only using two camera views, our method can achieve state-of-the-art performance in a weakly-supervised manner, requiring no 3D ground truth but only 2D annotations. Specifically, our method contains two steps: triangulation and refinement. First, given the 2D keypoints that can be obtained through any classic 2D detection methods, triangulation is performed across two views to lift the 2D keypoints into coarse 3D poses. Then, a novel cross-view U-shaped graph convolutional network (CV-UGCN), which can explore the spatial configurations and cross-view correlations, is designed to refine the coarse 3D poses. In particular, the refinement progress is achieved through weakly-supervised learning, in which geometric and structure-aware consistency checks are performed. We evaluate our method on the standard benchmark dataset, Human3.6M. The Mean Per Joint Position Error on the benchmark dataset is 27.4 mm, which outperforms existing state-of-the-art methods remarkably (27.4 mm vs 30.2 mm).

computer science, information systems,telecommunications, software engineering
Geometry-Driven Self-Supervised Method for 3D Human Pose Estimation

Yang Li,kan Li,Shuai Jiang,Ziyue Zhang,Congzhentao Huang,Richard Yi Da Xu

DOI: https://doi.org/10.1609/aaai.v34i07.6808

2020-01-01

Abstract:The neural network based approach for 3D human pose estimation from monocular images has attracted growing interest. However, annotating 3D poses is a labor-intensive and expensive process. In this paper, we propose a novel self-supervised approach to avoid the need of manual annotations. Different from existing weakly/self-supervised methods that require extra unpaired 3D ground-truth data to alleviate the depth ambiguity problem, our method trains the network only relying on geometric knowledge without any additional 3D pose annotations. The proposed method follows the two-stage pipeline: 2D pose estimation and 2D-to-3D pose lifting. We design the transform re-projection loss that is an effective way to explore multi-view consistency for training the 2D-to-3D lifting network. Besides, we adopt the confidences of 2D joints to integrate losses from different views to alleviate the influence of noises caused by the self-occlusion problem. Finally, we design a two-branch training architecture, which helps to preserve the scale information of re-projected 2D poses during training, resulting in accurate 3D pose predictions. We demonstrate the effectiveness of our method on two popular 3D human pose datasets, Human3.6M and MPI-INF-3DHP. The results show that our method significantly outperforms recent weakly/self-supervised approaches.
Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledge

Zhongwei Qiu,Kai Qiu,Jianlong Fu,Dongmei Fu

DOI: https://doi.org/10.48550/arXiv.2211.11983

2022-11-22

Abstract:Modern deep learning-based 3D pose estimation approaches require plenty of 3D pose annotations. However, existing 3D datasets lack diversity, which limits the performance of current methods and their generalization ability. Although existing methods utilize 2D pose annotations to help 3D pose estimation, they mainly focus on extracting 2D structural constraints from 2D poses, ignoring the 3D information hidden in the images. In this paper, we propose a novel method to extract weak 3D information directly from 2D images without 3D pose supervision. Firstly, we utilize 2D pose annotations and perspective prior knowledge to generate the relationship of that keypoint is closer or farther from the camera, called relative depth. We collect a 2D pose dataset (MCPC) and generate relative depth labels. Based on MCPC, we propose a weakly-supervised pre-training (WSP) strategy to distinguish the depth relationship between two points in an image. WSP enables the learning of the relative depth of two keypoints on lots of in-the-wild images, which is more capable of predicting depth and generalization ability for 3D human pose estimation. After fine-tuning on 3D pose datasets, WSP achieves state-of-the-art results on two widely-used benchmarks.

Computer Vision and Pattern Recognition
Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locations

Yasunori Kudo,Keisuke Ogaki,Yusuke Matsui,Yuri Odagiri

DOI: https://doi.org/10.48550/arXiv.1803.08244

2018-03-22

Abstract:The task of three-dimensional (3D) human pose estimation from a single image can be divided into two parts: (1) Two-dimensional (2D) human joint detection from the image and (2) estimating a 3D pose from the 2D joints. Herein, we focus on the second part, i.e., a 3D pose estimation from 2D joint locations. The problem with existing methods is that they require either (1) a 3D pose dataset or (2) 2D joint locations in consecutive frames taken from a video sequence. We aim to solve these problems. For the first time, we propose a method that learns a 3D human pose without any 3D datasets. Our method can predict a 3D pose from 2D joint locations in a single image. Our system is based on the generative adversarial networks, and the networks are trained in an unsupervised manner. Our primary idea is that, if the network can predict a 3D human pose correctly, the 3D pose that is projected onto a 2D plane should not collapse even if it is rotated perpendicularly. We evaluated the performance of our method using Human3.6M and the MPII dataset and showed that our network can predict a 3D pose well even if the 3D dataset is not available during training.

Computer Vision and Pattern Recognition
Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approach

Xingyi Zhou,Qixing Huang,Xiao Sun,Xiangyang Xue,Yichen Wei

DOI: https://doi.org/10.48550/arXiv.1704.02447

2017-07-30

Abstract:In this paper, we study the task of 3D human pose estimation in the wild. This task is challenging due to lack of training data, as existing datasets are either in the wild images with 2D pose or in the lab images with 3D pose. We propose a weakly-supervised transfer learning method that uses mixed 2D and 3D labels in a unified deep neutral network that presents two-stage cascaded structure. Our network augments a state-of-the-art 2D pose estimation sub-network with a 3D depth regression sub-network. Unlike previous two stage approaches that train the two sub-networks sequentially and separately, our training is end-to-end and fully exploits the correlation between the 2D pose and depth estimation sub-tasks. The deep features are better learnt through shared representations. In doing so, the 3D pose labels in controlled lab environments are transferred to in the wild images. In addition, we introduce a 3D geometric constraint to regularize the 3D pose prediction, which is effective in the absence of ground truth depth labels. Our method achieves competitive results on both 2D and 3D benchmarks.

Computer Vision and Pattern Recognition
Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild

Umar Iqbal,Pavlo Molchanov,Jan Kautz

DOI: https://doi.org/10.48550/arXiv.2003.07581

2020-03-17

Abstract:One major challenge for monocular 3D human pose estimation in-the-wild is the acquisition of training data that contains unconstrained images annotated with accurate 3D poses. In this paper, we address this challenge by proposing a weakly-supervised approach that does not require 3D annotations and learns to estimate 3D poses from unlabeled multi-view data, which can be acquired easily in in-the-wild environments. We propose a novel end-to-end learning framework that enables weakly-supervised training using multi-view consistency. Since multi-view consistency is prone to degenerated solutions, we adopt a 2.5D pose representation and propose a novel objective function that can only be minimized when the predictions of the trained model are consistent and plausible across all camera views. We evaluate our proposed approach on two large scale datasets (Human3.6M and MPII-INF-3DHP) where it achieves state-of-the-art performance among semi-/weakly-supervised methods.

Computer Vision and Pattern Recognition,Machine Learning
Lifting 2d Human Pose to 3d : A Weakly Supervised Approach

Sandika Biswas,Sanjana Sinha,Kavya Gupta,Brojeshwar Bhowmick

DOI: https://doi.org/10.48550/arXiv.1905.01047

2019-05-03

Abstract:Estimating 3d human pose from monocular images is a challenging problem due to the variety and complexity of human poses and the inherent ambiguity in recovering depth from the single view. Recent deep learning based methods show promising results by using supervised learning on 3d pose annotated datasets. However, the lack of large-scale 3d annotated training data captured under in-the-wild settings makes the 3d pose estimation difficult for in-the-wild poses. Few approaches have utilized training images from both 3d and 2d pose datasets in a weakly-supervised manner for learning 3d poses in unconstrained settings. In this paper, we propose a method which can effectively predict 3d human pose from 2d pose using a deep neural network trained in a weakly-supervised manner on a combination of ground-truth 3d pose and ground-truth 2d pose. Our method uses re-projection error minimization as a constraint to predict the 3d locations of body joints, and this is crucial for training on data where the 3d ground-truth is not present. Since minimizing re-projection error alone may not guarantee an accurate 3d pose, we also use additional geometric constraints on skeleton pose to regularize the pose in 3d. We demonstrate the superior generalization ability of our method by cross-dataset validation on a challenging 3d benchmark dataset MPI-INF-3DHP containing in the wild 3d poses.

Computer Vision and Pattern Recognition,Artificial Intelligence
Weakly-Supervised Discovery of Geometry-Aware Representation for 3D Human Pose Estimation

Xipeng Chen,Kwan-Yee Lin,Wentao Liu,Chen Qian,Xiaogang Wang,Liang Lin

DOI: https://doi.org/10.48550/arXiv.1903.08839

2019-03-27

Abstract:Recent studies have shown remarkable advances in 3D human pose estimation from monocular images, with the help of large-scale in-door 3D datasets and sophisticated network architectures. However, the generalizability to different environments remains an elusive goal. In this work, we propose a geometry-aware 3D representation for the human pose to address this limitation by using multiple views in a simple auto-encoder model at the training stage and only 2D keypoint information as supervision. A view synthesis framework is proposed to learn the shared 3D representation between viewpoints with synthesizing the human pose from one viewpoint to the other one. Instead of performing a direct transfer in the raw image-level, we propose a skeleton-based encoder-decoder mechanism to distil only pose-related representation in the latent space. A learning-based representation consistency constraint is further introduced to facilitate the robustness of latent 3D representation. Since the learnt representation encodes 3D geometry information, mapping it to 3D pose will be much easier than conventional frameworks that use an image or 2D coordinates as the input of 3D pose estimator. We demonstrate our approach on the task of 3D human pose estimation. Comprehensive experiments on three popular benchmarks show that our model can significantly improve the performance of state-of-the-art methods with simply injecting the representation as a robust 3D prior.

Computer Vision and Pattern Recognition
Weakly-supervised Transfer for 3D Human Pose Estimation in the Wild

Xingyi Zhou,Qixing Huang,Xiao Sun,Xiangyang Xue,Yichen Wei

2017-01-01

Abstract:In this paper, we study the task of 3D human pose estimation in the wild. This task is challenging because existing benchmark datasets provide either 2D annotations in the wild or 3D annotations in controlled environments. We propose a weakly-supervised transfer learning method that learns an end-to-end network using training data with mixed 2D and 3D labels. The network augments a state-of-the-art 2D pose estimation network with a 3D depth regression network. Unlike previous approaches that train these two sub-networks in a sequential manner, we introduce a unified training method that fully exploits the correlation between these two sub-tasks and learns common feature representations. In doing so, the 3D pose labels in controlled environments are transferred to images in the wild that only possess 2D annotations. In addition, we introduce a 3D geometric constraint to regularize the prediction 3D poses, which is effective on images that only have 2D annotations. Our method leads to considerable performance gains and achieves competitive results on both 2D and 3D benchmarks. It produces high quality 3D human poses in the wild, without supervision of in-the-wild 3D data.
Heuristic Weakly Supervised 3D Human Pose Estimation

Shuangjun Liu,Michael Wan,Sarah Ostadabbas

DOI: https://doi.org/10.48550/arXiv.2105.10996

2023-05-12

Abstract:Monocular 3D human pose estimation from RGB images has attracted significant attention in recent years. However, recent models depend on supervised training with 3D pose ground truth data or known pose priors for their target domains. 3D pose data is typically collected with motion capture devices, severely limiting their applicability. In this paper, we present a heuristic weakly supervised 3D human pose (HW-HuP) solution to estimate 3D poses in when no ground truth 3D pose data is available. HW-HuP learns partial pose priors from 3D human pose datasets and uses easy-to-access observations from the target domain to estimate 3D human pose and shape in an optimization and regression cycle. We employ depth data for weak supervision during training, but not inference. We show that HW-HuP meaningfully improves upon state-of-the-art models in two practical settings where 3D pose data can hardly be obtained: human poses in bed, and infant poses in the wild. Furthermore, we show that HW-HuP retains comparable performance to cutting-edge models on public benchmarks, even when such models train on 3D pose data.

Computer Vision and Pattern Recognition
Robust Estimation of 3D Human Poses from a Single Image

Chunyu Wang,Yizhou Wang,Zhouchen Lin,Alan L. Yuille,Wen Gao

DOI: https://doi.org/10.48550/arXiv.1406.2282

2014-06-09

Computer Vision and Pattern Recognition

Abstract:Human pose estimation is a key step to action recognition. We propose a method of estimating 3D human poses from a single image, which works in conjunction with an existing 2D pose/joint detector. 3D pose estimation is challenging because multiple 3D poses may correspond to the same 2D pose after projection due to the lack of depth information. Moreover, current 2D pose estimators are usually inaccurate which may cause errors in the 3D estimation. We address the challenges in three ways: (i) We represent a 3D pose as a linear combination of a sparse set of bases learned from 3D human skeletons. (ii) We enforce limb length constraints to eliminate anthropomorphically implausible skeletons. (iii) We estimate a 3D pose by minimizing the $L_1$-norm error between the projection of the 3D pose and the corresponding 2D detection. The $L_1$-norm loss term is robust to inaccurate 2D joint estimations. We use the alternating direction method (ADM) to solve the optimization problem efficiently. Our approach outperforms the state-of-the-arts on three benchmark datasets.
Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Gu Renshu,Jiang Zhongyu,Wang Gaoang,McQuade Kevin,Hwang Jenq-Neng

DOI: https://doi.org/10.1007/s11042-022-13079-5

IF: 2.577

2022-01-01

Multimedia Tools and Applications

Abstract:Multi-person 3D pose estimation using a monocular freely moving camera in real-world scenarios remains a challenge. There is a lack of data with 3D ground truth, and real-world scenes usually contain self-occlusions and inter-person occlusions. To address these challenges, an unsupervised Universal Hierarchical 3D Human Pose Estimation (UH3DHPE) method that optimizes the torso and limb poses based on a hierarchical framework is proposed. To handle the case of an occluded or inaccurate 2D torso keypoints, which play an important role for 3D pose initialization and subsequent inference, an effective method to directly estimate limb poses without building upon the estimated torso pose is proposed, and the torso pose can then be further refined to form the hierarchy in a bottom-up fashion. An adaptive merging strategy is proposed to determine the best hierarchy. To verify the effectiveness of the proposed scheme, a video dataset for multi-person interactions is collected by a moving camera, under a Motion Capture (MoCap) ground truth data acquisition environment, for our performance evaluations. Experimental results show the proposed method outperforms state-of-the-art methods on the multi-person moving camera scenarios.
Kinematic-Structure-Preserved Representation for Unsupervised 3D Human Pose Estimation

Jogendra Nath Kundu,Siddharth Seth,Rahul M V,Mugalodi Rakesh,R. Venkatesh Babu,Anirban Chakraborty

DOI: https://doi.org/10.48550/arXiv.2006.14107

2020-06-25

Abstract:Estimation of 3D human pose from monocular image has gained considerable attention, as a key step to several human-centric applications. However, generalizability of human pose estimation models developed using supervision on large-scale in-studio datasets remains questionable, as these models often perform unsatisfactorily on unseen in-the-wild environments. Though weakly-supervised models have been proposed to address this shortcoming, performance of such models relies on availability of paired supervision on some related tasks, such as 2D pose or multi-view image pairs. In contrast, we propose a novel kinematic-structure-preserved unsupervised 3D pose estimation framework, which is not restrained by any paired or unpaired weak supervisions. Our pose estimation framework relies on a minimal set of prior knowledge that defines the underlying kinematic 3D structure, such as skeletal joint connectivity information with bone-length ratios in a fixed canonical scale. The proposed model employs three consecutive differentiable transformations named as forward-kinematics, camera-projection and spatial-map transformation. This design not only acts as a suitable bottleneck stimulating effective pose disentanglement but also yields interpretable latent pose representations avoiding training of an explicit latent embedding to pose mapper. Furthermore, devoid of unstable adversarial setup, we re-utilize the decoder to formalize an energy-based loss, which enables us to learn from in-the-wild videos, beyond laboratory settings. Comprehensive experiments demonstrate our state-of-the-art unsupervised and weakly-supervised pose estimation performance on both Human3.6M and MPI-INF-3DHP datasets. Qualitative results on unseen environments further establish our superior generalization ability.

Computer Vision and Pattern Recognition
3D Human Pose Estimation using Spatio-Temporal Networks with Explicit Occlusion Training

Yu Cheng,Bo Yang,Bo Wang,Robby T. Tan

DOI: https://doi.org/10.48550/arXiv.2004.11822

2020-04-07

Abstract:Estimating 3D poses from a monocular video is still a challenging task, despite the significant progress that has been made in recent years. Generally, the performance of existing methods drops when the target person is too small/large, or the motion is too fast/slow relative to the scale and speed of the training data. Moreover, to our knowledge, many of these methods are not designed or trained under severe occlusion explicitly, making their performance on handling occlusion compromised. Addressing these problems, we introduce a spatio-temporal network for robust 3D human pose estimation. As humans in videos may appear in different scales and have various motion speeds, we apply multi-scale spatial features for 2D joints or keypoints prediction in each individual frame, and multi-stride temporal convolutional net-works (TCNs) to estimate 3D joints or keypoints. Furthermore, we design a spatio-temporal discriminator based on body structures as well as limb motions to assess whether the predicted pose forms a valid pose and a valid movement. During training, we explicitly mask out some keypoints to simulate various occlusion cases, from minor to severe occlusion, so that our network can learn better and becomes robust to various degrees of occlusion. As there are limited 3D ground-truth data, we further utilize 2D video data to inject a semi-supervised learning capability to our network. Experiments on public datasets validate the effectiveness of our method, and our ablation studies show the strengths of our networkś individual submodules.

Computer Vision and Pattern Recognition
Self-supervised 3D Human Pose Estimation from a Single Image

Jose Sosa,David Hogg

2023-04-05

Abstract:We propose a new self-supervised method for predicting 3D human body pose from a single image. The prediction network is trained from a dataset of unlabelled images depicting people in typical poses and a set of unpaired 2D poses. By minimising the need for annotated data, the method has the potential for rapid application to pose estimation of other articulated structures (e.g. animals). The self-supervision comes from an earlier idea exploiting consistency between predicted pose under 3D rotation. Our method is a substantial advance on state-of-the-art self-supervised methods in training a mapping directly from images, without limb articulation constraints or any 3D empirical pose prior. We compare performance with state-of-the-art self-supervised methods using benchmark datasets that provide images and ground-truth 3D pose (Human3.6M, MPI-INF-3DHP). Despite the reduced requirement for annotated data, we show that the method outperforms on Human3.6M and matches performance on MPI-INF-3DHP. Qualitative results on a dataset of human hands show the potential for rapidly learning to predict 3D pose for articulated structures other than the human body.

Computer Vision and Pattern Recognition
Self-supervised 3D Human Mesh Recovery from Noisy Point Clouds

Xinxin Zuo,Sen Wang,Qiang Sun,Minglun Gong,Li Cheng

DOI: https://doi.org/10.48550/arXiv.2107.07539

2021-11-27

Abstract:This paper presents a novel self-supervised approach to reconstruct human shape and pose from noisy point cloud data. Relying on large amount of dataset with ground-truth annotations, recent learning-based approaches predict correspondences for every vertice on the point cloud; Chamfer distance is usually used to minimize the distance between a deformed template model and the input point cloud. However, Chamfer distance is quite sensitive to noise and outliers, thus could be unreliable to assign correspondences. To address these issues, we model the probability distribution of the input point cloud as generated from a parametric human model under a Gaussian Mixture Model. Instead of explicitly aligning correspondences, we treat the process of correspondence search as an implicit probabilistic association by updating the posterior probability of the template model given the input. A novel self-supervised loss is further derived which penalizes the discrepancy between the deformed template and the input point cloud conditioned on the posterior probability. Our approach is very flexible, which works with both complete point cloud and incomplete ones including even a single depth image as input. Compared to previous self-supervised methods, our method shows the capability to deal with substantial noise and outliers. Extensive experiments conducted on various public synthetic datasets as well as a very noisy real dataset (i.e. CMU Panoptic) demonstrate the superior performance of our approach over the state-of-the-art methods.

Computer Vision and Pattern Recognition

Role of NO in pyloric, antral, and duodenal motility and its interaction with other inhibitory mediators

Adversarial learning for viewpoints invariant 3D human pose estimation.

Weakly Supervised 2D Human Pose Transfer

Global Adaptation Meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimation.

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Network

Geometry-Driven Self-Supervised Method for 3D Human Pose Estimation

Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledge

Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locations

Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approach

Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild

Lifting 2d Human Pose to 3d : A Weakly Supervised Approach

Weakly-Supervised Discovery of Geometry-Aware Representation for 3D Human Pose Estimation

Weakly-supervised Transfer for 3D Human Pose Estimation in the Wild

Heuristic Weakly Supervised 3D Human Pose Estimation

Robust Estimation of 3D Human Poses from a Single Image

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Kinematic-Structure-Preserved Representation for Unsupervised 3D Human Pose Estimation

3D Human Pose Estimation using Spatio-Temporal Networks with Explicit Occlusion Training

Self-supervised 3D Human Pose Estimation from a Single Image

Self-supervised 3D Human Mesh Recovery from Noisy Point Clouds