Safety and handling of MPTP

I. Irwin,J. Langston

DOI: https://doi.org/10.1212/WNL.35.4.619-a

IF: 9.9

1985-04-01

Neurology

Abstract:

What problem does this paper attempt to address?

Anisotropic Multi-Scale Graph Convolutional Network for Dense Shape Correspondence

Mohammad Farazi,Wenhui Zhu,Zhangsihao Yang,Yalin Wang

DOI: https://doi.org/10.48550/arXiv.2210.09466

2022-11-11

Abstract:This paper studies 3D dense shape correspondence, a key shape analysis application in computer vision and graphics. We introduce a novel hybrid geometric deep learning-based model that learns geometrically meaningful and discretization-independent features with a U-Net model as the primary node feature extraction module, followed by a successive spectral-based graph convolutional network. To create a diverse set of filters, we use anisotropic wavelet basis filters, being sensitive to both different directions and band-passes. This filter set overcomes the over-smoothing behavior of conventional graph neural networks. To further improve the model's performance, we add a function that perturbs the feature maps in the last layer ahead of fully connected layers, forcing the network to learn more discriminative features overall. The resulting correspondence maps show state-of-the-art performance on the benchmark datasets based on average geodesic errors and superior robustness to discretization in 3D meshes. Our approach provides new insights and practical solutions to the dense shape correspondence research.

Computer Vision and Pattern Recognition,Machine Learning
3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Huimin Huang,Nan Zhou,Lanfen Lin,Hongjie Hu,Yutaro Iwamoto,Xian-Hua Han,Yen-Wei Chen,Ruofeng Tong

DOI: https://doi.org/10.1007/978-3-030-87196-3_39

2021-01-01

Abstract:Semi-supervised learning (SSL) algorithms have attracted much attentions in medical image segmentation due to challenge in acquiring pixel-wise annotations by using unlabeled data. However, most of existing SSLs neglected the geometric shape constraint in object, leading to unsatisfactory boundary and non-smooth of object. In this paper, we propose a shape-aware semi-supervised 3D medical image segmentation network, named 3D Graph-S(2)Net, which incorporates the flexible shape information and learns duality constraints between semantics and geometrics in the graph domain. Specifically, our method consists of two parts: a multi-task learning network (3D S(2)Net) and a graph-based cross-task module (3D BGCM). The 3D S(2)Net improves the existing self-ensembling model (i.e., Mean-Teacher model) by adding a signed distance map (SDM) prediction task, which encodes richer features of object shape and surface. Moreover, the 3D BGCM explores the co-occurrence relations between the semantics segmentation and SDM prediction task, so that the network learns stronger semantic and geometric correspondences from both labeled and unlabeled data. Experimental results on the Atrial Segmentation Challenge confirm that our 3D Graph-S(2)Net outperforms the state-of-the-arts in semi-supervised segmentation.
Shape-Scale Co-Awareness Network for 3D Brain Tumor Segmentation.

Lifang Zhou,Yu Jiang,Weisheng Li,Jun Hu,Shenhai Zheng

DOI: https://doi.org/10.1109/tmi.2024.3368531

IF: 10.6

2024-01-01

IEEE Transactions on Medical Imaging

Abstract:The accurate segmentation of brain tumor is significant in clinical practice. Convolutional Neural Network (CNN)-based methods have made great progress in brain tumor segmentation due to powerful local modeling ability. However, brain tumors are frequently pattern-agnostic, i.e. variable in shape, size and location, which can not be effectively matched by traditional CNN-based methods with local and regular receptive fields. To address the above issues, we propose a shape-scale co-awareness network (S2CA-Net) for brain tumor segmentation, which can efficiently learn shape-aware and scale-aware features simultaneously to enhance pattern-agnostic representations. Primarily, three key components are proposed to accomplish the co-awareness of shape and scale. The Local-Global Scale Mixer (LGSM) decouples the extraction of local and global context by adopting the CNN-Former parallel structure, which contributes to obtaining finer hierarchical features. The Multi-level Context Aggregator (MCA) enriches the scale diversity of input patches by modeling global features across multiple receptive fields. The Multi-Scale Attentive Deformable Convolution (MS-ADC) learns the target deformation based on the multiscale inputs, which motivates the network to enforce feature constraints both in terms of scale and shape for optimal feature matching. Overall, LGSM and MCA focus on enhancing the scale-awareness of the network to cope with the size and location variations, while MS-ADC focuses on capturing deformation information for optimal shape matching. Finally, their effective integration prompts the network to perceive variations in shape and scale simultaneously, which can robustly tackle the variations in patterns of brain tumors. The experimental results on BraTS 2019, BraTS 2020, MSD BTS Task and BraTS2023-MEN show that S2CA-Net has superior overall performance in accuracy and efficiency compared to other state-of-the-art methods. Code: https://github.com/jiangyu945/S2CA-Net.
Learning Local Neighboring Structure for Robust 3D Shape Representation

Zhongpai Gao,Junchi Yan,Guangtao Zhai,Juyong Zhang,Yiyan Yang,Xiaokang Yang

DOI: https://doi.org/10.1609/aaai.v35i2.16229

2021-05-18

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Mesh is a powerful data structure for 3D shapes. Representation learning for 3D meshes is important in many computer vision and graphics applications. The recent success of convolutional neural networks (CNNs) for structured data (e.g., images) suggests the value of adapting insight from CNN for 3D shapes. However, 3D shape data are irregular since each node's neighbors are unordered. Various graph neural networks for 3D shapes have been developed with isotropic filters or predefined local coordinate systems to overcome the node inconsistency on graphs. However, isotropic filters or predefined local coordinate systems limit the representation power. In this paper, we propose a local structure-aware anisotropic convolutional operation (LSA-Conv) that learns adaptive weighting matrices for each node according to the local neighboring structure and performs shared anisotropic filters. In fact, the learnable weighting matrix is similar to the attention matrix in random synthesizer -- a new Transformer model for natural language processing (NLP). Comprehensive experiments demonstrate that our model produces significant improvement in 3D shape reconstruction compared to state-of-the-art methods.
Multi-scale Matching Networks for Semantic Correspondence

Dongyang Zhao,Ziyang Song,Zhenghao Ji,Gangming Zhao,Weifeng Ge,Yizhou Yu

DOI: https://doi.org/10.48550/arXiv.2108.00211

2021-08-27

Abstract:Deep features have been proven powerful in building accurate dense semantic correspondences in various previous works. However, the multi-scale and pyramidal hierarchy of convolutional neural networks has not been well studied to learn discriminative pixel-level features for semantic correspondence. In this paper, we propose a multi-scale matching network that is sensitive to tiny semantic differences between neighboring pixels. We follow the coarse-to-fine matching strategy and build a top-down feature and matching enhancement scheme that is coupled with the multi-scale hierarchy of deep convolutional neural networks. During feature enhancement, intra-scale enhancement fuses same-resolution feature maps from multiple layers together via local self-attention and cross-scale enhancement hallucinates higher-resolution feature maps along the top-down hierarchy. Besides, we learn complementary matching details at different scales thus the overall matching score is refined by features of different semantic levels gradually. Our multi-scale matching network can be trained end-to-end easily with few additional learnable parameters. Experimental results demonstrate that the proposed method achieves state-of-the-art performance on three popular benchmarks with high computational efficiency.

Computer Vision and Pattern Recognition
Dual octree graph networks for learning adaptive volumetric shape representations

Peng-Shuai Wang,Yang Liu,Xin Tong

DOI: https://doi.org/10.1145/3528223.3530087

IF: 6.2

2022-07-22

ACM Transactions on Graphics

Abstract:We present an adaptive deep representation of volumetric fields of 3D shapes and an efficient approach to learn this deep representation for high-quality 3D shape reconstruction and auto-encoding. Our method encodes the volumetric field of a 3D shape with an adaptive feature volume organized by an octree and applies a compact multilayer perceptron network for mapping the features to the field value at each 3D position. An encoder-decoder network is designed to learn the adaptive feature volume based on the graph convolutions over the dual graph of octree nodes. The core of our network is a new graph convolution operator defined over a regular grid of features fused from irregular neighboring octree nodes at different levels, which not only reduces the computational and memory cost of the convolutions over irregular neighboring octree nodes, but also improves the performance of feature learning. Our method effectively encodes shape details, enables fast 3D shape reconstruction, and exhibits good generality for modeling 3D shapes out of training categories. We evaluate our method on a set of reconstruction tasks of 3D shapes and scenes and validate its superiority over other existing approaches. Our code, data, and trained models are available at https://wang-ps.github.io/dualocnn.

computer science, software engineering
Learning View-Based Graph Convolutional Network for Multi-View 3D Shape Analysis

Xin Wei,Ruixuan Yu,Jian Sun

DOI: https://doi.org/10.1109/TPAMI.2022.3221785

Abstract:View-based approach that recognizes 3D shape through its projected 2D images has achieved state-of-the-art results for 3D shape recognition. The major challenges are how to aggregate multi-view features and deal with 3D shapes in arbitrary poses. We propose two versions of a novel view-based Graph Convolutional Network, dubbed view-GCN and view-GCN++, to recognize 3D shape based on graph representation of multiple views. We first construct view-graph with multiple views as graph nodes, then design two graph convolutional networks over the view-graph to hierarchically learn discriminative shape descriptor considering relations of multiple views. Specifically, view-GCN is a hierarchical network based on two pivotal operations, i.e., feature transform based on local positional and non-local graph convolution, and graph coarsening based on a selective view-sampling operation. To deal with rotation sensitivity, we further propose view-GCN++ with local attentional graph convolution operation and rotation robust view-sampling operation for graph coarsening. By these designs, view-GCN++ achieves invariance to transformations under the finite subgroup of rotation group SO(3). Extensive experiments on benchmark datasets (i.e., ModelNet40, ScanObjectNN, RGBD and ShapeNet Core55) show that view-GCN and view-GCN++ achieve state-of-the-art results for 3D shape classification and retrieval tasks under aligned and rotated settings.
Learning Point Cloud Shapes with Geometric and Topological Structures.

Yijie Zhu,Zhetong Dong,Chi Zhou,Hongwei Lin

DOI: https://doi.org/10.4310/cis.2022.v22.n1.a5

2022-01-01

Communications in Information and Systems

Abstract:3D point cloud semantic analysis is challenging due to irregular locations and ill-posed sparse representations. In this study, we explore the intrinsic structures of point clouds, which assist convolutional neural networks in classification and segmentation tasks. The network is referred to as a geometric and topological structures based convolutional neural network (GTS-CNN). Firstly, the method extracts meaningful geometric adjacency for each surface point as well as the topological persistence information for the whole point cloud. Then the GTS-CNN processes this information with a multi-head mechanism. There are three branches within the network executing graph neighborhood message passing, point position-related inference, and persistence image feature embedding, respectively. In this way, an expressive descriptor is obtained with a combination of three kinds of features, leading to a robust and finely grained representation. Experiments on standard benchmarks, such as ModelNet40 and ShapeNet, show that our network achieves promising performance compared to state-of-the-art methods.
Robust Mesh Representation Learning Via Efficient Local Structure-Aware Anisotropic Convolution

Zhongpai Gao,Junchi Yan,Guangtao Zhai,Juyong Zhang,Xiaokang Yang

DOI: https://doi.org/10.1109/tnnls.2022.3151609

IF: 14.255

2023-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Mesh is a type of data structure commonly used for 3-D shapes. Representation learning for 3-D meshes is essential in many computer vision and graphics applications. The recent success of convolutional neural networks (CNNs) for structured data (e.g., images) suggests the value of adapting insights from CNN for 3-D shapes. However, 3-D shape data are irregular since each node’s neighbors are unordered. Various graph neural networks for 3-D shapes have been developed with isotropic filters or predefined local coordinate systems to overcome the node inconsistency on graphs. However, isotropic filters or predefined local coordinate systems limit the representation power. In this article, we propose a local structure-aware anisotropic convolutional operation (LSA-Conv) that learns adaptive weighting matrices for each template’s node according to its neighboring structure and performs shared anisotropic filters. In fact, the learnable weighting matrix is similar to the attention matrix in the random synthesizer—a new Transformer model for natural language processing (NLP). Since the learnable weighting matrices require large amounts of parameters for high-resolution 3-D shapes, we introduce a matrix factorization technique to notably reduce the parameter size, denoted as LSA-small. Furthermore, a residual connection with a linear transformation is introduced to improve the performance of our LSA-Conv. Comprehensive experiments demonstrate that our model produces significant improvement in 3-D shape reconstruction compared to state-of-the-art methods.
Shape Sparse Correspondence for Nearly-Isometric Meshes Based on Green's Function Representation

Wang Jinrong,Feng Jieqing,Miao Yongwei

DOI: https://doi.org/10.3969/j.issn.1003-9775.2013.05.016

2013-01-01

Abstract:Based on global point signature and Green's function representation, a coarse-to-fine sparse correspondence algorithm for nearly-isometric meshes is proposed in this paper. To address the problem of undetermined signs of the corresponding basis vectors, the anchor points are extracted from the source mesh and the nearly-isometric destination mesh respectively based on the Morse theory and a modified hierarchically clustering approach. Their correspondences are then established by minimizing their GPS distances, which can be solved via a combinational searching strategy. Second, to solve the inconsistent problem of high dimensional GPS coordinates caused by different resolutions of meshes, a new Green's function presentation of point is proposed based on the anchor point pairs obtained. As a result, the sparse correspondence of nearly-isometric meshes is established incrementally. Experimental results demonstrate the proposed algorithm exhibits better computational efficiency and correspondence accuracy than other shape correspondence algorithms. It can be potentially applied to rigid or non-rigid mesh alignment, 3D morphing, shape matching, etc.
Deep Learning 3D Shapes Using Alt-az Anisotropic 2-Sphere Convolution

Min Liu,Fupin Yao,Chiho Choi,Ayan Sinha,Karthik Ramani

2018-01-01

Abstract:The ground-breaking performance obtained by deep convolutional neural networks (CNNs) for image processing tasks is inspiring research efforts attempt-ing to extend it for 3D geometric tasks. One of the main challenge in applying CNNs to 3D shape analysis is how to deﬁne a natural convolution operator on non-euclidean surfaces. In this paper, we present a method for applying deep learning to 3D surfaces using their spherical descriptors and alt-az anisotropic convolution on 2-sphere. A cascade set of geodesic disk ﬁlters rotate on the 2-sphere and collect spherical patterns and so to extract geometric features for various 3D shape analysis tasks. We demonstrate theoretically and experimentally that our proposed method has the possibility to bridge the gap between 2D images and 3D shapes with the desired rotation equivariance/invariance, and its effectiveness is evaluated in applications of non-rigid/ rigid shape classiﬁcation and shape retrieval
Dense correspondence of deformable volumetric images via deep spectral embedding and descriptor learning

Diya Sun,Yuru Pei,Yungeng Zhang,Tianmin Xu,Tianbing Wang,Hongbin Zha

DOI: https://doi.org/10.1016/j.media.2022.102604

IF: 10.9

2022-01-01

Medical Image Analysis

Abstract:Deformable image correspondence plays an essential role in a variety of medical image analysis tasks. Most existing deep learning-based registration and correspondence techniques exploit metric space alignments in the spatial domain and learn a nonlinear voxel-wise mapping function between volumetric images and displacement fields, agnostic to intrinsic structure correspondence. When confronted with high-frequency perturbations of patients’ poses and anatomical structural variations, they relied on prior rigid and affine transformations, as well as additional segmentation masks and landmark annotations for reliable registration. This paper presents a data-driven spectral mapping-based correspondence framework to handle the intrinsic correspondence of anatomical structures. At the core of our approach lies a deep convolutional framework that approximates spectral bases and optimizes volumetric descriptors. The multi-path graph convolutional network-based spectral embedding approximation module relieves the computationally expensive eigendecomposition-based embedding of volumetric images. The deep descriptor learning module surpasses the prior hand-crafted descriptors and the descriptor selection. We showcase the efficacy of the core modules, i.e., the spectral embedding approximation and descriptor learning, for volumetric image correspondence and the atlas-based registration on two volumetric image datasets. The proposed method achieves comparable correspondence accuracy with the state-of-the-art deep registration models, resilient to pose and shape perturbations.
Deep Volumetric Descriptor Learning for Dense Correspondence of Cone-Beam Computed Tomography Via Spectral Maps

Diya Sun,Yungeng Zhang,Yuru Pei,Peixin Li,Kaichen Nie,Tianmin Xu,Tianbing Wang,Hongbin Zha

DOI: https://doi.org/10.1109/tmi.2022.3158065

IF: 10.6

2022-01-01

IEEE Transactions on Medical Imaging

Abstract:The deep neural network has achieved great success in 3D volumetric correspondence. These methods infer the dense displacement or velocity fields directly from the extracted volumetric features without addressing the intrinsic structure correspondence, being prone to shape and pose variations. On the other hand, the spectral maps address the intrinsic structure matching in the low dimensional embedding space, remain less involved in volumetric image correspondence. This paper presents an unsupervised deep volumetric descriptor learning neural network via the low dimensional spectral maps to address the dense volumetric correspondence. The neural network is optimized by a novel criterion on descriptor alignments in the spectral domain regarding the supervoxel graph. Aside from the deep convolved multi-scale features, we explicitly address the supervoxel-wise spatial and cross-channel dependencies to enrich deep descriptors. The dense volumetric correspondence is formulated as the low-dimensional spectral mapping. The proposed approach has been applied to both synthetic and clinically obtained cone-beam computed tomography images to establish dense supervoxel-wise and up-scaled voxel-wise correspondences. Extensive series of experimental results demonstrate the contribution of the proposed approach in volumetric descriptor extraction and consistent correspondence, facilitating attribute transfer for segmentation and landmark location. The proposed approach performs favorably against the state-of-the-art volumetric descriptors and the deep registration models, being resilient to pose or shape variations and independent of the prior transformations.
Multi-Scale Representation Learning on Hypergraph for 3D Shape Retrieval and Recognition

Junjie Bai,Biao Gong,Yining Zhao,Fuqiang Lei,Chenggang Yan,Yue Gao

DOI: https://doi.org/10.1109/tip.2021.3082765

IF: 10.6

2021-01-01

IEEE Transactions on Image Processing

Abstract:Effective 3D shape retrieval and recognition are challenging but important tasks in computer vision research field, which have attracted much attention in recent decades. Although recent progress has shown significant improvement of deep learning methods on 3D shape retrieval and recognition performance, it is still under investigated of how to jointly learn an optimal representation of 3D shapes considering their relationships. To tackle this issue, we propose a multi-scale representation learning method on hypergraph for 3D shape retrieval and recognition, called multi-scale hypergraph neural network (MHGNN). In this method, the correlation among 3D shapes is formulated in a hypergraph and a hypergraph convolution process is conducted to learn the representations. Here, multiple representations can be obtained through different convolution layers, leading to multi-scale representations of 3D shapes. A fusion module is then introduced to combine these representations for 3D shape retrieval and recognition. The main advantages of our method lie in 1) the high-order correlation among 3D shapes can be investigated in the framework and 2) the joint multi-scale representation can be more robust for comparison. Comparisons with state-of-the-art methods on the public ModelNet40 dataset demonstrate remarkable performance improvement of our proposed method on the 3D shape retrieval task. Meanwhile, experiments on recognition tasks also show better results of our proposed method, which indicate the superiority of our method on learning better representation for retrieval and recognition.
Learning Deep Features for Shape Correspondence with Domain Invariance

Praful Agrawal,Ross T. Whitaker,Shireen Y. Elhabian

DOI: https://doi.org/10.48550/arXiv.2102.10493

2021-02-21

Abstract:Correspondence-based shape models are key to various medical imaging applications that rely on a statistical analysis of anatomies. Such shape models are expected to represent consistent anatomical features across the population for population-specific shape statistics. Early approaches for correspondence placement rely on nearest neighbor search for simpler anatomies. Coordinate transformations for shape correspondence hold promise to address the increasing anatomical complexities. Nonetheless, due to the inherent shape-level geometric complexity and population-level shape variation, the coordinate-wise correspondence often does not translate to the anatomical correspondence. An alternative, group-wise approach for correspondence placement explicitly models the trade-off between geometric description and the population's statistical compactness. However, these models achieve limited success in resolving nonlinear shape correspondence. Recent works have addressed this limitation by adopting an application-specific notion of correspondence through lifting positional data to a higher dimensional feature space. However, they heavily rely on manual expertise to create domain-specific features and consistent landmarks. This paper proposes an automated feature learning approach, using deep convolutional neural networks to extract correspondence-friendly features from shape ensembles. Further, an unsupervised domain adaptation scheme is introduced to augment the pretrained geometric features with new anatomies. Results on anatomical datasets of human scapula, femur, and pelvis bones demonstrate that features learned in supervised fashion show improved performance for correspondence estimation compared to the manual features. Further, unsupervised learning is demonstrated to learn complex anatomy features using the supervised domain adaptation from features learned on simpler anatomy.

Computer Vision and Pattern Recognition,Machine Learning
Deep Graph Matching Based Dense Correspondence Learning Between Non-Rigid Point Clouds.

Jiazheng Luo,Mingzhi Yuan,Kexue Fu,Manning Wang,Chenxi Zhang

DOI: https://doi.org/10.1109/lra.2022.3160237

2022-01-01

Abstract:Building point-to-point dense correspondence between non-rigid shapes is a fundamental and challenging problem. Although functional map-based methods which calculate basis and convert point-wise map to functional map have shown promising performance on meshes, they are not directly applicable to point clouds. Recently, learning-based frameworks were proposed to estimate correspondence directly using extracted features from non-rigid shapes, but they could not handle serious deformation well, especially with highly symmetrical and distorted shapes. In this letter, we propose a deep graph matching based end-to-end learning framework for building dense correspondence between non-rigid point clouds. Unlike functional map-based methods or recent learning-based studies, here we formulate correspondence estimation as a graph matching problem and use deep graph matching to better utilize both local geometry and global structure information. Specifically, we propose a Graph Generator, which takes high-dimensional features as nodes and calculates point-wise Euclidean distance as edges to build graphs. After the graphs’ topological structure information is embedded into nodes by the Graph Embedding Layer, the Affinity Layer and Sinkhorn Layer are used to estimate correspondence matrix between two point clouds finally. Extensive experiments on both synthetic and real scanned datasets show that the proposed method not only achieves better quantitative and qualitative performance, but also has better generalization than existing methods.
Robust Consistent Correspondence Between 3D Non-Rigid Shapes Based on &#x201c;dual Shape-DNA&#x201D;

Huaiyu Wu,Hongbin Zha

DOI: https://doi.org/10.1109/iccv.2011.6126292

2011-01-01

Abstract:In this paper, we propose a novel framework to construct dense and high-quality consistent correspondence between non-rigid surfaces. Our correspondence framework exploits “Dual Shape-DNA” (dual Laplace-Beltrami spectral embedding) to capture global characteristics of objects, and converts two originally different and complex shapes into two similar and simple shapes to facilitate the correspondence. Since our method avoids the computation of geodesic distances, it is robust to local topology changes. By exploiting the excellent properties of the dual domain, our dual spectral framework can robustly construct Laplace-Beltrami embeddings on highly non-regular 3D meshes. After performing initial non-rigid matching in the dual Laplace-Beltrami spectral domain, we return 3D spatial domain and apply a shape-preserving non-rigid deformation to produce the final dense consistent correspondence. We show that our framework is suitable for non-rigid consistent correspondence, and the high-quality correspondence results are achieved.
Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable Objects

Baowen Zhang,Jiahe Li,Xiaoming Deng,Yinda Zhang,Cuixia Ma,Hongan Wang

2023-12-25

Abstract:Learning 3D shape representation with dense correspondence for deformable objects is a fundamental problem in computer vision. Existing approaches often need additional annotations of specific semantic domain, e.g., skeleton poses for human bodies or animals, which require extra annotation effort and suffer from error accumulation, and they are limited to specific domain. In this paper, we propose a novel self-supervised approach to learn neural implicit shape representation for deformable objects, which can represent shapes with a template shape and dense correspondence in 3D. Our method does not require the priors of skeleton and skinning weight, and only requires a collection of shapes represented in signed distance fields. To handle the large deformation, we constrain the learned template shape in the same latent space with the training shapes, design a new formulation of local rigid constraint that enforces rigid transformation in local region and addresses local reflection issue, and present a new hierarchical rigid constraint to reduce the ambiguity due to the joint learning of template shape and correspondences. Extensive experiments show that our model can represent shapes with large deformations. We also show that our shape representation can support two typical applications, such as texture transfer and shape editing, with competitive performance. The code and models are available at <a class="link-external link-https" href="https://iscas3dv.github.io/deformshape" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition
Structure-aware Shape Correspondence Network for 3D Shape Synthesis.

Xufeng Lang,Zhengxing Sun

DOI: https://doi.org/10.1016/j.cagd.2020.101857

IF: 1.368

2020-01-01

Computer Aided Geometric Design

Abstract:Structure-aware methods can be used to create new 3D shapes by reusing existing parts of given shapes. However, it is still a challenging task to obtain the corresponding parts among different shapes using structure information. We propose a structure-aware shape correspondence network, SASCNet, which can be used to obtain the corresponding parts between a pair of over-segmented shapes and then perform 3D shape synthesis effectively. In this network, the structure features of parts, which are extracted from the structural graph of a shape by the graph attentional layer, can be further used to calculate the part correspondence matrix and obtain the corresponding parts by the correspondence module. According to our part reshuffle experiments on several pairs of shapes, reasonable new shapes are created effectively. Furthermore, the part correspondence performance of our SASCNet is verified by comparing several correspondence results with that of two reported methods. Our approach is found to achieve better performance than theirs in some experiments.
SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation

Li Yi,Hao Su,Xingwen Guo,Leonidas Guibas

DOI: https://doi.org/10.1109/cvpr.2017.697

2017-07-01

Abstract:In this paper, we study the problem of semantic annotation on 3D models that are represented as shape graphs. A functional view is taken to represent localized information on graphs, so that annotations such as part segment or keypoint are nothing but 0–1 indicator vertex functions. Compared with images that are 2D grids, shape graphs are irregular and non-isomorphic data structures. To enable the prediction of vertex functions on them by convolutional neural networks, we resort to spectral CNN method that enables weight sharing by parametrizing kernels in the spectral domain spanned by graph Laplacian eigenbases. Under this setting, our network, named SyncSpecCNN, strives to overcome two key challenges: how to share coefficients and conduct multi-scale analysis in different parts of the graph for a single shape, and how to share information across related but different shapes that may be represented by very different graphs. Towards these goals, we introduce a spectral parametrization of dilated convolutional kernels and a spectral transformer network. Experimentally we tested SyncSpecCNN on various tasks, including 3D shape part segmentation and keypoint prediction. State-of-the-art performance has been achieved on all benchmark datasets.

Safety and handling of MPTP

Anisotropic Multi-Scale Graph Convolutional Network for Dense Shape Correspondence

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Shape-Scale Co-Awareness Network for 3D Brain Tumor Segmentation.

Learning Local Neighboring Structure for Robust 3D Shape Representation

Multi-scale Matching Networks for Semantic Correspondence

Dual octree graph networks for learning adaptive volumetric shape representations

Learning View-Based Graph Convolutional Network for Multi-View 3D Shape Analysis

Learning Point Cloud Shapes with Geometric and Topological Structures.

Robust Mesh Representation Learning Via Efficient Local Structure-Aware Anisotropic Convolution

Shape Sparse Correspondence for Nearly-Isometric Meshes Based on Green's Function Representation

Deep Learning 3D Shapes Using Alt-az Anisotropic 2-Sphere Convolution

Dense correspondence of deformable volumetric images via deep spectral embedding and descriptor learning

Deep Volumetric Descriptor Learning for Dense Correspondence of Cone-Beam Computed Tomography Via Spectral Maps

Multi-Scale Representation Learning on Hypergraph for 3D Shape Retrieval and Recognition

Learning Deep Features for Shape Correspondence with Domain Invariance

Deep Graph Matching Based Dense Correspondence Learning Between Non-Rigid Point Clouds.

Robust Consistent Correspondence Between 3D Non-Rigid Shapes Based on &amp;#x201c;dual Shape-DNA&amp;#x201D;

Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable Objects

Structure-aware Shape Correspondence Network for 3D Shape Synthesis.

SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation

Robust Consistent Correspondence Between 3D Non-Rigid Shapes Based on “dual Shape-DNA”