Initial results of a phase I trial of continuous infusion SR 2508 (etanidazole): a radiation therapy oncology group study.

C.Norman Coleman,R.N. Lisa Noll,Anthony E. Howes,Jay R. Harris,Jehane Zakar,Robert A. Kramer

DOI: https://doi.org/10.1016/0360-3016(89)90922-X

1989-04-01

Abstract:

What problem does this paper attempt to address?

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

Hanxue Liang,Hehe Fan,Zhiwen Fan,Yi Wang,Tianlong Chen,Yu Cheng,Zhangyang Wang

DOI: https://doi.org/10.1007/978-3-031-20062-5_10

2022-01-01

Abstract:The superiority of deep learning based point cloud representations relies on large-scale labeled datasets, while the annotation of point clouds is notoriously expensive. One of the most effective solutions is to transfer the knowledge from existing labeled source data to unlabeled target data. However, domain bias typically hinders knowledge transfer and leads to accuracy degradation. In this paper, we propose a Masked Local Structure Prediction (MLSP) method to encode target data. Along with the supervised learning on the source domain, our method enables models to embed source and target data in a shared feature space. Specifically, we predict masked local structure via estimating point cardinality, position and normal. Our design philosophies lie in: 1) Point cardinality reflects basic structures (e.g., line, edge and plane) that are invariant to specific domains. 2) Predicting point positions in masked areas generalizes learned representations so that they are robust to incompletion-caused domain bias. 3) Point normal is generated by neighbors and thus robust to noise across domains. We conduct experiments on shape classification and semantic segmentation with different transfer permutations and the results demonstrate the effectiveness of our method. Code is available at https://github.com/VITA-Group/MLSP.
PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

Chen Hui,Chen Wanlou,Zuo Yipeng,Xu Peng,Hao Zhonghua

DOI: https://doi.org/10.1007/s12555-020-0571-x

IF: 2.964

2022-01-01

International Journal of Control Automation and Systems

Abstract:In the field of point cloud scene segmentation with deep learning, the ability of the network to extract spatial structure information limits the performance of semantic segmentation. This work proposes a novel framework named PointMS, which handles the semantic segmentation of point cloud scene, to solve the problem of missing local feature information due to the lack of spatial structure information on the training stage. The structure of framework utilizes spatial structure information of point cloud and balances the extraction of global feature and subtle feature when processing point cloud data. Firstly, a multi-scale combination module (SIFT-MS) is used to extract local features of different scales for enhancing the perception of local structure information at each point. Secondly, the process of feature transmission often leads to the loss of information, so a feature supplement module (FSM) is proposed to complete the information lost after feature transformation through the effective combination of global feature and subtle feature. This module integrates the features of different locations to supplement the information lost in feature conversion. The experimental results demonstrate that the proposed framework is efficient for semantic segmentation of S3DIS dataset. SIFT-MS module and FSM module can effectively improve the performance of the semantic segmentation model of point cloud.
3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Chen Hui,Xu Peng,Zuo Yipeng,Wang Weina

DOI: https://doi.org/10.1109/icemi46757.2019.9101756

2019-01-01

Abstract:3D laser point cloud can express complex large-scale 3D scenes. And yet, it is difficult to obtain the local structural model of each spatial point as the input feature to semantic segmentation. To address this issue, this work proposes a new 3D semantic segmentation method based on PointNet and PointSIFT model for large-scale indoor point cloud. First, several different sensing radius modules are built by PointSIFT model to extract the local features for 3D laser point cloud and form a multi-dimensional input features through the full connected layer. Then, the connection features of the PointNet network are full connected again, and the classification score of each point is obtained. Finally, the proposed deep neural network model is validated by the indoor dataset S3DIS. Experiments show that the overall and average accuracy of the proposed method for 3D laser point cloud classification are increased by 1.22% and 3.06%, verifying the accuracy of 3D semantic segmentation in complex indoor scenes.
Point Cloud Deep Learning Network Based on Local Domain Multi-Level Feature

Xianquan Han,Xijiang Chen,Hui Deng,Peng Wan,Jianzhou Li

DOI: https://doi.org/10.3390/app131910804

2023-09-28

Applied Sciences

Abstract:Point cloud deep learning networks have been widely applied in point cloud classification, part segmentation and semantic segmentation. However, current point cloud deep learning networks are insufficient in the local feature extraction of the point cloud, which affects the accuracy of point cloud classification and segmentation. To address this issue, this paper proposes a local domain multi-level feature fusion point cloud deep learning network. First, dynamic graph convolutional operation is utilized to obtain the local neighborhood feature of the point cloud. Then, relation-shape convolution is used to extract a deeper-level edge feature of the point cloud, and max pooling is adopted to aggregate the edge features. Finally, point cloud classification and segmentation are realized based on global features and local features. We use the ModelNet40 and ShapeNet datasets to conduct the comparison experiment, which is a large-scale 3D CAD model dataset and a richly annotated, large-scale dataset of 3D shapes. For ModelNet40, the overall accuracy (OA) of the proposed method is similar to DGCNN, RS-CNN, PointConv and GAPNet, all exceeding 92%. Compared to PointNet, PointNet++, SO-Net and MSHANet, the OA of the proposed method is improved by 5%, 2%, 3% and 2.6%, respectively. For the ShapeNet dataset, the mean Intersection over Union (mIoU) of the part segmentation achieved by the proposed method is 86.3%, which is 2.9%, 1.4%, 1.7%, 1.7%, 1.2%, 0.1% and 1.0% higher than PointNet, RS-Net, SCN, SPLATNet, DGCNN, RS-CNN and LRC-NET, respectively.

materials science, multidisciplinary,engineering,chemistry,physics, applied
Sharpness fields in point clouds using deep learning

Prashant Raina,Sudhir Mudur,Tiberiu Popa

DOI: https://doi.org/10.1016/j.cag.2018.11.003

2019-02-01

Abstract:Sharp features in 3D objects are often lost when the shapes are digitally acquired using a 3D scanning device. The resulting noisy point clouds do not usually contain points lying on sharp features, making it difficult to reconstruct these features or to reverse-engineer the original CAD model of the object. We presented a method in [1] to calculate a scalar field, defined on the underlying Moving Least-Squares surface of the point cloud, whose local maxima correspond to sharp edges. As this sharpness field is defined over a continuous domain, it allows us to determine the locations of sharp features on the object even at points not originally sampled from the scanned surface. The computation of the sharpness field is made possible by training deep neural networks to compute the value of the field for any given local neighborhood of a surface. We also presented in [1] a feature-aware smoothing algorithm which uses the computed sharpness field to smooth noisy point clouds while preserving sharp edges and yielding points that lie exactly on these edges. In addition, we described two approaches to segmentation of a point cloud using the sharpness field. In this paper, we extend our previous work in [1] with different neural network architectures and local neighborhood representations that improve sharpness field computation, resulting in significantly improved feature-aware smoothing. We also numerically evaluate the accuracy of different deep learning models for sharpness field computation.
MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

Yuhao Wang,Yong Zuo,Zhihua Du,Xiaohan Song,Tian Luo,Xiaobin Hong,Jian Wu

DOI: https://doi.org/10.3390/s23146327

2023-07-12

Abstract:Three-dimensional LiDAR systems that capture point cloud data enable the simultaneous acquisition of spatial geometry and multi-wavelength intensity information, thereby paving the way for three-dimensional point cloud recognition and processing. However, due to the irregular distribution, low resolution of point clouds, and limited spatial recognition accuracy in complex environments, inherent errors occur in classifying and segmenting the acquired target information. Conversely, two-dimensional visible light images provide real-color information, enabling the distinction of object contours and fine details, thus yielding clear, high-resolution images when desired. The integration of two-dimensional information with point clouds offers complementary advantages. In this paper, we present the incorporation of two-dimensional information to form a multi-modal representation. From this, we extract local features to establish three-dimensional geometric relationships and two-dimensional color relationships. We introduce a novel network model, termed MInet (Multi-Information net), which effectively captures features relating to both two-dimensional color and three-dimensional pose information. This enhanced network model improves feature saliency, thereby facilitating superior segmentation and recognition tasks. We evaluate our MInet architecture using the ShapeNet and ThreeDMatch datasets for point cloud segmentation, and the Stanford dataset for object recognition. The robust results, coupled with quantitative and qualitative experiments, demonstrate the superior performance of our proposed method in point cloud segmentation and object recognition tasks.
SDANet: spatial deep attention-based for point cloud classification and segmentation

Jiangjiang Gao,Jinhui Lan,Bingxu Wang,Feifan Li

DOI: https://doi.org/10.1007/s10994-022-06148-1

IF: 5.414

2022-03-30

Machine Learning

Abstract:Using deep learning to learn point cloud features directly have become one of the research hotspots in the field of 3D point cloud processing. The existing methods usually construct local regions, extract features from local regions, and then aggregate global features through multi-layer perceptron and maximum pooling layer. However, most of these processes do not consider the contribution of point cloud local features to the final decision and the spatial relationship between neighbor points, which limits the accuracy of 3D point cloud classification and segmentation. In this article, a novel network model called spatial depth attention network is designed to improve the accuracy of point cloud classification and segmentation, which embeds local depth attention mechanism into MLP layer to learn local neighborhood geometric representation. The local deep attention of the point cloud is obtained through the SDA module, and then combined with feature learning and local deep attention to effectively capture the local geometric structure. In order to achieve the best feature extraction ability, local depth attention features are combined with global features. Experiments show that SDANet achieves the same or better performance as the most advanced methods on several challenging benchmark datasets and tasks.

computer science, artificial intelligence
Deep Neural Network for Point Sets Based on Local Feature Integration

Hao Chu,Zhenquan He,Shangdong Liu,Chuanwen Liu,Jiyuan Yang,Fei Wang

DOI: https://doi.org/10.3390/s22093209

IF: 3.9

2022-04-22

Sensors

Abstract:The research of object classification and part segmentation is a hot topic in computer vision, robotics, and virtual reality. With the emergence of depth cameras, point clouds have become easier to collect and increasingly important because of their simple and unified structures. Recently, a considerable number of studies have been carried out about deep learning on 3D point clouds. However, data captured directly by sensors from the real-world often encounters severe incomplete sampling problems. The classical network is able to learn deep point set features efficiently, but it is not robust enough when the method suffers from the lack of point clouds. In this work, a novel and general network was proposed, whose effect does not depend on a large amount of point cloud input data. The mutual learning of neighboring points and the fusion between high and low feature layers can better promote the integration of local features so that the network can be more robust. The specific experiments were conducted on the ScanNet and Modelnet40 datasets with 84.5% and 92.8% accuracy, respectively, which proved that our model is comparable or even better than most existing methods for classification and segmentation tasks, and has good local feature integration ability. Particularly, it can still maintain 87.4% accuracy when the number of input points is further reduced to 128. The model proposed has bridged the gap between classical networks and point cloud processing.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
MSL3D: 3D object detection from monocular, stereo and point cloud for autonomous driving

Wenyu Chen,Peixuan Li,Huaici Zhao

DOI: https://doi.org/10.1016/j.neucom.2022.04.075

IF: 6

2022-07-01

Neurocomputing

Abstract:In this paper, we propose a novel deep architecture by combining multiple sensors for 3D object detection, named MSL3D. While recently LiDAR-Camera methods introduce additional semantic cues, working with fewer false detections, there is still a performance gap compared LiDAR-only methods. We argue that this gap is caused for two reasons: 1) the 3D spherical receptive fields of the set abstraction of the point clouds are not aligned with the 2D pixel-level receptive fields of the image. 2) the premature introduction of image information makes it is difficult to apply data augmentation both LiDAR and image synchronously. For the first problem, we extend 3D set abstraction to a 2D set abstraction that can transform the 2D image features to the 3D sphere to unify the receptive field of multi-modal data. For the second problem, we design a novel two-stage 3D detection framework that employs the LiDAR-only backbone in the first stage to estimate high-recall and high-quality proposals and then integrates the image and point clouds information for box refinement and confidence prediction. Besides, we add two auxiliary networks to effectively learn image features and point cloud features when using different multi-modal data augmentation strategies synchronously. Moreover, we design a consistency-structure generator using stereo images to determine whether any of a point in the 3D space belongs to the contour of the object, thereby supplementing the sparse point cloud information. Extensive experiments on the popular KITTI 3D objects detection dataset show that our proposed MSL3D achieves better performance comparing with other LiDAR-Only or LiDAR-Camera fusion approaches.

computer science, artificial intelligence
Deep Shape Representation with Sharp Feature Preservation

Yi-Fei Feng,Li-Yong Shen,Chun-Ming Yuan,Xin Li

DOI: https://doi.org/10.1016/j.cad.2022.103468

2023-01-08

Abstract:Highlights • We present a novel implicit neural representation for CAD preserving sharp features. • We propose a lightweight sharp feature detection network for point clouds. • We introduce the newly improved NURBS to generate Brep models with sharp features. We present a novel implicit neural representation to reconstruct CAD models from point clouds with high quality. Our method first extracts edge points from input points by an edge detection network and then recovers implicit surfaces while preserving the sharp features of ground-truth models. The edge detection network uses a U-Net structure for feature encoding, and the attention module is introduced to improve the accuracy in the CAD models. This detection network is light weighted and runs fast. Afterward, we propose an MLP-based network to train an implicit representation from input points with its extracted edge points. A two-stage training process is proposed, and loss functions are designed for each stage to ensure that the sharp features of the input points are learned while the surface details are fitted. Comparing our method with other SOTA methods in the ABC dataset, our method is significantly superior to the existing nonlearning and learning 3D reconstruction methods in terms of surface approximation quality and sharp feature preservation. Moreover, we can gain spline representations from learned shapes for CAM as the application of our method. Graphical abstract Download : Download high-res image (142KB) Download : Download full-size image

computer science, software engineering
Multilevel intuitive attention neural network for airborne LiDAR point cloud semantic segmentation

Ziyang Wang,Hui Chen,Jing Liu,Jiarui Qin,Yehua Sheng,Lin Yang

DOI: https://doi.org/10.1016/j.jag.2024.104020

IF: 7.5

2024-07-18

International Journal of Applied Earth Observation and Geoinformation

Abstract:Three-dimensional laser scanning technology is widely employed in various fields due to its advantage in rapid acquisition of geographic scene structures. Achieving high precision and automated semantic segmentation of three-dimensional point cloud data remains a vital challenge in point cloud recognition. This study introduces a Multilevel Intuitive Attention Network (MIA-Net) designed for point cloud segmentation. MIA-Net consists of three key components: local trigonometric function encoding, feature sampling, and intuitive attention interaction. Initially, trigonometric encoding captures fine-grained local semantics within disordered point clouds. Subsequently, a multilayer perceptron addresses point-cloud feature pyramid construction, and feature sampling is performed using the point offset mechanism in the different levels. Finally, the multilevel intuitive attention(MIA) mechanism facilitates feature interactions across different layers, enabling the capture of both local attention features and global structure. The point-offset attention scheme introduced in this study significantly reduces computational complexity compared to traditional attention mechanisms, enhancing computational efficiency while preserving the advantages of attention mechanisms. To evaluate the results of MIA-Net, the ISPRS Vaihingen benchmark, LASDU and GML airborne datasets were tested. Experiments show that our network can achieve state-of-art performance in terms of Overall Accuracy(OA) and average F1-score(e.g., reaching 96.2% and 66.7% for GML datasets, respectively).

remote sensing
Point Attention Network for Semantic Segmentation of 3D Point Clouds

Mingtao Feng,Liang Zhang,Xuefei Lin,Syed Zulqarnain Gilani,Ajmal Mian

DOI: https://doi.org/10.48550/arXiv.1909.12663

2019-09-27

Abstract:Convolutional Neural Networks (CNNs) have performed extremely well on data represented by regularly arranged grids such as images. However, directly leveraging the classic convolution kernels or parameter sharing mechanisms on sparse 3D point clouds is inefficient due to their irregular and unordered nature. We propose a point attention network that learns rich local shape features and their contextual correlations for 3D point cloud semantic segmentation. Since the geometric distribution of the neighboring points is invariant to the point ordering, we propose a Local Attention-Edge Convolution (LAE Conv) to construct a local graph based on the neighborhood points searched in multi-directions. We assign attention coefficients to each edge and then aggregate the point features as a weighted sum of its neighbors. The learned LAE-Conv layer features are then given to a point-wise spatial attention module to generate an interdependency matrix of all points regardless of their distances, which captures long-range spatial contextual features contributing to more precise semantic information. The proposed point attention network consists of an encoder and decoder which, together with the LAE-Conv layers and the point-wise spatial attention modules, make it an end-to-end trainable network for predicting dense labels for 3D point cloud segmentation. Experiments on challenging benchmarks of 3D point clouds show that our algorithm can perform at par or better than the existing state of the art methods.

Computer Vision and Pattern Recognition
PCPNET: Learning Local Shape Properties from Raw Point Clouds

Paul Guerrero,Yanir Kleiman,Maks Ovsjanikov,Niloy J. Mitra

DOI: https://doi.org/10.1111/cgf.13343

2018-06-19

Abstract:In this paper, we propose PCPNet, a deep-learning based approach for estimating local 3D shape properties in point clouds. In contrast to the majority of prior techniques that concentrate on global or mid-level attributes, e.g., for shape classification or semantic labeling, we suggest a patch-based learning method, in which a series of local patches at multiple scales around each point is encoded in a structured manner. Our approach is especially well-adapted for estimating local shape properties such as normals (both unoriented and oriented) and curvature from raw point clouds in the presence of strong noise and multi-scale features. Our main contributions include both a novel multi-scale variant of the recently proposed PointNet architecture with emphasis on local shape information, and a series of novel applications in which we demonstrate how learning from training data arising from well-structured triangle meshes, and applying the trained model to noisy point clouds can produce superior results compared to specialized state-of-the-art techniques. Finally, we demonstrate the utility of our approach in the context of shape reconstruction, by showing how it can be used to extract normal orientation information from point clouds.

Computational Geometry
PointDMS: An Improved Deep Learning Neural Network via Multi-Feature Aggregation for Large-Scale Point Cloud Segmentation in Smart Applications of Urban Forestry Management

Jiang Li,Jinhao Liu

DOI: https://doi.org/10.3390/f14112169

IF: 3.282

2023-10-31

Forests

Abstract:Background: The development of laser measurement techniques is of great significance in forestry monitoring and park management in smart cities. It provides many conveniences for improving landscape planning efficiency and strengthening digital construction. However, capturing 3D point clouds in large-scale landscape environments is a complex task that generates massive amounts of unstructured data with characteristics such as randomness, rotational invariance, sparsity, and serious barriers. Methods: To improve the processing efficiency of intelligent devices for massive point clouds, we propose a novel deep learning neural network based on a multi-feature aggregation strategy. This network is designed to divide 3D laser point clouds in complex large-scale scenarios. Firstly, we utilize multiple terrestrial laser sensors to collect a large amount of data in open scenes such as parks, streets, and forests in urban environments. These data are integrated into a practical database called DMSdataset, which contains different information variables, densities, and dimensions. Then, an automatic block integrated with a multi-feature extractor is constructed to pre-process the unstructured point cloud data and standardize the datasets. Finally, a novel semantic segmentation framework called PointDMS is designed using 3D convolutional deep networks. PointDMS achieves a better segmentation performance of point clouds with a lightweight parameter structure. Here, “D” stands for deep network, “M” stands for multi-feature, and “S” stands for segmentation. Results: Extensive experiments on self-built datasets show that the proposed PointDMS achieves similar or better performance in point cloud segmentation compared to other methods. The overall identification accuracy of the proposed model is up to 93.5%, which is a 14% increase. Particularly for living wood objects, the average identification accuracy is up to 88.7%, which is, at least, an 8.2% increase. These results effectively prove that PointDMS is beneficial for 3D point cloud processing, division, and mining applications in urban forest environments. It demonstrates good robustness and generalization.

forestry
S3Net: 3D LiDAR Sparse Semantic Segmentation Network

Ran Cheng,Ryan Razani,Yuan Ren,Liu Bingbing

DOI: https://doi.org/10.1109/icra48506.2021.9561305

2021-05-30

Abstract:Semantic Segmentation is a crucial component in the perception systems of many applications, such as robotics and autonomous driving that rely on accurate environmental perception and understanding. In literature, several approaches are introduced to attempt LiDAR semantic segmentation task, such as projection-based (range-view or birds-eye-view), and voxel-based approaches. However, they either abandon the valuable 3D topology and geometric relations and suffer from information loss introduced in the projection process or are inefficient. Therefore, there is a need for accurate models capable of processing the 3D driving-scene point cloud in 3D space. In this paper, we propose S3Net, a novel convolutional neural network for LiDAR point cloud semantic segmentation. It adopts an encoder-decoder backbone that consists of Sparse Intra-channel Attention Module (SIntraAM), and Sparse Inter-channel Attention Module (SInterAM) to emphasize the fine details of both within each feature map and among nearby feature maps. To extract the global contexts in deeper layers, we introduce Sparse Residual Tower based upon sparse convolution that suits varying sparsity of LiDAR point cloud. In addition, geo-aware anisotrophic loss is leveraged to emphasize the semantic boundaries and penalize the noise within each predicted regions, leading to a robust prediction. Our experimental results show that the proposed method leads to a large improvement (12%) compared to its baseline counterpart (MinkNet42 [1]) on SemanticKITTI [2] test set and achieves state-of-the-art mIoU accuracy of semantic segmentation approaches.
MNEW: Multi-domain Neighborhood Embedding and Weighting for Sparse Point Clouds Segmentation

Yang Zheng,Izzat H. Izzat,Sanling Song

DOI: https://doi.org/10.48550/arXiv.2004.03401

2020-04-05

Computer Vision and Pattern Recognition

Abstract:Point clouds have been widely adopted in 3D semantic scene understanding. However, point clouds for typical tasks such as 3D shape segmentation or indoor scenario parsing are much denser than outdoor LiDAR sweeps for the application of autonomous driving perception. Due to the spatial property disparity, many successful methods designed for dense point clouds behave depreciated effectiveness on the sparse data. In this paper, we focus on the semantic segmentation task of sparse outdoor point clouds. We propose a new method called MNEW, including multi-domain neighborhood embedding, and attention weighting based on their geometry distance, feature similarity, and neighborhood sparsity. The network architecture inherits PointNet which directly process point clouds to capture pointwise details and global semantics, and is improved by involving multi-scale local neighborhoods in static geometry domain and dynamic feature space. The distance/similarity attention and sparsity-adapted weighting mechanism of MNEW enable its capability for a wide range of data sparsity distribution. With experiments conducted on virtual and real KITTI semantic datasets, MNEW achieves the top performance for sparse point clouds, which is important to the application of LiDAR-based automated driving perception.
MSPR-Net: A Multi-Scale Features Based Point Cloud Registration Network

Jinjin Yu,Fenghao Zhang,Zhi Chen,Liman Liu

DOI: https://doi.org/10.3390/rs14194874

IF: 5

2022-09-30

Remote Sensing

Abstract:Point-cloud registration is a fundamental task in computer vision. However, most point clouds are partially overlapping, corrupted by noise and comprised of indistinguishable surfaces, especially for complexly distributed outdoor LiDAR point clouds, which makes registration challenging. In this paper, we propose a multi-scale features-based point cloud registration network named MSPR-Net for large-scale outdoor LiDAR point cloud registration. The main motivation of the proposed MSPR-Net is that the features of two keypoints from a true correspondence must match in different scales. From this point of view, we first utilize a multi-scale backbone to extract the multi-scale features of the keypoints. Next, we propose a bilateral outlier removal strategy to remove the potential outliers in the keypoints based on the multi-scale features. Finally, a coarse-to-fine registration way is applied to exploit the information both in feature and spatial space. Extensive experiments conducted on two large-scale outdoor LiDAR point cloud datasets demonstrate that MSPR-Net achieves state-of-the-art performance.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Local-Area-Learning Network: Meaningful Local Areas for Efficient Point Cloud Analysis

Qendrim Bytyqi,Nicola Wolpert,Elmar Schömer

DOI: https://doi.org/10.48550/arXiv.2006.07226

2020-06-12

Abstract:Research in point cloud analysis with deep neural networks has made rapid progress in recent years. The pioneering work PointNet offered a direct analysis of point clouds. However, due to its architecture PointNet is not able to capture local structures. To overcome this drawback, the same authors have developed PointNet++ by applying PointNet to local areas. The local areas are defined by center points and their neighbors. In PointNet++ and its further developments the center points are determined with a Farthest Point Sampling (FPS) algorithm. This has the disadvantage that the center points in general do not have meaningful local areas. In this paper, we introduce the neural Local-Area-Learning Network (LocAL-Net) which places emphasis on the selection and characterization of the local areas. Our approach learns critical points that we use as center points. In order to strengthen the recognition of local structures, the points are given additional metric properties depending on the local areas. Finally, we derive and combine two global feature vectors, one from the whole point cloud and one from all local areas. Experiments on the datasets ModelNet10/40 and ShapeNet show that LocAL-Net is competitive for part segmentation. For classification LocAL-Net outperforms the state-of-the-arts.

Computer Vision and Pattern Recognition,Machine Learning,Image and Video Processing
Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysis

Qijian Zhang,Junhui Hou,Yue Qian,Yiming Zeng,Juyong Zhang,Ying He

DOI: https://doi.org/10.1109/tpami.2023.3244828

IF: 23.6

2023-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Point clouds are characterized by irregularity and unstructuredness, which pose challenges in efficient data exploitation and discriminative feature extraction. In this paper, we present an unsupervised deep neural architecture called Flattening-Net to represent irregular 3D point clouds of arbitrary geometry and topology as a completely regular 2D point geometry image (PGI) structure, in which coordinates of spatial points are captured in colors of image pixels. Intuitively, Flattening-Net implicitly approximates a locally smooth 3D-to-2D surface flattening process while effectively preserving neighborhood consistency. As a generic representation modality, PGI inherently encodes the intrinsic property of the underlying manifold structure and facilitates surface-style point feature aggregation. To demonstrate its potential, we construct a unified learning framework directly operating on PGIs to achieve diverse types of high-level and low-level downstream applications driven by specific task networks, including classification, segmentation, reconstruction, and upsampling. Extensive experiments demonstrate that our methods perform favorably against the current state-of-the-art competitors. The source code and data are publicly available at https://github.com/keeganhk/Flattening-Net.

computer science, artificial intelligence,engineering, electrical & electronic
CS-Net: Deep Multibranch Network Considering Scene Features for Sharpness Assessment of Remote Sensing Images

Liangyu Chen,Jun Pan,Jin Yang,Mi Wang

DOI: https://doi.org/10.1109/tgrs.2024.3377629

IF: 8.2

2024-04-03

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Recently, many new results of sharpness assessment for digital images have been achieved, which help to select valuable images from massive images with ragged quality. However, remote sensing images encompass a wide range of scenes with diverse characteristics, and their acquisition is often influenced by blurs and noises. Many commonly used sharpness assessment methods based on uniform metrics face challenges in ensuring both subjective and objective impartiality when applied to remote sensing images. Therefore, a novel method for assessing the sharpness of remote sensing images based on a deep multibranch network considering scene features is proposed. In the method, a multitask module (MTM), comprising scene classification and sharpness assessment tasks, is proposed to comprehensively consider the potential impact of diverse scene characteristics on the assessment of sharpness. The accuracy of sharpness assessment is improved by sharing features that reflect the correlation between the scene and sharpness. To overcome the issue of imbalanced task predictions during the joint training of multiple tasks, a total loss function using gradient balance strategy is designed. In addition, the improved attention module (IAM) and the feature fusion module (FFM) are used to better utilize feature information at different scales. Experimental results obtained from datasets demonstrated that the proposed method can outperform the existing comparable methods and achieve satisfactory results, proving its feasibility and effectiveness.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics

Initial results of a phase I trial of continuous infusion SR 2508 (etanidazole): a radiation therapy oncology group study.

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Point Cloud Deep Learning Network Based on Local Domain Multi-Level Feature

Sharpness fields in point clouds using deep learning

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

SDANet: spatial deep attention-based for point cloud classification and segmentation

Deep Neural Network for Point Sets Based on Local Feature Integration

MSL3D: 3D object detection from monocular, stereo and point cloud for autonomous driving

Deep Shape Representation with Sharp Feature Preservation

Multilevel intuitive attention neural network for airborne LiDAR point cloud semantic segmentation

Point Attention Network for Semantic Segmentation of 3D Point Clouds

PCPNET: Learning Local Shape Properties from Raw Point Clouds

PointDMS: An Improved Deep Learning Neural Network via Multi-Feature Aggregation for Large-Scale Point Cloud Segmentation in Smart Applications of Urban Forestry Management

S3Net: 3D LiDAR Sparse Semantic Segmentation Network

MNEW: Multi-domain Neighborhood Embedding and Weighting for Sparse Point Clouds Segmentation

MSPR-Net: A Multi-Scale Features Based Point Cloud Registration Network

Local-Area-Learning Network: Meaningful Local Areas for Efficient Point Cloud Analysis

Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysis

CS-Net: Deep Multibranch Network Considering Scene Features for Sharpness Assessment of Remote Sensing Images