Malignant lymphoma of the pancreas.

T. Tanaka,Y. Matsugu,K. Koide,Y. Miura,Y. Ichiba,K. Dohi,H. Ito

DOI: https://doi.org/10.1007/BF02093835

1996-02-01

Digestive Diseases and Sciences

Abstract:

What problem does this paper attempt to address?

SOAMC: A Semi-Supervised Open-Set Recognition Algorithm for Automatic Modulation Classification

Chengliang Di,Jinwei Ji,Chao Sun,Linlin Liang

DOI: https://doi.org/10.3390/electronics13214196

IF: 2.9

2024-10-26

Electronics

Abstract:Traditional automatic modulation classification methods operate under the closed-set assumption, which proves to be impractical in real-world scenarios due to the diverse nature of wireless technologies and the dynamic characteristics of wireless propagation environments. Open-set environments introduce substantial technical challenges, particularly in terms of detection effectiveness and computational complexity. To address the limitations of modulation classification and recognition in open-set scenarios, this paper proposes a semi-supervised open-set recognition approach, termed SOAMC (Semi-Supervised Open-Set Automatic Modulation Classification). The primary objective of SOAMC is to accurately classify unknown modulation types, even when only a limited subset of samples is manually labeled. The proposed method consists of three key stages: (1) A signal recognition pre-training model is constructed using data augmentation and adaptive techniques to enhance robustness. (2) Feature extraction and embedding are performed via a specialized extraction network. (3) Label propagation is executed using a graph convolutional neural network (GCN) to efficiently annotate the unlabeled signal samples. Experimental results demonstrate that SOAMC significantly improves classification accuracy, particularly in challenging scenarios with limited amounts of labeled data and high signal similarity. These findings are critical for the practical identification of complex and diverse modulation signals in real-world wireless communication systems.

engineering, electrical & electronic,computer science, information systems,physics, applied
Multi-view Discriminant Framework for Automatic Modulation Open Set Recognition

Jiaye Hou,Dongwei Xu,Fuxing Song,Zhuangzhi Chen,Qi Xuan,Shilian Zheng,Yun Lin,Xiaoniu Yang

DOI: https://doi.org/10.1109/tcomm.2024.3506934

IF: 6.166

2024-01-01

IEEE Transactions on Communications

Abstract:Automatic Modulation Open Set Recognition (AMOSR) has practical significance in detecting unknown classes. However, a challenge arises when unknown samples closely resemble known samples, posing a formidable task for accurate detection. A novel AMOSR framework based on multi-view discriminators’ joint judgment is proposed to handle this challenge. Firstly, utilizing signal domain knowledge, multi-dimensional features are extrected through varied signal time-frequency transforms and encoders, baesd on which multiple discriminators are created. Secondly, Constrained Clustering Prototype Loss and Geodesic Contrastive Loss are introduced to pretrain these discriminators, providing more space for unknown signals. Then, collaborative learning is employed to further fine-tune the aforementioned discriminators, enhancing information sharing between modalities. Furthermore, a set of indicators is constructed, and multi-criteria fusion is performed using the TOPSIS algorithm to evaluate the discrimination capabilities of different classifiers in both closed-set and open-set scenarios. Furthermore, a decision tree is constructed to segregate test signals into known and unknown classes, in which discriminators with higher confidence levels are given precedence. Finally, TOPSIS hierarchical ensemble pruning algorithm that considers diversity and open-set recognition capabilities is adopted to reduce model complexity while maintaining original performance. Extensive experiments conducted on modulation datasets demonstrate the superiority of this framework over state-of-the-art AMOSR results.
Open Set Domain Adaptation for Automatic Modulation Classification in Dynamic Communication Environments

Maomao Zhang,Peng Tang,Guofeng Wei,Xue Ni,Guoru Ding,Huali Wang

DOI: https://doi.org/10.1109/tccn.2024.3375507

IF: 6.359

2024-01-01

IEEE Transactions on Cognitive Communications and Networking

Abstract:Automatic modulation classification (AMC) is gaining greater significance in both military and civilian contexts. However, the diversity and dynamics of actual wireless communication environments can cause shifts in signal data distribution, posing risks of encountering unfamiliar modulations and negatively impacting recognition performance. To tackle these challenges, we propose the Open set domain adaptation for AMC (OSDA-AMC) algorithm. The approach utilizes a partial iterative separation technique, consisting of a pre-processing unit, a deep feature extractor, and meticulously crafted unknown, known, and domain classifiers. OSDA-AMC innovatively introduces an unknown class to the source classifier, facilitating the differentiation between known and unknown class features. Through multiple binary classifiers, the algorithm estimates the similarity between target data and each source class, differentiating unknown and known class data. Iteratively, it separates unknown signals from the target domain and labels them as unknown class. Simultaneously, the known class domain adaptation unit utilizes classifiers and domain discriminator for adversarial domain adaptation within the known class, ensuring similar feature distribution across the two domains. The proposed OSDA-AMC method can enhance the adaptability of AMC for recognizing unknown signals in dynamic channels in real-world environments. The experimental results demonstrate that the algorithm performs better in dynamic communication environments. By utilizing unknown class sample information effectively, we improve the accuracy of recognition and overall robustness.

telecommunications
Class Information Guided Reconstruction for Automatic Modulation Open-Set Recognition

Ziwei Zhang,Mengtao Zhu,Jiabin Liu,Yunjie Li,Shafei Wang

2024-04-14

Abstract:Automatic Modulation Recognition (AMR) is a crucial technology in the domains of radar and communications. Traditional AMR approaches assume a closed-set scenario, where unknown samples are forcibly misclassified into known classes, leading to serious consequences for situation awareness and threat assessment. To address this issue, Automatic Modulation Open-set Recognition (AMOSR) defines two tasks as Known Class Classification (KCC) and Unknown Class Identification (UCI). However, AMOSR faces core challenges in terms of inappropriate decision boundaries and sparse feature distributions. To overcome the aforementioned challenges, we propose a Class Information guided Reconstruction (CIR) framework, which leverages reconstruction losses to distinguish known and unknown classes. To enhance distinguishability, we design Class Conditional Vectors (CCVs) to match the latent representations extracted from input samples, achieving perfect reconstruction for known samples while yielding poor results for unknown ones. We also propose a Mutual Information (MI) loss function to ensure reliable matching, with upper and lower bounds of MI derived for tractable optimization and mathematical proofs provided. The mutually beneficial CCVs and MI facilitate the CIR attaining optimal UCI performance without compromising KCC accuracy, especially in scenarios with a higher proportion of unknown classes. Additionally, a denoising module is introduced before reconstruction, enabling the CIR to achieve a significant performance improvement at low SNRs. Experimental results on simulated and measured signals validate the effectiveness and the robustness of the proposed method.

Signal Processing
Achieving Efficient Feature Representation for Modulation Signal: A Cooperative Contrast Learning Approach

Jing Bai,Xu Wang,Zhu Xiao,Huaji Zhou,Talal Ahmed Ali Ali,You Li,Licheng Jiao

DOI: https://doi.org/10.1109/jiot.2024.3350927

IF: 10.6

2024-01-01

IEEE Internet of Things Journal

Abstract:Seamless Internet of Things (IoT) connections expose many vulnerabilities in wireless networks, and IoT devices inevitably face many malicious active attacks. Automatic modulation recognition (AMR) is an effective way to combat IoT physical layer threats. In the field of non-collaborative communication, feature representation learning for unlabeled signals is an important task of AMR. However, due to the unavailability of a priori knowledge and the influence of interference during signal transmission, the intercepted unlabeled signals are difficult to perform efficient feature representation. In this paper, we propose cooperative contrast learning for unlabeled modulation signal (CoCL-Sig). Specifically, the CoCL-Sig is trained using both sequence and constellation diagram modalities, and is divided into two parts: modal-level feature representation and instance-level auxiliary feature representation. In modal-level feature representation, two modal projections are matched in the same hyperplane space. To ensure the stability of the feature representation, a sequence auxiliary branch is added to form an instance-level feature representation of the sequence. In addition, the feature representations obtained by the CoCL-Sig can be applied to modulation signals for semi-supervised classification and clustering tasks. We have conducted extensive experiments on two widely-used modulation signal datasets, RML2016.10A and RML2016.04C. The results demonstrate the effectiveness of our method in modulation signal feature representation and its superiority compared to other methods.

computer science, information systems,telecommunications,engineering, electrical & electronic
The Importance of Expert Knowledge for Automatic Modulation Open Set Recognition

Taotao Li,Zhenyu Wen,Yang Long,Zhen Hong,Shilian Zheng,Li Yu,Bo Chen,Xiaoniu Yang,Ling Shao

DOI: https://doi.org/10.1109/tpami.2023.3294505

IF: 23.6

2023-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Automatic modulation classification (AMC) is an important technology for the monitoring, management, and control of communication systems. In recent years, machine learning approaches are becoming popular to improve the effectiveness of AMC for radio signals. However, the automatic modulation open-set recognition (AMOSR) scheme that aims to identify the known modulation types and recognize the unknown modulation signals is not well studied. Therefore, in this paper, we propose a novel multi-modal marginal prototype framework for radio frequency (RF) signals (MMPRF) to improve AMOSR performance. First, MMPRF addresses the problem of simultaneous recognition of closed and open sets by partitioning the feature space in the way of one vs. other and marginal restrictions. Secondly, we exploit the wireless signal domain knowledge to extract a series of signal-related features to enhance the AMOSR capability. In addition, we propose a GAN-based unknown sample generation strategy to allow the model to understand the unknown world. Finally, we conduct extensive experiments on several publicly available radio modulation data, and experimental results show that our proposed MMPRF outperforms the state-of-the-art AMOSR methods.

computer science, artificial intelligence,engineering, electrical & electronic
FSOS-AMC: Few-Shot Open-Set Learning for Automatic Modulation Classification

Hao Zhang,Fuhui Zhou,Qihui Wu,Chau Yuen

2024-10-14

Abstract:Automatic modulation classification (AMC) is essential for the advancement and efficiency of future wireless communication networks. Deep learning (DL)-based AMC frameworks have garnered extensive attention for their impressive classification performance. However, existing DL-based AMC frameworks rely on two assumptions, large-scale training data and the same class pool between the training and testing data, which are not suitable for \emph{few-shot and open-set} scenarios. To address this issue, a novel few-shot open-set automatic modulation classification (FSOS-AMC) framework is proposed by exploiting a multi-scale attention network, meta-prototype training, and a modular open-set classifier. The multi-scale attention network is used to extract the features from the input signal, the meta-prototype training is adopted to train the feature extractor and the modular open-set classifier can be utilized to classify the testing data into one of the known modulations or potential unknown modulations. Extensive simulation results demonstrate that the proposed FSOS-AMC framework can achieve higher classification accuracy than the state-of-the-art methods for known modulations and unknown modulations in terms of accuracy and area under the receiver operating characteristic curve (AUROC). Moreover, the performance of the proposed FSOS-AMC framework under low signal-to-noise ratio (SNR) conditions is much better than the compared schemes.

Signal Processing
Discover Novel Unknown Signal Classes in Open Scenarios With Multi-Representation Discriminant Network

Xinyu Li,Lutao Liu,Muran Guo

DOI: https://doi.org/10.1109/lcomm.2024.3356619

IF: 3.5529

2024-03-13

IEEE Communications Letters

Abstract:This letter aims to achieve the automatic classification and annotation of novel unknown signal classes in open scenarios, enabling the continuous discovery and accumulation of novel modulation information across various tasks. It proposes a multi-representation transformation swapped prediction mechanism to learn invariant signal features and utilize fusion information, promoting consistent training and improving the clustering performance. Furthermore, a discriminative classification loss is introduced, enhancing the ability to discover previously unseen classes. We perform a five-fold cross-validation on two datasets. Experimental results demonstrate that our approach outperforms other comparative approaches in several aspects.

telecommunications
Meta Supervised Contrastive Learning for Few-Shot Open-Set Modulation Classification with Signal Constellation

Jikui Zhao,Huaxia Wang,Shengliang Peng,Yu-Dong Yao

DOI: https://doi.org/10.1109/lcomm.2024.3363630

IF: 3.5529

2024-01-01

IEEE Communications Letters

Abstract:In this work, we introduce a method for few-shot open-set modulation classification utilizing signal constellation diagrams, based on a Meta Supervised Contrastive Learning (MSCL) algorithm. MSCL combines the strengths of supervised contrastive learning and meta-learning to effectively amplify inter-class distinctions and reinforce intra-class compactness. The experimental results demonstrate that MSCL exhibits superior performance in both few-shot and open-set Automatic Modulation Classification (AMC) recognition. Code available at: https://github.com/jikuizhao/MSCL.

telecommunications
OpenCIL: Benchmarking Out-of-Distribution Detection in Class-Incremental Learning

Wenjun Miao,Guansong Pang,Trong-Tung Nguyen,Ruohang Fang,Jin Zheng,Xiao Bai

2024-07-09

Abstract:Class incremental learning (CIL) aims to learn a model that can not only incrementally accommodate new classes, but also maintain the learned knowledge of old classes. Out-of-distribution (OOD) detection in CIL is to retain this incremental learning ability, while being able to reject unknown samples that are drawn from different distributions of the learned classes. This capability is crucial to the safety of deploying CIL models in open worlds. However, despite remarkable advancements in the respective CIL and OOD detection, there lacks a systematic and large-scale benchmark to assess the capability of advanced CIL models in detecting OOD samples. To fill this gap, in this study we design a comprehensive empirical study to establish such a benchmark, named $\textbf{OpenCIL}$. To this end, we propose two principled frameworks for enabling four representative CIL models with 15 diverse OOD detection methods, resulting in 60 baseline models for OOD detection in CIL. The empirical evaluation is performed on two popular CIL datasets with six commonly-used OOD datasets. One key observation we find through our comprehensive evaluation is that the CIL models can be severely biased towards the OOD samples and newly added classes when they are exposed to open environments. Motivated by this, we further propose a new baseline for OOD detection in CIL, namely Bi-directional Energy Regularization ($\textbf{BER}$), which is specially designed to mitigate these two biases in different CIL models by having energy regularization on both old and new classes. Its superior performance is justified in our experiments. All codes and datasets are open-source at <a class="link-external link-https" href="https://github.com/mala-lab/OpenCIL" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Leveraging Incremental Learning for Dynamic Modulation Recognition

Song Ma,Lin Zhang,Zhangli Song,Wei Yu,Tian Liu

DOI: https://doi.org/10.3390/electronics13193948

IF: 2.9

2024-10-07

Electronics

Abstract:Modulation recognition is an important technology used to correctly identify the modulation modes of wireless signals and is widely used in cooperative and confrontational scenarios. Traditional modulation-recognition algorithms require the assistance of expert experiences, which constrains their applications. With the rapid development of artificial intelligence in recent years, deep learning (DL) is widely advocated for intelligent modulation recognition. Typically, DL-based modulation-recognition algorithms implicitly assume a relatively static scenario in which the signal samples of all the modulation modes can be completely collected in advance. In practical situations, the radio environment is quite dynamic and the signal samples with new modulation modes may appear sequentially, in which the current DL-based modulation-recognition algorithms may require unacceptable time and computing resource consumption to re-train the optimal model from scratch. In this study, we leveraged incremental learning (IL) and designed a novel IL-based modulation-recognition algorithm that consists of an initial stage and multiple incremental stages. The main novelty of the proposed algorithm lies in the new loss function design in each incremental stage, which combines the distillation loss of recognizing old modulation modes and the cross-entropy loss of recognizing new modulation modes. With the proposed algorithm, the knowledge of the signal samples with new modulation modes can be efficiently learned in the current stage without forgetting the knowledge learned in the previous stages. The simulation results demonstrate that the proposed algorithm could achieve a recognition accuracy close to the upper bound with a much lower computing time and it outperformed the existing IL-based benchmarks.

engineering, electrical & electronic,computer science, information systems,physics, applied
Electromagnetic Signal Classification Based on Class Exemplar Selection and Multi-Objective Linear Programming

Huaji Zhou,Jing Bai,Linchun Niu,Jie Xu,Zhu Xiao,Shilian Zheng,Licheng Jiao,Xiaoniu Yang

DOI: https://doi.org/10.3390/rs14051177

IF: 5

2022-02-27

Remote Sensing

Abstract:In the increasingly complex electromagnetic environment, a variety of new signal types are appearing; however, existing electromagnetic signal classification (ESC) models cannot handle new signal types. In this context, the emergence of class-incremental learning aims to incrementally update the classification model as new categories emerge. In this paper, an electromagnetic signal classification framework based on class exemplar selection and a multi-objective linear programming classifier (CES-MOLPC) is proposed in order to continuously learn new classes in an incremental manner. Specifically, our approach involves the adaptive selection of class exemplars considering normalized mutual information and a multi-objective linear programming classifier. The former is used to maintain the classification capability of the model for previous categories by selecting key samples, while the latter is used to allow the model to adapt quickly to new categories. Meanwhile, a weighted loss function based on cross-entropy and distillation loss is presented in order to fine-tune the model. We demonstrate the effectiveness of the proposed CES-MOLPC method through extensive experiments on the public RML2016.04c data set and the large-scale real-world ACARS signal data set. The results of the comparative experiments demonstrate that our method can achieve significant improvements over state-of-the-art methods.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Simple Image-level Classification Improves Open-vocabulary Object Detection

Ruohuan Fang,Guansong Pang,Xiao Bai

2023-12-19

Abstract:Open-Vocabulary Object Detection (OVOD) aims to detect novel objects beyond a given set of base categories on which the detection model is trained. Recent OVOD methods focus on adapting the image-level pre-trained vision-language models (VLMs), such as CLIP, to a region-level object detection task via, eg., region-level knowledge distillation, regional prompt learning, or region-text pre-training, to expand the detection vocabulary. These methods have demonstrated remarkable performance in recognizing regional visual concepts, but they are weak in exploiting the VLMs' powerful global scene understanding ability learned from the billion-scale image-level text descriptions. This limits their capability in detecting hard objects of small, blurred, or occluded appearance from novel/base categories, whose detection heavily relies on contextual information. To address this, we propose a novel approach, namely Simple Image-level Classification for Context-Aware Detection Scoring (SIC-CADS), to leverage the superior global knowledge yielded from CLIP for complementing the current OVOD models from a global perspective. The core of SIC-CADS is a multi-modal multi-label recognition (MLR) module that learns the object co-occurrence-based contextual information from CLIP to recognize all possible object categories in the scene. These image-level MLR scores can then be utilized to refine the instance-level detection scores of the current OVOD models in detecting those hard objects. This is verified by extensive empirical results on two popular benchmarks, OV-LVIS and OV-COCO, which show that SIC-CADS achieves significant and consistent improvement when combined with different types of OVOD models. Further, SIC-CADS also improves the cross-dataset generalization ability on Objects365 and OpenImages. The code is available at <a class="link-external link-https" href="https://github.com/mala-lab/SIC-CADS" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
OpenCon: Open-world Contrastive Learning

Yiyou Sun,Yixuan Li

DOI: https://doi.org/10.48550/arXiv.2208.02764

IF: 5.414

2022-08-04

Machine Learning

Abstract:Machine learning models deployed in the wild naturally encounter unlabeled samples from both known and novel classes. Challenges arise in learning from both the labeled and unlabeled data, in an open-world semi-supervised manner. In this paper, we introduce a new learning framework, open-world contrastive learning (OpenCon). OpenCon tackles the challenges of learning compact representations for both known and novel classes and facilitates novelty discovery along the way. We demonstrate the effectiveness of OpenCon on challenging benchmark datasets and establish competitive performance. On the ImageNet dataset, OpenCon significantly outperforms the current best method by 11.9% and 7.4% on novel and overall classification accuracy, respectively. Theoretically, OpenCon can be rigorously interpreted from an EM algorithm perspective--minimizing our contrastive loss partially maximizes the likelihood by clustering similar samples in the embedding space. The code is available at https://github.com/deeplearning-wisc/opencon.
Effective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundary

Xiaokang Liu,Jianquan Li,Jingjing Mu,Min Yang,Ruifeng Xu,Benyou Wang

2023-04-20

Abstract:Open intent classification, which aims to correctly classify the known intents into their corresponding classes while identifying the new unknown (open) intents, is an essential but challenging task in dialogue systems. In this paper, we introduce novel K-center contrastive learning and adjustable decision boundary learning (CLAB) to improve the effectiveness of open intent classification. First, we pre-train a feature encoder on the labeled training instances, which transfers knowledge from known intents to unknown intents. Specifically, we devise a K-center contrastive learning algorithm to learn discriminative and balanced intent features, improving the generalization of the model for recognizing open intents. Second, we devise an adjustable decision boundary learning method with expanding and shrinking (ADBES) to determine the suitable decision conditions. Concretely, we learn a decision boundary for each known intent class, which consists of a decision center and the radius of the decision boundary. We then expand the radius of the decision boundary to accommodate more in-class instances if the out-of-class instances are far from the decision boundary; otherwise, we shrink the radius of the decision boundary. Extensive experiments on three benchmark datasets clearly demonstrate the effectiveness of our method for open intent classification. For reproducibility, we submit the code at: <a class="link-external link-https" href="https://github.com/lxk00/CLAP" rel="external noopener nofollow">this https URL</a>

Computation and Language
Multi-Task Based Deep Learning Approach for Open-Set Wireless Signal Identification in ISM Band

Jialiang Gong,Xiaowei Qin,Xiaodong Xu

DOI: https://doi.org/10.1109/tccn.2021.3118456

IF: 6.359

2022-03-01

IEEE Transactions on Cognitive Communications and Networking

Abstract:Wireless signal identification plays an important role in effectively implementing spectrum monitoring and management. However, in ISM (Industrial, Science and Medical) band, it becomes a challenging task due to the heterogeneity of variously emerging wireless techniques, and part of the potential unknown spectral occupants may even hinder the feasibility of wireless signal identification. To overcome such difficulties, we focus on open-set recognition (OSR) in this paper and present a multi-task learning architecture based on deep neural network for identifying known and unknown spectral occupants. A novel structured extension of the counterfactual GAN (CountGAN) architecture is proposed and we introduce a multi-tasking architecture to take advantage of the modulation-domain information from the captured signal, thus improving the representation of individual wireless signals and further enhancing model robustness and adaptability to open-set scenarios. In particular, Circle-loss in metric learning and extreme value theory are also applied to make tighter and clearer decision boundaries for signal identification, and further enhance the optimization of the decision boundaries between known and unknown classes. Numerical results indicate that the proposed framework consistently outperforms state-of-the-art OSR algorithms and several baselines for wireless signal identification task, both in terms of convergence performance and classification accuracy.

telecommunications
SIGxCL: A Signal-Image-Graph Cross-Modal Contrastive Learning Framework for CVD Diagnosis Based on Internet of Medical Things

Huaicheng Zhang,Wenhan Liu,Zhoutong Li,Jiguang Shi,Sheng Chang,Hao Wang,Jin He,Qijun Huang

DOI: https://doi.org/10.1109/jiot.2023.3336915

IF: 10.6

2023-01-01

IEEE Internet of Things Journal

Abstract:Recently, contrastive learning (CL) has garnered wide interest because it enables unsupervised pre-training to alleviate conventional deep learning methods’ strong reliance on artificial labels. While CL-based methods have been applied to cardiovascular disease (CVD) diagnosis with non-invasive Electrocardiogram (ECG), most of these methods are limited within the 1-dimensional signal modality and primarily focus on temporal features like amplitude and time sequence. The morphological features derived from clinically significant image-like ECGs are ignored. Furthermore, the relationships among different leads are neglected as well, describing the activities and interaction of various heart regions that are essential in CVD diagnosis and lesion localization. To address these limitations, this work proposes a novel cross-modal contrastive learning framework named SIGxCL, which represents and jointly analyzes ECGs in signal, image, and graph modalities. Crucial for CL, modality-specific transformations are introduced for ECGs in the three modalities. SIGxCL enables signal-image-graph correspondence by maximizing the agreement of the accordant cross-modal ECGs in the invariant space. Consequently, SIGxCL could capture and leverage temporal, morphological, and spatially physiological features simultaneously. Compared to random initial and conventional supervised methods, SIGxCL achieves remarkable enhancements. Considering the best performances of the existing CL-based methods, SIGxCL outperforms them by up to 4.72%, 9.41%, and 4.31% across three datasets. SIGxCL is designed to be compatible with Internet of Medical Things (IoMT) and can be deployed on resource-limited portable devices. The deployment includes pre-training, online/offline tuning, and real-time inference modules. In conclusion, SIGxCL demonstrates superior performance and provides a promising approach for real-time IoMT-based diagnosis.

computer science, information systems,telecommunications,engineering, electrical & electronic
I2CANSAY:Inter-Class Analogical Augmentation and Intra-Class Significance Analysis for Non-Exemplar Online Task-Free Continual Learning

Songlin Dong,Yingjie Chen,Yuhang He,Yuhan Jin,Alex C. Kot,Yihong Gong

2024-04-21

Abstract:Online task-free continual learning (OTFCL) is a more challenging variant of continual learning which emphasizes the gradual shift of task boundaries and learns in an online mode. Existing methods rely on a memory buffer composed of old samples to prevent forgetting. However,the use of memory buffers not only raises privacy concerns but also hinders the efficient learning of new samples. To address this problem, we propose a novel framework called I2CANSAY that gets rid of the dependence on memory buffers and efficiently learns the knowledge of new data from one-shot samples. Concretely, our framework comprises two main modules. Firstly, the Inter-Class Analogical Augmentation (ICAN) module generates diverse pseudo-features for old classes based on the inter-class analogy of feature distributions for different new classes, serving as a substitute for the memory buffer. Secondly, the Intra-Class Significance Analysis (ISAY) module analyzes the significance of attributes for each class via its distribution standard deviation, and generates the importance vector as a correction bias for the linear classifier, thereby enhancing the capability of learning from new samples. We run our experiments on four popular image classification datasets: CoRe50, CIFAR-10, CIFAR-100, and CUB-200, our approach outperforms the prior state-of-the-art by a large margin.

Computer Vision and Pattern Recognition,Machine Learning
Dynamic Online Modulation Recognition using Incremental Learning

Ali Owfi,Ali Abbasi,Fatemeh Afghah,Jonathan Ashdown,Kurt Turck

2023-12-08

Abstract:Modulation recognition is a fundamental task in communication systems as the accurate identification of modulation schemes is essential for reliable signal processing, interference mitigation for coexistent communication technologies, and network optimization. Incorporating deep learning (DL) models into modulation recognition has demonstrated promising results in various scenarios. However, conventional DL models often fall short in online dynamic contexts, particularly in class incremental scenarios where new modulation schemes are encountered during online deployment. Retraining these models on all previously seen modulation schemes is not only time-consuming but may also not be feasible due to storage limitations. On the other hand, training solely on new modulation schemes often results in catastrophic forgetting of previously learned classes. This issue renders DL-based modulation recognition models inapplicable in real-world scenarios because the dynamic nature of communication systems necessitate the effective adaptability to new modulation schemes. This paper addresses this challenge by evaluating the performance of multiple Incremental Learning (IL) algorithms in dynamic modulation recognition scenarios, comparing them against conventional DL-based modulation recognition. Our results demonstrate that modulation recognition frameworks based on IL effectively prevent catastrophic forgetting, enabling models to perform robustly in dynamic scenarios.

Signal Processing,Machine Learning
Open-Set Object Detection Using Classification-free Object Proposal and Instance-level Contrastive Learning

Zhongxiang Zhou,Yifei Yang,Yue Wang,Rong Xiong

DOI: https://doi.org/10.1109/LRA.2023.3242169

2023-12-04

Abstract:Detecting both known and unknown objects is a fundamental skill for robot manipulation in unstructured environments. Open-set object detection (OSOD) is a promising direction to handle the problem consisting of two subtasks: objects and background separation, and open-set object classification. In this paper, we present Openset RCNN to address the challenging OSOD. To disambiguate unknown objects and background in the first subtask, we propose to use classification-free region proposal network (CF-RPN) which estimates the objectness score of each region purely using cues from object's location and shape preventing overfitting to the training categories. To identify unknown objects in the second subtask, we propose to represent them using the complementary region of known categories in a latent space which is accomplished by a prototype learning network (PLN). PLN performs instance-level contrastive learning to encode proposals to a latent space and builds a compact region centering with a prototype for each known category. Further, we note that the detection performance of unknown objects can not be unbiasedly evaluated on the situation that commonly used object detection datasets are not fully annotated. Thus, a new benchmark is introduced by reorganizing GraspNet-1billion, a robotic grasp pose detection dataset with complete annotation. Extensive experiments demonstrate the merits of our method. We finally show that our Openset RCNN can endow the robot with an open-set perception ability to support robotic rearrangement tasks in cluttered environments. More details can be found in <a class="link-external link-https" href="https://sites.google.com/view/openset-rcnn/" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Robotics

Malignant lymphoma of the pancreas.

SOAMC: A Semi-Supervised Open-Set Recognition Algorithm for Automatic Modulation Classification

Multi-view Discriminant Framework for Automatic Modulation Open Set Recognition

Open Set Domain Adaptation for Automatic Modulation Classification in Dynamic Communication Environments

Class Information Guided Reconstruction for Automatic Modulation Open-Set Recognition

Achieving Efficient Feature Representation for Modulation Signal: A Cooperative Contrast Learning Approach

The Importance of Expert Knowledge for Automatic Modulation Open Set Recognition

FSOS-AMC: Few-Shot Open-Set Learning for Automatic Modulation Classification

Discover Novel Unknown Signal Classes in Open Scenarios With Multi-Representation Discriminant Network

Meta Supervised Contrastive Learning for Few-Shot Open-Set Modulation Classification with Signal Constellation

OpenCIL: Benchmarking Out-of-Distribution Detection in Class-Incremental Learning

Leveraging Incremental Learning for Dynamic Modulation Recognition

Electromagnetic Signal Classification Based on Class Exemplar Selection and Multi-Objective Linear Programming

Simple Image-level Classification Improves Open-vocabulary Object Detection

OpenCon: Open-world Contrastive Learning

Effective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundary

Multi-Task Based Deep Learning Approach for Open-Set Wireless Signal Identification in ISM Band

SIGxCL: A Signal-Image-Graph Cross-Modal Contrastive Learning Framework for CVD Diagnosis Based on Internet of Medical Things

I2CANSAY:Inter-Class Analogical Augmentation and Intra-Class Significance Analysis for Non-Exemplar Online Task-Free Continual Learning

Dynamic Online Modulation Recognition using Incremental Learning

Open-Set Object Detection Using Classification-free Object Proposal and Instance-level Contrastive Learning