A new integrated SVM classifiers for relevance feedback content-based image retrieval using EM parameter estimation

WangXiang-Yang,ChenJing-Wei,YangHong-Ying

IF: 8.7

2011-01-01

Applied Soft Computing

Abstract:In content-based image retrieval (CBIR), the support vector machine (SVM) based relevance feedback is studied extensively to narrow the gap between low-level image feature and high-level semantic c...

What problem does this paper attempt to address?

Learning A Semantic Space from User'S Relevance Feedback for Image Retrieval

XF He,O King,WY Ma,MJ Li,HJ Zhang

DOI: https://doi.org/10.1109/tcsvt.2002.808087

2002-01-01

Abstract:As current methods for content-based retrieval are incapable of capturing the semantics of images, we experiment with using spectral methods to infer a semantic space from user's relevance feedback, so that our system will gradually improve its retrieval performance through accumulated user interactions. In addition to the long-term learning process, we also model the traditional approaches to query refinement using relevance feedback as a short-term learning process. The proposed short- and long-term learning frameworks have been integrated into an image retrieval system. Experimental results on a large collection of images have shown the effectiveness and robustness of our proposed algorithms.
Support Vector Machine Learning for Image Retrieval

Z Lei,FZ Lin,Z Bo

DOI: https://doi.org/10.1109/icip.2001.958595

2001-01-01

Abstract:A novel method of relevance feedback is presented based on support vector machine learning in the content-based image retrieval system. A SVM classifier can be learned from training data of relevance images and irrelevance images marked by users. Using the classifier, the system can retrieve more images relevant to the query in the database efficiently. Experiments were carried out on a large-size database of 9918 images. It shows that the interactive learning and retrieval process can find correct images increasingly. It also shows the generalization ability of SVM under the condition of limited training samples.
An Image Retrieval System with Color Emotion Query

Jingxuan Wang,Dazhan Zhang,Qiang Wang

DOI: https://doi.org/10.1109/icnc.2015.7378030

2015-01-01

Abstract:The traditional content-based image retrieval technology can't map underlying image features to semantics, leading to a "semantic gap" between the needs of users and the retrieval results. In this paper, we implement a color image retrieval system based on color emotions. By analyzing the distribution of color emotion histograms of the same theme image, we build a similarity calculation model, and then we use regional growth algorithm and fast particle swarm algorithm to accelerate the computation, and improve the accuracy on relevant feedback. Ultimately we achieve an image classification model based on emotional semantics. The test image data is from 10 classes of Corel standard image database. Experiments show that the color emotion-based image retrieval system in this paper can effectively extract the image emotional features, achieve a preferable retrieval results.
Asymmetric Bagging and Random Subspace for Support Vector Machines-Based Relevance Feedback in Image Retrieval

DC Tao,X Tang,XL Li,XD Wu

DOI: https://doi.org/10.1109/tpami.2006.134

IF: 23.6

2006-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Relevance feedback schemes based on support vector machines (SVM) have been widely used in content-based image retrieval (CBIR). However, the performance of SVM-based relevance feedback is often poor when the number of labeled positive feedback samples is small. This is mainly due to three reasons: 1) an SVM classifier is unstable on a small-sized training set, 2) SVM's optimal hyperplane may be biased when the positive feedback samples are much less than the negative feedback samples, and 3) overfitting happens because the number of feature dimensions is much higher than the size of the training set. In this paper, we develop a mechanism to overcome these problems. To address the first two problems, we propose an asymmetric bagging-based SVM (AB-SVM). For the third problem, we combine the random subspace method and SVM for relevance feedback, which is named random subspace SVM (RS-SVM). Finally, by integrating AB-SVM and RS-SVM, an asymmetric bagging and random subspace SVM (ABRS-SVM) is built to solve these three problems and further improve the relevance feedback performance.
A Survey on Relevance Feedback Techniques in Content-based Medical Image Retrieval

Ye SHEN,Shun-Ren XIA,Min-Dan LI

DOI: https://doi.org/10.3969/j.issn.0258-8021.2009.01.023

2009-01-01

Abstract:Efficiently and accurately searching for similar medical images in databases is a challenging task. Relevance feedback (RF) ,a effective approach to bridge "semantic gap" and boost image retrieval, has become a key part of content-based medical image retrieval (CBMIR) . RF algorithms can be categorized into three classes according to the retrieval models adopted in them. They are distance-based model, probabilistic model and machine learning based model. Following this categorization, representative algorithms were analyzed and evaluated in this paper with an emphasis on the machine learning algorithms. At last, some promising research directions about RF in CBMIR were discussed.
A Novel SVM Based Relevance Feedback Algorithm in Image Retrieval

许月华,李金龙,陈恩红,王煦法

DOI: https://doi.org/10.3969/j.issn.1000-3428.2004.24.045

2004-01-01

Abstract:This paper proposes a novel image retrieval method of support vector machine based relevance feedback. The experimental results demonstrate that the proposed approach partially solves the sample insufficiency problem that exists in SVM based relevance feedback algorithm, and show the approach has good performance for retrieval.
Support Vector Machine Based Relevance Feedback Algorithm in Image Retrieval

张磊,林福宗,张钹

DOI: https://doi.org/10.3321/j.issn:1000-0054.2002.01.024

2002-01-01

Abstract:Relevance feedback technique has been an important approach in image retrieval. A novel relevance feedback algorithm is presented based on Support Vector Machine learning in content based image retrieval system. During the retrieval process, users can mark positive sample images similar to the query image. Then the algorithm constructs a SVM classifier, which can be used to find more relevance images in the whole image database. Experiments were carried out on a large size database of 9918 images. It shows that more images relevant to the query can be found efficiently by the interactive learning and retrieval process. It also shows the generalization ability of SVM under the conditions of limited training samples.
Efficient Relevance Feedback Scheme Based on SVM in Image Retrieval

Jianxin Zhou,Ke Gao,Jintao Li,Yongdong Zhang,Sheng Tang

DOI: https://doi.org/10.3321/j.issn:1003-9775.2007.04.023

2007-01-01

Abstract:An approach called constrained random selection for relevance feedback is proposed in this paper. At first, all the images are sorted by similar measure, and then a threshold is selected to restrict the space of random selection. At last, the restricted space is divided into some sub-spaces, and random selection is applied to these sub-spaces to enlarge the training sets and resolve the small sample problem preferably. In addition, we compute the weights of multiple SVM classifiers dynamically and fuse the single results to resolve the users' preference problems in relevance feedback preferably. Experimental results demonstrate the effectiveness of the method.
Learning User'S Perception Using Region-Based Svm for Content-Based Image Retrieval

DC Tao,JZ Liu,XO Tang

2004-01-01

Abstract:Relevance feedback is often a critical component for content-based image retrieval to capture the user's perception. Previous methods for image retrieval with relevance feedback are image-based. In this paper, we propose a novel region-based retrieval method with relevance feedback using the support vector machine (SVM) algorithm. A new region-based image model is given to represent an image, with region-based low-level features defined. A novel distance measure based on SVM is proposed to achieve better image retrieval performance. Experimental results are given to show that our method performs better than the image-based retrieval scheme with relevance feedback using SVM.
Support Vector Machines For Region-Based Image Retrieval

F Jing,Mj Li,Hj Zhang,B Zhang

DOI: https://doi.org/10.1109/ICME.2003.1221543

2003-01-01

Abstract:In this paper, the application of support vector machines (SVM) in relevance feedback for region-based image retrieval is investigated. Both the one class SVM as a class distribution estimator and two classes SVM as a classifier are taken into account. For the latter, two representative display strategies are studied. Since the common kernels often rely on inner product or L, norm in the input space, they are infeasible in the region-based image retrieval systems that. use variable-length representations. To resolve the issue, a new kind of kernel that is a generalization of Gaussian kernel is proposed. Experimental results on a database of 10,000 general-purpose images demonstrate the effectiveness and robustness of the proposed approach.
Relevance Feedback For Keyword And Visual Feature-Based Image Retrieval

F Jing,Mj Li,Hj Zhang,B Zhang

DOI: https://doi.org/10.1007/978-3-540-27814-6_52

2004-01-01

Abstract:In this paper, a relevance feedback scheme for both keyword and visual feature-based image retrieval is proposed. For each keyword, a statistical model is trained offline based on visual features of a small set of manually labeled images and used to propagate the keyword to other unlabeled ones. Besides the offline model, another model is constructed online using the user provided positive and negative images as training set. Support vector machines (SVMs) in the binary setting are adopted as both offline and online models. To effectively combine the two models, a multi-model query refinement algorithm is introduced. Furthermore, an entropy-based active learning strategy is proposed to improve the efficiency of relevance feedback process. Experimental results on a database of 10,000 general-purpose images demonstrate the effectiveness of the proposed relevance feedback scheme.
Content-based Image Retrieval Using Optimal Feature Combination and Relevance Feedback

Lijun Zhao,Jiakui Tang

DOI: https://doi.org/10.1109/iccasm.2010.5620791

2010-01-01

Abstract:With the rapid development of the multimedia technology and Internet, content-based image retrieval (CBIR) has become an active research field at present. Many researches have been done on visual features and their combinations for CBIR, but few on the performance comparison of different visual feature combinations. Therefore, in the paper, different visual feature combinations are firstly compared in retrieval experiments. Moreover, only using low-level features for CBIR cannot achieve a satisfactory measurement performance, since the user's high-level semantics cannot be easily expressed by low-level features. In order to narrow the gap between user query concept and low-level features in CBIR, a multi-round relevance feedback (RF) strategy based on both support vector machine (SVM) and feature similarity is adopted to meet the user's requirement. The experiment results showed that this SVM and feature similarity based relevance feedback using best feature combination can greatly improve the retrieval precision with the number of feedback increasing.
An Image Retrieval Relevance Feedback Algorithm Based on the Bayesian Classifier

苏中,张宏江,马少平

2002-01-01

Journal of Software

Abstract:The biggest problem in content-based image retrieval (CBIR) is a big gap between high-level semantic contents and low-level features. As an effective solution, relevance feedback has been put on many efforts for the past few years. In this paper, a new relevance feedback approach with progressive learning capability is proposed. It is based on a Bayesian classifier and treats positive and negative feedback examples with different strategies. It can utilize previous users?feedback information to improve its retrieval ability. The experimental results show that this algorithm achieves high accuracy and effectiveness on real-world image collections.
Semi-supervised SVM Batch Mode Active Learning for Image Retrieval

Steven C. H. Hoi,Rong Jin,Jianke Zhu,Michael R. Lyu

DOI: https://doi.org/10.1109/cvpr.2008.4587350

2008-01-01

Abstract:Active learning has been shown as a key technique for improving content-based image retrieval (CBIR) performance. Among various methods, support vector machine (SVM) active learning is popular for its application to relevance feedback in CBIR. However, the regular SVM active learning has two main drawbacks when used for relevance feedback. First, SVM often suffers from learning with a small number of labeled examples, which is the case in relevance feedback. Second, SVM active learning usually does not take into account the redundancy among examples, and therefore could select multiple examples in relevance feedback that are similar (or even identical) to each other. In this paper, we propose a novel scheme that exploits both semi-supervised kernel learning and batch mode active learning for relevance feedback in CBIR. In particular, a kernel function is first learned from a mixture of labeled and unlabeled examples. The kernel will then be used to effectively identify the informative and diverse examples for active learning via a min-max framework. An empirical study with relevance feedback of CBIR showed that the proposed scheme is significantly more effective than other state-of-the-art approaches.
Semisupervised SVM Batch Mode Active Learning with Applications to Image Retrieval

Steven C. H. Hoi,Rong Jin,Jianke Zhu,Michael R. Lyu

DOI: https://doi.org/10.1145/1508850.1508854

2009-01-01

Abstract:Support vector machine (SVM) active learning is one popular and successful technique for relevance feedback in content-based image retrieval (CBIR). Despite the success, conventional SVM active learning has two main drawbacks. First, the performance of SVM is usually limited by the number of labeled examples. It often suffers a poor performance for the small-sized labeled examples, which is the case in relevance feedback. Second, conventional approaches do not take into account the redundancy among examples, and could select multiple examples that are similar (or even identical). In this work, we propose a novel scheme for explicitly addressing the drawbacks. It first learns a kernel function from a mixture of labeled and unlabeled data, and therefore alleviates the problem of small-sized training data. The kernel will then be used for a batch mode active learning method to identify the most informative and diverse examples via a min-max framework. Two novel algorithms are proposed to solve the related combinatorial optimization: the first approach approximates the problem into a quadratic program, and the second solves the combinatorial optimization approximately by a greedy algorithm that exploits the merits of submodular functions. Extensive experiments with image retrieval using both natural photo images and medical images show that the proposed algorithms are significantly more effective than the state-of-the-art approaches. A demo is available at http://msm.cais.ntu.edu.sg/LSCBIR/.
Probability fuzzy SVM for image retrieval

Deshan Liu,Deqin Yan,Yonghua Tang,Shenglan Liu

DOI: https://doi.org/10.1109/FSKD.2015.7381929

2015-01-01

Abstract:In the scheme of relevance feedback (RF) of conventional content-based image retrieval (CBIR) systems, only the labeled samples will be trained for learning, which gives rise to the small sample size (sss) problem. To solve the problem, a variety of RF schemes have been developed with exploiting support vector machine (SVM) which concentrates on enhancing classification ability of the schemes. In fact, there is not only classification distribution but also probability distribution in both numeric value data and image data. In fact, probability distribution existing in the images with multi-semantic meaning is more crucial for building a better scheme of RF. For modeling the scheme of RF under the consideration of both classification distribution and probability distribution, a framework of probability fuzzy support vector machine (PFSVM) is developed in this paper. In the framework, every pseudo-label sample is assigned both a fuzzy and a probability membership which are integrated into mechanism of PFSVM for active learning. Experimental results with a database of 1,000 images demonstrate the effectiveness of the proposed method.
Relevance Feedback in Content-Based Image Retrieval: Bayesian Framework, Feature Subspaces, and Progressive Learning

Z Su,HJ Zhang,S Li,SP Ma

DOI: https://doi.org/10.1109/tip.2003.815254

IF: 10.6

2003-01-01

IEEE Transactions on Image Processing

Abstract:Research has been devoted in the past few years to relevance feedback as an effective solution to improve performance of content-based image retrieval (CBIR). In this paper, we propose a new feedback approach with progressive learning capability combined with a novel method for the feature subspace extraction. The proposed approach is based on a Bayesian classifier and treats positive and negative feedback examples with different strategies. Positive examples are used to estimate a Gaussian distribution that represents the desired images for a given query; while the negative examples are used to modify the ranking of the retrieved candidates. In addition, feature subspace is extracted and updated during the feedback process using a principal component analysis (PCA) technique and based on user's feedback. That is, in addition to reducing the dimensionality of feature spaces, a proper subspace for each type of features is obtained in the feedback process to further improve the retrieval accuracy. Experiments demonstrate that the proposed method increases the retrieval speed, reduces the required memory and improves the retrieval accuracy significantly.
Multitraining support vector machine for image retrieval.

Jing Li,Nigel Allinson,Dacheng Tao,Xuelong Li

DOI: https://doi.org/10.1109/TIP.2006.881938

IF: 10.6

2006-01-01

IEEE Transactions on Image Processing

Abstract:Relevance feedback (RF) schemes based on support vector machines (SVMs) have been widely used in content-based image retrieval (CBIR). However, the performance of SVM-based RF approaches is often poor when the number of labeled feedback samples is small. This is mainly due to 1) the SVM classifier being unstable for small-size training sets because its optimal hyper plane is too sensitive to the training examples; and 2) the kernel method being ineffective because the feature dimension is much greater than the size of the training samples. In this paper, we develop a new machine learning technique, multitraining SVM (MTSVM), which combines the merits of the cotraining technique and a random sampling method in the feature space. Based on the proposed MTSVM algorithm, the above two problems can be mitigated. Experiments are carried out on a large image set of some 20,000 images, and the preliminary results demonstrate that the developed method consistently improves the performance over conventional SVM-based RFs in terms of precision and standard deviation, which are used to evaluate the effectiveness and robustness of a RF algorithm, respectively.
Relevance Feedback Techniques In Interactive Content-Based Image Retrieval

Y Rui,Ts Huang,S Mehrotra

DOI: https://doi.org/10.1117/12.298455

1997-01-01

Abstract:Content-Based Image Retrieval (CBIR) has become one of the most active research areas in the past few years. Many visual feature representations have been explored and many systems built. While these research efforts establish the basis of CBIR, the usefulness of the proposed approaches is limited. Specifically, these efforts have relatively ignored two distinct characteristics of CBIR systems: (1) the gap between high level concepts and low level features; (2) subjectivity of human perception of visual content.This paper proposes a relevance feedback based interactive retrieval approach, which effectively takes into account the above two characteristics in CBIR. During the retrieval process, the user's high level query and perception subjectivity are captured by dynamically updated weights based on the user's relevance feedback. The experimental results show that the proposed approach greatly reduces the user's effort of composing a query and captures the user's information need more precisely.
Color Image Retrieval Utilizing Extended Fast Vq Codeword Search Technique And Vector Composition-Based Feedback

Zhi-Wei Zhang,Ming-Hui Wang,Zhe-Ming Lu,Ting-Yuan Nie

2014-01-01

Abstract:This paper presents a novel fast image retrieval algorithm based on extended fast VQ codeword search (EFVQCS) technique to improve the efficiency of the content based image retrieval (CBIR) system. The proposed scheme can effectively reduce the retrieval time, without decreasing the accuracy of retrieving the first K most similar images. To make each feature component in a feature vector within the same range, the Gaussian normalization technique is adopted. Furthermore, a simple vector composition based relevance feedback method is utilized to improve the retrieval precision. Experimental results demonstrate that our scheme can not only speed up the retrieval process but also achieve satisfactory performance in precision, especially for large image databases with a high feature vector dimension.

A new integrated SVM classifiers for relevance feedback content-based image retrieval using EM parameter estimation

Learning A Semantic Space from User'S Relevance Feedback for Image Retrieval

Support Vector Machine Learning for Image Retrieval

An Image Retrieval System with Color Emotion Query

Asymmetric Bagging and Random Subspace for Support Vector Machines-Based Relevance Feedback in Image Retrieval

A Survey on Relevance Feedback Techniques in Content-based Medical Image Retrieval

A Novel SVM Based Relevance Feedback Algorithm in Image Retrieval

Support Vector Machine Based Relevance Feedback Algorithm in Image Retrieval

Efficient Relevance Feedback Scheme Based on SVM in Image Retrieval

Learning User'S Perception Using Region-Based Svm for Content-Based Image Retrieval

Support Vector Machines For Region-Based Image Retrieval

Relevance Feedback For Keyword And Visual Feature-Based Image Retrieval

Content-based Image Retrieval Using Optimal Feature Combination and Relevance Feedback

An Image Retrieval Relevance Feedback Algorithm Based on the Bayesian Classifier

Semi-supervised SVM Batch Mode Active Learning for Image Retrieval

Semisupervised SVM Batch Mode Active Learning with Applications to Image Retrieval

Probability fuzzy SVM for image retrieval

Relevance Feedback in Content-Based Image Retrieval: Bayesian Framework, Feature Subspaces, and Progressive Learning

Multitraining support vector machine for image retrieval.

Relevance Feedback Techniques In Interactive Content-Based Image Retrieval

Color Image Retrieval Utilizing Extended Fast Vq Codeword Search Technique And Vector Composition-Based Feedback