Image saliency detection based on background-absorbing Markov chain
Fengling Jiang,Haitao Zhang,Jing Yang,Bin Kong
DOI: https://doi.org/10.11834/jig.170492
2018-01-01
Journal of Image and Graphics
Abstract:Objective The method of saliency detection via absorbing Markov chain uses simple linear iterative cluster (SLIC) method to obtain superpixels as graph nodes.Then,a k-regular graph is constructed,and the edge weight is calculated by the difference of two nodes on CIELAB value.The superpixels are duplicated on boundary as absorbing nodes.Then,the absorbed time of transient nodes on the Markov chain is calculated.If the absorbed time is small,then the transient node is similar to the absorbing node,which is possibly a background node.On the contrary,the transient node is dissimilar to the absorbing node when the absorbed time is large.Then,the node is a salient node.Actually,the number of superpixels obtained by using the SLIC method influences the results of the saliency maps.If the size of the superpixel is extremely large,then the detailed information is ignored.On the contrary,if the size of the superpixel is extremely small,then the global cue is missed.The saliency objects usually occupy one or two boundaries of images,especially for portraits and sculptures.The final saliency results are influenced when four boundary nodes are duplicated as absorbing nodes.Considering these drawbacks,we propose an improved method based on background nodes as absorbing nodes on absorbing Markov chain.Multilayer image fusion is used to restrain the influence of the uncertain number of superpixels through the SLIC method.Method First,we confirm the edge selection.We separately obtain the four boundaries of the image nodes by SLIC method,duplicate them as absorbing nodes,and obtain four types of saliency maps.Then,we calculate the difference values of two saliency maps.The largest value of one saliency map is computed and compared with those of the other three maps.Then,we remove the most different edge and continue to use the remaining three boundary nodes to be duplicated as absorbing nodes.Then,the initial saliency map can be obtained by calculating the absorbed time of the transient nodes to absorbing nodes at the absorbing Markov chain.Second,to further optimize the algorithm,the number of absorbing nodes should be increased.In addition,the background may be a part of the boundary nodes.We add other nodes that are probably background nodes,which are selected from the initial saliency map by a threshold.If the initial saliency value of the node is lower than the threshold,then the node is considered a background node.The selected boundary and back-ground nodes are duplicated as absorbing nodes,by which the absorbed time of the transient nodes are calculated.The pixel saliency value can be obtained from the saliency value of the superpixels.Finally,we fuse the multiple pixel saliency maps and calculate the average values as the final results.The multiple saliency values are obtained via different numbers of superpixels by using the SLIC method.Result We evaluate the effectiveness of our method on the following three benchmark datasets:ASD,DUT-OMRON,and SED.We compare our method with 12 recent state-of-art saliency detection methods,namely,MC,CA,FT,SEG,BM,SWD,SF,GCHC,LMLC,PCA,MS,and MST.ASD contains 1 000 simple images.DUT-OMRONS contains 5 168 complex images.SED includes 200 images,in which 100 images have one salient object,and the other 100 images have two salient objects.The experimental results show that the improved algorithm is efficient and better than the 12 state-of-the-art methods in precision recall curves (pR-curve) and F-measure.The precision is calculated as the ratio of actual saliency results assigned to all predicted saliency pixels.Recall is defined as the ratio of the total saliency captured pixels to the ground-truth number.F-measure is an overall performance measurement.Some visual comparative examples selected from three datasets are shown intuitively.The F-measure values of the three benchmark databases are 0.775 6,0.903,and 0.544 7.These values are higher than that of the other 12 methods.Conclusion The image can be segmented into complex background,and the partition of human eyes is interesting.The visual image saliency detection extracts the portion of interest through the computer simulation as a human visual system.We propose an improved model,which is based on the background nodes and image fusion,to obtain the final results given the drawbacks of using four image boundaries to be duplicated as absorbing nodes and the uncertain number of superpixels through the SLIC method.The experiments show that the method is efficient and can be applicable to the bottom-up image saliency detcction,especially for images such as portraits or sculptures.It can also be applied to many fields,such as image retrieval,object recognition,image segmentation,and image compression.