Abstract:Semantic communication, as a revolutionary communication architecture, is considered a promising novel communication paradigm. Unlike traditional symbol-based error-free communication systems, semantic-based visual communication systems extract, compress, transmit, and reconstruct images at the semantic level. However, widely used image similarity evaluation metrics, whether pixel-based MSE or PSNR or structure-based MS-SSIM, struggle to accurately measure the loss of semantic-level information of the source during system transmission. This presents challenges in evaluating the performance of visual semantic communication systems, especially when comparing them with traditional communication systems. To address this, we propose a semantic evaluation metric -- SeSS (Semantic Similarity Score), based on Scene Graph Generation and graph matching, which shifts the similarity scores between images into semantic-level graph matching scores. Meanwhile, semantic similarity scores for tens of thousands of image pairs are manually annotated to fine-tune the hyperparameters in the graph matching algorithm, aligning the metric more closely with human semantic perception. The performance of the SeSS is tested on different datasets, including (1)images transmitted by traditional and semantic communication systems at different compression rates, (2)images transmitted by traditional and semantic communication systems at different signal-to-noise ratios, (3)images generated by large-scale model with different noise levels introduced, and (4)cases of images subjected to certain special transformations. The experiments demonstrate the effectiveness of SeSS, indicating that the metric can measure the semantic-level differences in semantic-level information of images and can be used for evaluation in visual semantic communication systems.

THE SURVEY ON SEMANTIC SIMILARITY METRIC

Improve Semantic Web Services Discovery Through Similarity Search in Metric Space

A Survey Of Semantic Similarity And Its Application To Social Network Analysis

A Review of Information Content Metric for Semantic Similarity

Study on Semantic Similarity Algorithms Based On Semantic Grid

A Hybrid Semantic Similarity Measurement for Geospatial Entities

Measurement of Text Similarity: A Survey

A survey on the techniques, applications, and performance of short text semantic similarity

Review of Ontology-based Semantic Similarity Measuring

A Semantic-Rich Similarity Measure in Heterogeneous Information Networks.

Semantic Similarity-Based Information Retrieval Method

A Semantic-Rich Similarity in Heterogeneous Information Networks

A Similarity Metric in Image Searching.

An Improved Method for Measuring Concept Semantic Similarity Combining Multiple Metrics

Similarity algorithm of text based on semantic understanding

Combined Measurement Approach for Semantic Similarity of Terms

Semantic Similarity Score for Measuring Visual Similarity at Semantic Level

Semantic Similarity Measurement Based on Ontology

Valuing Semantic Similarity

An effective algorithm for semantic similarity metric of word pairs

Measuring Semantic Similarity of Word Pairs Using Path and Information Content