Abstract:With the rapid development of the Internet technology and the digital imaging device,massive pictures are uploaded and saved in the network disks every day.Traditional image coding methods (such as JPEG,JPEG2000) only exploit spatial correlations inside a picture,thus their coding efficiency cannot satisfy the demand of the huge picture data.In order to compress the images in the Internet more efficiently,we proposed a novel cloud-based image compression method by taking advantage of the ‘ big data’ challenge,rather than simply treating it as a difficulty.The proposed system adopts the processing mode of ‘encoding one image immediately after it is uploaded’,which effectively adapts to the rapid change of the big-data environment.It compresses an image by fully exploiting the correlations between the image-to-be-compressed and other images in the cloud.We had three innovative technical designs to serve for the compression framework.(a) We designed a scheme based on an efficient image retrieval technique to effectively filter the ‘big data’ and to only keep the ‘small data’ that well matches the image to be compressed.(b) By utilizing the selected ‘small data’,we did inter-image prediction coding,which is essential for the performance of the compression system.We exploited the techniques of block matching-based prediction coding and rate-distortion optimization,so that coding bits are tremendously reduced in the premise of good reconstruction quality.(c) We ensured the prediction accuracy by applying a couple of preprocessing techniques on the retrieved similar image to obtain good references.In this step,we applied projective transformation to align the retrieved image and the current image,and did illumination compensation to make the values of corresponding pixels as close as possible.This paper presents a novel framework for image compression in the big-data era,which tremendously saves storage requirement for images in the cloud disks.The proposed system has significant compression performance gains compared to traditional image coding methods and even the advanced HEVC intra coding.The experimental results demonstrate that it outperforms JPEG and HEVC intra coding by 78.5％ and 67.2％ on average,respectively.Moreover,compared to the existing state-of-the-art attempt for cloud-based image coding in the literature,both the objective and subjective reconstruction quality of our algorithm have obvious improvement.

Understanding the impact of compression on web retrieval performance

Compression Performance Analysis of Different File Formats

Content-Aware Global Static Compression for Web Content Delivery

Exploiting fine grained parallelism for acceleration of web retrieval

Data Transmission in Mobile Edge Networks: Whether and Where to Compress?

Modeling Retrieval Parallelism In Web Content Delivery

INTELLIGENT PREFETCH AND CACHE TECHNIQUES BASED ON NETWORK PERFORMANCE

Are Visual Recognition Models Robust to Image Compression?

An Efficient Image Compression Method Based on Cloud Data

Quantitative Analysis On The Cacheability Pactors Of Web Objects

A General Framework for Progressive Data Compression and Retrieval

On the Impact of Perceptual Compression on Deep Learning

Similarity-Based Web Browser Optimization

Understanding The Effectiveness of Lossy Compression in Machine Learning Training Sets

Template-based Delta Compression of Large Scale Web Pages

Which One is Better: Assessing Objective Metrics for Point Cloud Compression

Parallel Data Compression Techniques

SECOMPAX: A Bitmap Index Compression Algorithm

Jointly Optimizing Query Encoder and Product Quantization to Improve Retrieval Performance

A Review of Image Retrieval Techniques in the Compressed Domain

A Survey of Bitmap Index Compression Algorithms for Big Data