Big Data and Image Search

Yong Rui

DOI: https://doi.org/10.1109/mmul.2014.39

IF: 3.4911

2014-01-01

IEEE Multimedia

Abstract:Editor-in-Chief Yong Rui reflects on what has been achieved in the past 20 years of multimedia research and where to go next, specifically on the past and future of image search.

What problem does this paper attempt to address?

Image Search—from Thousands to Billions in 20 Years

Lei Zhang,Yong Rui

DOI: https://doi.org/10.1145/2490823

2013-01-01

Abstract:This article presents a comprehensive review and analysis on image search in the past 20 years, emphasizing the challenges and opportunities brought by the astonishing increase of dataset scales from thousands to billions in the same time period, which was witnessed first-hand by the authors as active participants in this research area. Starting with a retrospective review of three stages of image search in the history, the article highlights major breakthroughs around the year 2000 in image search features, indexing methods, and commercial systems, which marked the transition from stage two to stage three. Subsequent sections describe the image search research from four important aspects: system framework, feature extraction and image representation, indexing, and big data's potential. Based on the review, the concluding section discusses open research challenges and suggests future research directions in effective visual representation, image knowledge base construction, implicit user feedback and crowdsourcing, mobile image search, and creative multimedia interfaces.
Image Retrieval: Past, Present, and Future

Y. Rui,T. S. Huang,S. F Chang

IF: 2.887

1999-01-01

Journal of Visual Communication and Image Representation

Abstract: This paper provides a comprehensive survey of the technicalachievements in the research area of Image Retrieval,especially Content-Based Image Retrieval, anarea so active and prosperous in the past few years.The survey includes 100+ papers covering the researchaspects of image feature representation and extraction,multi-dimensional indexing, and system design, threeof the fundamental bases of Content-Based Image Retrieval.Furthermore, based on the state-of-the-art technologyavailable...
Fuelling Big Data Intelligence into Future Multimedia System: Reflection and Outlook

Yonggang Wen,Wenwu Zhu

DOI: https://doi.org/10.1109/bigmm.2015.21

2015-01-01

Abstract:The last decade has witnessed an explosive growth in multimedia big data, with the invention of big data analytics technologies, such as Hadoop, Spark, Storm. All these technologies are valuable to mine intelligence from multimedia big data, and further shed new insights into multimedia networks. This paper presents an outlook on the development of future multimedia networks and discuss utilizing the big data intelligence into the design and optimization. We start with an end-to-end view for future multimedia networks, including contents, multimedia networks, and consumers. For each part, we enumerate several representative applications and technologies that bring new challenges and opportunities. After that, we discuss the common idea of utilizing the big data intelligence to benefit the whole ecosystem, and highlight some open research issues for the future.
Image Retrieval: Current Techniques, Promising Directions, and Open Issues

Yong Rui,Thomas S. Huang,Shih-Fu Chang

DOI: https://doi.org/10.1006/jvci.1999.0413

IF: 2.887

1999-01-01

Journal of Visual Communication and Image Representation

Abstract:This paper provides a comprehensive survey of the technical achievements in the research area of image retrieval, especially content-based image retrieval, an area that has been so active and prosperous in the past few years. The survey includes 100+ papers covering the research aspects of image feature representation and extraction, multidimensional indexing, and system design, three of the fundamental bases of content-based image retrieval. Furthermore, based on the state-of-the-art technology available now and the demand from real-world applications, open research issues are identified and future promising research directions are suggested.
Multimedia information retrieval at a crossroad

Qing Li,Jun Yang,Yueting Zhuang

DOI: https://doi.org/10.4018/978-1-60566-014-1.ch134

2008-01-01

Abstract:In the late 1990s, the availability of powerful computing capability, large storage devices, high-speed networking and especially the advent of the Internet, led to a phenomenal growth of digital multimedia content in terms of size, diversity and impact. As suggested by its name,“multimedia” is a name given to a collection of multiple types of data, which include not only “traditional multimedia” such as images and videos, but also emerging media such as 3D graphics (like VRML objects) and Web animations (like Flash animations). Furthermore, multimedia techniques have been penetrating into a growing number of applications, ranging from document-editing software to digital libraries and many Web applications. For example, most people who have used Microsoft Word have tried to insert pictures and diagrams into their documents, and they have the experience of watching online video clips, such as movie trailers …
Rethinking multimedia search in the "clients + cloud" era.

Wei-Ying Ma

DOI: https://doi.org/10.1145/1631058.1631060

2009-01-01

Abstract:The emergence of cloud computing is presenting us with unprecedented opportunities to redefine how people search for and interact with multimedia on client devices (such as PC, TV, and phone). In this talk, I will introduce some key trends in computing and discuss how these trends are creating both new opportunities and new challenges for large-scale multimedia analysis and search. I will also talk about some of Microsoft's latest research efforts in building a new kind of search engine - one that aims to empower people with knowledge and facilitate their decision making during various online activities.
Advanced Techniques for Object-Based Image Retrieval

Y. J. Zhang

DOI: https://doi.org/10.4018/978-1-59140-553-5.ch014

2005-01-01

Abstract:Along with the progress of imaging modality and the wide utility of digital images (including video) in various fields, many potential content producers have emerged, and many image databases have been built. Because images require large amounts of storage space and processing time, how to quickly and efficiently access and manage these large, both in the sense of information contents and data volume, databases has become an urgent problem. The research solution for this problem, using content-based image retrieval (CBIR) techniques, was initiated in the last decade (Kato, 1992). An international standard for multimedia content descriptions, MPEG-7, was formed in 2001 (MPEG). With the advantages of comprehensive descriptions of image contents and consistence to human visual perception, research in this direction is considered as one of the hottest research points in the new century (Castelli, 2002; Zhang, 2003; Deb, 2004).
Multimedia search reranking

Tao Mei,Yong Rui,Shipeng Li,Qi Tian

DOI: https://doi.org/10.1145/2536798

IF: 16.6

2014-01-01

ACM Computing Surveys

Abstract:The explosive growth and widespread accessibility of community-contributed media content on the Internet have led to a surge of research activity in multimedia search. Approaches that apply text search techniques for multimedia search have achieved limited success as they entirely ignore visual content as a ranking signal. Multimedia search reranking, which reorders visual documents based on multimodal cues to improve initial text-only searches, has received increasing attention in recent years. Such a problem is challenging because the initial search results often have a great deal of noise. Discovering knowledge or visual patterns from such a noisy ranked list to guide the reranking process is difficult. Numerous techniques have been developed for visual search re-ranking. The purpose of this paper is to categorize and evaluate these algorithms. We also discuss relevant issues such as data collection, evaluation metrics, and benchmarking. We conclude with several promising directions for future research.
Current Research Status and Prospects on Multimedia Content Understanding

Yuxin Peng,Jinwei Qi,Xin Huang

DOI: https://doi.org/10.7544/issn1000-1239.2019.20180770

2019-01-01

Abstract:With the rapid development of multimedia and Internet technologies, a large amount of multimedia data has been rapidly emerging, such as image, video, text and audio.Data of different media types from multi-source is heterogeneous in the form but relevant in the semantic.As indicated in the research of cognitive science, the perception and cognition of the environment is through the fusion across different sensory organs of human, which is decided by the human brain's organization structure.Therefore, it has been a key challenge to perform data semantic analysis and correlation modeling across different media types, for achieving comprehensive multimedia content understanding, which has drawn wide interests of both academic and industrial areas.In this paper, the basic concepts, representative methods and research status of 5latest highlighting research topics of multimedia content understanding are referred, including fine-grained image classification and retrieval, video classification and object detection, cross-media retrieval, visual description and generation, and visual question answering.This paper further presents the major challenges of multimedia content understanding, as well as gives the development trend in the future.The goal of this paper is to help readers get a comprehensive understanding on the research status of multimedia content understanding, draw more attention of researchers to relevant research topics, and provide the technical insights to promote further development of this area.
Multimedia search reranking: A literature survey

Tao Mei,Yong Rui,Shipeng Li,Qi Tian

DOI: https://doi.org/10.1145/2536798

2014-01-01

Abstract:The explosive growth and widespread accessibility of community-contributed media content on the Internet have led to a surge of research activity in multimedia search. Approaches that apply text search techniques for multimedia search have achieved limited success as they entirely ignore visual content as a ranking signal. Multimedia search reranking, which reorders visual documents based on multimodal cues to improve initial text-only searches, has received increasing attention in recent years. Such a problem is challenging because the initial search results often have a great deal of noise. Discovering knowledge or visual patterns from such a noisy ranked list to guide the reranking process is difficult. Numerous techniques have been developed for visual search re-ranking. The purpose of this paper is to categorize and evaluate these algorithms. We also discuss relevant issues such as data collection, evaluation metrics, and benchmarking. We conclude with several promising directions for future research.
An Overview of Cross-Media Retrieval: Concepts, Methodologies, Benchmarks, and Challenges

Yuxin Peng,Xin Huang,Yunzhen Zhao

DOI: https://doi.org/10.1109/tcsvt.2017.2705068

IF: 5.859

2018-09-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Multimedia retrieval plays an indispensable role in big data utilization. Past efforts mainly focused on single-media retrieval. However, the requirements of users are highly flexible, such as retrieving the relevant audio clips with one query of image. So challenges stemming from the “media gap,” which means that representations of different media types are inconsistent, have attracted increasing attention. Cross-media retrieval is designed for the scenarios where the queries and retrieval results are of different media types. As a relatively new research topic, its concepts, methodologies, and benchmarks are still not clear in the literature. To address these issues, we review more than 100 references, give an overview including the concepts, methodologies, major challenges, and open issues, as well as build up the benchmarks, including data sets and experimental results. Researchers can directly adopt the benchmarks to promptly evaluate their proposed methods. This will help them to focus on algorithm design, rather than the time-consuming compared methods and results. It is noted that we have constructed a new data set XMedia, which is the first publicly available data set with up to five media types (text, image, video, audio, and 3-D model). We believe this overview will attract more researchers to focus on cross-media retrieval and be helpful to them.

engineering, electrical & electronic
Image Engineering in China：2023

Zhang Yujin

DOI: https://doi.org/10.11834/jig.240166

2024-01-01

Abstract:This is the 29th annual survey series of bibliographies on image engineering in China.This statistic and analysis study aims to capture the up-to-date development of image engineering in China,provide a targeted means of literature searching facility for readers working in related areas,and supply a useful recommendation for the editors of journals and potential authors of papers.Specifically,considering the wide distribution of related publications in China,all references(865)on image engineering research and technique are selected carefully from the research papers(2 989 in total)pub-lished in all issues(154)of a set of 15 Chinese journals.These 15 journals are considered important,in which papers con-cerning image engineering have higher quality and are relatively concentrated.The selected references are initially classi-fied into five categories(image processing,image analysis,image understanding,technique application,and survey)and then into 23 specialized classes in accordance with their main contents(same as the last 18 years).Analysis and discus-sions about the statistics of the results of classifications by journal and by category are also presented.Analysis on the statis-tics in 2023 shows that:from a research perspective,image analysis has currently received the most attention,with image segmentation and primitive detection,object detection and recognition,as well as human biometric feature extraction and validation being the focus of research;from an application perspective,remote sensing,radar,sonar,surveying and map-ping are the most active fields,and the development and application of new image technologies are expanding rapidly.In conclusion,this work shows a general and up-to-date picture of the various continuing progresses,either for depth or for width,of image engineering in China in 2023.The statistics for 29 years also provide readers with more comprehensive and credible information on the development trends of various research directions.
Mobile Social Multimedia Analytics in the Big Data Era: an Introduction to the Special Issue.

Rongrong Ji,Wei Liu,Xing Xie,Yiqiang Chen,Jiebo Luo

DOI: https://doi.org/10.1145/3040934

IF: 5

2017-01-01

ACM Transactions on Intelligent Systems and Technology

Abstract:editorial Free Access Share on Mobile Social Multimedia Analytics in the Big Data Era: An Introduction to the Special Issue Editors: Rongrong Ji Xiamen University, China Xiamen University, ChinaView Profile , Wei Liu Tencent AI Lab, China Tencent AI Lab, ChinaView Profile , Xing Xie Microsoft Research Asia, China Microsoft Research Asia, ChinaView Profile , Yiqiang Chen Chinese Academy of Science, China Chinese Academy of Science, ChinaView Profile , Jiebo Luo University of Rochester, United States University of Rochester, United StatesView Profile Authors Info & Claims ACM Transactions on Intelligent Systems and TechnologyVolume 8Issue 3May 2017 Article No.: 34pp 1–3https://doi.org/10.1145/3040934Published:14 April 2017Publication History 2citation224DownloadsMetricsTotal Citations2Total Downloads224Last 12 Months11Last 6 weeks2 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF
Recent Advances And Challenges Of Semantic Image/Video Search

Shih-Fu Chang,Wei-Ying Ma,Arnold Smeulders

DOI: https://doi.org/10.1109/ICASSP.2007.367292

2007-01-01

Abstract:We present an overview of recent advances and major challenges in image and video search, with a specific focus on large-scale semantic concept detection and indexing. Such semantic indexing paradigm has been driven by the increasing availability of the large resources of corpora, novel labeling approaches, innovative image features, and machine learning techniques for visual content recognition. We will discus key approaches, recent results, and novel applications in text-to-concept semantic search and multimodal retrieval models. Open issues and major opportunities will also be presented.
Visualization Analysis on the Hotspots and Frontier Evolution of International Big Data Research

Wang Yucan,Li Yifei,Yuan Qinjian

DOI: https://doi.org/10.3724/sp.j.1224.2014.00282

2014-01-01

JOURNAL OF ENGINEERING STUDIES

Abstract:With the comprehensive collection of“big data”relevant literature from international core jour-nals database of WoS, we employs co-word analysis as the basic method, together with some other tools such as social network analysis, clustering and strategic diagram, to reveal the hotspots and frontier evolution of big data research. The results show that the current big data research has the following five main aspects:algorithm design and development, platform and framework for practice, data analysis methods and statistical practice, semantics and ontology research and big data applications. The related research has continued to expand and deepen, and has gradually reflected the inheritance, while overall is still in its infancy. Thus, we also give our forecast about the next research frontier:1) data processing techniques and methods research in big data environment, including ap-plication research on data processing and statistical methods in big data context;2) semantic analysis and ontology research;3) the mining of commercial values of big data.
Current Situation and Development Direction of Medical Image Processing Technology in the Background of Big Data

Chen Meng

DOI: https://doi.org/10.7753/ijsea1204.1033

2023-04-07

International Journal of Science and Engineering Applications

Abstract:With the progress of society and the development of technology, digital technology has been widely used in current life practices. From the perspective of practical application effects, digital technology has not only greatly improved people's work efficiency, but also significantly improved the quality of work. From the perspective of the current application of digital technology, digital image processing is very common. This work benefits from the digital technology and computer foundation, so the quality of image processing is higher, and the use effect is higher. The emergence and development of the main content of image enhancement and restoration, image segmentation, and image analysis, and based on the latest progress in this field, this paper briefly describes the latest hotspots in five main research areas of digital image processing technology, and finally summarizes the main challenges and future development directions in the field of digital image processing technology.
An Exploration on Sanya City Image Communication in the Era of Big Data

Yongfei Xie

DOI: https://doi.org/10.1007/978-3-030-79197-1_3

2021-01-01

Abstract:The advent of globalization has intensified the competition between cities, and the spread of city images has also received people’s attention. With the development of technologies such as the Internet, the Internet of Things, and the Internet of Vehicles, as well as the improvement of data mining and analysis technologies, mankind has entered the era of big data. Big data has played an important role in accurately insight into the needs of the audience, efficient integration of communication methods, and real-time guidance of public opinion. It can be said that big data has reversed the traditional urban image communication relying on administrative power and made up for the limitations of urban image communication. This article uses literature method, logical analysis method and other methods to explore the importance of Sanya city image communication under big data, analyze the problems of Sanya city image communication under big data, and finally analyze how to use big data to effectively spread Sanya city image.
Internet Visual Media Processing: A Survey with Graphics and Vision Applications

Shi-Min Hu,Tao Chen,Kun Xu,Ming-Ming Cheng,Ralph R. Martin

DOI: https://doi.org/10.1007/s00371-013-0792-6

2013-01-01

Abstract:In recent years, the computer graphics and computer vision communities have devoted significant attention to research based on Internet visual media resources. The huge number of images and videos continually being uploaded by millions of people have stimulated a variety of visual media creation and editing applications, while also posing serious challenges of retrieval, organization, and utilization. This article surveys recent research as regards processing of large collections of images and video, including work on analysis, manipulation, and synthesis. It discusses the problems involved, and suggests possible future directions in this emerging research area.
Big Search in Cyberspace

Binxing Fang,Yan Jia,Xiaoyong Li,Aiping Li,Xindong Wu

DOI: https://doi.org/10.1109/tkde.2017.2699675

IF: 9.235

2017-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:With the rapid development of big data analytics, mobile computing, Internet of Things, cloud computing, and social networking, cyberspace has expanded to a cross-fused and ubiquitous space made up of human beings, things, and information. Internet applications have evolved from Web 1.0 to Web 2.0 and Web 3.0, and web information has seen an explosive growth, which is strongly promoting the advent of a global era of big data. In this ubiquitous cyberspace, traditional search engines can no longer fully satisfy the evolving needs of various types of users. Therefore, search engines must make completely innovative, revolutionary changes for the next generation of search, which is referred to as "big search". This paper first studies the development needs of big search. Then, big search is defined, and the 5S properties (Sourcing, Sensing, Synthesizing, Solution, and Security) of big search, which are different from those of traditional search engines, are elaborated. Also, the paper provides a system architecture for big search, explores the key technologies that support the 5S properties, and describes potential application fields of big search technology. Finally, the research opportunities of big search are discussed.
Data-driven image analysis and editing: A survey

Miao Wang,Fanglue Zhang,Shimin Hu

2015-01-01

Abstract:Recent development of digital media and mobile Internet has boosted a huge amount of online images. Additional requirements such as intelligence and efficiency are required for data-driven image analysis and proc-essing technology. Lacking sufficient information, traditional image editing methods taking one or multiple images as inputs, are likely to generate unsatisfactory results. Data-driven image editing methods take ad-vantage of hidden knowledge in the image library, thus have potential to produce better results.

Big Data and Image Search

Image Search—from Thousands to Billions in 20 Years

Image Retrieval: Past, Present, and Future

Fuelling Big Data Intelligence into Future Multimedia System: Reflection and Outlook

Image Retrieval: Current Techniques, Promising Directions, and Open Issues

Multimedia information retrieval at a crossroad

Rethinking multimedia search in the "clients + cloud" era.

Advanced Techniques for Object-Based Image Retrieval

Multimedia search reranking

Current Research Status and Prospects on Multimedia Content Understanding

Multimedia search reranking: A literature survey

An Overview of Cross-Media Retrieval: Concepts, Methodologies, Benchmarks, and Challenges

Image Engineering in China：2023

Mobile Social Multimedia Analytics in the Big Data Era: an Introduction to the Special Issue.

Recent Advances And Challenges Of Semantic Image/Video Search

Visualization Analysis on the Hotspots and Frontier Evolution of International Big Data Research

Current Situation and Development Direction of Medical Image Processing Technology in the Background of Big Data

An Exploration on Sanya City Image Communication in the Era of Big Data

Internet Visual Media Processing: A Survey with Graphics and Vision Applications

Big Search in Cyberspace

Data-driven image analysis and editing: A survey