Bing Chat: The Future of Search Engines?

Dominique Kelly,Yimin Chen,Sarah E. Cornwell,Nicole S. Delellis,Alex Mayhew,Sodiq Onaolapo,Victoria L. Rubin

DOI: https://doi.org/10.1002/pra2.927

2023-10-23

Proceedings of the American Society for Information Science and Technology

Abstract:Proceedings of the Association for Information Science and Technology, Volume 60, Issue 1, Page 1007-1009, October 2023.

What problem does this paper attempt to address?

Conversational assistants in academic libraries: enhancing reference services through Bing Chat

Adebowale Jeremy Adetayo

DOI: https://doi.org/10.1108/lhtn-08-2023-0142

2023-09-19

Library Hi Tech News

Abstract:Purpose This research aims to explore the integration of Bing Chat, an artificial intelligence (AI)-powered conversational assistant, into academic libraries and its potential impact on reference services. Design/methodology/approach This study analyzes existing literature to investigate the integration of Bing Chat in academic libraries. This research focuses on its features, capabilities and implications for enhancing user experiences and addressing information needs. Findings The findings highlight that Bing Chat's conversational interface facilitates more dynamic and context-aware reference interactions, fostering user empowerment and personalized learning pathways. The integration of Bing Chat with existing library resources enhances resource discovery, navigational assistance and engagement with visual content. However, challenges related to accuracy, privacy and algorithmic bias require careful consideration. Originality/value This research contributes to the literature by providing an in-depth exploration of Bing Chat's integration into academic libraries, emphasizing its transformative potential for reference services. This study addresses ethical and social dimensions associated with AI-driven tools in library environments, offering insights into ensuring fairness, privacy and user trust.
Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based Search Engines

Lijia Ma,Xingchen Xu,Yong Tan

2024-03-01

Abstract:In the domain of digital information dissemination, search engines act as pivotal conduits linking information seekers with providers. The advent of chat-based search engines utilizing Large Language Models (LLMs) and Retrieval Augmented Generation (RAG), exemplified by Bing Chat, marks an evolutionary leap in the search ecosystem. They demonstrate metacognitive abilities in interpreting web information and crafting responses with human-like understanding and creativity. Nonetheless, the intricate nature of LLMs renders their "cognitive" processes opaque, challenging even their designers' understanding. This research aims to dissect the mechanisms through which an LLM-powered chat-based search engine, specifically Bing Chat, selects information sources for its responses. To this end, an extensive dataset has been compiled through engagements with New Bing, documenting the websites it cites alongside those listed by the conventional search engine. Employing natural language processing (NLP) techniques, the research reveals that Bing Chat exhibits a preference for content that is not only readable and formally structured, but also demonstrates lower perplexity levels, indicating a unique inclination towards text that is predictable by the underlying LLM. Further enriching our analysis, we procure an additional dataset through interactions with the GPT-4 based knowledge retrieval API, unveiling a congruent text preference between the RAG API and Bing Chat. This consensus suggests that these text preferences intrinsically emerge from the underlying language models, rather than being explicitly crafted by Bing Chat's developers. Moreover, our investigation documents a greater similarity among websites cited by RAG technologies compared to those ranked highest by conventional search engines.

Information Retrieval,Artificial Intelligence,General Economics
How does AI chat change search behaviors?

Robert Capra,Jaime Arguello

2023-07-08

Abstract:Generative AI tools such as chatGPT are poised to change the way people engage with online information. Recently, Microsoft announced their "new Bing" search system which incorporates chat and generative AI technology from OpenAI. Google has announced plans to deploy search interfaces that incorporate similar types of technology. These new technologies will transform how people can search for information. The research presented here is an early investigation into how people make use of a generative AI chat system (referred to simply as chat from here on) as part of a search process, and how the incorporation of chat systems with existing search tools may effect users search behaviors and strategies. We report on an exploratory user study with 10 participants who used a combined Chat+Search system that utilized the OpenAI GPT-3.5 API and the Bing Web Search v5 API. Participants completed three search tasks. In this pre-print paper of preliminary results, we report on ways that users integrated AI chat into their search process, things they liked and disliked about the chat system, their trust in the chat responses, and their mental models of how the chat system generated responses.

Human-Computer Interaction,Artificial Intelligence,Information Retrieval
Is ChatGPT-like technology going to replace commercial search engines?

Artur Strzelecki

DOI: https://doi.org/10.1108/lhtn-02-2024-0026

2024-04-04

Library Hi Tech News

Abstract:Purpose This paper aims to give an overview of the history and evolution of commercial search engines. It traces the development of search engines from their early days to their current form as complex technology-powered systems that offer a wide range of features and services. Design/methodology/approach In recent years, advancements in artificial intelligence (AI) technology have led to the development of AI-powered chat services. This study explores official announcements and releases of three major search engines, Google, Bing and Baidu, of AI-powered chat services. Findings Three major players in the search engine market, Google, Microsoft and Baidu started to integrate AI chat into their search results. Google has released Bard, later upgraded to Gemini, a LaMDA-powered conversational AI service. Microsoft has launched Bing Chat, renamed later to Copilot, a GPT-powered by OpenAI search engine. The largest search engine in China, Baidu, released a similar service called Ernie. There are also new AI-based search engines, which are briefly described. Originality/value This paper discusses the strengths and weaknesses of the traditional – algorithmic powered search engines and modern search with generative AI support, and the possibilities of merging them into one service. This study stresses the types of inquiries provided to search engines, users' habits of using search engines and the technological advantage of search engine infrastructure.
ChatGPT-3.5 and Bing Chat in ophthalmology: an updated evaluation of performance, readability, and informative sources

Brendan Ka-Lok Tao,Nicholas Hua,John Milkovich,Jonathan Andrew Micieli

DOI: https://doi.org/10.1038/s41433-024-03037-w

IF: 4.4563

2024-03-21

Eye

Abstract:Experimental investigation. Bing Chat (Microsoft) integration with ChatGPT-4 (OpenAI) integration has conferred the capability of accessing online data past 2021. We investigate its performance against ChatGPT-3.5 on a multiple-choice question ophthalmology exam.

ophthalmology
A Survey of Conversational Search

Fengran Mo,Kelong Mao,Ziliang Zhao,Hongjin Qian,Haonan Chen,Yiruo Cheng,Xiaoxi Li,Yutao Zhu,Zhicheng Dou,Jian-Yun Nie

2024-10-21

Abstract:As a cornerstone of modern information access, search engines have become indispensable in everyday life. With the rapid advancements in AI and natural language processing (NLP) technologies, particularly large language models (LLMs), search engines have evolved to support more intuitive and intelligent interactions between users and systems. Conversational search, an emerging paradigm for next-generation search engines, leverages natural language dialogue to facilitate complex and precise information retrieval, thus attracting significant attention. Unlike traditional keyword-based search engines, conversational search systems enhance user experience by supporting intricate queries, maintaining context over multi-turn interactions, and providing robust information integration and processing capabilities. Key components such as query reformulation, search clarification, conversational retrieval, and response generation work in unison to enable these sophisticated interactions. In this survey, we explore the recent advancements and potential future directions in conversational search, examining the critical modules that constitute a conversational search system. We highlight the integration of LLMs in enhancing these systems and discuss the challenges and opportunities that lie ahead in this dynamic field. Additionally, we provide insights into real-world applications and robust evaluations of current conversational search systems, aiming to guide future research and development in conversational search.

Computation and Language,Information Retrieval
From relevance to intelligence: toward next generation web search.

Wei-Ying Ma

DOI: https://doi.org/10.1145/1101826.1101827

2005-01-01

Abstract:ABSTRACTToday search engines have become one of the most critical applications on the Web, driving many important online businesses that connect users to information. As the Web continues to grow its size with a variety of new data and penetrate into every aspect of our life, the need for developing a more intelligent search engine is increasing.The primary function of current Web search engines is essentially relevance ranking at the document level, an old paradigm in information retrieval for more than 25 years. To make web search more intelligent, Microsoft Research Asia is currently developing a set of technologies to enable searching at the object level. For example, when a user is looking for information about a researcher, the user is not interested in just retrieving a set of papers or documents in which this researcher's name appears, but more interested in finding insight and knowledge about this researcher as to what works he has done in different period of time, what important contributions he has brought to the research community, how influential he is, and his social networks, etc. Such kind of intelligence is not possible to obtain through current search engines.In this talk, I will present the technical problems that we need to address, including information extraction, object identification and integration, and object relationship mining and ranking. I will also show how we apply these technologies to build more advanced vertical search engines such as product search, academic search, and image search that provide users not only relevant search results but also intelligence and insights in the retrieved data.
Assessing the performance of Bing Chat artificial intelligence: Dental exams, clinical guidelines, and patients' frequent questions

Juraj Brozović,Barbara Mikulić,Matej Tomas,Martina Juzbašić,Marko Blašković

DOI: https://doi.org/10.1016/j.jdent.2024.104927

Abstract:Objectives: Bing Chat is a large language model artificial intelligence (AI) with online search and text generating capabilities. This study assessed its performance within the scope of dentistry in: (a) tackling exam questions for dental students, (ii) providing guidelines for dental practitioners, and (iii) answering patients' frequently asked questions. We discuss the potential of clinical tutoring, common patient communication and impact on academia. Methods: With the aim of assessing AI's performance in dental exams, Bing Chat was presented with 532 multiple-choice questions and awarded scores based on its answers. In evaluating guidelines for clinicians, a further set of 15 questions, each with 2 follow-up questions on clinical protocols, was presented to the AI. The answers were assessed by 4 reviewers using electronic visual analog scale. In evaluating answers to patients' frequently asked questions, another list of 15 common questions was included in the session, with respective outputs assessed. Results: Bing Chat correctly answered 383 out of 532 multiple-choice questions in dental exam part, achieving a score of 71.99 %. As for outlining clinical protocols for practitioners, the overall assessment score was 81.05 %. In answering patients' frequently asked questions, Bing Chat achieved an overall mean score of 83.8 %. The assessments demonstrated low inter-rater reliability. Conclusions: The overall performance of Bing Chat was above the regularly adopted passing scores, particularly in answering patient's frequently asked questions. The generated content may have biased sources. These results suggest the importance of raising clinicians' awareness of AI's benefits and risks, as well as timely adaptations of dental education curricula, and safeguarding its use in dentistry and healthcare in general. Clinical significance: Bing Chat AI performed above the passing threshold in three categories, and thus demonstrated potential for educational assistance, clinical tutoring, and answering patients' questions. We recommend popularizing its benefits and risks among students and clinicians, while maintaining awareness of possible false information.
The Use of Generative Search Engines for Knowledge Work and Complex Tasks

Siddharth Suri,Scott Counts,Leijie Wang,Chacha Chen,Mengting Wan,Tara Safavi,Jennifer Neville,Chirag Shah,Ryen W. White,Reid Andersen,Georg Buscher,Sathish Manivannan,Nagu Rangan,Longqi Yang

2024-03-20

Abstract:Until recently, search engines were the predominant method for people to access online information. The recent emergence of large language models (LLMs) has given machines new capabilities such as the ability to generate new digital artifacts like text, images, code etc., resulting in a new tool, a generative search engine, which combines the capabilities of LLMs with a traditional search engine. Through the empirical analysis of Bing Copilot (Bing Chat), one of the first publicly available generative search engines, we analyze the types and complexity of tasks that people use Bing Copilot for compared to Bing Search. Findings indicate that people use the generative search engine for more knowledge work tasks that are higher in cognitive complexity than were commonly done with a traditional search engine.

Information Retrieval,Artificial Intelligence,Computers and Society,Social and Information Networks
Exploring the Future Development of Artificial Intelligence (AI) Applications in Chatbots: A Bibliometric Analysis

Li Liu,Vincent G. Duffy

DOI: https://doi.org/10.1007/s12369-022-00956-0

IF: 3.802

2023-04-05

International Journal of Social Robotics

Abstract:Chatbots are fast becoming a key instrument in the research community and enterprise, while few researchers have discussed the focus of existing research and future research directions from the perspective of bibliometrics. This study aimed to explore the evolution tracks of AI applications in chatbots through strict and systematic bibliometric analysis. The analysis began with data retrieval in Web of Science using defined search terms associated with AI and chatbots. Bibliometric tools, including BibExcel and CiteSpace, were employed to conduct performance analysis and co-citation network analysis. Results showed that 1320 documents have been identified until 2022 and research on chatbots exploded after 2016. The USA contributed the most publications and the leading journal mainly focused on engineering and science. The co-citation analysis revealed that the development of AI-based chatbots and the related topics can be summarized as user-centered design, implementation techniques, performance requirements, and media type and future directions of AI in chatbots can mainly focus on improvement of technological means, increased demand, and expansion of applications. This study can help researchers have a broader and deeper understanding of AI-based chatbots and provide an insight into aggregate performance in the AI-based chatbot field.

robotics
ChatGPT, AI Advertising, and Advertising Research and Education

Jisu Huh,Michelle R. Nelson,Cristel Antonia Russell

DOI: https://doi.org/10.1080/00913367.2023.2227013

IF: 6.528

2023-07-15

Journal of Advertising

Abstract:Since ChatGPT was released on November 30, 2022, followed by Microsoft's announcement of its artificial intelligence (AI)–powered new Bing search engine on February 7, 2023, and Google's Bard release on March 21, 2023, it seems AI generally has taken over conversations across all sectors of society. In a very short time span, consumers and a wide range of organizations have adopted generative AI technologies with astonishing capabilities (Bove Citation 2023 ). These new technological developments have accelerated the integration of AI into many tools, apps, and areas of our daily life, but the transformative AI technology is perhaps most deeply impacting the world of advertising. AI-enabled advertising spending worldwide in 2022 was estimated to be 1.3 trillion in the next ten years (Statista Citation 2023 ).

communication,business
DataChat: Prototyping a Conversational Agent for Dataset Search and Visualization

Lizhou Fan,Sara Lafia,Lingyao Li,Fangyuan Yang,Libby Hemphill

2023-05-27

Abstract:Data users need relevant context and research expertise to effectively search for and identify relevant datasets. Leading data providers, such as the Inter-university Consortium for Political and Social Research (ICPSR), offer standardized metadata and search tools to support data search. Metadata standards emphasize the machine-readability of data and its documentation. There are opportunities to enhance dataset search by improving users' ability to learn about, and make sense of, information about data. Prior research has shown that context and expertise are two main barriers users face in effectively searching for, evaluating, and deciding whether to reuse data. In this paper, we propose a novel chatbot-based search system, DataChat, that leverages a graph database and a large language model to provide novel ways for users to interact with and search for research data. DataChat complements data archives' and institutional repositories' ongoing efforts to curate, preserve, and share research data for reuse by making it easier for users to explore and learn about available research data.

Information Retrieval,Human-Computer Interaction
ChatGPT vs. Google: A Comparative Study of Search Performance and User Experience

Ruiyun Xu,Yue Feng,Hailiang Chen

2023-07-04

Abstract:The advent of ChatGPT, a large language model-powered chatbot, has prompted questions about its potential implications for traditional search engines. In this study, we investigate the differences in user behavior when employing search engines and chatbot tools for information-seeking tasks. We carry out a randomized online experiment, dividing participants into two groups: one using a ChatGPT-like tool and the other using a Google Search-like tool. Our findings reveal that the ChatGPT group consistently spends less time on all tasks, with no significant difference in overall task performance between the groups. Notably, ChatGPT levels user search performance across different education levels and excels in answering straightforward questions and providing general solutions but falls short in fact-checking tasks. Users perceive ChatGPT's responses as having higher information quality compared to Google Search, despite displaying a similar level of trust in both tools. Furthermore, participants using ChatGPT report significantly better user experiences in terms of usefulness, enjoyment, and satisfaction, while perceived ease of use remains comparable between the two tools. However, ChatGPT may also lead to overreliance and generate or replicate misinformation, yielding inconsistent results. Our study offers valuable insights for search engine management and highlights opportunities for integrating chatbot technologies into search engine designs.

Artificial Intelligence,Human-Computer Interaction,Information Retrieval
Web Search Via an Efficient and Effective Brain-Machine Interface

Xuesong Chen,Ziyi Ye,Xiaohui Xie,Yiqun Liu,Xiaorong Gao,Weihang Su,Shuqi Zhu,Yike Sun,Min Zhang,Shaoping Ma

DOI: https://doi.org/10.1145/3488560.3502185

2021-01-01

Abstract:While search technologies have evolved to be robust and ubiquitous, the fundamental interaction paradigm has remained relatively stable for decades. With the maturity of the Brain-Machine Interface, we build an efficient and effective communication system between human beings and search engines based on electroencephalogram(EEG) signals, called Brain-Machine Search Interface(BMSI) system. The BMSI system provides functions including query reformulation and search result interaction. In our system, users can perform search tasks without having to use the mouse and keyboard. Therefore, it is useful for application scenarios in which hand-based interactions are infeasible, e.g, for users with severe neuromuscular disorders. Besides, based on brain signals decoding, our system can provide abundant and valuable user-side context information(e.g., real-time satisfaction feedback, extensive context information, and a clearer description of information needs) to the search engine, which is hard to capture in the previous paradigm. In our implementation, the system can decode user satisfaction from brain signals in real-time during the interaction process and re-rank the search results list based on user satisfaction feedback. The demo video is available at http://www.thuir.cn/group/YQLiu/datasets/BMSISystem.mp4.
Revolutionizing Search: Artificial Intelligence and Machine Learning's Impact on Information Retrieval

JYOTISMAN MOHARANA -,ADITI BAWANGADE -,YOGESHWARI SAMARTH -,TRUPTI GHATE -,PAYAL GOMASE -

DOI: https://doi.org/10.36948/ijfmr.2023.v05i05.8106

2023-10-29

International Journal For Multidisciplinary Research

Abstract:In today’s world the field of artificial intelligence and machine learning is expanding day by day. The amount of data that is made by humans and machines is difficult to abs orb, analysis and make a complex decision from the data which can be implemented through artificial intelligence and machine learning algorithms. A chatbot is a good example of implementation of AI search engine and machine learning in real world. It can respond to various queries and respond to it accordingly. So, it can be a vital tool for both industrial professionals and regulatory authorities. Such a chatbot can provide quick and accurate information, improving compliance and reducing the time spend on searching for relevant topic.
Rethinking multimedia search in the "clients + cloud" era.

Stefano Ceri,Alessandro Bozzon,Marco Brambilla,Emanuele Della Valle,Piero Fraternali,Silvia Quarteroni

DOI: https://doi.org/10.1145/1631058.1631060

2009-01-01

Abstract:The emergence of cloud computing is presenting us with unprecedented opportunities to redefine how people search for and interact with multimedia on client devices (such as PC, TV, and phone). In this talk, I will introduce some key trends in computing and discuss how these trends are creating both new opportunities and new challenges for large-scale multimedia analysis and search. I will also talk about some of Microsoft's latest research efforts in building a new kind of search engine - one that aims to empower people with knowledge and facilitate their decision making during various online activities.
How to Approach Ambiguous Queries in Conversational Search: A Survey of Techniques, Approaches, Tools, and Challenges

Kimiya Keyvan,Jimmy Xiangji Huang

DOI: https://doi.org/10.1145/3534965

IF: 16.6

2022-12-08

ACM Computing Surveys

Abstract:The advent of recent Natural Language Processing technology has led human and machine interactions more toward conversation. In Conversational Search Systems (CSS) like chatbots and Virtual Personal Assistants such as Apple’s Siri, Amazon Alexa, Microsoft’s Cortana, and Google Assistant, both user and device have a limited platform to communicate through chatting or voice. In the information-seeking process, often users do not know how to properly describe their information need in a machine understandable language. Consequently, it is hard for the assistant agent to predict the user’s intent and yield relevant results by only relying on the original query. Studies have shown many unsatisfactory results can be enhanced with the benefit of CSS, which can dig deeper into the user’s query to reveal the real need. This survey intends to provide a comprehensive and comparative overview of ambiguous query clarification task in the context of conversational search technology. We investigate different approaches, their evaluation methods, and future work. We also address the importance of understanding a query for retrieving the most relevant document(s) and satisfying user’s need by predicting their potential request. This work provides an overview of characteristics of ambiguous queries and contributes to better understanding of the existing technologies and challenges in CSS focus on disambiguation of unclear queries from various dimensions.

computer science, theory & methods
Search Systems and Artificial Intelligence: Enhancing Searching as Learning Approaches to Counter Misinformation

Souvick Ghosh,Jacek Gwizdka,Dirk Lewandowski,Rebecca Reynolds,Soo Young Rieh,Tamara Heck,Aylin Imeri

DOI: https://doi.org/10.1002/pra2.859

2023-10-23

Proceedings of the American Society for Information Science and Technology

Abstract:Proceedings of the Association for Information Science and Technology, Volume 60, Issue 1, Page 775-779, October 2023.
Confucius and its intelligent disciples: integrating social with search

Xiance Si,Edward Y. Chang,Zoltán Gyöngyi,Maosong Sun

DOI: https://doi.org/10.14778/1920841.1921025

2010-01-01

Abstract:Q&A sites continue to flourish as a large number of users rely on them as useful substitutes for incomplete or missing search results. In this paper, we present our experience with developing Confucius, a Google Q&A service launched in 21 countries and four languages by the end of 2009. Confucius employs six data mining subroutines to harness synergy between web search and social networks. We present these subroutines' design goals, algorithms, and their effects on service quality. We also describe techniques for and experience with scaling the subroutines to mine massive data sets.
Future directions for chatbot research: an interdisciplinary research agenda

Asbjørn Følstad,Theo Araujo,Effie Lai-Chong Law,Petter Bae Brandtzaeg,Symeon Papadopoulos,Lea Reis,Marcos Baez,Guy Laban,Patrick McAllister,Carolin Ischen,Rebecca Wald,Fabio Catania,Raphael Meyer von Wolff,Sebastian Hobert,Ewa Luger

DOI: https://doi.org/10.1007/s00607-021-01016-7

2021-10-19

Computing

Abstract:Abstract Chatbots are increasingly becoming important gateways to digital services and information—taken up within domains such as customer service, health, education, and work support. However, there is only limited knowledge concerning the impact of chatbots at the individual, group, and societal level. Furthermore, a number of challenges remain to be resolved before the potential of chatbots can be fully realized. In response, chatbots have emerged as a substantial research area in recent years. To help advance knowledge in this emerging research area, we propose a research agenda in the form of future directions and challenges to be addressed by chatbot research. This proposal consolidates years of discussions at the CONVERSATIONS workshop series on chatbot research. Following a deliberative research analysis process among the workshop participants, we explore future directions within six topics of interest: (a) users and implications, (b) user experience and design, (c) frameworks and platforms, (d) chatbots for collaboration, (e) democratizing chatbots, and (f) ethics and privacy. For each of these topics, we provide a brief overview of the state of the art, discuss key research challenges, and suggest promising directions for future research. The six topics are detailed with a 5-year perspective in mind and are to be considered items of an interdisciplinary research agenda produced collaboratively by avid researchers in the field.

computer science, theory & methods

Bing Chat: The Future of Search Engines?

Conversational assistants in academic libraries: enhancing reference services through Bing Chat

Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based Search Engines

How does AI chat change search behaviors?

Is ChatGPT-like technology going to replace commercial search engines?

ChatGPT-3.5 and Bing Chat in ophthalmology: an updated evaluation of performance, readability, and informative sources

A Survey of Conversational Search

From relevance to intelligence: toward next generation web search.

Assessing the performance of Bing Chat artificial intelligence: Dental exams, clinical guidelines, and patients' frequent questions

The Use of Generative Search Engines for Knowledge Work and Complex Tasks

Exploring the Future Development of Artificial Intelligence (AI) Applications in Chatbots: A Bibliometric Analysis

ChatGPT, AI Advertising, and Advertising Research and Education

DataChat: Prototyping a Conversational Agent for Dataset Search and Visualization

ChatGPT vs. Google: A Comparative Study of Search Performance and User Experience

Web Search Via an Efficient and Effective Brain-Machine Interface

Revolutionizing Search: Artificial Intelligence and Machine Learning's Impact on Information Retrieval

Rethinking multimedia search in the "clients + cloud" era.

How to Approach Ambiguous Queries in Conversational Search: A Survey of Techniques, Approaches, Tools, and Challenges

Search Systems and Artificial Intelligence: Enhancing Searching as Learning Approaches to Counter Misinformation

Confucius and its intelligent disciples: integrating social with search

Future directions for chatbot research: an interdisciplinary research agenda