Chatbots in science: What can ChatGPT do for you?

Milton Pividori

DOI: https://doi.org/10.1038/d41586-024-02630-z

IF: 64.8

2024-08-16

Nature

Abstract:Milton Pividori spent a year and a half studying how best to use ChatGPT in research. Here, he highlights three key lessons. Milton Pividori spent a year and a half studying how best to use ChatGPT in research. Here, he highlights three key lessons.

multidisciplinary sciences

What problem does this paper attempt to address?

ChatGPT turns two: how the AI chatbot has changed scientists' lives

Mariana Lenharo

DOI: https://doi.org/10.1038/d41586-024-03940-y

IF: 64.8

2024-12-03

Nature

Abstract:How many researchers are using the AI tool? Nature gathers data and talks to members of the academic community. How many researchers are using the AI tool? Nature gathers data and talks to members of the academic community.

multidisciplinary sciences
The advantages and limitations of using ChatGPT to enhance technological research

Stephen Rice,Sean R. Crouse,Scott R. Winter,Connor Rice

DOI: https://doi.org/10.1016/j.techsoc.2023.102426

IF: 6.879

2024-03-01

Technology in Society

Abstract:In 2022, OpenAI made a groundbreaking entrance with the release of ChatGPT, a new online chatbot that allows users to interact with the GPT-3.5 language model. Users can ask questions and converse with ChatGPT by typing into a text field similar to direct messaging software. Then, ChatGPT will generate a response. Users can then either respond to ChatGPT, regenerate the previous response, or “like” the response and give feedback. OpenAI improved the program on March 14th, 2023, with the release of GPT 4, which promised better reasoning ability. Both these iterations of ChatGPT have attracted significant attention from researchers due to the software's remarkably enhanced capabilities compared to earlier versions. Due to its inherent value as a research tool, ChatGPT will likely become a permanent fixture, so a thorough evaluation of ethical and professional boundaries is crucial. In this opinion paper, we explore ChatGPT 4.0 by addressing: a) its capabilities, b) its limitations and weaknesses, and c) strategies for fact-checking its output to ensure high-quality responses. Subsequently, the authors delve into the diverse implications of this software and discuss how it can be optimally employed to advance research in technology and various other domains.

social sciences, interdisciplinary,social issues
[Applications, techniques, and best practices for using ChatGPT]

Dorian Garin,Christian Lovis

DOI: https://doi.org/10.53738/REVMED.2024.20.865.557

2024-03-13

Abstract:The future of a machine writing our reports for us could also lead to it carrying out our consultations, a scenario whose relevance is open to debate. Nevertheless, the present offers us new artificial intelligence tools that can support us in our daily activities. The publication in 2017 of Transformers initiated a disruptive revolution by enabling the emergence of major language models, of which ChatGPT is the best known. In view of their growing adoption, the authors felt it would be useful to offer some pragmatic advice on how to improve the use of these tools. In this article, we first look at how ChatGPT works and its potential applications in medicine, before providing a practical guide to using it to get the best results.
Chatting about ChatGPT: how may AI and GPT impact academia and libraries?

Brady D. Lund,Ting Wang

DOI: https://doi.org/10.1108/lhtn-01-2023-0009

2023-02-16

Library Hi Tech News

Abstract:Purpose This paper aims to provide an overview of key definitions related to ChatGPT, a public tool developed by OpenAI, and its underlying technology, Generative Pretrained Transformer (GPT). Design/methodology/approach This paper includes an interview with ChatGPT on its potential impact on academia and libraries. The interview discusses the benefits of ChatGPT such as improving search and discovery, reference and information services; cataloging and metadata generation; and content creation, as well as the ethical considerations that need to be taken into account, such as privacy and bias. Findings ChatGPT has considerable power to advance academia and librarianship in both anxiety-provoking and exciting new ways. However, it is important to consider how to use this technology responsibly and ethically, and to uncover how we, as professionals, can work alongside this technology to improve our work, rather than to abuse it or allow it to abuse us in the race to create new scholarly knowledge and educate future professionals. Originality/value This paper discusses the history and technology of GPT, including its generative pretrained transformer model, its ability to perform a wide range of language-based tasks and how ChatGPT uses this technology to function as a sophisticated chatbot.
ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor

Steven A. Lehr,Aylin Caliskan,Suneragiri Liyanage,Mahzarin R. Banaji

2024-06-21

Abstract:How good a research scientist is ChatGPT? We systematically probed the capabilities of GPT-3.5 and GPT-4 across four central components of the scientific process: as a Research Librarian, Research Ethicist, Data Generator, and Novel Data Predictor, using psychological science as a testing field. In Study 1 (Research Librarian), unlike human researchers, GPT-3.5 and GPT-4 hallucinated, authoritatively generating fictional references 36.0% and 5.4% of the time, respectively, although GPT-4 exhibited an evolving capacity to acknowledge its fictions. In Study 2 (Research Ethicist), GPT-4 (though not GPT-3.5) proved capable of detecting violations like p-hacking in fictional research protocols, correcting 88.6% of blatantly presented issues, and 72.6% of subtly presented issues. In Study 3 (Data Generator), both models consistently replicated patterns of cultural bias previously discovered in large language corpora, indicating that ChatGPT can simulate known results, an antecedent to usefulness for both data generation and skills like hypothesis generation. Contrastingly, in Study 4 (Novel Data Predictor), neither model was successful at predicting new results absent in their training data, and neither appeared to leverage substantially new information when predicting more versus less novel outcomes. Together, these results suggest that GPT is a flawed but rapidly improving librarian, a decent research ethicist already, capable of data generation in simple domains with known characteristics but poor at predicting novel patterns of empirical data to aid future experimentation.

Artificial Intelligence,Computation and Language,Computers and Society,Information Retrieval,Machine Learning
ChatGPT is a Remarkable Tool -- For Experts

Amos Azaria,Rina Azoulay,Shulamit Reches

2023-06-02

Abstract:This paper investigates the capabilities of ChatGPT as an automated assistant in diverse domains, including scientific writing, mathematics, education, programming, and healthcare. We explore the potential of ChatGPT to enhance productivity, streamline problem-solving processes, and improve writing style. Furthermore, we highlight the potential risks associated with excessive reliance on ChatGPT in these fields. These limitations encompass factors like incorrect and fictitious responses, inaccuracies in code, limited logical reasoning abilities, overconfidence, and critical ethical concerns of copyrights and privacy violation. We outline areas and objectives where ChatGPT proves beneficial, applications where it should be used judiciously, and scenarios where its reliability may be limited. In light of observed limitations, and given that the tool's fundamental errors may pose a special challenge for non-experts, ChatGPT should be used with a strategic methodology. By drawing from comprehensive experimental studies, we offer methods and flow charts for effectively using ChatGPT. Our recommendations emphasize iterative interaction with ChatGPT and independent verification of its outputs. Considering the importance of utilizing ChatGPT judiciously and with expertise, we recommend its usage for experts who are well-versed in the respective domains.

Human-Computer Interaction,Artificial Intelligence,Computation and Language,Computers and Society
How ChatGPT is transforming the postdoc experience

Linda Nordling

DOI: https://doi.org/10.1038/d41586-023-03235-8

IF: 64.8

2023-10-17

Nature

Abstract:Around one in three respondents to Nature's global postdoc survey are using AI chatbots to help to refine text, generate or edit code, wrangle the literature in their field and more. Around one in three respondents to Nature's global postdoc survey are using AI chatbots to help to refine text, generate or edit code, wrangle the literature in their field and more.

multidisciplinary sciences
ChatGPT as a Software Development Bot: A Project-based Study

Muhammad Waseem,Teerath Das,Aakash Ahmad,Peng Liang,Mahdi Fehmideh,Tommi Mikkonen

DOI: https://doi.org/10.48550/arXiv.2310.13648

2024-02-23

Abstract:Artificial Intelligence has demonstrated its significance in software engineering through notable improvements in productivity, accuracy, collaboration, and learning outcomes. This study examines the impact of generative AI tools, specifically ChatGPT, on the software development experiences of undergraduate students. Over a three-month project with seven students, ChatGPT was used as a support tool. The research focused on assessing ChatGPT's effectiveness, benefits, limitations, and its influence on learning. Results showed that ChatGPT significantly addresses skill gaps in software development education, enhancing efficiency, accuracy, and collaboration. It also improved participants' fundamental understanding and soft skills. The study highlights the importance of incorporating AI tools like ChatGPT in education to bridge skill gaps and increase productivity, but stresses the need for a balanced approach to technology use. Future research should focus on optimizing ChatGPT's application in various development contexts to maximize learning and address specific challenges.

Software Engineering
Knowledge, Perceptions and Attitude of Researchers Towards Using ChatGPT in Research

Ahmed Samir Abdelhafiz,Asmaa Ali,Ayman Mohamed Maaly,Hany Hassan Ziady,Eman Anwar Sultan,Mohamed Anwar Mahgoub

DOI: https://doi.org/10.1007/s10916-024-02044-4

IF: 4.92

2024-02-29

Journal of Medical Systems

Abstract:ChatGPT, a recently released chatbot from OpenAI, has found applications in various aspects of life, including academic research. This study investigated the knowledge, perceptions, and attitudes of researchers towards using ChatGPT and other chatbots in academic research.

health care sciences & services,medical informatics
AI chatbots can boost scientific coding

Cory Merow,Josep M. Serra-Diaz,Brian J. Enquist,Adam M. Wilson

DOI: https://doi.org/10.1038/s41559-023-02063-3

2023-04-27

Abstract:Chatbots powered by artificial intelligence, such as ChatGPT, are ready to speed up monotonous coding tasks and teach you new skills. We highlight, with worked examples, some advantages and limitations of using generative artificial intelligence for scientific coding and argue that if you are willing to debug, you can get a head start on more challenging tasks.

ecology,evolutionary biology
ChatGPT in Climatology: Transforming Climate Research with Conversational AI

Jacob Fields,Geddy Davis,Zachary Leasor,Jason Cervenec

DOI: https://doi.org/10.46275/joasc.2024.07.001

2024-07-18

Journal of Applied and Service Climatology

Abstract:In recent years, advancements in the field of artificial intelligence have increased exponentially, culminating in widely available user-based tools such as ChatGPT. Although fairly new, these tools have as of yet been underutilized by the scientific community, including climatology. As a large language model, ChatGPT’s strong ability to accurately respond to prompts allows it to be used as a comprehensive tool with a variety of applications in climatology, which this article groups into practical and conceptual applications. Practically, ChatGPT excels in the assistance of code creation and troubleshooting, allowing for efficient automation of data collection, as well as the process of basic data sorting. Conceptually, the tool gives a foundation for researchers to “fill the knowledge gap” by gaining a basic understanding of supplementary information presented in the literature review portion of a research project. While ChatGPT is powerful, it contains significant limitations that hinder its status as a standalone tool, such as occasional inaccurate responses, lack of transparency, and absence of data protection. Despite these setbacks, use of ChatGPT in a responsible and ethical manner with awareness of its limitations can be efficient, dynamic, and adherent to the principles of scientific integrity.
Let's have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitations

Sakib Shahriar,Kadhim Hayawi

DOI: https://doi.org/10.47852/bonviewAIA3202939

2023-08-10

Abstract:The emergence of an AI-powered chatbot that can generate human-like sentences and write coherent essays has caught the world's attention. This paper discusses the historical overview of chatbots and the technology behind Chat Generative Pre-trained Transformer, better known as ChatGPT. Moreover, potential applications of ChatGPT in various domains, including healthcare, education, and research, are highlighted. Despite promising results, there are several privacy and ethical concerns surrounding ChatGPT. In addition, we highlight some of the important limitations of the current version of ChatGPT. We also ask ChatGPT to provide its point of view and present its responses to several questions we attempt to answer.

Computation and Language,Artificial Intelligence
Transformative effects of ChatGPT on modern education: Emerging Era of AI Chatbots

Sukhpal Singh Gill,Minxian Xu,Panos Patros,Huaming Wu,Rupinder Kaur,Kamalpreet Kaur,Stephanie Fuller,Manmeet Singh,Priyansh Arora,Ajith Kumar Parlikad,Vlado Stankovski,Ajith Abraham,Soumya K. Ghosh,Hanan Lutfiyya,Salil S. Kanhere,Rami Bahsoon,Omer Rana,Schahram Dustdar,Rizos Sakellariou,Steve Uhlig,Rajkumar Buyya

DOI: https://doi.org/10.1016/j.iotcps.2023.06.002

2023-06-01

Internet of Things and Cyber-Physical Systems

Abstract:ChatGPT, an AI-based chatbot, offers coherent and useful replies based on analysis of large volumes of data. In this article, leading academics, scientists, distinguish researchers and engineers discuss the transformative effects of ChatGPT on modern education. This research discusses ChatGPT capabilities and its use in the education sector, identifies potential concerns and challenges. Our preliminary evaluation shows that ChatGPT perform differently in different subject areas including finance, coding, maths, and general public queries. While ChatGPT has the ability to help educators by creating instructional content, offering suggestions and acting as an online educator to learners by answering questions, transforming education through smartphones and IoT gadgets, and promoting group work, there are clear drawbacks in its use, such as the possibility of producing inaccurate or false data and circumventing duplicate content (plagiarism) detectors where originality is essential. The often reported “hallucinations” within GenerativeAI in general, and also relevant for ChatGPT, can render its use of limited benefit where accuracy is essential. What ChatGPT lacks is a stochastic measure to help provide sincere and sensitive communication with its users. Academic regulations and evaluation practices used in educational institutions need to be updated, should ChatGPT be used as a tool in education. To address the transformative effects of ChatGPT on the learning environment, educating teachers and students alike about its capabilities and limitations will be crucial.

English Else
Using ChatGPT in the Medical Field: A Narrative

Ali Peksen,Chat GPT

DOI: https://doi.org/10.36519/idcm.2023.227

2023-03-11

Infectious Diseases and Clinical Microbiology

Abstract:This text was written by filtering the response of ChatGPT to our querries. ChatGPT has jumped into many fields including the scientific arena. It seems that there could be benefits of this application, however there is a huge area that could be misused. We optimistically focused on the positive sides to inform our readers, and decided to ask ChatGPT to talk about itself.
ChatGPT: ethical concerns and challenges in academics and research

Ankita Guleria,Kewal Krishan,Vishal Sharma,Tanuj Kanchan

DOI: https://doi.org/10.3855/jidc.18738

2023-09-30

Abstract:Introduction: The emergence of artificial intelligence (AI) has presented several opportunities to ease human work. AI applications are available for almost every domain of life. A new technology, Chat Generative Pre-Trained Transformer (ChatGPT), was introduced by OpenAI in November 2022, and has become a topic of discussion across the world. ChatGPT-3 has brought many opportunities, as well as ethical and privacy considerations. ChatGPT is a large language model (LLM) which has been trained on the events that happened until 2021. The use of AI and its assisted technologies in scientific writing is against research and publication ethics. Therefore, policies and guidelines need to be developed over the use of such tools in scientific writing. The main objective of the present study was to highlight the use of AI and AI assisted technologies such as the ChatGPT and other chatbots in the scientific writing and in the research domain resulting in bias, spread of inaccurate information and plagiarism. Methodology: Experiments were designed to test the accuracy of ChatGPT when used in research and academic writing. Results: The information provided by ChatGPT was inaccurate and may have far-reaching implications in the field of medical science and engineering. Critical thinking should be encouraged among researchers to raise awareness about the associated privacy and ethical risks. Conclusions: Regulations for ethical and privacy concerns related to the use of ChatGPT in academics and research need to be developed.
Ten quick tips for harnessing the power of ChatGPT in computational biology

Tiago Lubiana,Rafael Lopes,Pedro Medeiros,Juan Carlo Silva,Andre Nicolau Aquime Goncalves,Vinicius Maracaja-Coutinho,Helder I. Nakaya

DOI: https://doi.org/10.1371/journal.pcbi.1011319

2023-08-11

PLoS Computational Biology

Abstract:The rise of advanced chatbots, such as ChatGPT, has stirred excitement and curiosity in the scientific community. Powered by large language models (LLMs) based on generative pre-trained transformers (GPTs)—specifically GPT-3.5 and GPT-4—ChatGPT is considered a general-purpose technology with the potential to impact the job market and research endeavors in numerous fields [1]. Although similar models have been fine-tuned for biology-specific projects, including text-based analysis and biological sequence decoding [2,3], ChatGPT provides a natural interface for bioinformaticians to begin using LLMs in their activities. This tool is already accelerating various activities undertaken by computational biologists, ranging from data cleaning to interpreting results and publishing. However, with great power comes great responsibility. As scientists, we must harness the full potential of ChatGPT while adhering to ethical guidelines and avoiding pitfalls associated with the technology. Here, we provide 10 insightful tips designed to help computational biologists optimize their workflows with ChatGPT, ranging from basic prompts to more advanced techniques. Although our primary focus is on the current ChatGPT/GPT-4 model, we believe that these tips will remain relevant for future iterations of the technology, as well as other LLMs and chatbots (such as Meta's LLaMa and Google's Bard) [4,5]. We invite you to explore our 10 tips (summarized in Fig 1) aimed at effectively utilizing ChatGPT to advance computational biology research while maintaining a strong commitment to research integrity.

biochemical research methods,mathematical & computational biology
ChatGPT impacts in programming education: A recent literature overview that debates ChatGPT responses

Christos-Nikolaos Anagnostopoulos

2023-09-26

Abstract:This paper aims at a brief overview of the main impact of ChatGTP in the scientific field of programming and learning/education in computer science. It lists, covers and documents from the literature the major issues that have been identified for this topic, such as applications, advantages and limitations, ethical issues raised. Answers to the above questions were solicited from ChatGPT itself, the responses were collected, and then the recent literature was surveyed to determine whether or not the responses are supported. The paper ends with a short discussion on what is expected to happen in the near future. A future that can be extremely promising if humanity manages to have AI as a proper ally and partner, with distinct roles and specific rules of cooperation and interaction.

Computers and Society
Large language model, AI and scientific research: why ChatGPT is only the beginning

Pietro Zangrossi,Massimo Martini,Francesco Guerrini,Pasquale DE Bonis,Giannantonio Spena,Pietro ZANGROSSI,Massimo MARTINI,Francesco GUERRINI,Pasquale DE BONIS,Giannantonio SPENA

DOI: https://doi.org/10.23736/s0390-5616.23.06171-4

2024-01-01

Journal of Neurosurgical Sciences

Abstract:ChatGPT, a conversational artificial intelligence model based on the generative pre-trained transformer GPT architecture, has garnered widespread attention due to its user-friendly nature and diverse capabilities. This technology enables users of all backgrounds to effortlessly engage in human-like conversations and receive coherent and intelligible responses. Beyond casual interactions, ChatGPT offers compelling prospects for scientific research, facilitating tasks like literature review and content summarization, ultimately expediting and enhancing the academic writing process. Still, in the field of medicine and surgery, it has already shown its endless potential in many tasks (enhancing decision-making processes, aiding in surgical planning and simulation, providing real-time assistance during surgery, improving postoperative care and rehabilitation, contributing to training, education, research, and development). However, it is crucial to acknowledge the model's limitations, encompassing knowledge constraints and the potential for erroneous responses, as well as ethical and legal considerations. This paper explores the potential benefits and pitfalls of these innovative technologies in scientific research, shedding light on their transformative impact while addressing concerns surrounding their use.

surgery,clinical neurology
Use of ChatGPT: What Does It Mean for Biology and Environmental Science?

Evgenios Agathokleous,Costas J Saitanis,Chao Fang,Zhen Yu

DOI: https://doi.org/10.1016/j.scitotenv.2023.164154

IF: 9.8

2023-01-01

The Science of The Total Environment

Abstract:Artificial intelligence (AI) large language models (LLMs) have emerged as important technologies. Recently, ChatGPT (Generative Pre-trained Transformer) has been released and attracted massive interest from the public, owing to its unique capabilities to simplify many daily tasks of people from diverse backgrounds and social statuses. Here, we discuss how ChatGPT (and similar AI technologies) can impact biology and environmental science, providing examples obtained through interactive sessions with ChatGPT. The benefits that ChatGPT offers are ample and can impact many aspects of biology and environmental science, including education, research, scientific publishing, outreach, and societal translation. Among others, ChatGPT can simplify and expedite highly complex and challenging tasks. As an example to illustrate this, we provide 100 important questions for biology and 100 important questions for environmental science. Although ChatGPT offers a plethora of benefits, there are several risks and potential harms associated with its use, which we analyze herein. Awareness of risks and potential harms should be raised. However, understanding and overcoming the current limitations could lead these recent technological advances to push biology and environmental science to their limits.
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education

Ahmed Tlili,Boulus Shehata,Michael Agyemang Adarkwah,Aras Bozkurt,Daniel T. Hickey,Ronghuai Huang,Brighter Agyemang

DOI: https://doi.org/10.1186/s40561-023-00237-x

2023-02-22

Smart Learning Environments

Abstract:Abstract Artificial Intelligence (AI) technologies have been progressing constantly and being more visible in different aspects of our lives. One recent phenomenon is ChatGPT, a chatbot with a conversational artificial intelligence interface that was developed by OpenAI. As one of the most advanced artificial intelligence applications, ChatGPT has drawn much public attention across the globe. In this regard, this study examines ChatGPT in education, among early adopters, through a qualitative instrumental case study. Conducted in three stages, the first stage of the study reveals that the public discourse in social media is generally positive and there is enthusiasm regarding its use in educational settings. However, there are also voices who are approaching cautiously using ChatGPT in educational settings. The second stage of the study examines the case of ChatGPT through lenses of educational transformation, response quality, usefulness, personality and emotion, and ethics. In the third and final stage of the study, the investigation of user experiences through ten educational scenarios revealed various issues, including cheating, honesty and truthfulness of ChatGPT, privacy misleading, and manipulation. The findings of this study provide several research directions that should be considered to ensure a safe and responsible adoption of chatbots, specifically ChatGPT, in education.

English Else

Chatbots in science: What can ChatGPT do for you?

ChatGPT turns two: how the AI chatbot has changed scientists' lives

The advantages and limitations of using ChatGPT to enhance technological research

[Applications, techniques, and best practices for using ChatGPT]

Chatting about ChatGPT: how may AI and GPT impact academia and libraries?

ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor

ChatGPT is a Remarkable Tool -- For Experts

How ChatGPT is transforming the postdoc experience

ChatGPT as a Software Development Bot: A Project-based Study

Knowledge, Perceptions and Attitude of Researchers Towards Using ChatGPT in Research

AI chatbots can boost scientific coding

ChatGPT in Climatology: Transforming Climate Research with Conversational AI

Let's have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitations

Transformative effects of ChatGPT on modern education: Emerging Era of AI Chatbots

Using ChatGPT in the Medical Field: A Narrative

ChatGPT: ethical concerns and challenges in academics and research

Ten quick tips for harnessing the power of ChatGPT in computational biology

ChatGPT impacts in programming education: A recent literature overview that debates ChatGPT responses

Large language model, AI and scientific research: why ChatGPT is only the beginning

Use of ChatGPT: What Does It Mean for Biology and Environmental Science?

What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education