ChatGPT: five priorities for research

Eva A. M. van Dis,Johan Bollen,Willem Zuidema,Robert van Rooij,Claudi L. Bockting

DOI: https://doi.org/10.1038/d41586-023-00288-7

IF: 64.8

2023-02-04

Nature

Abstract:Conversational AI is a game-changer for science. Here's how to respond. Conversational AI is a game-changer for science. Here's how to respond.

multidisciplinary sciences

What problem does this paper attempt to address?

Chatbots in science: What can ChatGPT do for you?

Milton Pividori

DOI: https://doi.org/10.1038/d41586-024-02630-z

IF: 64.8

2024-08-16

Nature

Abstract:Milton Pividori spent a year and a half studying how best to use ChatGPT in research. Here, he highlights three key lessons. Milton Pividori spent a year and a half studying how best to use ChatGPT in research. Here, he highlights three key lessons.

multidisciplinary sciences
ChatGPT in Climatology: Transforming Climate Research with Conversational AI

Jacob Fields,Geddy Davis,Zachary Leasor,Jason Cervenec

DOI: https://doi.org/10.46275/joasc.2024.07.001

2024-07-18

Journal of Applied and Service Climatology

Abstract:In recent years, advancements in the field of artificial intelligence have increased exponentially, culminating in widely available user-based tools such as ChatGPT. Although fairly new, these tools have as of yet been underutilized by the scientific community, including climatology. As a large language model, ChatGPT’s strong ability to accurately respond to prompts allows it to be used as a comprehensive tool with a variety of applications in climatology, which this article groups into practical and conceptual applications. Practically, ChatGPT excels in the assistance of code creation and troubleshooting, allowing for efficient automation of data collection, as well as the process of basic data sorting. Conceptually, the tool gives a foundation for researchers to “fill the knowledge gap” by gaining a basic understanding of supplementary information presented in the literature review portion of a research project. While ChatGPT is powerful, it contains significant limitations that hinder its status as a standalone tool, such as occasional inaccurate responses, lack of transparency, and absence of data protection. Despite these setbacks, use of ChatGPT in a responsible and ethical manner with awareness of its limitations can be efficient, dynamic, and adherent to the principles of scientific integrity.
Large language model, AI and scientific research: why ChatGPT is only the beginning

Pietro Zangrossi,Massimo Martini,Francesco Guerrini,Pasquale DE Bonis,Giannantonio Spena,Pietro ZANGROSSI,Massimo MARTINI,Francesco GUERRINI,Pasquale DE BONIS,Giannantonio SPENA

DOI: https://doi.org/10.23736/s0390-5616.23.06171-4

2024-01-01

Journal of Neurosurgical Sciences

Abstract:ChatGPT, a conversational artificial intelligence model based on the generative pre-trained transformer GPT architecture, has garnered widespread attention due to its user-friendly nature and diverse capabilities. This technology enables users of all backgrounds to effortlessly engage in human-like conversations and receive coherent and intelligible responses. Beyond casual interactions, ChatGPT offers compelling prospects for scientific research, facilitating tasks like literature review and content summarization, ultimately expediting and enhancing the academic writing process. Still, in the field of medicine and surgery, it has already shown its endless potential in many tasks (enhancing decision-making processes, aiding in surgical planning and simulation, providing real-time assistance during surgery, improving postoperative care and rehabilitation, contributing to training, education, research, and development). However, it is crucial to acknowledge the model's limitations, encompassing knowledge constraints and the potential for erroneous responses, as well as ethical and legal considerations. This paper explores the potential benefits and pitfalls of these innovative technologies in scientific research, shedding light on their transformative impact while addressing concerns surrounding their use.

surgery,clinical neurology
ChatGPT turns two: how the AI chatbot has changed scientists' lives

Mariana Lenharo

DOI: https://doi.org/10.1038/d41586-024-03940-y

IF: 64.8

2024-12-03

Nature

Abstract:How many researchers are using the AI tool? Nature gathers data and talks to members of the academic community. How many researchers are using the AI tool? Nature gathers data and talks to members of the academic community.

multidisciplinary sciences
ChatGPT and generative AI are revolutionizing the scientific community: A Janus-faced conundrum

Zhongji Pu,Chun-Lin Shi,Che Ok Jeon,Jingyuan Fu,Shuang-Jiang Liu,Canhui Lan,Yanlai Yao,Yong-Xin Liu,Baolei Jia

DOI: https://doi.org/10.1002/imt2.178

2024-02-27

iMeta

Abstract:The advent of generative artificial intelligence (AI) technologies marks a transformative moment for the scientific sphere, unlocking novel avenues to elevate scientific writing's efficiency and quality, expedite insight discovery, and enhance code development processes. Essential to leveraging these advancements is prompt engineering, a method that enhances AI interaction efficiency and quality. Despite its benefits, effective application requires blending researchers' expertise with AI, avoiding overreliance. A balanced strategy of integrating AI with independent critical thinking ensures the advancement and quality of scientific research, leveraging innovation while maintaining research integrity.
Et Machina: Exploring the Use of Conversational Agents Such as ChatGPT in Scientific Writing

F. Michahelles,Khaled Kassem

Abstract:Background: Advancements in natural language processing have led to the development of powerful language models like ChatGPT, capable of generating coherent text with minimal human input. While the potential for using ChatGPT in scientific paper writing is of growing interest, its full potential and usefulness remain unexplored. Method: We investigated the use of ChatGPT to write scientific papers on the topic of conversational agents in scientific writing. ChatGPT served as a tool to facilitate scientific writing, and we evaluated the quality, factuality, and coherence of the generated text. In this paper, we include information about the generation, processing, or adjustments made to the text in differently-colored blocks. ∗ Position: We argue that large-scale trained conversational agents like ChatGPT can generate concise, grammatically correct, and well-structured text. However, occasional errors in factual accuracy, clarity, and scientific rigor were observed. We acknowledge the potential of ChatGPT and similar models as tools for generating initial drafts of scientific work. Conclusion: ChatGPT demonstrates promise as a scientific writing tool, but unsupervised use in this context is not yet recommended. Further research is necessary to enhance the accuracy and scientific validity of the generated text. Researchers should exercise caution and view ChatGPT as a complement to human writing rather than a replacement. We provide key recommendations for using conversational agents in scientific writing, including human oversight and training the model on scientific literature and unbiased data. By utilizing AI in the authorship process, we present an example of how AI involvement can be reported.

Biology,Computer Science
The advantages and limitations of using ChatGPT to enhance technological research

Stephen Rice,Sean R. Crouse,Scott R. Winter,Connor Rice

DOI: https://doi.org/10.1016/j.techsoc.2023.102426

IF: 6.879

2024-03-01

Technology in Society

Abstract:In 2022, OpenAI made a groundbreaking entrance with the release of ChatGPT, a new online chatbot that allows users to interact with the GPT-3.5 language model. Users can ask questions and converse with ChatGPT by typing into a text field similar to direct messaging software. Then, ChatGPT will generate a response. Users can then either respond to ChatGPT, regenerate the previous response, or “like” the response and give feedback. OpenAI improved the program on March 14th, 2023, with the release of GPT 4, which promised better reasoning ability. Both these iterations of ChatGPT have attracted significant attention from researchers due to the software's remarkably enhanced capabilities compared to earlier versions. Due to its inherent value as a research tool, ChatGPT will likely become a permanent fixture, so a thorough evaluation of ethical and professional boundaries is crucial. In this opinion paper, we explore ChatGPT 4.0 by addressing: a) its capabilities, b) its limitations and weaknesses, and c) strategies for fact-checking its output to ensure high-quality responses. Subsequently, the authors delve into the diverse implications of this software and discuss how it can be optimally employed to advance research in technology and various other domains.

social sciences, interdisciplinary,social issues
Transforming Conversations with AI—A Comprehensive Study of ChatGPT

Gaurang Bansal,Vinay Chamola,Amir Hussain,Mohsen Guizani,Dusit Niyato

DOI: https://doi.org/10.1007/s12559-023-10236-2

IF: 4.89

2024-01-25

Cognitive Computation

Abstract:The field of cognitive computing, conversational AI has witnessed remarkable progress, largely driven by the development of the Generative Pre-trained Transformer (GPT) series, notably ChatGPT. These transformer-based models have revolutionized natural language understanding by effectively capturing context and long-range dependencies. In light of this, this paper conducts a comprehensive exploration of ChatGPT, encompassing its architectural design, training methodology, real-world applications, and future potential within the conversational AI landscape. The paper studies the ChatGPT ability for advanced control and responsiveness, exhibiting a superior capacity for comprehending language and generating precise, informative responses. The comprehensive survey depicts ChatGPT excels in sustaining context and engaging in multi-turn dialogues, thereby fostering more interactive and meaningful conversations. Furthermore, its adaptability for integration into various systems and scalability has broadened its applicability across diverse domains, including customer service, education, content generation, healthcare, gaming, research, and exploration. Additionally, the paper presents alternative conversational AI models, such as Amazon Codewhisperer, Google Bard (LaMDA), Microsoft Bing AI, DeepMind Sparrow, and Character AI, providing a comparative analysis that underscores ChatGPT's advantages in terms of inference capabilities and future promise. Recognizing the evolution and profound impact of ChatGPT holds paramount significance for researchers and developers at the forefront of AI innovation. In a rapidly evolving conversational AI landscape, ChatGPT emerges as a pivotal player, capable of reshaping the way we interact with AI systems across a wide array of applications.

computer science, artificial intelligence,neurosciences
ChatGPT's Role in Gerontology Research

Christopher N Kaufmann,Chen Bai,Brianne Borgia,Christiaan Leeuwenburgh,Yi Lin,Mamoun T Mardini,Taylor McElroy,Clayton W Swanson,Keon D Wimberly,Ruben Zapata,Rola S Zeidan,Todd M Manini

DOI: https://doi.org/10.1093/gerona/glae184

2024-07-24

Abstract:Background: ChatGPT and other ChatBots have emerged as tools for interacting with information in manners resembling natural human speech. Consequently, the technology is used across various disciplines, including business, education, and even in biomedical sciences. There is a need to better understand how ChatGPT can be used to advance gerontology research. Therefore, we evaluated ChatGPT responses to questions on specific topics in gerontology research, and brainstormed recommendations for its use in the field. Methods: We conducted semi-structured brainstorming sessions to identify uses of ChatGPT in gerontology research. We divided a team of multidisciplinary researchers into four topical groups: a) gero-clinical science, b) basic geroscience, c) informatics as it relates to electronic health records (EHR), and d) gero-technology. Each group prompted ChatGPT on a theory-, methods-, and interpretation-based question and rated responses for accuracy and completeness based on standardized scales. Results: ChatGPT responses were rated by all groups as generally accurate. However, the completeness of responses was rated lower, except by members of the informatics group, who rated responses as highly comprehensive. Conclusions: ChatGPT accurately depicts some major concepts in gerontological research. However, researchers have an important role in critically appraising the completeness of its responses. Having a single generalized resource like ChatGPT may help summarize the preponderance of evidence in the field to identify gaps in knowledge and promote cross-disciplinary collaboration.
Tracking ChatGPT Research: Insights From the Literature and the Web

Omar Mubin,Fady Alnajjar,Zouheir Trabelsi,Luqman Ali,Medha Mohan Ambali Parambil,Zhao Zou

DOI: https://doi.org/10.1109/access.2024.3356584

IF: 3.9

2024-03-06

IEEE Access

Abstract:This article presents a scientometric and literature analysis of current research on ChatGPT, a conversational AI technology developed by OpenAI. Using various databases, 103 relevant articles were retrieved and analyzed through scientometric, quantitative, and application-based approaches. A Google trend analysis and comparison with other generative AI and chatbot technologies were also carried out. The study provides insights into the distribution of ChatGPT publications across different countries and regions, the network of co-occurring keywords, authorship analysis, article typology, and publishing entities. The findings offer a comprehensive overview of the current state of ChatGPT research, highlighting key directions for future research. The study finds that ChatGPT has gained significant attention and interest in online platforms, particularly in technology, education, and healthcare, and highlights potential ethical and legal concerns related to its use. Its applications extend to several literary and text generation areas. We do note that the sample of extracted publications is lower than anticipated due to the niche area of investigation. The article is relevant to researchers, practitioners, and policymakers interested in the field of AI-powered language models, especially ChatGPT.

computer science, information systems,telecommunications,engineering, electrical & electronic
The Role of ChatGPT in Data Science: How AI-Assisted Conversational Interfaces Are Revolutionizing the Field

Hossein Hassani,Emmanuel Sirmal Silva

DOI: https://doi.org/10.3390/bdcc7020062

2023-03-27

Big Data and Cognitive Computing

Abstract:ChatGPT, a conversational AI interface that utilizes natural language processing and machine learning algorithms, is taking the world by storm and is the buzzword across many sectors today. Given the likely impact of this model on data science, through this perspective article, we seek to provide an overview of the potential opportunities and challenges associated with using ChatGPT in data science, provide readers with a snapshot of its advantages, and stimulate interest in its use for data science projects. The paper discusses how ChatGPT can assist data scientists in automating various aspects of their workflow, including data cleaning and preprocessing, model training, and result interpretation. It also highlights how ChatGPT has the potential to provide new insights and improve decision-making processes by analyzing unstructured data. We then examine the advantages of ChatGPT’s architecture, including its ability to be fine-tuned for a wide range of language-related tasks and generate synthetic data. Limitations and issues are also addressed, particularly around concerns about bias and plagiarism when using ChatGPT. Overall, the paper concludes that the benefits outweigh the costs and ChatGPT has the potential to greatly enhance the productivity and accuracy of data science workflows and is likely to become an increasingly important tool for intelligence augmentation in the field of data science. ChatGPT can assist with a wide range of natural language processing tasks in data science, including language translation, sentiment analysis, and text classification. However, while ChatGPT can save time and resources compared to training a model from scratch, and can be fine-tuned for specific use cases, it may not perform well on certain tasks if it has not been specifically trained for them. Additionally, the output of ChatGPT may be difficult to interpret, which could pose challenges for decision-making in data science applications.

English Else
ChatGPT and Medical Research: A Meta-Synthesis of Opportunities and Challenges

Ahmad Keykha,Sara Behravesh,Fereshteh Ghaemi

DOI: https://doi.org/10.30476/JAMP.2024.101068.1910

2024-07-01

Abstract:Introduction: The utility of ChatGPT in research is ambiguous, serving as both a boon and bane and presenting challenges and opportunities. Accordingly, this study aimed to delineate the merits and demerits of ChatGPT within the realm of research. Methods: A meta-synthesis methodology involving a seven-step process was adopted to pursue the research objectives. Data were collected from comprehensive studies across specialized research databases, such as Science Direct, Springer, Eric, Emerald, Sage Journals, Wiley Online Library, PubMed, and Google Scholar, within the time frame spanning from 2022 to 2023. A total of 57 articles were meticulously chosen for analysis through judgmental sampling. Subsequently, key concepts were distilled from these articles and categorized using the thematic analysis approach while considering Karl Llewellyn's octagonal model from 1963. Results: The outcomes underwent scrutiny employing the thematic analysis strategy devised by Wolcott. The results about the capabilities and constraints of ChatGPT encompass eight dimensions, including formulating the research problem, reviewing relevant literature, selecting an appropriate research design, defining the population and choosing the sample, collecting data, analyzing data, interpreting data, and discussing and drawing conclusions. The credibility of these dimensions was substantiated through adherence to the criteria established by Lincoln and Guba. Conclusion: ChatGPT manifests myriad potentialities and constraints within the research purview based on the results. In light of the expeditious progression of artificial intelligence across multifarious domains, integrating this technological paradigm in research becomes an inexorable imperative, and excluding its use in research is untenable. Thus, policymakers and higher education strategists should devise policies that harness ChatGPT's potential in research endeavors, engendering many opportunities.
How generative artificial intelligence portrays science: Interviewing ChatGPT from the perspective of different audience segments

Sophia Charlotte Volk,Mike S Schäfer,Damiano Lombardi,Daniela Mahl,Xiaoyue Yan

DOI: https://doi.org/10.1177/09636625241268910

2024-09-29

Abstract:Generative artificial intelligence in general and ChatGPT in particular have risen in importance. ChatGPT is widely known and used increasingly as an information source for different topics, including science. It is therefore relevant to examine how ChatGPT portrays science and science-related issues. Research on this question is lacking, however. Hence, we simulate "interviews" with ChatGPT and reconstruct how it presents science, science communication, scientific misbehavior, and controversial scientific issues. Combining qualitative and quantitative content analysis, we find that, generally, ChatGPT portrays science largely as the STEM disciplines, in a positivist-empiricist way and a positive light. When comparing ChatGPT's responses to different simulated user profiles and responses from the GPT-3.5 and GPT-4 versions, we find similarities in that the scientific consensus on questions such as climate change, COVID-19 vaccinations, or astrology is consistently conveyed across them. Beyond these similarities in substance, however, pronounced differences are found in the personalization of responses to different user profiles and between GPT-3.5 and GPT-4.
A Chat(GPT) about the future of scientific publishing

Elisa L. Hill-Yardin,Mark R. Hutchinson,Robin Laycock,Sarah J. Spencer

DOI: https://doi.org/10.1016/j.bbi.2023.02.022

2023-03-05

Abstract:Brain Behav Immun . 2023 Mar 1:S0889-1591(23)00053-3. doi: 10.1016/j.bbi.2023.02.022. Online ahead of print. NO

immunology,neurosciences,psychiatry
ChatGPT impacts in programming education: A recent literature overview that debates ChatGPT responses

Christos-Nikolaos Anagnostopoulos

2023-09-26

Abstract:This paper aims at a brief overview of the main impact of ChatGTP in the scientific field of programming and learning/education in computer science. It lists, covers and documents from the literature the major issues that have been identified for this topic, such as applications, advantages and limitations, ethical issues raised. Answers to the above questions were solicited from ChatGPT itself, the responses were collected, and then the recent literature was surveyed to determine whether or not the responses are supported. The paper ends with a short discussion on what is expected to happen in the near future. A future that can be extremely promising if humanity manages to have AI as a proper ally and partner, with distinct roles and specific rules of cooperation and interaction.

Computers and Society
How ChatGPT is transforming the postdoc experience

Linda Nordling

DOI: https://doi.org/10.1038/d41586-023-03235-8

IF: 64.8

2023-10-17

Nature

Abstract:Around one in three respondents to Nature's global postdoc survey are using AI chatbots to help to refine text, generate or edit code, wrangle the literature in their field and more. Around one in three respondents to Nature's global postdoc survey are using AI chatbots to help to refine text, generate or edit code, wrangle the literature in their field and more.

multidisciplinary sciences
Leveraging ChatGPT for Effective Research Design and Data Analysis — An Example with Research on Short Video Addiction

Mengchan Zhang,Kehui Wu,Mi Kang

DOI: https://doi.org/10.58896/aja.v2i1.3

2024-01-01

Abstract:Artificial intelligence, particularly advanced models like ChatGPT, offers significant enhancements in data processing efficiency, decision-making velocity, and precision across various domains. This study explores the transformative potential of ChatGPT within mixed methods research, emphasizing its integration into the exploratory sequential design against a backdrop of increasing reliance on AI in academic settings. Focusing on short video addiction as a research topic, this research employed ChatGPT to develop a qualitative research framework and refine interview outlines before utilizing it to design quantitative research instruments informed by qualitative insights. Results indicate that ChatGPT not only streamlined data collection, analysis, and interpretation but also emphasized the need for human oversight to interpret AI outputs and ensure data privacy. Conclusively, while ChatGPT significantly enhances the efficiency and depth of research methodologies, it also highlights the challenges of maintaining ethical standards and methodological integrity. Continuous refinement and responsible integration of AI tools like ChatGPT are essential to advance methodological sophistication and ensure the reliability of research findings.
Rise of ChatGPT and other tools raises major questions for research

Simon Baker

DOI: https://doi.org/10.1038/d41586-024-02984-4

IF: 64.8

2024-09-19

Nature

Abstract:AI is changing the way researchers work forever, but human expertise must continue to hold sway. AI is changing the way researchers work forever, but human expertise must continue to hold sway.

multidisciplinary sciences
A Comprehensive Survey of ChatGPT: Advancements, Applications, Prospects, and Challenges

Anam Nazir,Ze Wang

DOI: https://doi.org/10.1016/j.metrad.2023.100022

Abstract:Large Language Models (LLMs) especially when combined with Generative Pre-trained Transformers (GPT) represent a groundbreaking in natural language processing. In particular, ChatGPT, a state-of-the-art conversational language model with a user-friendly interface, has garnered substantial attention owing to its remarkable capability for generating human-like responses across a variety of conversational scenarios. This survey offers an overview of ChatGPT, delving into its inception, evolution, and key technology. We summarize the fundamental principles that underpin ChatGPT, encompassing its introduction in conjunction with GPT and LLMs. We also highlight the specific characteristics of GPT models with details of their impressive language understanding and generation capabilities. We then summarize applications of ChatGPT in a few representative domains. In parallel to the many advantages that ChatGPT can provide, we discuss the limitations and challenges along with potential mitigation strategies. Despite various controversial arguments and ethical concerns, ChatGPT has drawn significant attention from research industries and academia in a very short period. The survey concludes with an envision of promising avenues for future research in the field of ChatGPT. It is worth noting that knowing and addressing the challenges faced by ChatGPT will mount the way for more reliable and trustworthy conversational agents in the years to come.

ChatGPT: five priorities for research

Chatbots in science: What can ChatGPT do for you?

ChatGPT in Climatology: Transforming Climate Research with Conversational AI

Large language model, AI and scientific research: why ChatGPT is only the beginning

ChatGPT turns two: how the AI chatbot has changed scientists' lives

ChatGPT and generative AI are revolutionizing the scientific community: A Janus-faced conundrum

Et Machina: Exploring the Use of Conversational Agents Such as ChatGPT in Scientific Writing

The advantages and limitations of using ChatGPT to enhance technological research

Transforming Conversations with AI—A Comprehensive Study of ChatGPT

ChatGPT's Role in Gerontology Research

Tracking ChatGPT Research: Insights From the Literature and the Web

The Role of ChatGPT in Data Science: How AI-Assisted Conversational Interfaces Are Revolutionizing the Field

ChatGPT and Medical Research: A Meta-Synthesis of Opportunities and Challenges

How generative artificial intelligence portrays science: Interviewing ChatGPT from the perspective of different audience segments

A Chat(GPT) about the future of scientific publishing

ChatGPT impacts in programming education: A recent literature overview that debates ChatGPT responses

How ChatGPT is transforming the postdoc experience

Leveraging ChatGPT for Effective Research Design and Data Analysis — An Example with Research on Short Video Addiction

Rise of ChatGPT and other tools raises major questions for research

A Comprehensive Survey of ChatGPT: Advancements, Applications, Prospects, and Challenges