Can AI be used to assess research quality?

Jackson Ryan

DOI: https://doi.org/10.1038/d41586-024-02989-z

IF: 64.8

2024-09-19

Nature

Abstract:Chatbots and other tools are increasingly being considered, but people power is still seen as a safer option. Chatbots and other tools are increasingly being considered, but people power is still seen as a safer option.

multidisciplinary sciences

What problem does this paper attempt to address?

Evaluating Quality of Chatbots and Intelligent Conversational Agents

Nicole M. Radziwill,Morgan C. Benton

DOI: https://doi.org/10.48550/arXiv.1704.04579

2017-04-15

Abstract:Chatbots are one class of intelligent, conversational software agents activated by natural language input (which can be in the form of text, voice, or both). They provide conversational output in response, and if commanded, can sometimes also execute tasks. Although chatbot technologies have existed since the 1960s and have influenced user interface development in games since the early 1980s, chatbots are now easier to train and implement. This is due to plentiful open source code, widely available development platforms, and implementation options via Software as a Service (SaaS). In addition to enhancing customer experiences and supporting learning, chatbots can also be used to engineer social harm - that is, to spread rumors and misinformation, or attack people for posting their thoughts and opinions online. This paper presents a literature review of quality issues and attributes as they relate to the contemporary issue of chatbot development and implementation. Finally, quality assessment approaches are reviewed, and a quality assessment method based on these attributes and the Analytic Hierarchy Process (AHP) is proposed and examined.

Computers and Society,Software Engineering
On the use of AI-based tools like ChatGPT to support management research

Bastian Burger,Dominik K. Kanbach,Sascha Kraus,Matthias Breier,Vincenzo Corvello

DOI: https://doi.org/10.1108/ejim-02-2023-0156

IF: 5.1

2023-04-08

European Journal of Innovation Management

Abstract:Purpose The article discusses the current relevance of artificial intelligence (AI) in research and how AI improves various research methods. This article focuses on the practical case study of systematic literature reviews (SLRs) to provide a guideline for employing AI in the process. Design/methodology/approach Researchers no longer require technical skills to use AI in their research. The recent discussion about using Chat Generative Pre-trained Transformer (GPT), a chatbot by OpenAI, has reached the academic world and fueled heated debates about the future of academic research. Nevertheless, as the saying goes, AI will not replace our job; a human being using AI will. This editorial aims to provide an overview of the current state of using AI in research, highlighting recent trends and developments in the field. Findings The main result is guidelines for the use of AI in the scientific research process. The guidelines were developed for the literature review case but the authors believe the instructions provided can be adjusted to many fields of research, including but not limited to quantitative research, data qualification, research on unstructured data, qualitative data and even on many support functions and repetitive tasks. Originality/value AI already has the potential to make researchers' work faster, more reliable and more convenient. The authors highlight the advantages and limitations of AI in the current time, which should be present in any research utilizing AI. Advantages include objectivity and repeatability in research processes that currently are subject to human error. The most substantial disadvantages lie in the architecture of current general-purpose models, which understanding is essential for using them in research. The authors will describe the most critical shortcomings without going into technical detail and suggest how to work with the shortcomings daily.

management,business
Attitudes and perceptions of medical researchers towards the use of artificial intelligence chatbots in the scientific process: an international cross-sectional survey

Jeremy Y Ng,Sharleen G Maduranayagam,Nirekah Suthakar,Amy Li,Cynthia Lokker,Alfonso Iorio,R Brian Haynes,David Moher

DOI: https://doi.org/10.1016/s2589-7500(24)00202-4

IF: 36.615

2024-11-24

The Lancet Digital Health

Abstract:Summary Chatbots are artificial intelligence (AI) programs designed to simulate conversations with humans that present opportunities and challenges in scientific research. Despite growing clarity from publishing organisations on the use of AI chatbots, researchers' perceptions remain less understood. In this international cross-sectional survey, we aimed to assess researchers' attitudes, familiarity, perceived benefits, and limitations related to AI chatbots. Our online survey was open from July 9 to Aug 11, 2023, with 61 560 corresponding authors identified from 122 323 articles indexed in PubMed. 2452 (4·0%) provided responses and 2165 (94·5%) of 2292 who met eligibility criteria completed the survey. 1161 (54·0%) of 2149 respondents were male and 959 (44·6%) were female. 1294 (60·5%) of 2138 respondents were familiar with AI chatbots, and 945 (44·5%) of 2125 had previously used AI chatbots in research. Only 244 (11·4%) of 2137 reported institutional training on AI tools, and 211 (9·9%) of 2131 noted institutional policies on AI chatbot use. Despite mixed opinions on the benefits, 1428 (69·7%) of 2048 expressed interest in further training. Although many valued AI chatbots for reducing administrative workload (1299 [66·9%] of 1941), there was insufficient understanding of the decision making process (1484 [77·2%] of 1923). Overall, this study highlights substantial interest in AI chatbots among researchers, but also points to the need for more formal training and clarity on their use.

medicine, general & internal,medical informatics
Can linguists distinguish between ChatGPT/AI and human writing?: A study of research ethics and academic publishing

J. Elliott Casal,Matthew Kessler,Matt Kessler

DOI: https://doi.org/10.1016/j.rmal.2023.100068

2023-12-01

Research Methods in Applied Linguistics

Abstract:There has been considerable intrigue surrounding the use of Large Language Model powered AI chatbots such as ChatGPT in research, educational contexts, and beyond. However, most studies have explored such tools’ general capabilities and applications for language teaching purposes. The current study advances this discussion to examine issues pertaining to human judgements, accuracy, and research ethics. Specifically, we investigate: 1) the extent to which linguists/reviewers from top journals can distinguish AI- from human-generated writing, 2) what the basis of reviewers’ decisions are, and 3) the extent to which editors of top Applied Linguistics journals believe AI tools are ethical for research purposes. In the study, reviewers (N = 72) completed a judgement task involving AI- and human-generated research abstracts, and several reviewers participated in follow-up interviews to explain their rationales. Similarly, editors (N = 27) completed a survey and interviews to discuss their beliefs. Findings suggest that despite employing multiple rationales to judge texts, reviewers were largely unsuccessful in identifying AI versus human writing, with an overall positive identification rate of only 38.9%. Additionally, many editors believed there are ethical uses of AI tools for facilitating research processes, yet some disagreed. Future research directions are discussed involving AI tools and academic publishing.

English Else
The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation

Zuheir N Khlaif,Allam Mousa,Muayad Kamal Hattab,Jamil Itmazi,Amjad A Hassan,Mageswaran Sanmugam,Abedalkarim Ayyoub

DOI: https://doi.org/10.2196/47049

2023-09-14

Abstract:Background: Artificial intelligence (AI) has many applications in various aspects of our daily life, including health, criminal, education, civil, business, and liability law. One aspect of AI that has gained significant attention is natural language processing (NLP), which refers to the ability of computers to understand and generate human language. Objective: This study aims to examine the potential for, and concerns of, using AI in scientific research. For this purpose, high-impact research articles were generated by analyzing the quality of reports generated by ChatGPT and assessing the application's impact on the research framework, data analysis, and the literature review. The study also explored concerns around ownership and the integrity of research when using AI-generated text. Methods: A total of 4 articles were generated using ChatGPT, and thereafter evaluated by 23 reviewers. The researchers developed an evaluation form to assess the quality of the articles generated. Additionally, 50 abstracts were generated using ChatGPT and their quality was evaluated. The data were subjected to ANOVA and thematic analysis to analyze the qualitative data provided by the reviewers. Results: When using detailed prompts and providing the context of the study, ChatGPT would generate high-quality research that could be published in high-impact journals. However, ChatGPT had a minor impact on developing the research framework and data analysis. The primary area needing improvement was the development of the literature review. Moreover, reviewers expressed concerns around ownership and the integrity of the research when using AI-generated text. Nonetheless, ChatGPT has a strong potential to increase human productivity in research and can be used in academic writing. Conclusions: AI-generated text has the potential to improve the quality of high-impact research articles. The findings of this study suggest that decision makers and researchers should focus more on the methodology part of the research, which includes research design, developing research tools, and analyzing data in depth, to draw strong theoretical and practical implications, thereby establishing a revolution in scientific research in the era of AI. The practical implications of this study can be used in different fields such as medical education to deliver materials to develop the basic competencies for both medicine students and faculty members.
Chatbots in Education and Research: A Critical Examination of Ethical Implications and Solutions

Chokri Kooli

DOI: https://doi.org/10.3390/su15075614

IF: 3.9

2023-03-24

Sustainability

Abstract:A new era of education and research based on chatbots and artificial intelligence is quickly growing. However, the application of these new systems is associated with several challenges and limitations, mainly related to ethics. This paper explores the potential use of AI systems and chatbots in the academic field and their impact on research and education from an ethical perspective. Through a qualitative methodology, the researcher perform exploratory research and data collection based on expert analysis and interpretation. The researcher conducted a comprehensive review of the main potential challenges associated with the use of chatbots in education and research to identify current practices, challenges, and opportunities. This explorative work provides a foundational understanding of the studied topic. It also helps us to better understand the subjective experiences and perspectives of the observed phenomenon, and uncovers their meanings and proposes potential solutions to the observed issues. This study examines the advantages and limitations of AI systems and chatbots, as well as their role in supporting human expertise and judgment. The paper also discusses the ethical challenges related to the use of AI systems and chatbots in research, as well as the potential for misuse and exploitation. It also proposes effective solutions to the observed ethical dilemmas. The research admits that we live in a new era of AI-based education and research. The observed technological advancements will definitely shift research processes and transform educative systems, especially in term of assessments. Digital assessments are going to disappear and assessment methods need to be more creative and innovative. The paper highlights the necessity of adaptation to the new reality of AI systems and chatbots. Co-living, sustainability and continuous adaptation to the development of these systems will become a matter of emergency. Raising awareness, adopting appropriate legislations and solidifying ethical values will strengthen research and protect educational systems. The presence of AI systems and chatbots in education needs to be considered as an opportunity for development rather than a threat.

environmental sciences,environmental studies,green & sustainable science & technology
Robo academic advisor: Can chatbots and artificial intelligence replace human interaction?

Mohammed Muneerali Thottoli,Badria Hamed Alruqaishi,Arockiasamy Soosaimanickam

DOI: https://doi.org/10.30935/cedtech/13948

2024-01-01

Contemporary Educational Technology

Abstract:Purpose : Chatbots and artificial intelligence (AI) have the potential to alleviate some of the challenges faced by humans. Faculties frequently swamped with teaching and research may find it difficult to act in a parental role for students by offering them individualized advice. Hence, the primary purpose of this study is to review the literature on chatbots and AI in light of their role in auto-advising systems. The authors aimed to gain insights into the most pertinent topics and concerns related to robo academic advisor and identify any gaps in the literature that could serve as potential avenues for further research. Design/methodology/approach: The research employs a systematic literature review and bibliometric techniques to find 67 primary papers that have been published between 1984 and 2023. Using the Scopus database, the researchers built a summary of the literature on chatbots and AI in academic advice. Findings: Chatbot applications can be a promising approach to address the challenges of balancing personalized student advising with automation. More empirical research is required, especially on chatbots and other AI-based advising systems, to understand their effectiveness and how they can be integrated into educational settings. Research limitations/implications: This research’s sample size may restrict its findings’ generalizability. Furthermore, the study’s focus on chatbots may overlook the potential benefits of other AI technologies in enhancing robo academic advising systems. Future research could explore the impact of robo academic advisors in diverse societal backgrounds to gain a more comprehensive understanding of their implications. Practical implications: Higher educational institutions (HEIs) should establish a robo academic advising system that serves various stakeholders. The system’s chatbots and AI features must be user-friendly, considering the customers’ familiarity with robots. Originality/value: This study contributes to a better understanding of HEIs’ perceptions of the adoption of chatbots and AI in academic advising by providing insightful information about the main forces behind robo academic advising, illuminating the most frequently studied uses of chatbots and AI in academic advising.
Mini review on the ethical use of AI bots in academic writing

Kwong Siew Shia John,Siti Nooraishah Hussin,Rosmadi Mohd Yusoff,Nik Ateerah Rasheeda Mohd Rocky,Mohd Nasrom Mohd Nawi,Sharifah Salmah Syed Hussain,Siti Syairah Mohd Mutalip

DOI: https://doi.org/10.24191/ijelhe.v19n2.1924

2024-03-31

Abstract:Academic writing is a specialised form of written communication that prioritizes accuracy and innovation to effectively convey knowledge. Internet bots, such as Grammarly, Quillbot, TextCortex, and ChatGPT, are commonly used to improve academic writing, particularly essays. However, AI bot-generated text has become a concern to educational institutions with academic integrity, as fabricated abstracts have been accepted through peer review processes. AI bots can generate texts, based on a given topic or keyword, leading to plagiarism accusations and misrepresentations of research findings. Researchers should always verify the accuracy and use of correct technical terms for their research write-up. Additionally, relying too heavily on AI-generated texts may result in a lack of creativity and originality, which is important in scientific writing and young scientist grooming. To address these ethical issues, OpenAI has developed a free tool called AI text Classifier13 to distinguish between AI-written and human-written texts. However, this tool has been described as an ‘imperfect tool’ by OpenAI, warning that it should not be used as a primary decision-making tool. Academic and research institutions must accept the revolution of generative AI tools in academic writing, as it is not sustainable to ban or deny it. AI tools can be efficient and time-saving for both lecturers and students, but acknowledging AI tools should be included in academic integrity policies. Additionally, institutions with current assessment methods based on written essays may need to change from accessing finished essays to assessing critical thinking through additional oral examinations.
Artificial Intelligence - A Help or Hindrance to Scientific Writing?

Philipp Kron,Shahid Farid,Sharib Ali,Peter Lodge

DOI: https://doi.org/10.1097/SLA.0000000000006464

2024-08-01

Abstract:We have assessed the chatbot Generative Pre-trained Transformer (ChatGPT), a type of Artificial Intelligence (AI) software designed to simulate conversations with human users, in an experiment designed to test its relevance to scientific writing. ChatGPT could become a promising and powerful tool for tasks such as automated draft generation, which may be useful in academic activities to make writing work faster and easier. However, the use of this tool in scientific writing raises some ethical concerns and therefore there have been calls for it to be regulated. It may be difficult to recognise whether an abstract or paper is written by a chatbot or a human being, because chatbots use advanced techniques, such as natural language processing and machine learning, to generate text that is similar to human writing. To detect the author is a complex task and requires thorough critical reading to reach a conclusion. The aim of this paper is, therefore, to explore the pros and cons of the use of chatbots in scientific writing.
Can AI serve as a substitute for human subjects in software engineering research?

Gerosa, Marco,Trinkenreich, Bianca,Steinmacher, Igor,Sarma, Anita

DOI: https://doi.org/10.1007/s10515-023-00409-6

IF: 1.677

2024-01-12

Automated Software Engineering

Abstract:Research within sociotechnical domains, such as software engineering, fundamentally requires the human perspective. Nevertheless, traditional qualitative data collection methods suffer from difficulties in participant recruitment, scaling, and labor intensity. This vision paper proposes a novel approach to qualitative data collection in software engineering research by harnessing the capabilities of artificial intelligence (AI), especially large language models (LLMs) like ChatGPT and multimodal foundation models. We explore the potential of AI-generated synthetic text as an alternative source of qualitative data, discussing how LLMs can replicate human responses and behaviors in research settings. We discuss AI applications in emulating humans in interviews, focus groups, surveys, observational studies, and user evaluations. We discuss open problems and research opportunities to implement this vision. In the future, an integrated approach where both AI and human-generated data coexist will likely yield the most effective outcomes.

computer science, software engineering
Fake academic writing: ethics during chatbot era

A Caprioglio,L Paglia

DOI: https://doi.org/10.23804/ejpd.2023.24.02.01

2023-06-01

Abstract:"Professor, have you ever seen anything like this?". Few weeks ago I was asked this question by two young and esteemed specialist in orthodontics of my research group, actually PhD students, who showed me a laptop screen. "No, I have never seen anything so potentially extraordinary. But doubts arise: is this legal? Or rather, is it ethical for us to use it in the field of research?" So I asked the questioners, Dr. Serafin and Dr. Bocchieri, to write a short essay on this new form of artificial intelligence, the chatbots, to give me an idea of what they are, what their potential is, and how they can change the veracity of data when an artificial mind replaces a human one. After "letterally" 5 minutes, they returned to me and let me read the following: The rapid advancement of artificial intelligence (AI) technology has led to a proliferation of AI-powered tools that are having a significant impact in the realm of academic writing to automate various aspects of the editorial process, from research to proofreading and even generating complete high-quality scientific articles. Chatbots are AI-virtual assistants that offer significant benefits but there are also important ethical considerations that must be considered. One concern is related to the accuracy and reliability of AI-generated content, particularly in scientific writing where accuracy is of utmost importance. There are also concerns about the potential for AI to be used to produce plagiarized or fraudulent content, which could undermine the credibility of scientific soundness. To mitigate this risk, it is crucial to establish clear guidelines and regulations for their use. Additionally, academic institutions and publishers should take steps to verify the authenticity of authors and promote transparency and accountability in the publishing process. The use of chatbots in academic writing has the potential to revolutionize the way in which research is conducted and written. However, it is important to ensure that the ethical implications of this technology are carefully considered and addressed. This includes ensuring that AI-generated content is accurate, reliable, and trustworthy and that the use of AI does not result in the displacement of human imagination. To address these ethical considerations, it is recommended that academic institutions and scientific journals work together to establish clear guidelines and regulations for the use of AI in academic writing, ensuring that AI-powered tools are ethical. By taking a responsible approach, we can ensure that the benefits of this technology are realized while minimizing any potential negative consequences. Finally, the most important but missing information is that this editorial is fully written by a chatbot. Therefore, pay attention: the search for health for our patients must go through scientific honesty that produces data and analyzes them "humanly". I share my amazement, but also my concern. As a university professor, as a clinician, as a researcher, but also as a "father" of future orthodontists, I always have doubts about the message we want to leave, and in this editorial I would like to reproduce an excerpt from a conversation with Marco and Salvo, as if we were discussing the legitimacy of cheating in a card game.
Can artificial intelligence help for scientific writing?

Michele Salvagno,ChatGPT,Fabio Silvio Taccone,Alberto Giovanni Gerli

DOI: https://doi.org/10.1186/s13054-023-04380-2

IF: 15.1

2023-02-27

Critical Care

Abstract:This paper discusses the use of Artificial Intelligence Chatbot in scientific writing. ChatGPT is a type of chatbot, developed by OpenAI, that uses the Generative Pre-trained Transformer (GPT) language model to understand and respond to natural language inputs. AI chatbot and ChatGPT in particular appear to be useful tools in scientific writing, assisting researchers and scientists in organizing material, generating an initial draft and/or in proofreading. There is no publication in the field of critical care medicine prepared using this approach; however, this will be a possibility in the next future. ChatGPT work should not be used as a replacement for human judgment and the output should always be reviewed by experts before being used in any critical decision-making or application. Moreover, several ethical issues arise about using these tools, such as the risk of plagiarism and inaccuracies, as well as a potential imbalance in its accessibility between high- and low-income countries, if the software becomes paying. For this reason, a consensus on how to regulate the use of chatbots in scientific writing will soon be required.

critical care medicine
The use of artificial intelligence (AI) to enhance academic communication, education and research: a balanced approach

Mireia Esplugas

DOI: https://doi.org/10.1177/17531934231185746

Abstract:Much has been written about the concerns surrounding artificial intelligence (AI). This article looks positively at how AI can enhance communication and academic skills, including teaching and research. The article explains what AI, Generative Pre-trained Transformer (GPT), and chat-GPT are and highlights a few AI-based tools that are currently in use to improve communication and academic skills. It also mentions potential AI problems, such as a lack of personalization, societal biases, and privacy concerns. The future lies in the training of hand surgeons to master the skill of precise communication and academia using AI tools.
Inform the uninformed: Improving Online Informed Consent Reading with an AI-Powered Chatbot

Ziang Xiao,Tiffany Wenting Li,Karrie Karahalios,Hari Sundaram

DOI: https://doi.org/10.1145/3544548.3581252

2023-02-02

Abstract:Informed consent is a core cornerstone of ethics in human subject research. Through the informed consent process, participants learn about the study procedure, benefits, risks, and more to make an informed decision. However, recent studies showed that current practices might lead to uninformed decisions and expose participants to unknown risks, especially in online studies. Without the researcher's presence and guidance, online participants must read a lengthy form on their own with no answers to their questions. In this paper, we examined the role of an AI-powered chatbot in improving informed consent online. By comparing the chatbot with form-based interaction, we found the chatbot improved consent form reading, promoted participants' feelings of agency, and closed the power gap between the participant and the researcher. Our exploratory analysis further revealed the altered power dynamic might eventually benefit study response quality. We discussed design implications for creating AI-powered chatbots to offer effective informed consent in broader settings.

Human-Computer Interaction,Artificial Intelligence
Identification of Human-Generated vs AI-Generated Research Abstracts by Health Care Professionals

Dennis Ren,Andrew James Tagg,Helena Wilcox,Damian Roland

DOI: https://doi.org/10.1001/jamapediatrics.2024.0760

2024-04-29

JAMA Pediatrics

Abstract:This survey study assesses the ability of health care professionals to discern whether abstracts were written by investigators or by an artificial intelligence (AI) chatbot.

pediatrics
Can ChatGPT Replace Humans in Crisis Communication? the Effects of AI-mediated Crisis Communication on Stakeholder Satisfaction and Responsibility Attribution

Yi Xiao,Shubin Yu

DOI: https://doi.org/10.1016/j.ijinfomgt.2024.102835

IF: 18.958

2025-01-01

International Journal of Information Management

Abstract:Imagine a world where chatbots are the first responders to crises, efficiently addressing concerns and providing crucial information. ChatGPT has demonstrated the capability of GenAI (Generative Artificial Intelligence)-powered chatbots when deployed to answer crisis-related questions in a timely and cost-efficient manner, thus replacing humans in crisis communication. However, public reactions to such messages remain unknown. To address this problem, this study recruited participants (N1 = 399, N2 = 189, and N3 = 121) and conducted two online vignette experiments and a qualitative survey. The results suggest that, when organizations fail to handle crisis-related requests, stakeholders exhibit higher satisfaction and lower responsibility attribution to chatbots providing instructing (vs. adjusting) information, as they are perceived to be more competent. However, when organizations satisfy requests, chatbots that provide adjusting (vs. instructing information) lead to higher satisfaction and lower responsibility attribution due to higher perceived competence. The second experiment involving a public emergency crisis scenario reveals that, regardless of the information provided (instructing or adjusting), stakeholders exhibit greater satisfaction and positive attitudes toward high-competence (vs. low-competence) chatbots. The qualitative study further confirms the experimental findings and offers insights to improve crisis chatbots. These findings contribute to the literature by extending situational crisis communication theory to nonhuman touchpoints and providing a deeper understanding of using chatbots in crisis communication through the lens of machine heuristics. The study also offers practical guidance for organizations to strategically integrate chatbots and human agents in crisis management based on context.
Elicit: AI literature review research assistant

Sharon Whitfield,Melissa A. Hofmann

DOI: https://doi.org/10.1080/15228959.2023.2224125

2023-09-20

Public Services Quarterly

Abstract:Can Artificial Intelligence (AI) be used for good in the academic and creative worlds? This is a question that is being asked by educators who are concerned about student learning and academic integrity AI use in higher education. Numerous articles decry the potential of college students using AI to cheat on exam questions, discussion board posts, and research papers. Yet, through the use of language learning models (LLM), AI may be used as a tool to increase efficiency, perform repetitive tasks, and aid with research and analysis. It is through the lens of AI as a tool, not as a concern or replacement of human involvement, that the authors examined Elicit.org, a literature review search tool that uses LLM to aid the research process.
“Knock, Knock . . . Who’s There?” ChatGPT and Artificial Intelligence-Powered Large Language Models: Reflections on Potential Impacts Within Health and Physical Education Teacher Education

Chad M. Killian,Risto Marttinen,Donal Howley,Julia Sargent,Emily M. Jones

DOI: https://doi.org/10.1123/jtpe.2023-0058

IF: 2.66

2023-01-01

Journal of Teaching in Physical Education

Abstract:This research note suggests the emergence of Artificial Intelligence-powered chatbots like ChatGPT pose challenges to the future of higher education. We as a field should pay attention to issues and opportunities associated with this technology across learning, teaching, and research spaces. We propose ignoring, or being indifferent to, predictions about what technologies like Artificial Intelligence-powered chatbots can do can cause us to do “dumb things.” All health and physical education teacher education faculty members should make efforts to learn about these tools to facilitate informed, solution-focused decisions about whether and where to leverage them. We highlight the importance of maintaining sociocritical perspectives when considering use of digital technologies to understand and address digital (in)equity and promote equitable practices. We conclude by emphasizing the need for field-specific consensus statements to guide ethical and appropriate use of Artificial Intelligence-powered chatbots, to ensure the value of these tools is harnessed for the good of the society. [Output by ChatGPT-3]

education & educational research,sport sciences
Rise of ChatGPT and other tools raises major questions for research

Simon Baker

DOI: https://doi.org/10.1038/d41586-024-02984-4

IF: 64.8

2024-09-19

Nature

Abstract:AI is changing the way researchers work forever, but human expertise must continue to hold sway. AI is changing the way researchers work forever, but human expertise must continue to hold sway.

multidisciplinary sciences

Can AI be used to assess research quality?

Evaluating Quality of Chatbots and Intelligent Conversational Agents

On the use of AI-based tools like ChatGPT to support management research

Attitudes and perceptions of medical researchers towards the use of artificial intelligence chatbots in the scientific process: an international cross-sectional survey

Can linguists distinguish between ChatGPT/AI and human writing?: A study of research ethics and academic publishing

The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation

Chatbots in Education and Research: A Critical Examination of Ethical Implications and Solutions

Robo academic advisor: Can chatbots and artificial intelligence replace human interaction?

Mini review on the ethical use of AI bots in academic writing

Artificial Intelligence - A Help or Hindrance to Scientific Writing?

Can AI serve as a substitute for human subjects in software engineering research?

Fake academic writing: ethics during chatbot era

Can artificial intelligence help for scientific writing?

The use of artificial intelligence (AI) to enhance academic communication, education and research: a balanced approach

Inform the uninformed: Improving Online Informed Consent Reading with an AI-Powered Chatbot

Identification of Human-Generated vs AI-Generated Research Abstracts by Health Care Professionals

Can ChatGPT Replace Humans in Crisis Communication? the Effects of AI-mediated Crisis Communication on Stakeholder Satisfaction and Responsibility Attribution

Elicit: AI literature review research assistant

“Knock, Knock . . . Who’s There?” ChatGPT and Artificial Intelligence-Powered Large Language Models: Reflections on Potential Impacts Within Health and Physical Education Teacher Education

Rise of ChatGPT and other tools raises major questions for research