Academic Writing with GPT-3.5: Reflections on Practices, Efficacy and Transparency

Oğuz 'Oz' Buruk
DOI: https://doi.org/10.1145/3616961.3616992
2023-02-13
Abstract:The debate around the use of GPT 3.5 has been a popular topic among academics since the release of ChatGPT. Whilst some have argued for the advantages of GPT 3.5 in enhancing academic writing, others have raised concerns such as plagiarism, the spread of false information, and ecological issues. The need for finding ways to use GPT 3.5 models transparently has been voiced, and suggestions have been made on social media as to how to use GPT 3.5 models in a smart way. Nevertheless, to date, there is a lack of literature which clearly outlines how to use GPT 3.5 models in academic writing, how effective they are, and how to use them transparently. To address this, I conducted a personal experience experiment with GPT 3.5, specifically by using OpenAI text davinci 003 model, for writing this article. I identified five ways of using GPT 3.5: Chunk Stylist, Bullet to Paragraph, Talk Textualizer, Research Buddy, and Polisher. I reflected on their efficacy, and commented on their potential impact on writing ethics. Additionally, I provided a comprehensive document which shows the prompts I used, results I got from GPT 3.5, the final edits and visually compares those by showing the differences in percentages.
Computation and Language,Artificial Intelligence,Human-Computer Interaction,Machine Learning
What problem does this paper attempt to address?
The problems that this paper attempts to solve mainly focus on the following aspects: 1. **Effectiveness and Transparency of Using GPT - 3.5 in Academic Writing**: Although the application of GPT - 3.5 in academic writing is becoming more and more widespread, there is relatively little research on its effectiveness and how to use these models transparently. Through personal experiments, the author explores the specific application methods and effects of GPT - 3.5 in academic writing. 2. **Ethical and Responsibility Issues**: The paper also focuses on the ethical issues that may be brought about by using GPT - 3.5, such as content ownership, plagiarism, and the potential spread of misinformation. Through his own experiments, the author reflects on the impact of these tools on writing ethics and puts forward suggestions for transparent use. 3. **Effect Evaluation of Different Usage Methods**: The author introduces in detail five methods of using GPT - 3.5, including "Chunk Stylist", "Bullet - to - Paragraph", "Talk Textualizer", "Research Buddy" and "Polisher", and evaluates the effect of each method. 4. **Promoting the Efficiency and Quality of Academic Writing**: The paper aims to show, through specific experimental results, how GPT - 3.5 can help researchers improve their writing efficiency and quality, especially among those researchers with limited writing skills or for whom English is not their native language. In conclusion, through personal experiments and detailed analysis, this paper aims to fill the current research gap regarding the application of GPT - 3.5 in academic writing, while providing practical suggestions and reflections to promote more efficient, transparent and responsible academic writing practices.