ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples
Md. Mizanur Rahman | Harold Jan R. Terano | Md Nafizur Rahman | Aidin Salamzadeh | Md. Saidur Rahaman
Discipline: Education
Abstract:
In the academic world, academicians, researchers, and students have already employed Large
Language Models (LLMs) such as ChatGPT to complete their various academic and non-academic
tasks, including essay writing, different formal and informal speech writing, summarising literature,
and generating ideas. However, yet, it is a controversial issue to use ChatGPT in academic
research. Recently, its impact on academic research and publication has been scrutinized. The
fundamental objective of this study is to highlight the application of ChatGPT in academic
research by demonstrating a practical example with some recommendations. Data for this study
was gathered using published articles, websites, blogs, and visual and numerical artefacts. We
have analyzed, synthesized, and described our gathered data using an "introductory literature
review." The findings revealed that for the initial idea generation for academic scientific research,
ChatGPT could be an effective tool. However, in the case of literature synthesis, citations, problem
statements, research gaps, and data analysis, the researchers might encounter some challenges.
Therefore, in these cases, researchers must be cautious about using ChatGPT in academic research.
Considering the potential applications and consequences of ChatGPT, it is a must for the academic
and scientific community to establish the necessary guidelines for the appropriate use of LLMs,
especially ChatGPT, in research and publishing.
References:
- Aydın, Ö., & Karaarslan, E. (2022). OpenAI ChatGPT Generated Literature Review: Digital Twin in Healthcare. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4308687
- Cooper, H. M. (1998). Synthesizing Research: A Guide for Literature Reviews. SAGE.
- Dowling, M., & Lucey, B. (2023). ChatGPT for (Finance) research: The Bananarama Conjecture. Finance Research Letters, 53, 103662. https://doi.org/10.1016/j.frl.2023.103662
- Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642
- Eagly, A. H., & Wood, W. (1994). Using research syntheses to plan future research. In H. Cooper & L. V. Hedges (Eds.), The Handbook of Research Synthesis (pp. 485–500). Russell Sage Foundation.
- Else, H. (2023). Abstracts written by ChatGPT fool scientists. Nature, 613(7944), 423–423. https://doi.org/10.1038/d41586-023-00056-7
- Elsevier. (2023). The Use of AI and AI-assisted Technologies in Scientific Writing. Elsevier. https://www.elsevier.com/about/policies/publishing-ethics
- Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022). Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. bioRxiv. https://doi.org/10.1101/2022.12.23.521610
- Gordijn, B., & Have, H. ten. (2023). ChatGPT: evolution or revolution? Medicine, Health Care and Philosophy, 26(1), 1–2. https://doi.org/10.1007/s11019-023-10136-0
- Grimaldi, G., & Ehrler, B. (2023). AI et al.: Machines Are About to Change Scientific Publishing Forever. ACS Energy Letters, 8(1), 878–880. https://doi.org/10.1021/acsenergylett.2c02828
- Hutson, M. (2022). Could AI help you to write your next paper? Nature, 611(7934), 192–193. https://doi.org/10.1038/d41586-022-03479-w
- Liebrenz, M., Schleifer, R., Buadze, A., Bhugra, D., & Smith, A. (2023). Generating scholarly content with ChatGPT: ethical challenges for medical publishing. The Lancet Digital Health, 5(3), e105–e106. https://doi.org/10.1016/S2589-7500(23)00019-5
- M Alshater, M. (2022). Exploring the Role of Artificial Intelligence in Enhancing Academic Performance: A Case Study of ChatGPT. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4312358
- McMaster LibGuides at McMaster University. (n.d.). Retrieved March 15, 2023, from https://libguides.mcmaster.ca/guidetoresources
- O’Connor, S., & ChatGPT. (2023). Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse? Nurse Education in Practice, 66, 103537. https://doi.org/10.1016/j.nepr.2022.103537
- Rahaman, Md. S., Ahsan, M. M. T., Anjum, N., Rahman, Md. M., & Rahman, M. N. (2023). The AI Race is on! Google’s Bard and Openai’s Chatgpt Head to Head: An Opinion Article. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4351785
- Sankaran, V. (2023). Scientific journals ban ChatGPT use by researchers to write studies. The Independent. https://www.independent.co.uk/tech/chatgpt-ai-journals-ban-author-b2270334.html
- Spring Nature. (2023). Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. Nature, 613(7945), 612–612. https://doi.org/10.1038/d41586-023-00191-1
- Stokel-Walker, C. (2023). ChatGPT listed as author on research papers: many scientists disapprove. Nature, 613(7945), 620–621. https://doi.org/10.1038/d41586-023-00107-z
- Taylor & Francis. (2023). Taylor & Francis Clarifies the Responsible use of AI Tools in Academic Content Creation. Taylor & Francis. https://newsroom.taylorandfrancisgroup.com/taylor-francis-clarifies-the-responsible-use-of-ai-tools-in-academic-content-creation/
- Transformer, C. G. P., & Zhavoronkov, A. (2022). Rapamycin in the context of Pascal’s Wager: generative pre-trained transformer perspective. Oncoscience, 9, 82–84. https://doi.org/10.18632/oncoscience.571
- Van Dis, E. A. M., Bollen, J., Zuidema, W., Van Rooij, R., & Bockting, C. L. (2023). ChatGPT: five priorities for research. Nature, 614(7947), 224–226. https://doi.org/10.1038/d41586-023-00288-7
- Ventresca, M. J., & Mohr, J. W. (2017). Archival Research Methods. In J. A. C. Baum (Ed.), The Blackwell Companion to Organizations (pp. 805–828). Blackwell Publishing Ltd. https://doi.org/10.1002/9781405164061.ch35
- Vogt, P. W., Gardner, D. C., & Haeffele, L. M. (2012). When to Use What Research Design. Guilford Press. https://books.google.com.bd/books?hl=en&lr=&id=iDELMeGcIgAC&oi=fnd&pg=PP2&dq=Vogt,+W.+P.,+Gardner,+D.+C.,++Haeffele,+L.+M.+When+to+use+what+research+design.+%09Guilford+Press,+2012.+&ots=7_GOVKvlay&sig=M-mbGj_MFZoaBcJ9R1M9FeSwm14&redir_esc=y#v=onepage&q&f=false
ISSN 2799-0583 (Online)
ISSN 2782-9413 (Print)