Author(s)

Lin Zhong ¹, ChaoMin Gao ^2*

Affiliation(s)

¹ Youjiang Medical University For Nationalities, Journal Editorial Department, Baise 533000, Guangxi, China.

² Baise University, School of Business Administration, Baise 533000, Guangxi, China.

Corresponding Author

ChaoMin Gao

ABSTRACT

This study aims to explore the application of generative artificial intelligence (AI) in the editorial process of scientific journals and its impact on editing efficiency and accuracy, thereby foreseeing potential changes in future scientific communication. Utilizing literature reviews and data analysis, this study focuses on literature published between 2020 and 2023, involving top academic journals, conference papers, and authoritative databases. Through qualitative analysis, content analysis, and comparative analysis, the study comprehensively assesses the application of generative AI in the editing of scientific journals. The research shows that generative AI has significant advantages in the preliminary review, language polishing, and format standardization of scientific journal submissions. Although it enhances editing efficiency and manuscript quality, AI has limitations in understanding complex academic content and maintaining high accuracy. The application of generative AI in the editing of scientific journals is in a rapid development stage, but its potential is immense, especially in improving editing efficiency and accuracy. Future research needs to explore in-depth the limitations and ethical responsibilities of AI, as well as the collaboration model between AI and human editors, to ensure the quality and integrity of scientific journal content.

KEYWORDS

Generative Artificial Intelligence; Technological Journal Editing; Editorial Efficiency; Content Accuracy; Challenges in AI Applications

CITE THIS PAPER

Lin Zhong, ChaoMin Gao. Research on the efficiency and accuracy of generative AI in the editorial process of scientific journals. World Journal of Information and Knowledge Management. 2024, 2(2): 28-36. DOI: 10.61784/wjikmv2n295.

REFERENCES

[1] Hsu, H. P. Can Generative Artificial Intelligence Write an Academic Journal Article? Opportunities, Challenges, and Implications. Irish Journal of Technology Enhanced Learning, 2023, 7(2), 158-171.

[2] Grillo, R. The rising tide of artificial intelligence in scientific journals: A profound shift in research landscape. European Journal of Therapeutics, 2023, 29(3), 686-688.

[3] Zenni, R. D., Andrew, N. R. Artificial intelligence text generators for overcoming language barriers in ecological research communication. Austral Ecology, 2023, 48(7), 1225-1229.

[4] Lin, Z. Supercharging academic writing with generative AI: framework, techniques, and caveats. arXiv preprint arXiv:2310.17143. 2023.

[5] Dawson, P., Sutherland-Smith, W., Ricksen, M. Academic integrity considerations of AI large language models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching & Learning Practice, 2023, 20(2).

[6] Nex?e, J. Scientific papers and artificial intelligence. Brave new world?. Scandinavian Journal of Primary Health Care, 2023, 41, 187 - 188.

[7] Rahali, A., Akhloufi, M. A. End-to-end transformer-based models in textual-based NLP. AI, 2023, 4(1), 54-110.

[8] Kaebnick, G., Magnus, D., Kao, A., Hosseini, M., Resnik, D., Dubljevi?, V., Rentmeester, C., Gordijn, B., Cherry, M. Editors’ Statement on the Responsible Use of Generative AI Technologies in Scholarly Journal Publishing. AJOB Neuroscience, 2023, 14, 337 - 340.

[9] Park, S. Use of Generative Artificial Intelligence, Including Large Language Models Such as ChatGPT, in Scientific Publications: Policies of KJR and Prominent Authorities. Korean Journal of Radiology, 2023, 24, 715 - 718.

[10] Koga, S. The integration of large language models such as ChatGPT in scientific writing: Harnessing potential and addressing pitfalls. PubMed, 2023, 24(9), 924–925.

[11] Piano, S. Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward. Palgrave Communications, 2020, 7, 1-7.

[12] Taiwo, E., Akinsola, A., Tella, E., Makinde, K., Akinwande, M. A Review of the Ethics of Artificial Intelligence and its Applications in the United States. arXiv preprint arXiv:2310.05751. 2023.

[13] Kousha, K., Thelwall, M. Artificial intelligence to support publishing and peer review: A summary and review. Learned Publishing, 2024, 37(1), 4-12.

[14] Yeo-Teh, N. S. L., Tang, B. L. Letter to editor: NLP systems such as ChatGPT cannot be listed as an author because these cannot fulfill widely adopted authorship criteria. Accountability in research, 1-3. 2023.

[15] Liao, H., Xiao, H., Hu, B. Revolutionizing ESL Teaching with Generative Artificial Intelligence—Take ChatGPT as an Example. International Journal of New Developments in Education, 2023, 5(20), 39-46.

[16] Cao, Y., Li, S., Liu, Y., Yan, Z., Dai, Y., Yu, P. S., Sun, L. A comprehensive survey of ai-generated content (aigc): A history of generative ai from gan to chatgpt. arXiv preprint arXiv:2303.04226. 2023.

[17] Heintz, K., Roh, Y.-W., Lee, J. Comparing the accuracy and effectiveness of Wordvice AI proofreader to two automated editing tools and human editors. Science Editing, 2022, 9(1), 37-45.

[18] Yuan, A., Coenen, A., Reif, E., Ippolito, D. Wordcraft: story writing with large language models. In 27th International Conference on Intelligent User Interfaces 2022: 841-852.

[19] Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., Pearson, A. T. Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. BioRxiv, 2022, 2022-12.

[20] Putnings, M., Borchert, C., Eichler, F. Automatic XML extraction from Word and e-book formatting: an insight into the Open Source Academic Publishing Suite (OS-APS) project. PUBMET, 2022, 70-71.

[21] Jain, V. How AI could lead to a better understanding of the brain. Nature, 2023, 623(7986), 247-250.

[22] Zohny, H., McMillan, J., King, M. Ethics of generative AI. Journal of medical ethics, 2023, 49(2), 79-80.

[23] Ganjavi, C., Eppler, M. B., Pekcan, A., Biedermann, B., Abreu, A., Collins, G. S., ... & Cacciamani, G. E. Bibliometric Analysis of Publisher and Journal Instructions to Authors on Generative-AI in Academic and Scientific Publishing. arXiv preprint arXiv:2307.11918. 2023.

[24] Christou, P. A. Ηow to Use Artificial Intelligence (AI) as a Resource, Methodological and Analysis Tool in Qualitative Research?. The Qualitative Report, 2023, 28(7), 1968-1980.

[25] Lopez, R., Gayoso, A., Yosef, N. Enhancing scientific discoveries in molecular biology with deep generative models. Molecular systems biology, 2020, 16(9), e9198.

[26] Burlina, P., Joshi, N., Paul, W., Pacheco, K. D., Bressler, N. M. Addressing artificial intelligence bias in retinal diagnostics. Translational Vision Science & Technology, 2021, 10(2), 13-13.

[27] Spector-Bagdady, K. Generative-AI-generated challenges for health data research. The American Journal of Bioethics, 2023, 23(10), 1-5.

[28] Yoo, Y. Evolving Epistemic Infrastructure: The Role of Scientific Journals in the Age of Generative AI. Journal of the Association for Information Systems, 2024, 25(1), 137-144.

[29] Carobene, A., Padoan, A., Cabitza, F., Banfi, G., Plebani, M. Rising adoption of artificial intelligence in scientific publishing: evaluating the role, risks, and ethical implications in paper drafting and review process. Clinical Chemistry and Laboratory Medicine (CCLM),  2023, 62(5): 835–843.

[30] Grimaldi, G., Ehrler, B. AI et al.: Machines are about to change scientific publishing forever. ACS energy letters, 2023, 8(1), 878-880.

[31] Checco, A., Bracciale, L., Loreti, P., Pinfield, S., Bianchi, G. AI-assisted peer review. Humanities and Social Sciences Communications, 2021, 8(1), 1-11.

[32] Van Noorden, R., Perkel, J. M. AI and science: what 1,600 researchers think. Nature, 2023, 621(7980), 672-675.

[33] Arya, S., Sharma, G. Generative AI Images and Indian Media Industry: An Overview of Opportunities and Challenges. Journal of Communication and Management, 2023, 2(04), 271-274.

[34] Shah, C. Generative AI and the Future of Information Access. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023: 3-3.

[35] Ju, Q. Experimental Evidence on Negative Impact of Generative AI on Scientific Learning Outcomes. arXiv preprint arXiv:2311.05629. 2023.

[36] Park, S. H. Use of Generative Artificial Intelligence, Including Large Language Models Such as ChatGPT, in Scientific Publications: Policies of KJR and Prominent Authorities. Korean journal of radiology, 2023, 24(8), 715-718.

[37] Upshall, M. Using AI to solve business problems in scholarly publishing. Insights, 2019, 32, 1-7.

[38] Ghosal, T., Verma, R., Ekbal, A., Saha, S., Bhattacharyya, P. Investigating impact features in editorial pre-screening of research papers. In Proceedings of the 18th ACM/IEEE on Joint Conference on Digital Libraries. 2018: 333-334.

[39] Ghosal, T. Exploring the implications of artificial intelligence in various aspects of scholarly peer review. Bull. IEEE Tech. Comm. Digit. Libr, 2019, 15(1),1-9.

[40] Shi, S., Zhao, E., Tang, D., Wang, Y., Li, P., Bi, W., ... & Ma, D. Effidit: Your ai writing assistant. arXiv preprint arXiv:2208.01815. 2022.

[41] Cho, W. I., Cho, E., Cho, K. PaperCard: Towards Explainable Machine Assistance in Academic Writing.hal-04019842v3. 2023.

[42] Herbert, S. The road to data maturity-Why publishing has to stay relevant in the digital age and why it needs to start now. Information Services & Use, 2019, 39(4), 297-302.

[43] Biradar, U. B., Khamari, L., Bhate, J. Artificial Intelligence-Led Content Publishing, Metadata Creation, and Knowledge Discovery: In Quest of Sustainable and Profitable Business Models. In Transforming Scholarly Publishing With Blockchain Technologies and AI. IGI Global. 2021: 198-213.

[44] Correia, A., Lindley, S. Collaboration in relation to human-AI systems: Status, trends, and impact. In 2022 IEEE International Conference on Big Data (Big Data). IEEE. 2022: 3417-3422.

[45] Vanhaelen, Q., Lin, Y. C.,Zhavoronkov, A. The advent of generative chemistry. ACS Medicinal Chemistry Letters, 2020, 11(8), 1496-1505.

[46] Lopez, R., Gayoso, A., Yosef, N. Enhancing scientific discoveries in molecular biology with deep generative models. Molecular systems biology, 2020, 16(9), e9198.

[47] Eysenbach, G. The role of ChatGPT, generative language models, and artificial intelligence in medical education: a conversation with ChatGPT and a call for papers. JMIR Medical Education, 2023, 9(1), e46885.

[48] Cooper, G. Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 2023, 32(3), 444-452.