Cornell University
Library
Cornell UniversityLibrary

eCommons

Help
Log In(current)
  1. Home
  2. Weill Cornell Medicine
  3. Medical College Research and Papers
  4. Department of Otolaryngology - Head and Neck Surgery
  5. An Evaluation of Current Trends in AI-Generated Text in Otolaryngology Publications.

An Evaluation of Current Trends in AI-Generated Text in Otolaryngology Publications.

File(s)
40277459.pdf (236.48 KB)
No Access Until
2026-04-25
Permanent Link(s)
https://hdl.handle.net/1813/117378
Collections
Department of Otolaryngology - Head and Neck Surgery
Author
Kutler, R.B.
Setzen, S.A.
Tsai, S.
Rameau, A.
Abstract

OBJECTIVES: Since the release of ChatGPT-4 in March 2023, large language models (LLMs) application in biomedical manuscript production has been widespread. GPT-modified text detectors, such as GPTzero, lack sensitivity and reliability and do not quantify the amount of AI-generated text. However, recent work has identified certain adjectives more frequently used by LLMs that can help identify and quantify LLM-modified text. The aim of this study is to utilize these adjectives to identify LLM-generated text in otolaryngology publications. STUDY DESIGN: Meta-research. METHODS: Twenty-five otolaryngology journals were studied between November 2022 and July 2024, encompassing 8751 published works. Articles from countries where ChatGPT-4 is not available were removed, yielding 7702 articles for study inclusion. These publications were analyzed using a Python script to determine the frequency of the top 100 adjectives disproportionately generated by ChatGPT-4. RESULTS: A significant increase in the frequency of adjectives associated with GPT use was observed from November 2023 to July 2024 across all journals (p < 0.001), with a significant difference before and after the release of ChatGPT in March 2023. Journals with higher impact factors had significantly lower usage of GPT-associated adjectives than those with lower impact factors (p < 0.001). There was no significant difference in GPT-associated adjective use by first authors with a doctoral degree versus those without. Publications by authors from English-speaking countries demonstrated a significantly more frequent use of LLM-associated adjectives (p < 0.001). CONCLUSIONS: This study suggests that ChatGPT use in otolaryngology manuscript production has significantly increased since the release of ChatGPT-4. Future research should be aimed at further characterizing the landscape of AI-generated text in otolaryngology and developing tools that encourage authors' transparency regarding the use of LLMs. LEVEL OF EVIDENCE: NA.

Journal / Series
The Laryngoscope
Date Issued
2025-04-25
Publisher
Wiley
Keywords
WCM Library Coordinated Deposit
•
artificial intelligence
•
large language models
•
otolaryngology
Related DOI
https://doi.org/10.1002/lary.32202
Previously Published as
Kutler RB, Setzen SA, Tsai S, Rameau Aï. An Evaluation of Current Trends in AI-Generated Text in Otolaryngology Publications. The Laryngoscope. 2025;():. doi: 10.1002/lary.32202. PMID: 40277459.
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Rights URI
https://creativecommons.org/licenses/by-nc-nd/4.0/
Type
article

Site Statistics | Help

About eCommons | Policies | Terms of use | Contact Us

copyright © 2002-2026 Cornell University Library | Privacy | Web Accessibility Assistance