Objective To evaluate whether and how the radiological journals present their policies on the use of large language models (LLMs), and identify the journal characteristic variables that are associated with the presence. Methods In this meta-research study, we screened Journals from the Radiology, Nuclear Medicine and Medical Imaging Category, 2022 Journal Citation Reports, excluding journals in non-English languages and relevant documents unavailable. We assessed their LLM use policies: (1) whether the policy is present; (2) whether the policy for the authors, the reviewers, and the editors is present; and (3) whether the policy asks the author to report the usage of LLMs, the name of LLMs, the section that used LLMs, the role of LLMs, the verification of LLMs, and the potential influence of LLMs. The association between the presence of policies and journal characteristic variables was evaluated. Results The LLM use policies were presented in 43.9% (83/189) of journals, and those for the authors, the reviewers, and the editor were presented in 43.4% (82/189), 29.6% (56/189) and 25.9% (49/189) of journals, respectively. Many journals mentioned the aspects of the usage (43.4%, 82/189), the name (34.9%, 66/189), the verification (33.3%, 63/189), and the role (31.7%, 60/189) of LLMs, while the potential influence of LLMs (4.2%, 8/189), and the section that used LLMs (1.6%, 3/189) were seldomly touched. The publisher is related to the presence of LLM use policies (p < 0.001). Conclusion The presence of LLM use policies is suboptimal in radiological journals. A reporting guideline is encouraged to facilitate reporting quality and transparency. Critical relevance statementIt may facilitate the quality and transparency of the use of LLMs in scientific writing if a shared complete reporting guideline is developed by stakeholders and then endorsed by journals.
基金:
National Natural Science Foundation of China (82302183 and 82271934), Yangfan Project of Science and Technology Commission of Shanghai Municipality (22YF1442400), Research Found of Health Commission of Changing District, Shanghai Municipality (2023QN01), Laboratory Open Fund of Key Technology and Materials in Minimally Invasive Spine Surgery (2024JZWC-ZDA03 and 2024JZWC-YBA07), Research Fund of Tongren Hospital, Shanghai Jiao Tong University School of Medicine (TRKYRCXX202204, TRYJ2021JC06, TRYXJH18, and TRYXJH28), and Research Fund of Ruijin Hospital, Shanghai Jiao Tong University School of Medicine (YW20220014).
第一作者机构:[1]Shanghai Jiao Tong Univ, Tongren Hosp, Sch Med, Lab Key Technol & Mat Minimally Invas Spine Surg, Shanghai, Peoples R China[2]Shanghai Jiao Tong Univ, Ctr Spinal Minimally Invas Res, Shanghai, Peoples R China[3]Shanghai Jiao Tong Univ, Tongren Hosp, Sch Med, Dept Imaging, Shanghai, Peoples R China
共同第一作者:
通讯作者:
通讯机构:[1]Shanghai Jiao Tong Univ, Tongren Hosp, Sch Med, Lab Key Technol & Mat Minimally Invas Spine Surg, Shanghai, Peoples R China[2]Shanghai Jiao Tong Univ, Ctr Spinal Minimally Invas Res, Shanghai, Peoples R China[3]Shanghai Jiao Tong Univ, Tongren Hosp, Sch Med, Dept Imaging, Shanghai, Peoples R China
推荐引用方式(GB/T 7714):
Zhong Jingyu,Xing Yue,Hu Yangfan,et al.The policies on the use of large language models in radiological journals are lacking: a meta-research study[J].INSIGHTS INTO IMAGING.2024,15(1):doi:10.1186/s13244-024-01769-7.
APA:
Zhong, Jingyu,Xing, Yue,Hu, Yangfan,Lu, Junjie,Yang, Jiarui...&Yao, Weiwu.(2024).The policies on the use of large language models in radiological journals are lacking: a meta-research study.INSIGHTS INTO IMAGING,15,(1)
MLA:
Zhong, Jingyu,et al."The policies on the use of large language models in radiological journals are lacking: a meta-research study".INSIGHTS INTO IMAGING 15..1(2024)