Evaluation of AI Tools Assisting Prescription Review for Medicare Dual-channel Outpatient Dispensing: A Comparative Study

JU Fengge, TANG Li, FENG Tao, QIN Qing, YU Jing

Journal of Hunan Normal University(Medical Science) ›› 2025, Vol. 22 ›› Issue (5) : 192-196.

PDF(1795 KB)
PDF(1795 KB)
Journal of Hunan Normal University(Medical Science) ›› 2025, Vol. 22 ›› Issue (5) : 192-196.
Pharmacy

Evaluation of AI Tools Assisting Prescription Review for Medicare Dual-channel Outpatient Dispensing: A Comparative Study

  • JU Fengge1, TANG Li2, FENG Tao1, QIN Qing1, YU Jing1
Author information +
History +

Abstract

Objective The purpose of this study is to systematically evaluate the efficacy of artificial intelligence (AI) tools in the review of dual-channel outpatient prescriptions for health insurance, and to explore the practical value of the human-machine collaborative review model. Method Retrospectively selected 138 Medicare dual-channel outpatient prescriptions in our hospital information system (HIS) from January to March 2025 as the study object and utilized four AI tools, namely, Tencent Yuanbao (deep seek), Doubao, Kimi Chat, and DeepSeek web version, to screen the prescriptions for standardization and medication appropriateness based on the Audit Specification and the Hospital Prescription Review Management Code (for Trial Implementation) to screen prescriptions for standardization and medication appropriateness, with manual review results as the gold standard. Comparison of timeliness, accuracy, and problem detection consistency of prescription reviews by 4 AI tools. Result The average review time consumed by Tencent Yuanbao (90±12 s), Doubao for (36±4 s), and Kimi Chat for (20±5 s) was significantly lower than that of manual review (276±23 s), with Kimi Chat being the fastest (P<0.05). Tencent Yuanbao (deep seek), Doubao and Kimi Chat had false-positive rates of 9.23%, 3.08% and 3.08%, respectively, and false-negative rates of 62.5%, 12.50% and 75%, respectively, with Doubao having the highest accuracy rate. Doubao (Deep Thinking) achieved the highest detection rate (62.50%), followed by Tencent Yuanbao (deep seek) with a detection rate of 25.00%, while Kimi Chat had the lowest detection rate at 12.50% (P<0.05). Conclusion AI tools in the medical insurance dual-channel external dispensing prescription audit timeliness is better than manual, beanbag consistency detection rate and accuracy rate is the highest, has a better application efficacy, human-computer synergy mode is worth paying attention to.

Key words

artificial intelligence / dual channel pharmaceuticals / external prescription dispensing / prescription review

Cite this article

Download Citations
JU Fengge, TANG Li, FENG Tao, QIN Qing, YU Jing. Evaluation of AI Tools Assisting Prescription Review for Medicare Dual-channel Outpatient Dispensing: A Comparative Study[J]. Journal of Hunan Normal University(Medical Science). 2025, 22(5): 192-196

References

[1] 徐源, 金春林, 宋捷, 等. 慢性病长期用药处方外配的落地障碍和实现途径[J]. 中国药房, 2024, 35(7): 778-782.
[2] 医保局卫生健康委关于建立完善国家医保谈判药品“双通道”管理机制的指导意见[J]. 中华人民共和国国务院公报, 2021, (19): 59-60.
[3] 国务院办公厅关于建立健全职工基本医疗保险门诊共济保障机制的指导意见[J]. 中华人民共和国国务院公报, 2021, (13): 16-18.
[4] 国家医疗保障局办公室. 关于规范医保药品外配处方管理的通知(医保办函〔2024〕86号) [EB/OL]. (2024-10-16)[2025-06-20]. https://www.gov.cn/zhengce/zhengceku/202410/content_6980794.htm.
[5] VAN LOON WEE, BORGSTEEDE SDS, BAAS GWG, et al.Nature and frequency of prescription modifications in community pharmacies: A nationwide study in the Netherlands[J]. Br J Clin Pharmacol.2021, 87(3): 1455-1465.
[6] PONS-MESQUIDA MÀ, OMS-ARIAS M, FIGUERAS A, et al.Impact of a system to assist in clinical decision-making in primary healthcare in Catalonia: prescription Self Audit[J]. BMC Med Inform Decis Mak, 2022, 22(1): 70.
[7] SAGUIL A.Chatbots and Large Language Models in Family Medicine[J]. Am Fam Physician, 2024, 109(6): 501-502.
[8] CLUSMANN J, KOLBINGER FR, MUTI HS, et al.The future landscape of large language models in medicine[J]. Commun Med (Lond), 2023, 3(1): 141.
[9] BURNETTE H, PABANI A, VON ITZSTEIN MS, et al.Use of artificial intelligence chatbots in clinical management of immune-related adverse events[J]. J Immunother Cancer, 2024, 12(5): e008599.
[10] 毕波. 妇幼保健中心门诊药房处方点评与分析[J]. 青岛医药卫生, 2025, 57(6): 406-409.
[11] 北京市市场监督管理局. DB11/T1934-2021 医院处方评价规范[S/OL]. [2022-04-01]. https://wjw.beijing.gov.cn/zwgk_20040/zcwj2022/dfbz/202304/P020230408536883610480.pdf.
[12] 王智. 2020年某三甲医院24000张门急诊处方点评与分析[J]. 湖北民族大学学报 (医学版), 2022, 39(2): 66-69.
[13] 聂毓恬. 我院门诊西药处方点评及不合理处方探讨[J]. 北方药学, 2021, 18(9): 107-108.
[14] ZITU MM, OWEN D, MANNE A, et al.Large Language Models for Adverse Drug Events: A Clinical Perspective[J]. J Clin Med, 2025, 14(15): 5490.
[15] 吴倩倩, 黄智生, 徐锋. ChatGPT的抗抑郁药用药知识准确性评估[J]. 中国数字医学, 2023, 18(12): 31-35.
[16] 吴青, 冯越, 孔粼. 基于”互联网人工智能”的智慧临床药学服务模式探索——以儿童癫痫病为例[J]. 卫生软科学, 2025, (2): 58-62.
PDF(1795 KB)

Accesses

Citation

Detail

Sections
Recommended

/