Development and effectiveness of an automatic response system for disease code search for medical code providers, Thammasat University Hospital

Abstract

Background: In fiscal year 2023, there was a problem of failure to submit medical service fee reimbursement, which was partly due to the incorrect disease code at 53.31%. Therefore, the researcher is interested in developing an automatic response system for searching for disease codes (Line Chatbot) to meet user needs for the correct ICD-10 codes and reduce the time spent searching for the criteria for providing ICD-10 codes.

Objective: To develop and study the effectiveness of the automatic response system according to the ICD-10 coding criteria, including coding duration, coding accuracy, and satisfaction with using the Line Chatbot.

Material and methods: This research was a developmental study. Phase 1 studied the content of the Line Chatbot and the criteria for ICD-10 coding. Phase 2 created a Line Chatbot. Phase 3 tested it with 11 medical coders and administered a test and satisfaction assessment. Phase 4 evaluated the results, comparing the time and accuracy obtained from the test before and after using the Line Chatbot using Wilcoxon statistics. Satisfaction with using Line Chatbot was analyzed using the mean () and standard deviation (SD).

Result: After using Line Chatbot, the sample group had a statistically significantly higher mean score of ICD 10 coding accuracy (p < 0.003). The mean score before using Line Chatbot was 17.09 (SD = 3.208) and increased to 19.00 (SD = 1.732). The time taken to give ICD-10 coding decreased statistically significantly (p < 0.003). The mean score before using Line Chatbot was 39.09 (SD = 15.391) and decreased to 21.82 (SD = 8.340). The overall satisfaction assessment of Line Chatbot was at the highest level ( = 4.77, SD = 0.447).

Conclusion: The developed Line Chatbot can increase the accuracy and speed of ICD-10 coding, which is a collection of criteria and techniques for coding diseases, easy to search, useful for submitting medical service fees, and leading to the development of other medical coding in all levels of hospitals.