Extracting Daily Dosage from Medication Instructions in EHRs: An Automated Approach and Lessons Learned
Table 7: System evaluation results on all 1000 prescriptions.
['[EMPTY]', '[EMPTY]', '[BOLD] System  [BOLD] Daily dosage extracted and CORRECT', '[BOLD] System  [BOLD] Daily dosage extracted but INCORRECT', '[BOLD] System  [BOLD] Daily dosage NOT extracted']
Our system achieved 0.98 precision, 0.95 recall, 0.96 F1 score and 96.2% accuracy on the evaluation dataset of 1000 Sigs. Another way to understand these results is by comparison to daily dosage as provided by human experts in the ground truth. In our evaluation dataset, human experts provided a daily dosage in 83% of the data, and is 100% correct when a daily dosage value is returned. Whereas, our system returned a daily dosage in 81.6% of the data, and is 98.2% correct when returned.