Conversational Help for Task Completion and Feature Discovery in Personal AssistantsThis work was presented at 2nd Workshop on Humanizing AI (HAI) at IJCAI’19 in Macao, China.
Table 5: Precision vs Recall trade-off for various similarity thresholds in semantic query matching scores.
['[BOLD] Similarity  [BOLD] Threshold', '[BOLD] Precision', '[BOLD] Recall', '[BOLD] F1 Score']
As it can be seen, reducing the threshold yields higher recall at the cost of lower precision and vice-versa. We chose the similarity threshold to be greater than 0.75, as it gives the best F1-score of 0.801.