Incrementalizing RASA’s Open-SourceNatural Language Understanding Pipeline
Table 1: Test data results of non-incremental TensorFlow, restart-incremental TensorFlow, non-incremental SIUM, and update-incremental SIUM.
['[BOLD] Implementation', '[BOLD] Intent F1-Score', '[BOLD] Entities F1-Score']
These results show that our incremental implementation works as intended, as the incremental and non-incremental version of each component yieled the same results. While there is a small variation between the F1 scores between the non-incremental and incremental components, 1% is well within a reasonable tolerance as there is some randomness in training the underlying model.