Speeding up Natural Language Parsing by Reusing Partial Results
Table 2: Performance of MaltParser with arc-eager transition system and the % of the text reduction after applying templates with different thresholds, on the development set. The total number of words in the development set: 25150 and test set: 25097.
['Setup', 'UAS (%)', 'LAS (%)', 'Word Reduction (%)']
In the experimental setup we use templates consisting of bigrams alone, trigrams alone or combined in order to compare their performance. While the specific parameters to choose depend on the speed-accuracy balance one wants to achieve , we selected the models where the thresholds for the dominant head and label pattern are 83-83 and 87-87 as our “optimal models”, considering that they provide a reasonable trade-off between speed and accuracy. Thus, only these optimal thresholds were used afterwards when testing the technique on the development and test sets in order to investigate more in detail and to compare the accuracy and parsing speed. We use the notation Mx,yz where x indicates whether bigrams (2) were used, y trigrams (3) and z level of confidence for head and label pattern respectively.