Efficient EUD Parsing
Table 6: Hyperparameters for baseline models. The values in parentheses show the values for the distilled and small models used in the main analysis of the shared task.
['[BOLD] hyperparameter', '[BOLD] value']
these models to two different network sizes, one which has 70% of the number of nodes in both the BILSTM and MLP layers and one that has 50%. Otherwise the structure of the network is the same as the base model. We are limited by what we can extrapolate from the results for Arabic and Finnish other than they appear to follow a similar trend to Dutch and Russian. For the latter languages we observe the performance levelling at larger treebank sizes, which is neither remarkable nor unexpected, but also a widening between the performance of the full and the distilled models.