Sequential Graph Dependency Parser
Table 2: Varying oracle and roll-in policies on German. (U), (C), (A) refer to uniform, coaching, and annealing, respectively. The π∗coach and πvalidθ roll-ins are mixtures with a uniform oracle, with β=0.5 for coaching (C), and β linearly annealed by 0.02 every 2000 steps for annealing (CA).
['[BOLD] Oracle', '[BOLD] Roll-in', '[BOLD] UAS', '[BOLD] Loss']
In this experiment, we study the effects of varying the oracle and roll-in distributions. Models trained with coaching (C) use a mixture with β=0.5, after observing lower UAS in preliminary experiments with lower β. The π∗coach and πvalidθ roll-ins use a mixture with β=0.5 and greedy decoding, which generally outperformed stochastic sampling.