Distilling Knowledge for Search-based Structured Prediction
Table 5: The minimal, maximum, and standard derivation values on differently-seeded runs.
['system', 'seeds', 'min', 'max', '[ITALIC] σ']
Besides the improved performance, knowledge distillation also leads to more stable learning. As Keskar et al.