CUNI System for the Building Educational Applications 2019Shared Task: Grammatical Error Correction
Table 4: The effect of source word dropout, target word dropout, and MLE weight on development combined F0.5 score.
['Source', 'Target', 'MLE', 'Dev']
We improved the F0.5 score by adding source_word_dropout, target_word_dropout and MLE weighting by almost 4%. To find out optimal values of all three hyper-parameters, we ran a small grid search. The source-word dropout improves the results the most, MLE provides minor gains, while the influence of target-word dropout on the results is unclear.