Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data
Table 1: The ratio of unchanged words in the target sentence to the source sentence. “Sent.” means the sentence number. “Tok.” means the token number of the target sentence. “Same %” means the same word percentage.
['[BOLD] Corpus', '[BOLD] Sent.', '[BOLD] Tok.', '[BOLD] Same %']
Although machine translation systems have become state-of-the-art approaches for GEC, GEC is different from translation since it only changes several words of the source sentence. We can observe that more than 80% of the words can be copied from the source sentence.