JParaCrawl: A Large Scale Web-Based English-Japanese Parallel Corpus
Table 1: Number of collected sentences and words on English side in JParaCrawl corpus
['[EMPTY]', '[BOLD] # sentences', '[BOLD] # words']
After the bitext alignment process, we mined over 27 million parallel sentences. However, these collected sentences contained many noisy pairs. The filtering model was trained with our in-house English-Japanese parallel corpora. After removing sentence pairs whose scores were lower than 0.5, we retained around 8.7 million sentences.