The NYU-CUBoulder Systems forSIGMORPHON 2020 Task 0 and Task 2
Table 3: Results for all test languages on the official test sets for Task 2.
['System Test Set', 'Baseline 1 Test Set', 'Baseline 1 Test Set', 'Baseline 2 Test Set', 'Baseline 2 Test Set', 'Sub-1 Test Set', 'Sub-1 Test Set', 'Sub-2 Test Set', 'Sub-2 Test Set', 'Sub-3 Test Set', 'Sub-3 Test Set']
All three systems produce relatively similar results. NYU-CUBoulder-2, our vanilla transformer ensemble, performed slightly better overall with an average best-match accuracy of 18.02%. Since our system is close to the baseline models, it performs similarly, achieving slightly worse results. For Basque, our all-round ensemble NYU-CUBoulder-2 outperformed both baselines with a best-match accuracy of 00.07%, achieving the highest result in the shared task.