Cross-modal Language Generation using Pivot Stabilization for Web-scale Language Coverage
Table 5: SxS performance of PLuGS-5L vs. PLuGS-2L models for three languages.
['[BOLD] Lang', '[ITALIC] Wins', '[ITALIC] Losses', '[ITALIC] Gainsxs', '[ITALIC] BAccept', '[ITALIC] AAccept', '[ITALIC] GainAccept']
To accurately evaluate the impact of multi-linguality, we also perform SxS evaluations between the PLuGS-2L (as the base condition) vs. PLuGS-5L (as the test condition) models, over three languages (French, German, and Hindi). The results are encouraging, and indeed support the hypothesis that similar languages are reinforcing each other in the common representation space, explaining the gain observed for the Romance languages and the detrimental impact on Hindi.