Cross-Linguistic Syntactic Evaluation of Word Prediction Models
Таблица 6: Number of minimal sets for all languages and stimulus types using animate nouns.
['[EMPTY]', 'English', 'French', 'German', 'Hebrew', 'Russian']
These are also the number of examples that the LSTM is evaluated on. We do not include inanimate-noun cases in our evaluations for now, since these are much more difficult to replicate cross-linguistically. Indeed, grammatical gender is a confounding variable which—according to preliminary experiments—does have an effect on model performance. Additionally, Hebrew has differing inflections depending on the combination of the subject and object noun genders, which means that we rarely have all needed inflections in the vocabulary.