Transfer learning from language models to image caption generators: Better models may not transfer better
(a) Hyperparameters for the language models.
['[EMPTY]', 'No transfer', 'Same captions', 'Different captions', 'General text']
The model, whose purpose is to predict the fitness of a given hyperparameter combination, is a random forest and was initialized using 32 random hyperparameter combinations paired with their evaluated fitness (the perplexity or WMD). The hyperparameter combinations were then optimised by exploring a sequence of 64 candidate hyperparameters that the model suggests will maximize the expected improvement in fitness.