Neural Wikipedian: Generating Textual Summaries from Knowledge Base Triples
Table 5: Model Hyperparameters
['[BOLD] Parameter', 'Triples2LSTM w/ URIs DBpedia', 'Triples2LSTM w/ URIs Wikidata', 'Triples2GRU w/ URIs DBpedia', 'Triples2GRU w/ URIs Wikidata', 'Triples2LSTM w/ Surf. Form Tuples DBpedia', 'Triples2LSTM w/ Surf. Form Tuples Wikidata', 'Triples2GRU w/ Surf. Form Tuples DBpedia', 'Triples2GRU w/ Surf. Form Tuples Wikidata']
For the recurrent component of our networks, we use 1 layer of (i) 650LSTM cells and (ii) 750GRUs , resulting in 3.38M and 3.375M recurrent connections respectively. We found that increasing the number of layers does not improve the performance of our architectures, whereas the dimensionality of the hidden states plays a crucial role in achieving the best possible results.