Neural Networks as Explicit Word-Based Rules
Table 3: Percentage of POS tags in extracted words for different kernel sizes.
['[EMPTY]', 'Kernel size 1', 'Kernel size 2', 'Kernel size 3', 'Kernel size 4', 'Kernel size 5']
The most frequent POS tag among the extracted word is adjective. With increasing network capacity, the model becomes sensitive to nouns and proper nouns. The proportion of function words decreases with the increasing kernel size which suggests that it is unlikely that the filters of large kernel size would capture more complex phrases.