Aspect Based Sentiment Analysis with Gated Convolutional Networks
Table 7: The accuracy of different gating units on restaurant reviews on ACSA task.
['Gates', 'Restaurant-Large Test', 'Restaurant-Large Hard Test', 'Restaurant 2014 Test', 'Restaurant 2014 Hard Test']
In this section, we compare GLU ( X∗W+b)×σ(X∗Wa+Vva+ba) Dauphin et al. , GTU tanh(X∗W+b)×σ(X∗Wa+Vva+ba) van den Oord et al. GTRU outperforms the other gates. It has a convolutional layer generating aspect features via ReLU activation function, which controls the magnitude of the sentiment signals according to the given aspect information. On the other hand, the sigmoid function in GTU and GLU has the upper bound +1, which may not be able to distill sentiment features effectively.