Legal Question Answering using Ranking SVM and Deep Convolutional Neural Network
Table 10: Formal run in phase 2 & 3, COLIEE 2016.
['[BOLD] Method', '[BOLD] Phase 2', '[BOLD] Phase 3']
In phase 2, two best systems are iList7 and KIS-1. iList7 applies major voting of decision tree, SVM and CNN with various features; KIS-1 just uses simple rules of subjective cases and an end-of-sentence expression. In phase 3, UofA achives the best score. It extracts the article segment which related to the query. This system also performs paraphrasing and detects condition-conclusion-exceptions for the query/article. From the experimental results, deep learning models do not show their advantages in case of a small dataset. On the other hand, providing handcraft features and rules are shown to be useful in this case.