Methodology and Results for the Competition on Semantic Similarity Evaluation and Entailment Recognition for PROPOR 2016
Tabela 1: Evaluation results, considering Trial as test set.
['[BOLD] Configuration', '[BOLD] Similarity', '[BOLD] Entailment']
In this case, the best results have been achieved with Kenter’s features with either SVRs or Lasso for semantic similarity evaluation, and SVMs for entailment recognition. With SVR, Pearson correlation of 0.51, 0.49, and 0.50 have been reached for PT-BR, PT-PT, and Overall sets, respectively. In the entailment recognition task, F1 scores of 0.45, 0.50, and 0.51, have been achieved on the same sets, respectively. In addition, we observe that with Lasso, the results are very similar to those of SVR.