RPM-Oriented Query Rewriting Framework for E-commerce Keyword-Based Sponsored Search (Student Abstract)
Table 1: Comparison with query embedding baselines.
['Models', 'NLL', 'MAP', 'MRR', 'NDCG']
Offline Evaluation Apart from NLL, we also employ commonly-used ranking metrics, including mean average precision (MAP), mean reciprocal rank (MRR) and normalized discounted cumulative gain (NDCG) to evaluate RQRF. We compare our query embedding model with various baselines, including BM25, PM(non-linear projection),CLSM[DBLP:journals/corr/abs-1812-00158],BIDAF[seo2016bidirectional]. Statistical significance of observed differences between the performance of two runs are tested using a two-tailed paired t-test and is denoted using {}^{\blacktriangle}(or {}^{\blacktriangledown}) for strong significance for \alpha=0.01.