Semantic Product Search
Table 4. Normalization Layer Experiments
['Query Sorted', 'Normalization', 'Recall', 'MAP', 'Matching NDCG', 'Matching MRR', 'Ranking NDCG', 'Ranking MRR']
The “Query Sorted” column refers to whether all positive, impressed, and random negative examples for a single query appear together or are shuffled throughout the data. The best matching performance is achieved using batch normalization and shuffled data. Using sorted data has a significantly negative impact on performance when using batch normalization but not when using layer normalization. Possibly, the batch estimates of mean and variance are highly biased when using sorted data.