Learning to Ask Screening Questions for Job Postings
Table 6. Question ranking offline evaluation.
['Model', 'AUROC', 'Precision @1', 'Precision @3', 'Recall @1', 'Recall @3', 'NDCG @1', 'NDCG @3']
Question Ranking. We evaluated four question ranking models listed in Sec. As shown in Tab. the proposed J2Q-QR-XGB-pairwise model outperforms other baselines with up to 24.03% improvement in NDCG. This significant improvement indicates the effectiveness of the proposed model on predicting job poster actions on screening questions. Based on the observation, we chose the pairwise J2Q model as our online question ranking model due to its great ranking performance.