Learning Inference Networks for Structured Prediction Energy Networks
Table 9: Comparison of inference network stabilization terms and showing impact of retuning when training SPENs with margin-rescaled hinge (Twitter POS validation accuracies).
['inference network stabilization terms', 'validation accuracy (%) -retuning', 'validation accuracy (%) +retuning']
Cross entropy works better than entropy in this setting, though retuning permits the latter to bridge the gap more than halfway.