Combinatorial Topic Models using Small-Variance Asymptotics
Table 4: Optimized combinatorial topic modeling objective function values for different algorithms with λ=10.
['objective value (×106)', 'SynthA', 'SynthB']
Objective optimization. We can see that the Word algorithm significantly reduces the objective value when compared with the Basic algorithm, and the Word+Refine algorithm reduces further. However, this is not the case for the Word and Word+Refine algorithms and they are quite robust to initializations. From the objective values, the improvement from Word+Refine to Word seems to be marginal. But we will show in the following that the incorporation of the topic refinement is crucial for learning good topic models.