SceneSeer: 3D Scene Design with Natural Language
Table 2: Average scene-description match ratings for each of the conditions in our experiment.
['condition', 'mean rating']
Generated scene ratings We see that the basic condition receives the lowest average rating, while predictably the scenes designed by people receive the highest rating. Adding learned support, spatial relation parsing, and priors for relative position improve the rating for the scenes generated by our system, and the full combined condition receives the highest average rating. We note that the scenes generated with additional inferred objects (full+infer) actually receive a lower rating. We hypothesize that two factors may contribute to the lower rating for full+infer. Firstly, adding extra objects makes the scene layout more complicated and prone to exhibiting object selection or spatial relation errors. Secondly, inferred objects are not explicitly mentioned in the description so participants may not have viewed them as significantly improving the quality of the scene (though they were instructed to consider additional objects positively if they add naturally to the appearance of the scene).