I don't think this refers to "inference time"--it is part of the training process in order to improve its ability to work with its own output. Once you are talking to, say, ChatGPT (i.e. inference time),