and i dont doubt that they use that method during sampling for chatgpt (they do in the gpt3 playground because you can specify temp, topk and topp iirc, and those are parameters that that specific sampling method uses)