Hmm issue is ChatGPT/GPT-3 incrementally start outputting from the first token so I don't think that's it I think what you're talking about in the random behavior is down to sampling. You probably lucked into an unlike