ChatGPT responses do feel very templated. Almost as if it searches for relevant templates based on the query first and performs edit/insert operations on top. Curious if it is because RLHF is susceptible to low prediction variability or deployment settings.