I guess the reinforcement setting was such that the humans had to flag ChatGPT output with politically correct vs politically incorrect (though Im sure they used different terms), and reading the p.i. output was the traumati