Unclear what to make of these reports of mass human annotation behind chatGPT. Imitation learning, after all, is in a certain sense formally equivalent to 'general' supervised learning anyway ie one is always 'imitating' feedback to some extent (