I admittedly dont know all the methods by which ChatGPT models are trained, but I would assume that the reinforcement learning is performed via algorithm and not manual labeling. Manual labeling across such an en