Self supervised learning (SSL) alone is not going to produce ChatGPT. It is the combination of SSL with reinforcement learning (RL) that produces the magic. While Yann has advocated SSL, he has talked down RL.