This model is trained on a large dataset of text and learns to predict the probability distribution of the next word in a sequence, given the previous words. Reinforcement Learning from Human Feedback is the main ingredient behind the working of chatGPT.