How GPT3 works? GPT-3, or Generative Pretrained Transformer 3, is a large language model trained by OpenAI. It uses machine learning algorithms to generate text based on the input it receives, and can be used for a variety of natural language processing tasks.