Partial list of innovations that made ChatGPT possible: - Language models - Neural networks - Backprop, Adam - Batch / layer normalization - Contextual embeddings - Attention / transformers - Open-source AI libraries - GPUs