Specialized LLMs: ChatGPT, LaMDA, Galactica, Codex, Sparrow, and More Simple techniques for creating better, domain-specific LLMs... 1. Domain-specific pre-training 2. Supervised Fine-Tuning 3. RL from human feedback (RLHF)