PaLM + RLHF - PyTorch (1K) An open-source implementation of RLHF + PaLM (Google's large language model). RLHF is what's used to train ChatGPT. Looks like there's also a plan to add retrieval. Amazing! Had to share this one! Go open-source!