A new open-source version of ChatGPT has been released: PaLM-rlhf-pytorch ( This version uses RLHF (Reinforcement Learning with Human Feedback) and is built on top of Google's PaLM architecture, which has 540 billion parameters.