An implementation of RLHF (Reinforcement Learning with Human Feedback) based on Google's 540 billion parameter PaLM architecture has recently been released as the first open-source equivalent of ChatGPT. The link to the implementation can be found here: