RL4LMs is one of the first open source RLHF libraries but it isn't "basically ChatGPT" or "production ready". No open source repo is currently. Open source libs are an important prereq (reproduceability!)... but so is acknowledging limitations. 1/n