A browser plugin to collect ChatGPT prompts in large scale and ask open source to improve the response. Then train a reward model sufficiently good for first iteration. The big open questions are: what is the RM size or 3B?) How the Cha