I don't know! Would be very interested to find out Often training a model is expensive and hence not something you do on a continuous basis, but maybe that's only true for huge models like GPT3 itself while the RLHF model used by Chat