I think the most interesting part of ChatGPT for alignment will be how will it can improve, capability itself not too new. RLHF clearly done much but many many security holes. Can they be patched up to the point it's genuinely hard to jai