They don't have to curate that much data for this. That's the whole point of self-supervised pre-training (the PT in ChatGPT). Train on a lot of not-heavily-curated data, then fine tune via the RLHF process to make it a politically