ChatGPT works really well, even if it does fudge the truth a bit now and then. I wanted to figure out data what exactly it was trained on. Websites, books and wikipedia, sure, but it's also "value-aligned" by 40 human contractors. Here's what I found out.