As long as human programming biases continue to be put in systems like ChatGPT, it will act to cripple the progress of these systems toward the best and most creative answers the AIs might otherwise provide. Is this a just a speed-bump, or will it amount to something worse?