ChatGPT doesn't yet know about autodiff, but at least it understands the problems with finite difference methods and evolutionary algorithms. Maybe ChatGPT2 will know the secret to its own existence...