I asked ChatGPT to write a transformer model for language modeling from scratch using nothing but standard Python libraries and then asked it to write the code to train it using Huggingfaces Wikipedia dataset. It worked until Google Colab