I had a super fun time speaking at the last year about everything transformer architecture related. If you want a deep understanding of the underlying architecture of Large Language Models like ChatGPT, I hope this gets you started.