I did a similar exercise some time ago and here is what I found: ChatGPT is great about everything you mentioned, but try to ask it to change layer input/output sizes, it will fail! ChatGPT is still bad at math :)