Im tempted to say transformers alone will not be what makes AGI, noticing how chatGPT doesnt clearly know what it doesnt know. More often than not, instead of saying it does not know an answer it will make something up that sounds convincing