AGI are still far off; ChatGPT is incredible regardless. But its important to note that the underlying architecture is still mostly transformer based, just with a many parameters. A transformer in the end is just regurgitating the same data it was given, by first compressing it.