IMO those who say gpt3 is simply "predicting the next word" and therefore not very interesting are missing something about it, even if that's true in some narrow sense. IMO it is successfully bridging small gaps in logic to provide solutions to nontrivial problems.