Can ChatGPT replace Google? To a (very?) large extent but not all. It would be very difficult and inefficient to store the whole Internet in neural networks. It's cost-effective to just build a mapping from queries to pages or to spans. Looking up is much cheaper than inference.