Moores law and analog chips to run models on will put the current chat gpt capabilities in reach of basement hackers within a cpl years. Sharding already lets us run models that dont actually fit in GPU memory. Search will be irrelevant soon