One of the key reasons Microsoft is able to roll out Prometheus to the masses (via Bing) is that it figured out a way to use Prometheus only when needed. Simple queries get back-end routed to traditional search or older ChatGPT servers. Server load is everything.