Actually, you can serve ads profitably off of a model like ChatGPT. 1) Run a large batch size (512+) with a lot of concurrent users 2) Avoid long sequences (O(N^2), kv cache) with tools like And now your inference runs are cheaper than ads!