Ah interesting. I wasn't aware of that. I tried out a chatgpt api client and it didn't stream the response, but I didn't look under the hood as to how that was working. I guess it must have been batching the tokens up and then sendi