Overall, I think these scaling results will guide the next wave of quantization research. If we want to reduce the latency of models like ChatGPT, quantization is an essential tool. We will see FP8 training be common in the next months. Can we push further to 4-bit?