Yeah I think they moved to things like distillation quantization to make their embedding network smaller. I'm not sure how much ChatGPT their Embeddings networks are to each other though, embeddings are more about finding a