GPT-JT 6 billion param modelwas opensourced few days ago. It s performance is way better than the GPT3 from 2 years ago, and almost the same with InstructGPT3. Opensourcing chat datasets may help training an open source chat GPT