Cool, thanks for sharing!! GLM-130B was an attempt to open-source a 100B-scale model at least as good as GPT-3 (davinci) and unveil how models of such a scale can be successfully pre-trained! Stay tuned for more advanced models. Btn GPT3 and there was a long way...