Hmm I think it is a genuinely hard Q, though (perhaps biasedly since I do have some proprietary info) I am not sure limited transparency is the only bottleneck in answering it. BLOOM, GPT-J etc. are all available to probe + it isnt much easie