Unless the models, weights, data, etc. are closed-source. Then it really is a black box where skills arent rooted in knowledge. For example, all ChatGPT prompting could change tomorrow and no one would know why.