As Michael Scott would say, ‘Well, well, well… how the turntables!’ OpenAI seems upset that another AI company is training on its data without permission. The article also provides a gentle introduction to distillation.
It is, as many have already pointed out, incredibly ironic that OpenAI, a company that has been obtaining large amounts of data from all of humankind largely in an “unauthorized manner,” and, in some cases, in violation of the terms of service of those from whom they have been taking from, is now complaining about the very practices by which it has built its company.