Model distillation is the mechanism behind the current dispute between US AI companies and Chinese developers. The technique trains a smaller model on the outputs of a larger one. The student model learns to replicate its teacher's decisions, capturing a significant portion of the larger model's capability without access to the underlying training data or the compute investment behind it. That decoupling is the concern the labs are pressing: a party that can observe a frontier model's outputs has a path to a capable model without reproducing the original cost. At Y Combinator's annual Demo Day, CEO Garry Tan told founders the right response is to "do nothing."
Frontier AI companies have accused China of using distillation to copy their models, framing it as a threat to competitive positions built on scale and proprietary training data. Tan's read at Demo Day diverges from that alarm. He said he is less concerned about frontier AI model distillation than the current industry posture implies, placing Y Combinator's leadership at a remove from the labs pressing the copying case most loudly.
His stance extends to the existential risk framing that runs alongside frontier AI development. Tan indicated he is also less concerned about the existential risk of AI, a line of argument that has shaped the public posture of several leading AI companies. Tan's choice to address both issues at Demo Day, and in the same direction, amounts to a deliberate break from the dominant rhetoric in frontier AI. For the founders in the audience, the message was consistent: the threats occupying the largest AI companies are not the ones worth organizing around.