TechnicalAI glossary
Synthetic data
AI-generated data used to train another AI, valuable when real data is scarce, expensive, or sensitive. In the right doses, they supplement the models' diet; used without oversight, they pave the way for model collapse.
In other words
Model supplements: useful as a complement to a real diet, dangerous as an exclusive regimen.
Alyriaz articles that mention it
- What if AI ends up poisoning itself?
Model collapse describes what happens when an AI trains on content generated by other AIs: a gradual impoverishment, like a photocopy of a photocopy. A recent study revives the concern. We explore the phenomenon and the philosophical question it raises: can an intelligence that feeds only on itself still learn?