Meta pulls Galactica science LLM demo after three days of hallucinations

Meta's Galactica LLM, trained on 48M scientific papers and intended to summarize knowledge, was taken offline within three days of its public demo after it produced alarmingly plausible fabricated science, racist outputs, and 'research papers' on dangerous topics like eating crushed glass.

What this means for youAt home and at work, an AI tool can write convincing but false science, complete with fake-looking citations, so check any claim against a primary source before relying on it. Governments and institutions should require independent testing before public release of tools that present themselves as sources of knowledge.