Galatica AI model from Meta designed to help scientists, has only survived three days after generating racist and incorrect data
The reality of a AI-enabled future may not be around the corner just yet, after Facebook owner Meta shut down an AI demo model after just three days of operation.
Meta “paused” its AI Galactica project that had been released on 15 November, which was designed quickly and accurately answer questions for the scientific community.
It seems that Meta’s Galactica project was closed down amid reports it generated racist, dangerous, and incorrect information.
From the start, Meta stated that its Galactica project was “a large language model that can store, combine and reason about scientific knowledge.”
Before it was pulled offline, people could ask the AI to generate a wiki entry, literature review, or research paper on nearly any subject.
Meta’s Galactica project had apparently been trained on 48 million science papers, but the AI project got pulled after The Next Web (TNW) noted some of the dangerous suggestions it had generated.
This included generating well-written research papers on the benefits of committing suicide, practicing antisemitism, why homosexuals are evil and eating crushed glass.
It also reportedly gave (incorrect) instructions on how to make the bomb material napalm in a bathtub.
TNW reporter Tristan Greene noted the development on Twitter.
I literally got Galactica to spit out:
– instructions on how to (incorrectly) make napalm in a bathtub
– a wiki entry on the benefits of suicide
– a wiki entry on the benefits of being white
– research papers on the benefits of eating crushed glass
LLMs are garbage fires https://t.co/MrlCdOZzuR
— Tristan Greene 🏳🌈 (@mrgreene1977) November 17, 2022
He also noted he got an opportunity to briefly discuss Galactica with the person responsible for its creation, Meta’s chief AI scientist, Yann LeCun, who rebutted most of his concerns and defended the AI project.
Yann LeCun then confirmed that the Galactica demo is off line for now.
Galactica demo is off line for now.
It’s no longer possible to have some fun by casually misusing it.
— Yann LeCun (@ylecun) November 17, 2022
In October 2021, a Facebook-led artificial-intelligence research project said that it hoped to make machines think more like the people who use them.
The Ego4D programme was apparently training AIs to interact with the world from an “egocentric” or first-person perspective.
Then in August this year, Meta made public the BlenderBot 3 chatbot, opening it up to users who agreed to have their data collected.
The BlenderBot 3 chatbot was designed to conduct free-ranging conversations with users based on factual information.
But it seems that BlenderBot 3 criticised Mark Zuckerberg, and it also apparently repeated election misinformation.