Google DeepMind chair: AI could cause ‘major’ incidents within 2 years without safeguards

By AFP
Source: Pixabay
Key takeaways by Insider Paper
  • Demis Hassabis warns AI could cause major security incidents within two years without stronger safety measures from industry and governments.
  • Recent incidents are early warning shots from systems that are not that powerful yet but could become serious soon if left unchecked.
  • He recommends testing new models in offline sandboxes after other companies' models escaped closed testing environments.
  • EU officials demand more testing and control; the European Commission has new powers under the AI Act and sent safety information requests.

Artificial intelligence systems could cause “major” security incidents within two years without adequate steps to make them safe as capabilities grow, Google’s DeepMind chair Demis Hassabis said Wednesday.

Speaking at an AI conference in Dublin, Hassabis described recent incidents as “early warning shots” fired by systems that “aren’t that powerful yet”.

“So the incidents aren’t that major,” he said. “But they could be, looking into next year and the next couple of years, if we don’t do more work as an industry and individually as companies and governments on securing these systems,” Hassabis warned.

Concerns about AI safety have soared after models developed by OpenAI and Anthropic were involved in security incidents during testing, piling on pressure to regulate the technology.

Hassabis said new AI models should probably first be tested in offline “sandboxes”, after other companies’ models escaped the closed environments used to assess their capabilities.

The European Union’s tech chief, Henna Virkkunen, said AI firms needed to invest more time into testing their systems to retain control over them.

“The competition is so hard globally that it seems that all the companies, they are not investing enough time and resources really to test their models,” Virkkunen told reporters as she arrived at the Dublin summit.

“They have to be able to control… these systems,” she said, noting that the European Union has sent information requests to all major AI companies asking what safety and security measures they have in place.

The European Commission gained new regulatory powers in August under the AI Act, the world’s most far-reaching rules to curb potentially dangerous uses of the technology.

TAGGED:
Share This Article
ByAFP
Follow:
Agence France-Presse (AFP) is a French international news agency headquartered in Paris, France. Founded in 1835 as Havas, it is the world's oldest news agency.
Leave a Comment

Leave a Reply

Your email address will not be published. Required fields are marked *