Google's new AI training data fivefold larger than predecessors

New AI model been trained on 3.6 trillion tokens

clock • 3 min read
Google's PaLM 2 training data surpasses that of its predecessor by nearly fivefold, report
Image:

Google's PaLM 2 training data surpasses that of its predecessor by nearly fivefold, report

Google unveiled PaLM 2, its latest large language model (LLM), at its annual developer conference last week - but its claims at the time about using a smaller training data set have been called into question.

A report by CNBC has found that PaLM 2 actually uses nearly five times the amount of training data as its predecessor, PaLM (Pathways Language Model), giving it the capability to perform in tasks s...

To continue reading this article...

Join Computing

  • Unlimited access to real-time news, analysis and opinion from the technology industry
  • Receive important and breaking news in our daily newsletter
  • Be the first to hear about our events and awards programmes
  • Join live member only interviews with IT leaders at the ‘IT Lounge’; your chance to ask your burning tech questions and have them answered
  • Access to the Computing Delta hub providing market intelligence and research
  • Receive our members-only newsletter with exclusive opinion pieces from senior IT Leaders

Join now

 

Already a Computing member?

Login

You may also like
Health and safety gone rad: Fogsphere brings AI chops to workplace monitoring

Artificial Intelligence

London-based startup Fogsphere uses standard 4K security cameras - the type that can be purchased for £70 - to monitor workplaces and create immediate alerts as soon as dangerous conditions are spotted.

clock 23 July 2024 • 3 min read
Google abandons plan to phase out third-party cookies

Privacy

In a bid to please everyone, Google has done the opposite

clock 23 July 2024 • 3 min read
Google's $23bn Wiz bid fizzles

Mergers and Acquisitions

Startup cites antitrust and investor concerns

clock 23 July 2024 • 1 min read
Most read
01
02
04

Google's $23bn Wiz bid fizzles

23 July 2024 • 1 min read

Sign up to our newsletter

The best news, stories, features and photos from the day in one perfectly formed email.

More on Big Data and Analytics

Industry Voice: How tech investment is improving efficiency at Mitie

Industry Voice: How tech investment is improving efficiency at Mitie

A single source of truth underpinning everything

Shaun Carroll
clock 19 June 2024 • 1 min read
A matter of scale: How this World Heritage site is getting a handle on big data

A matter of scale: How this World Heritage site is getting a handle on big data

'In two years it will be 45 million rows, easily'

Tom Allen
clock 19 June 2024 • 4 min read
Blenheim Estate: How tech is protecting 'the finest view in England'

Blenheim Estate: How tech is protecting 'the finest view in England'

Data analysis and a sprawling sensor network are saving money and boosting biodiversity

Tom Allen
clock 12 June 2024 • 5 min read