Researchers claim new approach to LLMs could slash AI power consumption

Work was conducted as concerns about power demands of AI have risen

clock • 2 min read
Researchers claim new approach to LLMs could slash AI power consumption

ChatGPT uses 10 times the electricity of a Google search – but cutting out ‘matrix multiplication’ could cut this number without affecting performance

New research suggests that eliminating the ‘matrix multiplication' stage of large-language models (LLMs) used in AI could slash power consumption without affecting performance. The research was ...

To continue reading this article...

Join Computing

  • Unlimited access to real-time news, analysis and opinion from the technology industry
  • Receive important and breaking news in our daily newsletter
  • Be the first to hear about our events and awards programmes
  • Join live member only interviews with IT leaders at the ‘IT Lounge’; your chance to ask your burning tech questions and have them answered
  • Access to the Computing Delta hub providing market intelligence and research
  • Receive our members-only newsletter with exclusive opinion pieces from senior IT Leaders

Join now

 

Already a Computing member?

Login

You may also like
Long Reads: The EU AI Act - What you need to know

Legislation and Regulation

The world's first AI Act comes into force next month

clock 18 July 2024 • 14 min read
Cost of GenAI is a negative for software companies, Gartner

Artificial Intelligence

'Revenue gains from the sale of GenAI add-ons ... flow back to their AI model provider partner'

clock 17 July 2024 • 1 min read

Sign up to our newsletter

The best news, stories, features and photos from the day in one perfectly formed email.

More on Artificial Intelligence

Cost of GenAI is a negative for software companies, Gartner

Cost of GenAI is a negative for software companies, Gartner

'Revenue gains from the sale of GenAI add-ons ... flow back to their AI model provider partner'

John Leonard
clock 17 July 2024 • 1 min read
Microsoft unveils prototype LLM designed to analyse spreadsheets

Microsoft unveils prototype LLM designed to analyse spreadsheets

SpreadsheetLLM excels at tabulated number crunching, researchers claim

clock 16 July 2024 • 3 min read
Microsoft AI chief makes questionable claims about copyright and online content

Microsoft AI chief makes questionable claims about copyright and online content

Says web content is 'freeware' for training AI

clock 02 July 2024 • 3 min read