AI interview: Chunk wisely to avoid RAG hell

DataStax's Ed Anuff on the finer points of AI app development

John Leonard
clock • 4 min read
AI interview: Chunk wisely to avoid RAG hell
Image:

AI interview: Chunk wisely to avoid RAG hell

"Almost any developer worth their salt could build a RAG application with an LLM, once they understand the basics of it," said chief product officer at DataStax, Ed Anuff.

"And then chunking hits and your results start to get really wonky. Now you're in RAG hell, and you have to go off and Google." Most of us, we suspect, would have gone off and Googled well befor...

To continue reading this article...

Join Computing

  • Unlimited access to real-time news, analysis and opinion from the technology industry
  • Receive important and breaking news in our daily newsletter
  • Be the first to hear about our events and awards programmes
  • Join live member only interviews with IT leaders at the ‘IT Lounge’; your chance to ask your burning tech questions and have them answered
  • Access to the Computing Delta hub providing market intelligence and research
  • Receive our members-only newsletter with exclusive opinion pieces from senior IT Leaders

Join now

 

Already a Computing member?

Login

You may also like
Meta confirms initial release of Llama 3 LLM within weeks

Artificial Intelligence

Several iterations to be rolled out over next few months

clock 10 April 2024 • 2 min read
'We can become the best airport in the world': How Heathrow's new CIO is transforming travel

Strategy

‘I want my time in the airport to be seamless, personalised and digital-first'

clock 10 April 2024 • 3 min read

More on Developer

 Github releases results of first empirical study of DevEx

Github releases results of first empirical study of DevEx

Results show that improving developer experience matters more than you might think

Penny Horwood
clock 24 January 2024 • 4 min read
Researchers unveil AI-driven software verification breakthrough

Researchers unveil AI-driven software verification breakthrough

Most effective and efficient means yet devised for verifying software correctness, they claim

clock 08 January 2024 • 2 min read
Life after Oracle: Redefining Java in the enterprise in 2024

Life after Oracle: Redefining Java in the enterprise in 2024

Ignore the cool kids. 2024 will see Java redefine its value to enterprise

Simon Ritter
clock 08 December 2023 • 5 min read