What's new in Spark and machine learning?

John Leonard
clock • 4 min read

Original creator of Spark Zaharia talks about ML Flow and Project Hydrogen, two recent projects designed to make machine learning easier

At the Spark + AI Summit Europe in London last week, we caught up with Apache Spark's original creator Matei Zaharia to talk about recent developments. Zaharia (pictured left) created the cluste...

To continue reading this article...

Join Computing

  • Unlimited access to real-time news, analysis and opinion from the technology industry
  • Receive important and breaking news in our daily newsletter
  • Be the first to hear about our events and awards programmes
  • Join live member only interviews with IT leaders at the ‘IT Lounge’; your chance to ask your burning tech questions and have them answered
  • Access to the Computing Delta hub providing market intelligence and research
  • Receive our members-only newsletter with exclusive opinion pieces from senior IT Leaders

Join now

 

Already a Computing member?

Login

You may also like
'Levelling up cybersecurity is a team effort,' says Jacob DePriest of GitHub

Open Source

But security starts with developers, and AI isn’t going to replace them

clock 09 May 2024 • 5 min read
Facebook chatbot claims to have a child with 'unique needs and abilities'

Social Networking

Moving fast and breaking things again

clock 19 April 2024 • 3 min read
 Microsoft announces new London AI hub

Corporate

New hub is part of ongoing £2.5bn investment in UK

clock 08 April 2024 • 3 min read

Sign up to our newsletter

The best news, stories, features and photos from the day in one perfectly formed email.

More on Big Data and Analytics

Blenheim Estate: How tech is protecting 'the finest view in England'

Blenheim Estate: How tech is protecting 'the finest view in England'

Data analysis and a sprawling sensor network are saving money and boosting biodiversity

Tom Allen
clock 12 June 2024 • 5 min read
Belfast to spearhead UK's digital revolution with £37m Digital Twin Centre

Belfast to spearhead UK's digital revolution with £37m Digital Twin Centre

Aim is to foster innovation across engineering sectors

clock 02 May 2024 • 2 min read
Even CERN has to queue for GPUs. Here's how they optimise what they have

Even CERN has to queue for GPUs. Here's how they optimise what they have

'There's a tendency to say that all ML workloads need a GPU, but for inference you probably don't need them'

John Leonard
clock 17 April 2024 • 4 min read