Nvidia’s $20bn AI chip pile-up - Asian Tech Roundup

Plus: Canva crops jobs

Image:
Nvidia’s $20bn AI chip pile-up in Hong Kong

Welcome to Computing's weekly roundup of tech news in Asia. This time we look at the battle of wills between the Chinese authorities and the country's chip-hungry AI companies. There's also news of sweeping layoffs at Australia's Canva, and a sovereignty proposal by India that would see LLMs come to data rather than vice versa.

Around 600,000 Nvidia H200 AI chips are sitting in Hong Kong awaiting shipment to mainland China, Reuters reports.

The stranded GPUs would be sufficient to provide the compute for three xAI Colossus-sized hyperscale datacentres.

The high-end AI chips, which typically sell for $32,000-$40,000 a piece, are worth around $20 billion in total - but they could fetch three times that amount on China's grey market, with many companies willing to pay those inflated prices. But for now they remain stranded in Hong Kong, refused entry by the Chinese government, which has been reinforcing its self-sufficiency strategy.

While small shipments have been approved, the authorities have yet to allow large-scale imports of the US-made processors, despite strong demand from the country’s AI companies.

In October, eight-GPU H200 servers were being offered in mainland China for more than $900,000, around three times their price a year earlier on the grey market. At that valuation, the 600,000 GPUs installed in 75,000 eight-GPU servers would be worth more than $67 billion.

The stand-off represents a test of Beijing's desire for domestic companies to reduce their dependence on US technology while also seeking to match or surpass it in terms of AI capability.

Australia

China

India

Japan

Malaysia

South Korea

Taiwan

Elsewhere in Asia