DeepSeek: Did a little known Chinese startup cause a ‘Sputnik moment’ for AI?

Did AI just have a “Sputnik moment”?

That’s what some investors, after the little known Chinese startup DeepSeek released a chatbot that experts say holds its own against industry leaders, like OpenAI and Google, despite being made with less money and computing power.

Buzz around DeepSeek built into a wave of concern that hammered tech stocks on Monday. It wiped almost $600bn from chipmaker Nvidia’s market value.

Not iterative or evolutionary, but pathbreaking

“This is, I think, something that has really shown to some degree how much the U.S. was living in a bubble,” said Antonia Hmaidi, a senior analyst at the Mercator Institute for China Studies in Berlin.

“OpenAI and companies like OpenAI had really bet on scaling being sort of infinite, and needing to buy more and more and more chips for performance to improve.”

What DeepSeek showed, she said, is that there are different paths.

The company says it used a little more than 2,000 Nvidia H800 GPUs to train the bot, and it did so in a matter of weeks for $5.6 million. Others have reportedly deployed 10,000 or more GPUs, and spent upwards of $100 million or more to get similar results.

Marina Zhang, a scholar with University of Technology Sydney, said DeepSeek has also demonstrated a new kind of innovation for China – not iterative or evolutionary, but pathbreaking.

“They’re not really following existing models,” she said. “It’s basically based on algorithm optimization, using software to break through the constraints of not enough computational power.”

Have the U.S. chip export controls failed?

Those constraints were imposed on China by the United States. In 2022, the Biden Administration banned the export of cutting edge microchips to China, arguing that they could be used to enhance the Chinese military.

Zhang said DeepSeek has shown that the chip blockade has not been successful so far. Beijing has been doubling down on a self-reliance drive in tech for several years, pouring money into chip development and other sectors, including AI.

Others argue it’s too early to say the chip export controls have failed.

Gregory Allen, director of the Wadhwani AI Center at the Center for Strategic and International Studies in Washington, said DeepSeek could have acquired all its chips before the effect of the controls started to be felt.

In a widely reported 2023 interview, DeepSeek founder Liang Wenfeng said the company had stockpiled some 10,000 Nvidia A100 GPUs – a variety that was put on the U.S. export control list. Experts think those may have been deployed in earlier versions of DeepSeek’s model.

After the chip blockade started, Nvidia developed a workaround, creating the slightly less powerful H800 GPU, which was legal to sell to China for a time.

“We are currently living through the era of the lagging impact of the Biden administration’s misfire in that first batch of AI export controls,” said Allen.

DeepSeek had a window in which it was able to buy H800s – before the administration eventually banned the sale of them to China, too.

“DeepSeek has discovered some architectural innovations, some algorithmic innovations that sort of increase the number of IQ points, the amount of intelligence, that a given AI model can get from a given quantity of computational resources,” he said.

But AI development requires computing power, and the number of advanced GPUs that DeepSeek, or any other Chinese company, can access is limited by the export controls, he said. That will eventually bite.

Allen says it means the U.S. has an edge: access to advanced chips without restrictions.

“We can copy China’s advantages. They cannot copy our advantages. At least not any time soon,” he said.

In terms of the hype around DeepSeek developing its near-cutting edge model on the cheap, Allen said the cost was undoubtedly far north of the reported $5.6 million. He likened it to the development of a drug.

“The cost of developing a new medication is not just the cost of the clinical trial that worked,” he said. “It’s the cost of all the clinical trials that didn’t work. And it’s the same with this AI model training run. DeepSeek has published how much it cost them for that final successful training run.”

It’s not known how much the company spent to get to that point, he said.

Hmaidi says DeepSeek is a “very legitimate triumph of Chinese engineering”. But she says it’s not yet the threat that many are making it out to be.

“I currently don’t see how you get a significantly better model with their current pipeline – without more compute,” she said.

“Personally, I don’t think it’s a threat to America’s AI prowess at this point.”

 

A 2nd U.S. judge says Trump administration must pause its federal spending freeze

The decision came in response to a petition by attorneys general in 22 states and Washington, D.C., seeking to block the administration's efforts to freeze payments for grants and other programs.

Plane with 6 aboard crashes in Philadelphia, setting homes ablaze

A medical transport jet crashed in Philadelphia on Friday about 30 seconds after taking off, unleashing a fireball into the night sky and rattling residents after the second U.S. air disaster in as many days.

Map: A look at helicopter traffic patterns over D.C.

The airspace above Reagan National Airport, where a commercial plane collided with an Army helicopter this week, has become increasingly congested with air traffic, including helicopters.

Oscar-nominated actress Karla Sofía Gascón apologizes for old social media posts

The first openly trans actress to be nominated for an Oscar is facing backlash for old social media posts that denigrate certain marginalized groups. She apologized for the posts through a statement.

Federal websites down as agencies implement executive order ‘defending women’

After the president signed an executive order "defending women against gender ideology extremism," several federal government websites on gender and sexual health disappeared.

5 things to know about the fighting in the Democratic Republic of Congo

Rwandan-backed M23 rebels say they are now in control of the key eastern Congolese city of Goma. Their fighters continue to claim more territory in one of the world's most mineral-rich territories.

More Front Page Coverage