AI boom to keep supply of high-end memory chips ‘tight’ through 2024

A Samsung Electronics Co. 12-layer HBM3E, top, and other DDR modules arranged in Seoul, South Korea, on Thursday, April 4, 2024. Samsung’s profit rebounded sharply in the first quarter of 2024, reflecting a turnaround in the company’s pivotal semiconductor division and robust sales of Galaxy S24 smartphones. Photographer: SeongJoon Cho/Bloomberg via Getty Images

Bloomberg | Bloomberg | Getty Images

High-performance memory chips are likely to remain in tight supply this year, as explosive AI demand drives a shortage for these chips, according to analysts.

SK Hynix and Micron – two of the world’s largest memory chip suppliers – are out of high-bandwidth memory chips for 2024, while the stock for 2025 is also nearly sold out, according to the firms.

We expect the general memory supply to remain tight throughout 2024,” Kazunori Ito, director of equity research at Morningstar said in a report last week.

The demand for AI chipsets has boosted the high-end memory chip market, hugely benefiting firms such Samsung Electronics and SK Hynix, the top two memory chipmakers in the world. While SK Hynix already supplies chips to Nvidia, the company is reportedly considering Samsung as a potential supplier too.

High-performance memory chips play a crucial role in the training of large language models (LLMs) such as OpenAI’s ChatGPT, which led AI adoption to skyrocket. LLMs need these chips to remember details from past conversations with users and their preferences to generate human-like responses to queries.

“The manufacturing of these chips are more complex and ramping up production has been difficult. This likely sets up shortages through the rest of 2024 and through much of 2025,” said William Bailey, director at Nasdaq IR Intelligence.

HBM’s production cycle is longer by 1.5 to 2 months compared with DDR5 memory chip commonly found in personal computers and servers, market intelligence firm TrendForce said in March.

Samsung gets $6.4 billion for chip plants

To meet soaring demand, SK Hynix plans to expand production capacity by investing in advanced packaging facilities in Indiana, U.S. as well as in the M15X fab in Cheongju and the Yongin semiconductor cluster in South Korea.

Samsung during its first-quarter earnings call in April said its HBM bit supply in 2024 “expanded by more than threefold versus last year.” Chip capacity refers to the number of bits of data a memory chip can store.

“And we have already completed discussions with our customers with that committed supply. In 2025, we will continue to expand supply by at least two times or more year on year, and we’re already in smooth talks with our customers on that supply,” Samsung said.

Micron didn’t respond to CNBC’s request for comment.

Intense competition

Big Tech companies Microsoft, Amazon and Google are spending billions to train their own LLMs to stay competitive, fueling demand for AI chips.

“The big buyers of AI chips – firms like Meta and Microsoft – have signaled they plan to keep pouring resources into building AI infrastructure. This means they will be buying large volumes of AI chips, including HBM, at least through 2024,” said Chris Miller, author of “Chip War,” a book on the semiconductor industry.

Chipmakers are in a fierce race to manufacture the most advanced memory chips in the market to capture the AI boom.

SK Hynix in a press conference earlier this month said that it would begin mass production of its latest generation of HBM chips, the 12-layer HBM3E, in the third quarter, while Samsung Electronics plans to do so within the second quarter, having been the first in the industry to ship samples of the latest chip.

“Currently Samsung is ahead in 12-layer HBM3E sampling process. If they can get qualification earlier than its peers, I assume it can get majority shares in end-2024 and 2025,” said SK Kim, executive director and analyst at Daiwa Securities.

Source link

Related Posts

European banks in Russia face ‘awful lot of risk’, Yellen says

U.S. Secretary of the Treasury Janet Yellen speaks while presiding over a meeting of the Financial Stability Oversight Council at the Treasury Department on May 10, 2024 in Washington, DC. …

Read more

What Porsche Teen’s Grandfather Told Driver After Crash

The crash that took place late on Saturday night left two young engineers dead Pune: The grandfather of the 17-year-old, whose late-night drunken drive in a Porsche, left two 24-year-old…

Read more

FDA panel votes against Novo Nordisk’s weekly insulin in type 1 diabetes patients

A view of the logo of Novo Nordisk at the company’s office in Bagsvaerd, on the outskirts of Copenhagen, Denmark, March 8, 2024.  Tom Little | Reuters Advisers to the…

Read more

Lok Sabha Election 2024 Phase 6: Delhi, Haryana Vote Today In Penultimate Phase: 10 Points

Lok Sabha Election 2024: Election will be completed in 486 of the 543 Lok Sabha seats today. New Delhi: Voting will take place in 58 seats across seven states and…

Read more

Stock market today: Live updates

Traders work on the floor of the New York Stock Exchange during morning trading on May 24, 2024 in New York City.  Michael M. Santiago | Getty Images Stocks ticked…

Read more

India Great Took Pay Cut To Work For BCCI, Now Reluctant To Apply For ‘Taxing’ Coach’s Job: Report

VVS Laxman‘s reluctance to become the Indian team’s head coach is an open secret but with the former batting stalwart’s stint as NCA’s ‘Head of Cricket’ ending in…

Read more

Leave a Reply