Digital Storage And Reminiscence Projections For 2024, Half 2

That is the second in a set of three blogs about projections for digital storage and reminiscence for the next 12 months that now we have been doing for some time. Our first weblog targeted on the newest developments and projections for magnetic recording (HDDs and magnetic tape). This weblog focuses on varied sorts of solid-state non-volatile reminiscence and storage. We’ll speak concerning the newest developments in flash reminiscence, DRAM, NVMe, NVMe-oF, together with computational storage and CXL and the way this may change the way in which we do computing.

On the shut of 2023 demand for all storage and reminiscence applied sciences has been down for a couple of 12 months and a half for shopper, shopper and server purposes. This was as a result of a big extent to the top of the pandemic and the discount in shopper demand and the normalization of provide chains. Specifically many storage clients and information facilities have been left with giant inventories of storage merchandise. As a consequence, NAND flash and HDD firms have in the reduction of on manufacturing and usually down sized to manage their prices.

The drop in NAND demand resulted in vital worth declines by means of most of 2023 to the purpose the place NAND flash was mainly promoting at the price of manufacturing. As a consequence, in September Samsung lower its NAND flash manufacturing by 50% and different flash reminiscence producers made related manufacturing cuts. The NAND flash firms additionally reported that they targeted their manufacturing on lower than 128 layer flash.

TrendForce projected that this these cuts in unit and capability manufacturing would cease the NAND flash worth erosion within the 4^th quarter of 2023 and will improve $/GB costs by 5%. The analyst agency lately stated that enterprise SSD income grew 4.2% in 3Q23 and this was anticipated to extend by 20% in 4Q23. TrendForce additionally projected that DDR5 DRAM costs might rise 3-8% in 4Q23. WDC lately stated that NAND flash costs might rise by 55% within the coming quarters. These are encouraging indicators that the solid-state storage market is stabilizing and may look ahead to stable development in 2024.

There are numerous drivers for greater storage demand in 2024 and past and this could drive demand for storage gadgets. This appears like it can drive new capital spending going ahead. Semi reported that memory-related capital expenditures noticed a pointy decline in 2023. NAND gear gross sales are predicted to have dropped by 49% to $8.8 billion in 2023 but it surely expects this spending will surge 21% to $10.7 billion in 2024 and rise one other 51% to $16.2 billion in 2025. This in signifies projections for demand will increase beginning in 2024.

DRAM gear gross sales are anticipated to stay steady, rising by 1% and three% in 2023 and 2024, respectively. Supported by steady expertise migration and increasing demand for high-bandwidth reminiscence (HBM), DRAM gear phase gross sales are anticipated to extend an extra 20% to $15.5 billion in 2025.

NAND flash is the dominant main storage (storage for energetic in-process information) in information facilities and enterprise purposes and it’s usually the one storage utilized in shopper gadgets equivalent to sensible telephones and in most private computer systems. In bigger amenities energetic information lives on SSDs with colder information typically stored on arduous disk drives (HDDs) and magnetic tape.

Nonetheless, there are firms, equivalent to Pure Storage, who undertaking that with decrease costs and higher endurance utilizing QLC NAND flash that it’ll displace demand for HDDs in secondary storage. Whether or not this occurs to a major diploma in information facilities relies upon upon whether or not HAMR HDDs are profitable in enabling worth declines for HDD storage, persevering with the choice for HDDs for storing colder information.

On the 2023 Flash Reminiscence Summit, SK hynix introduced that that they had made 321-layer 3D NAND flash (their 4D flash) however indicated that this might not go into mass manufacturing till 1H 2025. They stated that this was attainable by lowering the stress within the supplies, with a number of overlay alignment corrections and with a more cost effective course of. This prolonged introduction date is in step with flash reminiscence firms slowing their introduction of upper density reminiscence till the marketplace for NAND flash recovers.

SK hynix stated that it began mass manufacturing of 238-layer NAND merchandise in March 2023 for cell gadgets. SK hynix additionally stated that it was engaged on enhanced key-value computational storage gadgets for AI workloads. The corporate can also be sampling processing in reminiscence (PIM) merchandise for AI purposes.

Kioxia and Western Digital and different NAND flash distributors are shifting to bonding separate logic and reminiscence wafers collectively relatively than making them on the identical wafer. This permits the next reminiscence density and permits separate growth of the logic and flash reminiscence elements. This method was pioneers by Chinese language flash reminiscence firm YMTC a couple of years in the past.

NVMe is now the dominant flash reminiscence interface and NVMe-oF (over cloth) the place the material is usually ethernet, is changing into frequent in information facilities. NVMe-oF is getting used to create swimming pools of solid-state storage that may be shared between CPUs and servers.

This pooling and sharing of storage is known as disaggregation (breaking down the varied elements of servers right into a shared pool), which software program can then use to create composable infrastructure supporting digital gadgets or containers that may be created or destroyed as wanted. This sort of pooling and composability is being prolonged to reminiscence with the Compute Categorical Hyperlink (CXL) interconnect.

CXL gives for a switched community for reminiscence of varied sorts with totally different prices and efficiency. CXL 3.0 allows creating reminiscence swimming pools that may be shared between CPUs. There are some merchandise being introduced in 2023 for reminiscence pooling with CXL and we anticipate some shipments of merchandise together with these advances in 2024.

Marvell, Microchip, Phision and different controller firms are supporting CXL (in addition to NVMe) of their controllers as a way of attaining full information middle composability that features reminiscence pooling in addition to storage pooling.

There was a lot dialogue this 12 months about utilizing NAND flash as a part of upcoming CXL reminiscence techniques in 2023. This effort is partially pushed by a requirement for cheaper reminiscence to help DRAM for the reason that finish of Optane reminiscence growth. SK hynix stated that they’re engaged on two sorts of CXL reminiscence modules on the 2023 FMS, one targeted on bandwidth reminiscence growth (BME) and one on capability reminiscence growth (CME) in addition to computational reminiscence options (CMS). The slide under describes the BME, CME and CMS reminiscence module gadgets.

Different main NAND firms, equivalent to Samsung have additionally launched their very own CXL-based NAND flash merchandise in addition to controller firm Microchip and unbiased SSD firms equivalent to Fadu. Kioxia believes that greater CLX storage density utilizing flash reminiscence permits for much less information transfers and elevated processing effectivity for purposes equivalent to AI. They see utilizing their BiCS flash for learn intensive CXL purposes and XL-Flash (with single degree cells) for random learn/write entry reminiscence growth. Samsung is selling its CXL semantic reminiscence SSD for AI techniques as proven under.

Kioxia additionally talked about placing extra intelligence into their SSDs, with extra highly effective SoCs on enterprise SSDs that enable offloading RAID capabilities with their Gen 5 PCI merchandise, to cut back CPU masses. In addition they talked about utilizing flash reminiscence storage for personal AI fashions. Samsung spoke about SSDs for zonal management automotive purposes. Samsung additionally introduced excessive efficiency SSDs for generative AI purposes. The corporate was displaying its 256TB SSD which can be geared in the direction of constructing petabyte-scale stable state storage options.

In addition to developments from the 2023 FMS there have been additionally some related developments on the 2023 IEDM convention. As an illustration, Macronix has a way for therapeutic put on utilizing warmth on NOR flash. They plan to make use of this on particular areas on the die for the reason that heating components to do the refresh take up actual property. The corporate additionally had a paper on 3D NOR and 4Gbit die anticipated in 2024.

Throughout WDC’s FMS speak regarded into the varied components for growing flash reminiscence density and the affect they make on density enhancements (see determine under). Vertical scaling (the variety of layers) has a smaller contribution as we speak than it did prior to now since extra layers means longer course of time. Lateral scaling (the density of the reminiscence holes can have the most important affect, adopted by logical density (bits per cell). Architectural modifications, equivalent to bonding logic and reminiscence wafers collectively may improve reminiscence density.

Though Intel’s Optane reminiscence began to wind down in 2022, varied different non-volatile reminiscence applied sciences are ramping up in embedded software, initially changing NOR flash for code storage and a few SRAM for cache reminiscence. These embrace magnetic random-access reminiscence (MRAM) and varied resistive RAM (RRAM) applied sciences. TSMC, Samsung and different foundries have produced varied embedded gadgets for wearable and automotive purposes, as well as, the growing recognition of chiplet expertise and the brand new common chiplet interconnect specific (UCIe) interface might drive discrete reminiscence chiplet demand, each for DRAM in addition to rising recollections.

Because the chart under from the Coughlin Associates and Goal Evaluation Rising Recollections Department Outreport signifies, development in each embedded and discrete non-volatile reminiscence expertise (represented by MRAM) might drive growing capability shipments to a probable $59B of income by 2033.

On the 2023 IEEE MRAM Discussion board it seems that embedded reminiscence purposes are driving growth and purposes for rising recollections. Specifically foundry firms equivalent to Samsung are growing MRAM reminiscence merchandise to allow the following technology of automotive purposes as proven under. That is driving growth of 14nm and even all the way down to 5nm merchandise within the subsequent few years.

Though 2023 ended with demand down for every type of storage and reminiscence applied sciences for a second 12 months, we anticipate that demand will recuperate in 2024 to fulfill growing storage demand and to achieve efficiencies from the newest applied sciences that embrace advances in NAND, DRAM, CXL and varied rising recollections.

Observe me on Twitter or LinkedIn. Try my web site.