A year and a half after first publicly unveiling their new 3D XPoint non-volatile memory technology, Intel is launching the first product incorporating the new memory. The Intel Optane SSD DC P4800X is an enterprise PCIe 3 x4 NVMe SSD that Intel promises will be the the most responsive data center SSD with lower latency than all of the fastest NAND flash based competitors. After months of touting 3D XPoint memory primarily with rough order of magnitude claims about its performance, endurance and cost relative to DRAM and NAND flash, and after some unexplained delays, Intel is finally providing some concrete specifications and pricing for a complete SSD that is shipping today. The information is more limited than we're accustomed to for their NAND flash SSDs, and Intel still isn't confirming anything about the materials or exact operating principle of the 3D XPoint memory cell.

Current computer system architectures are based around the use of DRAM as working memory and NAND flash for fast storage. 3D XPoint memory falls between the two technologies on most important metrics, so Optane SSDs bring a new dimension of complication to a server architect's task. For most enterprise use cases, the most enticing feature of Optane SSDs over NAND SSDs is the former's higher performance, especially reduced latencies. Aside from the gains from switching to the NVMe protocol, the latency offered by NAND flash based SSDs has been mostly stagnant or even regressed with the disappearance of SLC NAND from the market, even as throughput and capacity have grown with every generation.

The Intel Optane SSD DC P4800X is rated for a typical read or write latency under 10µs, compared to tens of microseconds for the best NAND flash based SSDs, and about 4µs minimum imposed by PCIe and NVMe transaction overhead. More impressive is how little latency degrades under less than ideal conditions. Queue depth 1 random reads are rated to remain below 30µs even while the drive is simultaneously accepting 2GB/s of sustained random writes (about 500k IOPS). Intel even specifies Quality of Service (QoS) standards for latency at the 99.999th percentile, with even QD16 random writes staying almost entirely below 200µs. A consequence of the low latency is that the P4800X can deliver full throughput at lower queue depths: the P4800X is rated to deliver maximum IOPS at QD16 while flash-based SSDs are specified for queue depths of at least 32. Unlike flash memory, the read and write performance of 3D XPoint memory is roughly equal, and this is reflected in Intel's specifications for the P4800X.

Conspicuously missing from the performance specifications are sequential throughput. The P4800X can already use more than half of the available PCIe bandwidth with a completely random I/O workload. Rather than reassure us that the P4800X can do even better with larger transfer sizes, Intel suggests that being overly concerned with the sequential transfer speeds is a sign that you should be shopping for their 3D NAND SSDs instead. They'll offer plenty of throughput for a far lower price.

Intel's 3D XPoint memory is being manufactured as a 128Gb (16GB) die, slightly behind the trend for NAND flash capacities. As a result, the Optane SSD DC P4800X will start with a 375GB model and later this year be followed by 750GB and 1.5TB models. The top-performing enterprise SSDs currently tend to be multi-TB drives. Intel has shared very few details about the new controller they've developed for the P4800X, but they have disclosed that the 375GB model uses seven channels with four dies per channel, for a total of 28 chips and a raw capacity of 448GB. Fourteen packages of 3D XPoint memory are visible on the back side of the drive in the photographs Intel has released, suggesting that fourteen more packages are hiding under the heatsink and that the 375GB add-in card model is using single-die packages. The controller implements a high-performance all-hardware read path that does not involve the drive's firmware, and while the exact stride of memory accesses is not known, a single 4k read will be spread across all seven channels.

3D XPoint memory can be read or written with byte granularity and modifications can be written in place, so it is free from the worst internal fragmentation and write amplification challenges that are caused by the large page sizes and huge erase block sizes of NAND flash. This means that further overprovisioning beyond the drive's native amount will have minimal impact on performance and that the performance of a full drive should not suffer severely the way flash based SSDs do. However, some amount of spare area is still required for error correction and other metadata and for a pool of spare blocks to replace failed or defective blocks. The write endurance of 3D XPoint memory is not infinite so wear leveling is still required, but it is a much simpler process that requires much less spare area.

The Intel Optane SSD DC P4800X has a write endurance rating of 30 Drive Writes Per Day, and Intel is hopeful that future products can offer even higher ratings once 3D XPoint memory has more broadly proven its reliability. Today's limited release 375GB models have a three year warranty for a total write endurance rating of 12.3 PB, and once the product line is expanded to broad availability of the full range of capacities in the second half of this year the warranty period will be five years.

Intel is offering the 375GB P4800X in PCIe add-in card form factor with a MSRP of $1520 starting today with a limited early-ship program. In Q2 a 375GB U.2 model will ship, as well as a 750GB add-in card. In the second half of the year the rest of the capacity and form factor options will be available, but prices and exact release dates for those models have not been announced. At just over $4/GB the P4800X seems to fall much closer to DRAM than NAND in price, though to be fair the enterprise SSDs it will compete against are all well over $1/GB and the largest DDR4 DIMMs are around $10/GB.

Intel Optane SSD DC P4800X Specifications
Capacity 375 GB 750 GB 1.5 TB
Form Factor PCIe HHHL or 2.5" 15mm U.2
Interface PCIe 3.0 x4 NVMe
Controller Intel unnamed
Memory 128Gb 20nm Intel 3D XPoint
Typical Latency (R/W) <10µs
Random Read (4 KB) IOPS (QD16) 550k TBA TBA
Random Read 99.999% Latency (QD1) 60µs TBA TBA
Random Read 99.999% Latency (QD16) 150µs TBA TBA
Random Write (4 KB) IOPS (QD16) 500k TBA TBA
Random Write 99.999% Latency (QD1) 100µs TBA TBA
Random Write 99.999% Latency (QD16) 200µs TBA TBA
Endurance 30 DWPD
Warranty 5 years (3 years during early limited release)
MSRP $1520 TBA TBA
Release Date March 19 (HHHL)
Q2 2017 (U.2)
Q2 2017 (HHHL)
2H 2017 (U.2)
2H 2017

 

Intel Memory Drive Technology

Along with the DC P4800X, Intel is launching Intel Memory Drive Technology software as a paid add-on. The Memory Drive Technology software is a custom virtual memory system implemented as a minimal hypervisor. The guest operating system or general-purpose hypervisor is presented with the illusion that a portion of the 3D XPoint memory on the Optane SSD is directly addressable, producing an apparent memory capacity that far exceeds the capacity of the system's installed DRAM. Under the hood and almost entirely transparent to the guest OS, Intel Memory Drive Technology monitors memory access patterns to cache actively used data in DRAM and prefetch from Optane SSDs. At a high level, this is merely duplicating the paging mechanisms all operating systems already provide. However, Intel claims that the heuristics used by Memory Drive Technology can far outperform those currently used by operating systems to manage swap space residing on storage that is far slower than Optane SSDs. On some workloads Intel Memory Drive Technology can offer performance approaching that of an all-DRAM memory pool of equal capacity, though this will depend highly on the specific application workload.

Intel Memory Drive Technology has a substantial capacity overhead: a 375GB Optane SSD can provide up to 320GB of virtual memory. Multiple Optane SSDs can be used to provide virtual memory up to ten times the system's DRAM capacity, though Intel recommends Optane to DRAM ratios between 3:1 and 8:1. When multiple CPUs or Optane SSDs are in use, the Memory Drive Technology software will take into account non-uniform memory access (NUMA) effects and attempt to optimize data placement to put data in the DRAM or Optane SSD that is closest to the core using it. By default, the Memory Drive Technology software will present to the guest OS a NUMA topology equivalent to the underlying DRAM configuration plus a pool of memory that is not local to any of the processors, with capacity equal to the virtual memory provided by the Optane SSDs. However, this is implemented purely for the sake of allowing NUMA-aware software to adapt its usage patterns; regardless of the NUMA configuration seen by the guest software, the Memory Drive Technology software will not be statically allocating specific address ranges to DRAM or Optane storage. The approach taken by the Memory Drive Technology software allows operating systems and applications to function without modification and without requiring Optane-specific optimizations, but it also means there is no way for applications that are NUMA-aware or use system calls like madvise to communicate directly with the real memory allocator.

The full licensing cost structure for Intel Memory Drive Technology is not clear, but the MSRP for a 375GB P4800X bundled with Memory Drive Technology is $1951 compared to $1520 for the SSD alone. The Memory Drive Technology hypervisor must be booted from a USB device or an IDE-compatible storage controller, and the guest operating system cannot be booted in UEFI mode. Intel Xeon E5-x6xx v2 or later and E7- x8xx v2 or later processors are supported.

Future 3D XPoint-based Optane products on Intel's roadmap include Optane Memory cache drives for the client/consumer segment, due in Q2 of this year. They will also be followed by larger Optane SSDs for the client market. DIMMs featuring 3D XPoint memory are planned for 2018.

Source: Intel

Comments Locked

77 Comments

View All Comments

  • woggs - Monday, March 20, 2017 - link

    Right. Billions in investment and many years of RnD is just misleading.
  • witeken - Sunday, March 19, 2017 - link

    What? If this was a regular SSD, it would get praised into heaven. Go look at Ars Technica, they have some more info and slides.
  • close - Sunday, March 19, 2017 - link

    Well everything is compared to the expectations. And they were really built up by Intel. So it looks like an awesome product that just falls short of what Intel hyped.
  • ddriver - Sunday, March 19, 2017 - link

    Oh wow, I was 100% right about my skepticism while folk like you were going in admiration frenzy. Who would have thought :)

    As time passes by and intel reveal more technological details, I expect my technical predictions about the source of the improvements will turn out to be true as well, namely that the actual storage process is nothing too fancy, and the superior throughput, endurance and latency come from more of the good old parallelism, over-provisioning and caching.

    But I guess when you are right you are right. About it being an awesome product, even if barely incremental, mediocre and not worth the money, because it is an intel product, and as such it is intrinsically awesome in the eyes of folk like you ;)
  • prisonerX - Sunday, March 19, 2017 - link

    I bet their codename for this drive was Yawnsville.
  • investlite - Sunday, March 19, 2017 - link

    Lol, not really right at all. This is gen 1 of this technology. What were the benchmarks of gen 1 NAND? As they clean up the manufacturing processes and refine the product I expect it will blow NAND out of the water. Don't celebrate prematurely, you'll end up looking like the fool you think everyone else is.
  • ddriver - Sunday, March 19, 2017 - link

    The two are not proportional. You can expect to see the same kind of improvement over time. 1st gen optane already incorporates a lot of already developed and available technology. 2nd gen will certainly be only a minor increment, as gen 1 is already based on mature technology with only a tiny subset of it that is really "new".

    It is people like you who celebrate prematurely, and keep hoping even in the face of the hype crashing down hard.

    I am not saying optane could not be made much better. On the contrary, it easily could, but so could flash. Yet in both cases, it will not be a product of technology maturing, but about increasing in complexity and capability. Technology is never really as good as it can be, it is only as good as the industry needs it to be to make the most money on it. There is no point for the industry to get ahead of itself, as neither it, much less consumers need it, they are much better making barely incremental upgrades, milking every step as much as possible before moving onto the next.

    Enough time has passed since the initial silicon for intel to make several iterations of the process, so I doubt we will see huge improvements there. Besides what makes it fast is in all likelihood not the medium but the controller. And I guess the reason why they are so secretive about the medium is not because it is something exceptional, but exactly because it is not. It would kill the magic to it and destroy the hype revealing it is nothing that much special than an improved controller.
  • alysdexia - Sunday, March 19, 2017 - link

    will -> shall
    fast -> swift
  • ddriver - Sunday, March 19, 2017 - link

    It seems that the storage medium is somewhere between SLC and MLC.

    30 DWPD over 3 years is about 30k P/E cycles, 50k for 5 years. SLC is 100k P/E cycles.

    Latency is in the range of 50 to 200 microseconds for the controller + medium. In comparison, SLC for the medium alone is like 100-200 nanoseconds. Granted, that's just the media, but also that number is like a 1000 times better, so even if we factor the delay of the controller, a sufficiently advanced controller + SLC could go much lower than optane.

    I personally would love to see the industry churn out stacked SLC modules at a larger process node for optimal endurance. SLC is good enough to annihilate xpoint and is tried and true technology, whose only disadvantage is low density, which can be overcome by vertical stacking, and besides, judging by what intel has for xpoint at 20 nm, their density isn't anywhere near their claims of superiority, and it wouldn't be even if they scale it down to 10 nm either.
  • melgross - Monday, March 20, 2017 - link

    Some of you guys are seriously shortsighted. If you really believe the nonsense you're spouting, that's really surprising.

    This is different enough from NAND to enable far better performance over time. NAND is nearing its performance limit, as industry experts keep stating. It's just a stop on the road.

Log in

Don't have an account? Sign up now