Flash Myths, Tested

A Higher Sequential Speed Means a Faster PC

Sequential read speed against the PCMark 10 Storage score of 84 drives on my bench: they rise together, but drives that read alike score up to 1.9 times apart.

On this page 6 sections

A drive with a higher sequential speed does tend to score higher, but the number can’t tell you which drive will be faster in your PC. On my bench, 29 drives that all read at 7,000MB/s or more scored anywhere from 2,440 to 4,606 in PCMark 10 Storage, and across the 64 PCIe 4.0 drives sequential read speed explains about a third of the differences in score. I don’t have stopwatch times for real applications, only replayed storage traces, so this page tests the claim as far as a storage benchmark can. It is part of Flash Myths, Tested, and the Gen5 game loading myth uses the same trace approach on a faster drive generation.

Sequential read speed and the PCMark 10 Storage score: same speed, the share explained, and the gainA three-panel cover. Left: 29 drives that all read 7,000MB/s or more sequentially scored from 2,440 to 4,606 in PCMark 10 Storage, drawn as two bars. Center: sequential read speed accounts for 52 percent of the variation in the score across all drives and 35 percent across PCIe 4.0 drives. Right: the median PCIe 4.0 drive reads 99 percent faster than the median PCIe 3.0 drive but scores 53 percent higher.FLASH MYTHS, TESTED / SPEEDRead speed is not the scoreSAME SPEED · SHARE · GAIN01 SAME SPEEDBest scoreLowest score02 SHAREAll drivesPCIe 4.0 only03 GAINSequential readPCMark 10 score1.9x apart29 drives at7,000MB/s or moreBars from zero35% explainedby read speed, PCIe4.0 drives onlyBars: 0 to 100%+99% vs +53%PCIe 4.0 against3.0, mediansBars: 0 to 100%

Where the myth comes from

Sequential speed is the headline number on every SSD box, and it is real. A large file copy is a sequential job, and Solidigm’s traces of a game level load and of a Total War: Warhammer III battle load found mostly sequential reads, with a most common transfer size of 128KB in the level load. So a drive with a bigger number does move large files faster.

Going from there to a faster PC is where it goes wrong. Solidigm’s white paper on real-world PC storage points out that the numbers on a retail box are almost always measured at a very high queue depth, with 32 common, while the vast majority of real I/O it traced came at queue depth 1 or 2. Queue depth is how many requests are waiting on the drive at once. Across the 12 workloads it traced, 92% of all I/O operations were at queue depth 1 or 2.

Where the myth comes from

The box number is measured at a queue depth real use rarely sees

Queue depth is how many requests wait on the drive at once

A horizontal bar chart of queue depth, from 0 to 32. The box number for an SSD is almost always measured at a very high queue depth, 32 common. Across 12 traced real PC workloads, 92 percent of I/O operations came at a queue depth of 1 or 2. The PCMark 10 Quick System Drive trace had a mean queue depth of 1.2.What was measured08162432Queue depth (requests waiting)Box numbermeasured at32 (common)Real PC I/O92% of operations1 or 2PCMark 10 tracemean, 96% at 1 or 21.2Number printed on the boxTraced real use
Figure 1 · Solidigm’s traces of 12 real PC workloads found 92% of I/O operations at queue depth 1 or 2, while box numbers are almost always measured at very high queue depth. Source: Solidigm, PC Storage Performance in the Real World.

Intel’s own evaluation guide for its 760p SSD makes the same distinction between kinds of benchmark. It marks a synthetic benchmark as not representing real-world use cases, and a trace-based one as possibly doing so.

What I measured

Both numbers come from the same retail drives on my test bench. One is CrystalDiskMark’s sequential read of 1MiB blocks at queue depth 8 (QD8), the median of repeated runs. That is a deep-queue number, like the ones a box prints. The other is the PCMark 10 Storage score from its Full System Drive test, the median of 3 runs. UL’s PCMark 10 technical guide says that test replays 23 traces of real applications and tasks, such as booting Windows 10 and starting Adobe programs, with 3 passes of each trace. Its score is the geometric mean of the bandwidth the traces reach and the inverse of their average access time.

The data covers the 84 retail NAND drives that have both results, 64 on PCIe 4.0 and 20 on PCIe 3.0. They’re the drives I tested for reviews, so they aren’t a random sample of every drive, and everything below comes from my test archive.

What I measured

Drives with the same read speed score very differently

84 drives from my bench: sequential read speed against the PCMark 10 Storage score

A scatter chart of 84 drives. The horizontal axis is CrystalDiskMark sequential read speed at queue depth 8, from 0 to 8,000. The vertical axis is the PCMark 10 Storage score, from 0 to 5,000. 20 PCIe 3.0 drives are teal circles and 64 PCIe 4.0 drives are copper diamonds. The points rise from lower left to upper right, with a correlation of 0.72 across all drives and 0.59 across the PCIe 4.0 drives alone. A shaded band marks the 29 drives that read 7,000MB/s or more. Their scores run from 2,440 to 4,606.PCMark 10 Storage score01,0002,0003,0004,0005,00002,0004,0006,0008,000Sequential read, queue depth 8 (MB/s)29 drives at7,000MB/s or morePCIe 3.0 (20)PCIe 4.0 (64)
Figure 2 · The 29 drives at 7,000MB/s or more scored anywhere from 2,440 to 4,606. Source: Sean Webster’s own test data.

Figure 2 plots all 84. There is a trend. The correlation between sequential read speed and the score is 0.72, so faster-reading drives do score higher on average. Squared, that is 52%, so read speed accounts for about half of the differences in score, and the other half comes from something else. Part of the 0.72 comes from the two generations sitting in different places on both axes. Across the 64 PCIe 4.0 drives alone the correlation falls to 0.59, which is 35%.

Drives that read at the same speed

Figure 2’s right-hand band is the sharpest test. Twenty-nine PCIe 4.0 drives read at 7,000MB/s or more, all within 159MB/s of each other. Their scores run from 2,440 to 4,606.

Drives that read at the same speed

29 drives that all read about 7,000MB/s

PCMark 10 Storage score of each drive that reads 7,000MB/s or more sequentially

A column chart with one column per drive for the 29 PCIe 4.0 drives whose CrystalDiskMark sequential read at queue depth 8 is 7,000MB/s or more, sorted by PCMark 10 Storage score from 2,440 to 4,606. The vertical axis runs from 0 to 5,000. Their sequential read speeds span only 7,013 to 7,171MB/s.PCMark 10 Storage score01,0002,0003,0004,0005,00029 drives, sorted by scoreLowest score, 2,440Best score, 4,606Other drives
Figure 3 · The best score is 1.9 times the lowest, on read speeds within 159MB/s of each other. Source: Sean Webster’s own test data.

Figure 3 sorts those 29 by score. The best is 1.9 times the lowest on a read speed that differs by about 2%. It shows up across the whole set too. Of the 84 drives, 1,047 pairs read within 5% of each other, and in 83 of those pairs the scores differ by 1.5 times or more. The widest pair differs by 2.4 times.

It happens in reverse too. In 11 of the 464 pairs where one drive reads at least twice as fast as the other, the faster-reading drive scored lower. Five drives in the table show the widest pairs and one reversal.

Drive Sequential read, QD8 (MB/s) Sequential read, QD1 (MB/s) PCMark 10 Storage score Average access time (µs)
WD Black SN770 2230 1TB 5,227 4,944 3,851 44
Team Group T-Force Cardea Z44Q 4TB 5,003 2,913 1,582 110
Samsung 990 Pro 2TB 7,153 4,608 4,606 36
Patriot Viper VP4300 2TB 7,149 3,309 2,440 70
Intel SSD 670P 2TB 3,397 3,141 2,761 62

The first two rows are the widest pair within 5% on read speed. Next come the top and bottom of the 7,000MB/s group. Intel’s 670P is a PCIe 3.0 drive that reads at less than half the speed of the Patriot and still scores higher. I’m showing what the data records. These results don’t isolate a cause, so I make no claim about one.

What moves with the score isn’t the number on the box. Rows one and two differ by 4% at a queue depth of 8 and by 70% at a queue depth of 1, and rows three and four by under 1% and 39%. Sequential read at a queue depth of 1 has a correlation of 0.84 with the score, against 0.72 at a queue depth of 8, and random 4KB read at a queue depth of 1 reaches 0.77.

What PCIe 4.0 bought

What PCIe 4.0 bought

The read speed doubled, the score rose by half

Median of 64 PCIe 4.0 drives over median of 20 PCIe 3.0 drives, by test

A bar chart of how much faster the median PCIe 4.0 drive is than the median PCIe 3.0 drive, from 0 to 100 percent. Sequential read, QD8: 3,514 to 6,979, 99 percent. Sequential read, QD1: 2,612 to 3,911, 50 percent. Random 4K read, QD1: 65 to 87, 35 percent. PCMark 10 Storage score: 2,068 to 3,174, 53 percent.Test0%20%40%60%80%100%Gain of the PCIe 4.0 median over the PCIe 3.0 medianSequential read, QD83,514 to 6,979MB/s+99%Sequential read, QD12,612 to 3,911MB/s+50%Random 4K read, QD165 to 87MB/s+35%PCMark 10 Storage score2,068 to 3,174+53%Read testPCMark 10 score
Figure 4 · Sequential read at queue depth 8 gained 99%, the PCMark 10 Storage score 53%. Source: Sean Webster’s own test data.

Figure 4 compares the median of each generation. The median PCIe 4.0 drive reads 99% faster than the median PCIe 3.0 drive at a queue depth of 8, 6,979MB/s against 3,514MB/s. Its PCMark 10 score is 53% higher, 3,174 against 2,068. Results at QD1 sit nearer the score. Sequential read is 50% faster and random 4KB read 35% faster. Deep-queue speed nearly doubled, and the score rose by about half as much.

Solidigm’s own trace of the PCMark 10 Quick System Drive test found a mean queue depth of 1.2, with 96% of operations at queue depth 1 or 2, and concluded the test is useful for gauging how a drive does on real applications. It adds that PCMark 10 speeds up the replayed I/O, which stresses storage more than the original tasks did. I ran the longer Full System Drive test rather than the Quick one, so that trace shows how this style of test behaves, not what my runs did. Across my 84 drives the median PCMark 10 run moved 457MB/s, against a median sequential read of 5,225MB/s at QD8.

Why the box number misses

A deep-queue number shows how much a drive can do when the host keeps it busy, and a PC usually does not. A drive gets its speed by working on many commands at once across its channels and dies, and Flash Foundations Part 5 covers why a deep queue helps and why at a shallow one a lot of that hardware sits idle. On PCIe 4.0 the deep-queue read bunches up near 7,000MB/s, and 29 drives land within 2% of each other on it. At QD1 the same drives separate.

Why the box number misses

A shallow queue leaves most of the drive idle

Requests waiting on the left, the drive’s dies on the right

A two-row sketch. In the top row many requests are waiting and every one of the drive's dies is busy. In the bottom row a single request is waiting and one die is busy while the others sit idle. The die count is illustrative.DEEP QUEUEthe box numberRequestsDiesSHALLOW QUEUEmost real useRequestsDiesRequestBusy dieIdle die
Figure 5 · A deep queue keeps every die busy; a shallow one keeps few busy, so the box number does not carry over. Illustrative values.

Beyond the drive there is the rest of the PC. Solidigm notes that if the bottleneck is elsewhere, such as a CPU under full load or exhausted memory, better storage won’t give a better experience. Its trace of the Warhammer III load showed the GPU at full utilization, and it judged the network the likeliest limit in joining a Zoom call, ahead of storage. That bridge from a score to a faster PC is the part I can’t measure.

What to do with this

Do not pay extra for a higher sequential number between two drives in the same class. Among the PCIe 4.0 drives here that read within 159MB/s of each other, the box number told me nothing about the score.

Look for numbers taken at a queue depth of 1: random 4KB read, sequential read at a queue depth of 1, and a trace-based score such as PCMark 10 Storage. Those moved with the score on my bench. If a review reports only deep-queue sequential results, ask what else it measured.

What to do with this

Which number to look at, by situation

Skip the box number between like drives; check the queue depth 1 results

A three-row decision diagram with no values. Row one: for two drives in the same class, skip paying extra for a higher sequential number. Row two: when reading a review, look for queue depth 1 results such as random 4KB read, sequential read at queue depth 1 and a trace score like PCMark 10 Storage. Row three: for copying a video project or cloning a drive, sequential speed still matters.Two drives inthe same classSkip paying extra fora higher sequential numberReading a reviewLook for queue depth 1:random 4KB read,sequential read at QD1,a trace score like PCMark 10Copying a video projector cloning a driveSequential speedstill matters hereSkip itCheck it
Figure 6 · What the closing advice comes to: skip the box number between like drives, check queue depth 1 numbers, and use sequential speed for large transfers. Illustrative values.

Sequential speed still matters for large transfers, such as copying a video project or cloning a drive. For those jobs, the box speed myth looks at the speed after the cache fills. For the method behind these tests, SSD Benchmarking 101 walks through queue depth, workload mix and why a spec sheet is a best case.

Sources

Primary is the original paper, standard or datasheet. Secondary is a review, a vendor summary or a news report. Measured is my own test data.

Show all 4 sources, 3 primary