Running a NAS

Running a NAS, Part 8: Keeping a NAS Healthy

Keeping a NAS healthy: SMART alerts, scrubs, replacing a drive and the rebuild window, UPS shutdown and updates.

On this page 15 sections

A NAS that runs fine today says little about next year, because in Backblaze’s 2016 data about three in four failed drives had a warning sign in their SMART health record first, and the rest gave no warning at all. The previous part of Running a NAS was Apps and Backing Up the NAS, which covered the NAS’s apps and the tools that copy its data to another place, including the protections that stop ransomware from deleting that copy, so data survives losing the NAS itself. This part covers the routine that decides how often a drive is lost unnoticed. It takes in reading drive health, running self-tests and scrubs, replacing a drive, riding out a power cut, and applying updates. It ends where NAS Problems Found Too Late begins.

Three parts of keeping a NAS healthy: a drive health check, a drive swap and a UPS joined to the NASThree numbered panels. First, the check: five stacked reading bars, one of them filled in mint to show a flagged value. Second, the rebuild: a row of four drives with the third drawn as a dashed outline for the replacement. Third, the power: a NAS box joined by a copper link to a dashed UPS box beneath it.GUIDE / RUNNING A NAS, PART 8Alerts, scrubs, rebuilds and powerCHECK · REBUILD · POWER01 THE CHECKRead, test, scrub02 THE REBUILDSwap a drive03 THE POWERShut down in order

Each NAS operating system exposes these controls under different names. Synology’s DSM, QNAP’s QTS, TrueNAS, and Unraid appear throughout, and the page names the setting each one calls it. The TrueNAS pages cited here describe earlier releases than the current one in NAS Operating Systems Compared, so check a menu name against the version installed. QNAP appears only under self-tests and updates; this part does not cover its scrubs, drive replacement, UPS or alerts.

Which SMART attributes predict failure

Self-Monitoring, Analysis and Reporting Technology (SMART) is the health record a drive keeps about itself. Drives report over 70 SMART statistics, and a 2014 post from Backblaze names only five of them as the ones it uses. Its five are 5 (reallocated sectors count), 187 (reported uncorrectable errors), 188 (command timeout), 197 (current pending sector count), and 198 (uncorrectable sector count). Backblaze investigates a drive when the raw value of any of them is greater than zero. For 187 the rule is firmer, because it schedules the drive for replacement once that value goes above zero.

Backblaze’s 2016 data shows what the five can and cannot do. Of the drives that failed, 76.7% had at least one of the five above zero, against 4.2% of drives still operating. So a nonzero value is a strong signal and an uncommon one. Yet 23.3% of failed drives showed no warning from the statistics Backblaze records. Even a clean report does not make a drive healthy, which is why the routines in the rest of this part exist.

Which SMART attributes predict failure

Most failed drives showed a SMART warning, but 23.3% showed none

A horizontal bar chart of three shares of drives, from zero to one hundred percent. Of the drives that failed, 76.7% had at least one of the five SMART attributes above zero: reallocated sectors count, reported uncorrectable errors, command timeout, current pending sector count and uncorrectable sector count. Of the drives still operating, only 4.2% did. A third bar shows the other side of the failed drives: 23.3% showed no warning from the statistics Backblaze records. The bars are Backblaze's 2016 fleet data, so a nonzero value is a strong but uncommon signal, and a clean report does not make a drive healthy.Drive group0255075100Share of drives in the group, %Failed drivesone of five above zero76.7%Operating drivesone of five above zero4.2%Failed drivesno warning at all23.3%flagged, failedflagged, operatingfailed, no warning
Figure 8.1 · In Backblaze's 2016 data, a nonzero value on any of five SMART attributes flagged most failed drives and few working ones. Source: Backblaze, What SMART Stats Tell Us About Hard Drives (2016 data).

Three points come from the same posts. A small raw value on one attribute means little on its own until it is combined with other factors, with two remapped sectors as Backblaze’s example. Only 197 and 198 correlate well enough to count as one indicator, while the others are largely independent. And every attribute it tracks except 197 is cumulative, so the period over which the errors were reported matters. A count that grew this month says more than one that has not moved in years. Backblaze reads these values once a day for each drive with smartmontools.

What the NAS systems watch

Unraid watches 5, 187, 188, 197, 198, and 199 by default and shows an orange icon on the Dashboard when one changes. Its documentation says a pending sector count above zero means the drive cannot read some areas. It says to replace the drive if the value does not return to zero after a few days. That matches Backblaze’s caution about 197, the one attribute that is not cumulative.

On the same Unraid page, SMART monitoring works for SATA drives but is not available for SAS drives. My own server runs Unraid and its cache pool is built from SAS SSDs, so by the documentation those drives aren’t covered by the attribute watching described here.

NVMe drives are a separate case on Synology, where an NVMe SSD has its own built-in monitoring and does not support the Storage Manager S.M.A.R.T. test. Wear on an NVMe SSD shows in that health log. Its Percentage Used field is a vendor estimate of endurance consumed, and the value is allowed to exceed 100, so read it as a vendor estimate of endurance used. The log also reports Data Units Written, counted in units of 512,000 bytes. The NVMe SMART Decoder reads both in the browser.

A Windows pool watches its drives with different tools, which Drive Pooling on Windows covers.

Self-tests and when to run them

Reading attributes only shows what the drive has already noticed. A self-test makes it look. The smartctl manual documents a short ATA test that is usually under ten minutes and can run during normal operation, and a long test that takes tens of minutes to several hours. Both kinds of test check the electrical and mechanical performance as well as the read performance of the disk.

Two cautions come from the same manual. A running self-test can degrade drive performance, and frequent I/O requests make the test last longer, which I read as a busy NAS stretching the schedule it was meant to keep. If the machine is shut down or power cycled mid-test, the manual says no harm should result and the test is aborted or resumes.

Scheduling on each system

smartd is the scheduler in smartmontools, and its configuration file schedules tests with the -s option, where L stands for a long test and S for a short one. The manual’s own example runs a short test every day and a long test every Saturday, both in the early morning.

Self-tests and when to run them

A short test every day and a long test every Saturday

A one-week schedule with seven day columns, Sunday to Saturday. The top row is the short self-test, which runs every day from 1 to 2 am and usually takes under ten minutes. The second row is the long self-test, which runs only on Saturday from 3 to 4 am; the other six days are dashed empty cells because no long test runs. A box under the grid says to keep the scrub on a different day from the long test, since a self-test and a scrub should not run at the same time.SunMonTueWedThuFriSat01 SHORT TEST, 1 TO 2 AMShortShortShortShortShortShortShort02 LONG TEST, 3 TO 4 AMLongPut the scrub on another day,never with the long testtest runsno test that dayrule
Figure 8.2 · The smartd manual's own example schedules the short test early each morning and the long test on Saturday. Source: smartd.conf manual page, example schedule.

Vendors wrap the same idea in menus. Synology’s Storage Manager offers a Quick Test and an Extended Test and a Test Scheduler under HDD/SSD settings on supported models. QNAP’s QTS has a rapid test that takes about one minute and a complete test that covers the full disk surface, and it can schedule both periodically. TrueNAS documents the same tests on its page for managing self-tests.

TrueNAS adds the rule that matters most when several jobs share a pool. It recommends scheduling tests when the system is in a low-usage state and says to avoid running them at the same time as a scrub or other data protection task, because tests can offline disks. A long test should not overlap the scrubs covered next. The smartctl manual puts a long test at tens of minutes to several hours, so leave room for it to finish.

Scrubs and parity checks

A self-test asks one drive about itself, and a scrub asks the data. An OpenZFS scrub walks all data in a pool and verifies each block’s checksum, repairing damage where redundancy allows. Part 2, Pools and Filesystems on a NAS sets scrubs against resilvers and explains how ZFS, Btrfs, and Unraid lay data out, so this section only covers how often to check it.

How often

The OpenZFS documentation gives monthly as a common baseline for consumer disks and quarterly for enterprise disks. That page also notes that scrubs are I/O-intensive and only one scrub or resilver runs at a time. TrueNAS creates a scrub task when a pool is created and sets it to run every Sunday at midnight, which is a weekly default. Its Threshold Days setting controls how many days must pass before a completed scrub can run again. TrueNAS gives its reasons for scrubbing as that scrubs detect silent data corruption caused by transient hardware issues and give early warning of disk failure.

Synology recommends running data scrubbing periodically and gives no interval. Which volumes and shared folders can be scrubbed at all is covered under Synology and Btrfs in Part 2. Scheduled scrubs also stop if the NAS was shut down improperly during writing and resume automatically at the next power-on.

Scrubs and parity checks

Monthly is the usual scrub interval; quarterly suits enterprise disks

Three equal columns group the documented scrub and parity-check intervals. Every Sunday: TrueNAS creates a scrub task when a pool is created and runs it Sunday at 12:00 AM, and its Threshold Days setting sets how many days must pass before a completed scrub can run again. Monthly: the OpenZFS baseline for consumer disks, and Unraid's correcting parity check. Quarterly: the OpenZFS baseline for enterprise disks, and Unraid's correcting check. A dashed box below says Synology recommends running data scrubbing periodically and gives no interval. A last box says to keep the scrub off the day of a long self-test.01 EVERY SUNDAYTrueNAS scrub taskSunday 12:00 AMThreshold Days setsdays before a rerun02 MONTHLYOpenZFS baselineconsumer disksUnraid, correctingmonthly check03 QUARTERLYOpenZFS baselineenterprise disksUnraid, correctingquarterly checkSynology: periodically, no interval givenKeep scrubs off the day of a long self-testinterval statedno intervalrule
Figure 8.3 · TrueNAS runs a scrub every Sunday by default, OpenZFS and Unraid advise monthly or quarterly, and Synology names no interval. Source: OpenZFS, TrueNAS, Unraid and Synology documentation.

Unraid’s counterpart is the parity check, and its documentation advises automated, correcting checks monthly or quarterly, scheduled under Settings and Scheduler. After an unsafe shutdown it starts a parity check on its own in the mode set there, which is non-correcting by default. The sources differ on cadence. OpenZFS and Unraid advise monthly or quarterly, TrueNAS defaults to a weekly task, and Synology names no interval. Keeping scrubs and long self-tests on different days is my own advice, since TrueNAS says only to avoid scheduling them at the same time.

Replacing a drive

A failing drive is replaced before it dies or after, and Synology’s Replace Drive feature swaps a drive in a storage pool when drive issues are detected, which keeps the pool from becoming degraded. Without it, a pool becomes Degraded when a drive becomes defective but stays accessible because no data has been lost. A nonzero 187, or a 197 that stays above zero, is a reason to use the first route, since Backblaze schedules replacement for the first and Unraid says to replace a drive for the second.

Replacing a drive

Swapping a drive early keeps the pool from ever being degraded

Two three-step lanes compare replacing a drive early with replacing it after it fails. In the top lane, problems are detected on a drive, Synology's Replace Drive feature swaps it in the pool, and the pool never becomes degraded. In the lower lane, a drive becomes defective, the pool becomes Degraded but stays accessible because no data has been lost, and the pool is repaired onto a replacement drive that is erased first and must be no smaller than the smallest drive in the pool. A dashed box at the bottom names the two things that speed a repair: Fast Repair skips unused space, and a hot spare repairs a degraded pool automatically.01 REPLACE EARLYProblems aredetected on a driveReplace Drive swapsit in the poolThe pool neverbecomes degraded02 REPLACE AFTER A FAILUREA drivebecomes defectiveThe pool is Degraded,still accessibleRepair onto a driveno smaller than thesmallest in the poolFaster repair: Fast Repair skips unused space,and a hot spare repairs on its ownbefore a failureafter a failurespeeds a repair
Figure 8.4 · Synology's Replace Drive feature acts before a failure; after one, the pool runs degraded until a repair onto an erased replacement. Source: Synology DSM Storage Manager help, Replace Drive and Repair a Storage Pool.

Synology’s repair procedure sets the practical rules. On a model without hot-swap support, the NAS must be powered off before drives are removed or installed. A replacement is erased during the repair. On the RAID pool types the help page lists, it must be at least as large as the smallest drive in the pool, and SHR pools have a size rule of their own that Part 2 covers. Fast Repair is on by default and skips unused space to restore RAID protection faster than a traditional rebuild. Hot spares repair a degraded pool automatically. DSM limits repair speed by default to protect other services, and the RAID resync speed limit can be raised to shorten the repair.

Resilvering on TrueNAS

On TrueNAS, replacing a disk triggers a pool resilver automatically, which can take a long time on pools with a lot of data. TrueNAS does not recommend replacing a failed disk after a hot spare has taken over, because that causes two resilver events. Its scrub-task page also advises avoiding heavy load during a resilver, naming replication, SMB, NFS, and rsync transfers, self-tests, and scrubs. OpenZFS offers a faster route for some layouts. Its sequential reconstruction restores redundancy faster than a healing resilver but does not verify checksums. A scrub starts automatically afterward, and raidz does not support the method.

Rebuilding on Unraid

On Unraid, rebuilding a disk can take several hours to more than a day for larger drives. Drive capacity, disk speed, and system load are the factors it names. My own server runs dual parity. Part 2 covers how single and dual parity differ when a disk fails during a rebuild.

How long a rebuild takes and what it risks

A rebuild reads the surviving drives for as long as the pool is degraded, so its length is the length of the exposed period. The estimate below is arithmetic on two data sheet inputs, and nobody ran a rebuild to check it. It also assumes a drive that holds its rated speed through the whole rebuild. How drives that use shingled magnetic recording (SMR) behave during a rebuild is in the last part of the series, and How a Hard Drive Works explains the recording methods themselves.

The time estimate

The Seagate IronWolf Pro 24TB HAMR data sheet gives a maximum sustained transfer rate of 240MB/s at the outer diameter, so the average rate over a whole drive is lower. By my estimate, one full pass over 24TB at 240MB/s takes about 28 hours at best. Real rebuilds run longer, because system load is among the factors that stretch them. Pools that rebuild only used space, as Synology’s Fast Repair does, can finish sooner than a full pass.

The error estimate

That data sheet also gives a maximum nonrecoverable read error rate of 1 per 10¹⁵ bits read. WD’s Red Pro sheet says less than 1 in 10¹⁵, and WD’s Black sheet, for a 3.5-inch gaming drive rather than a NAS drive, says less than 1 in 10¹⁴.

How long a rebuild takes and what it risks

A full read of a 24TB drive is expected to hit 0.19 to 1.9 errors

An estimate from rated limits, not a measured rebuild

A chart of an estimate, with its inputs shown first. Three boxes give the inputs: reading a 24TB drive covers 24TB times 8 bits per byte, which is 1.92 times ten to the fourteenth bits; one full pass at the data sheet's 240MB/s takes about 28 hours or more; and the rated read error rates are one error per ten to the fourteenth bits for the WD Black and one per ten to the fifteenth bits for the IronWolf Pro and Red Pro. Below them a horizontal bar chart of the expected read errors in one full pass, from zero to two, with dashed bars because they are estimates: about 1.9 errors at one per ten to the fourteenth bits, and about 0.19 at one per ten to the fifteenth. These are average counts from rated limits and say little about any one drive.01 INPUTS FROM THE DATA SHEETS24TB × 8 bitsper byte= 1.92 × 10¹⁴ bits24TB at 240MB/stakes about28 hours or moreRated error rate1 per 10¹⁴ or1 per 10¹⁵ bits02 EXPECTED ERRORS IN ONE FULL PASSRated error rate00.511.52Expected read errors per full 24TB pass, count1 error per 10¹⁴ bitsWD Black1.91 error per 10¹⁵ bitsIronWolf Pro, Red Pro0.19estimate, not measureddata sheet input
Figure 8.5 · Derived: 24TB × 8 bits per byte = 1.92 × 10¹⁴ bits, times the rated errors per bit; an estimate from data sheet limits that nobody measured. Source: Seagate IronWolf Pro 24TB, WD Red Pro and WD Black data sheets.

Reading a full 24TB drive covers 24TB × 8 bits per byte = 1.92 × 10¹⁴ bits. At one error per 10¹⁴ bits, my estimate is that this read would hit about 1.9 errors, and at one per 10¹⁵ about 0.19. These are average counts from rated limits, so they say little about any one drive. A rebuild reads every surviving drive, so the expected count multiplies by the number of survivors. That shows why the data sheet’s class matters when a rebuild leans on every surviving disk. The estimate scales with capacity, and the server I run is full of 20TB drives.

Surviving a power cut

The NAS-side settings decide what happens when a battery runs low. By default a Synology NAS enters Standby Mode when the UPS starts running low on power, which stops all services and unmounts volumes to prevent data loss. After a shutdown in that mode the NAS turns itself on when power returns only if the option to restart automatically after a power failure is enabled. Connected to a USB UPS, a Synology can also act as a network UPS server for other Synology devices whose addresses are listed as permitted.

TrueNAS builds on Network UPS Tools (NUT) for UPS support. It can shut down when the UPS reaches low battery or as soon as the UPS goes on battery, and its shutdown timer applies only to the on-battery mode. In Master mode the UPS is attached to that system, while Slave mode shuts the system down before the master, using the master’s address and port 3493 by default.

Surviving a power cut

In NUT the primary waits for secondaries before it shuts down

A six-step order of events when one UPS powers several machines, read left to right on the top row and right to left on the row below. Step one, power fails and the UPS runs on battery. Step two, the NUT primary sees a critical UPS situation. Step three, it sets the forced shutdown flag. Step four, every secondary is told the load will soon power down. Step five, the primary waits up to 15 seconds, the HOSTSYNC value, for the secondaries to disconnect. Step six, the primary shuts down. A box at the bottom adds that a Synology NAS enters Standby Mode when the UPS runs low, which stops all services and unmounts volumes.01 THE SHUTDOWN ORDER IN NUT1 Power fails,UPS on battery2 Primary sees acritical UPS state3 Primary setsthe FSD flag6 Primary thenshuts down5 Primary waits upto 15 seconds4 Secondaries aretold the loadwill power down02 ON A SYNOLOGY NASStandby Mode when the UPS runs low:services stop and volumes unmountpower eventNUT actionwait
Figure 8.6 · The primary sets a forced shutdown flag, then waits up to HOSTSYNC seconds, typically 15, for secondaries to disconnect. Source: Network UPS Tools user manual, configuration notes; Synology DSM UPS help.

The order matters when one UPS powers several machines. In NUT, the primary sets a forced shutdown flag when it sees a critical UPS situation, which tells every secondary that it will soon power down the load. That primary then waits up to HOSTSYNC seconds, typically 15, for the secondaries to disconnect. Unraid can be connected to an APC or compatible UPS so the system shuts down safely during a power loss, with shutdown policies set on the UPS settings page. A UPS covers the whole box, while the power-loss protection inside an SSD is a separate feature that SSDs in a NAS covers.

Alerts and updates

An alert that nobody receives does nothing. TrueNAS email and other alert services notify for every warning at or above the level chosen for that service, and the frequency can be set to Immediately (the default), Hourly, Daily, or Never. Synology sends email from Control Panel under Notification and Email, after a sender has been set up. Unraid can notify through the browser, email, or third-party services, and recommends turning notifications on so SMART alerts arrive when you are not logged in to the interface.

Alerts and updates

Every system wants something saved before an update

Two groups of boxes. The first shows how alerts reach you: TrueNAS notifies for every warning at or above the level chosen for the service, Synology sends email from Control Panel once a sender is set up, and Unraid notifies through the browser, email or third-party services. The second group is a two by two grid of what to save before an update. Synology updates are irreversible, so back up first. QNAP says to back up all data before a firmware update. TrueNAS says to save the secret seed with the configuration file, because a configuration restored without it leaves encrypted fields empty. Unraid says to back up the boot device, read the release notes and update plugins before the operating system.01 HOW ALERTS REACH YOUTrueNAS: warningsat or above thelevel you pickSynology: emailfrom Control Panelonce a sender is setUnraid: browser,email or third-partyservices02 SAVE THIS BEFORE YOU UPDATESynologyUpdates are irreversible;back up firstQNAPBack up all databefore a firmware updateTrueNASSave the secret seedwith the config fileUnraidBack up the boot device,read notes, update pluginsalert channelsave first
Figure 8.7 · Alerts reach you only once a channel is set up, and each system names what to back up or save first. Source: TrueNAS, Synology, Unraid and QNAP documentation.

Updates need a backup first on every system, though the systems ask for different things. Synology labels fixes for critical security issues as important and can install them automatically, but DSM updates are irreversible, so you can only move to a newer version, and Synology strongly recommends a backup. QNAP’s update policies run from automatic installation of critical updates to notification only, and QNAP recommends backing up all data before a firmware update. TrueNAS asks for a saved configuration rather than a data backup: it tells you to save the secret seed with the system configuration file, because a configuration restored without it leaves encrypted fields empty. Unraid asks for a boot-device backup instead: back up the boot device, read the release notes, and update plugins before updating the OS.

Backup tools themselves were the subject of Apps and Backing Up the NAS, and the Cloning and Backup guide covers how many copies to keep and where. Why a skipped update leaves a security hole is covered with the ransomware campaigns in Sharing and Remote Access, and how long a model keeps receiving updates is in NAS Operating Systems Compared.

What the failure rates say now

Backblaze’s Q2 2026 Drive Stats put the quarterly annualized failure rate across its data drives at 1.73%, its highest in quite a while, against a lifetime rate of 1.41%. Outliers with the highest failure rates included a drive nearly seven years old and one nearly 8.5 years old. When this part was checked on November 5, 2026, Backblaze’s Drive Stats page listed Q2 2026 as its newest quarter.

For a home array those figures are a rough guide at best, because Backblaze’s data comes from the drives in its data centers. As an estimate, a 24-drive array at the 1.41% lifetime rate would lose about 0.34 drives a year, or roughly one drive every three years.

What the failure rates say now

Q2 2026 failure ran 1.73%, above the 1.41% lifetime rate

A vertical bar chart of annualized failure rates in percent, from zero to ten. Backblaze's lifetime rate through Q2 2026 is 1.41%. The quarterly rate for Q2 2026 across its data drives is 1.73%, its highest in quite a while. The outlier drives with the highest failure rates in that quarter range from 7.63% for the lowest to 9.33% for the highest, and include a drive nearly seven years old and one nearly 8.5 years old.Annualized failure rate, %02468101.41%LifetimethroughQ2 20261.73%Q2 2026quarterly,all drives7.63%Q2 2026outlier,lowest9.33%Q2 2026outlier,highestDrive grouplifetime ratequarterly rateoutlier drives
Figure 8.8 · Backblaze's outlier drives in the same quarter failed at far higher rates than the fleet. Source: Backblaze Drive Stats for Q2 2026.

This routine cannot catch the 23.3% of failures that gave no warning in Backblaze’s 2016 data, so it lowers the odds of being surprised and leaves the backup to do the rest. Faults that only show up after the build are the subject of NAS Problems Found Too Late.

KEEP GOING / NEXT CHAPTERContinue to Part 9

Sources

Primary is the original paper, standard or datasheet. Secondary is a review, a vendor summary or a news report. Measured is my own test data.

Show all 37 sources, 36 primary