upvote
SMR drives are the worst, even had issue resilvering a 2TB mirror.

What's frustrating is even just a little info from the manufactures would be beneficial, like the size of a shingle so the computer could batch writes, or even if the drive is shingled!

reply
That's why libzbc exists. Host-aware and host-managed SMR give you the tools to optimize I/O around the batching needed. It doesn't change the fundamental outlook - you still have to organize writes in these huge blocks and do some math to figure out the best timing to commit cache to re-writes - but it's at least a tractable problem compared to chucking everything over the wall with device-managed SMR.

In any case, I don't think hobbyists get to play with the non-disk-managed drives, and anyone with the money and the special disks is probably not using ZFS because it's a bit of an uphill battle to fit SMR to a copy-on-write filesystem.

reply
How come copy-on-write is not easier with SMR? Each SMR zone a.k.a. shingle or flash erase block is effectively a tiny tape drive. It is basically append only.

Shouldn't this be especially useful with ZFS doing copy-on-write with linked lists as a reversed heap?

reply
+1 SMR drives are really great if you pack your data into large enough groups so that you occupy exacly N SMR zones, and allocate your files to specific SMR zones that you then only rewrite atomically. The sibling comment is on point - it's pretty similar to how to work effectively with SSDs.

The drive doesn't have enough information to do this itself, we need SMR aware filesystems.

reply
What we need is host-based SMR. SMR-aware filesystems exist (e.g. Zoned XFS, btrfs' zone mode, f2fs' zone mode).
reply
There are very good deals currently on eBay for 14TB HM-SR drives! I just got quite a few - should be interesting to see how the current zone aware filesystems perform. XFS with an optane metadata device? Could be pretty okay!
reply
Handling SMRs well probably would require a custom replacement for SPA (block layer) component in ZFS, talking directly with DMU (object storage).

Could also expose the drives as SCSI object storage devices

reply
And all of that for a pretty paltry gain in capacity.
reply
deleted
reply
Uh, they do advertise zone size. At least, host-aware SMR. Yes, yes, host-unaware SMR is even more terrible.
reply
I read a nice write-up of Dropbox's use of SMR drives here:

https://dropbox.tech/infrastructure/four-years-of-smr-storag...

reply
This is a bug/design flaw in ZFS, they work fine in md IME.
reply
When SSDs appeared, many filesystems performed badly on them, or degraded them much more quickly than needed, because they were not SSD-aware. It took a while to fix the issues, add TRIM, etc.

Sounds like ZFS has the same problem today, it's not aware of SMR, and it treats those drives as if they are regular hard-drives.

reply