Hive: Difference between revisions

From Bitpost wiki
 
(60 intermediate revisions by the same user not shown)
Line 1: Line 1:
== Overview ==
Hive is a VM on [[Melange]] that runs my [[TrueNAS]] storage.


FreeNAS provides storage via Pools.  A pool is a bunch of raw drives gathered and managed as a set.  My pools are one of these:
== Pools ==
* single drive: no FreeNAS advantage other than health checks
* raid1 pair: mirrored drives give normal write speeds, fast reads, single-fail redundancy, costs half of storage potential
* raid0 pair: striped drives gives fast writes, normal reads, no redundancy, no storage cost
* raid of multiple drives: FreeNAS optimization of read/write speed, redundancy, storage potential


The three levels of raid are:
* raidz: one drive is consumed for parity (no data), and one drive can be lost without losing data
* raidz2: two drives for parity, two can be lost
* raidz3: three drives for parity, three can be lost
== Hardware ==
LSI 8-drive SAS board passed through proxmox to hive as "PCI Device":
[[File:Melange-LSI-board.png]]
Drives:
{| class="wikitable"
{| class="wikitable"
! Pool
! Pool
Line 24: Line 9:
! Drives
! Drives
|-
|-
|sassy
|mine
|0.2 TB
|43 TB
| style="color:red" |single
| style="color:green" |raidz
|250GB ssd
|8TB ssd x7
|-
|splat
|3.6 TB
| style="color:red" |raid0
|1.82 TB hdd x2
|-
|mack
|0.9 TB
| style="color:red" |single
|1 TB ssd
|-
|-
|reservoir
|safe
|2.7 TB
|5.2 TB
| style="color:red" |single
| style="color:green" |raidz
|2.73 TB hdd
|1 TB ssd x7
|-
|grim
|7.2 TB
| style="color:red" |raid0
|3.64 TB ssd x2
|}
|}


   
NOTE that there is an eighth 8TB drive matching the mine array in [[Bluto]]. Harvest it from there if one of the 7 dies.


=== Mine Drives ===
Unfortunately I opted for Samsung SSD 879 QVO drives.  The ONLY 8TB SSD option available, for a long time now.
Problems:
* They are not designed to survive lots of reads/writes.
* Because they are so big, it is very hard to maintain them, with scrubs taking hours, and resilvers BARELY able to complete after days.
Yep, they suck.  And now I am stuck with them.  So I will keep getting new ones and returning the bad ones, until I can move to MVME drives on a new PCIe card.
== Hardware ==
* LSI 8-drive SAS board passed through proxmox to hive as "PCI Device":
[[File:Melange-LSI-board.png]]


* Need to remove SN S1DBNSAF215837R
* 7 1 TB Crucial SSDs
Plugged in to SATA 1, 2, 3 and U.2 1, 2, 3, 4.
NOTE: to get U.2 drives to be recognized by Melange ASUS mobo required a BIOS change:
Bios > advanced > onboard devices config > U.2 mode (bottom) > SATA (NOT PCI-E)


Original drives, it's one of the 250GB...
[[Hive history]]
/dev/sdh1: LABEL="hare-s3-4t" UUID="b1859924-f309-4940-bced-06274567c0cf"
/dev/sda1: LABEL="macatak-1tb-ssd" UUID="08c0ca8c-4325-47ac-8173-1e0f78377e66"
/dev/sdc1: LABEL="bold-250gb-ssd" UUID="39c4f3ef-6df8-4a9f-967b-8fff7f6b09af"
/dev/sde1: LABEL="mello-250gb-ssd" UUID="323c424b-0741-4479-a863-9994a092f04a"
/dev/sdb1: LABEL="rosewill-2tb-hd" UUID="a7fa0b5a-6fdc-4459-be54-c5f5b43a4758"
/dev/sdf1: LABEL="blah-2tb-hd" UUID="d83fad9e-9bac-4186-bf13-8eae64266be9"
/dev/sdd1: LABEL="reservoir-3tb-hd" UUID="9c1573d4-398a-4edc-a52f-05076124c3b6"
/dev/sdg1: LABEL="sans-1.5tb-hd" UUID="459ee65f-ec5a-4c0c-80bf-f024a69ee9b7"

Latest revision as of 22:32, 13 January 2025

Hive is a VM on Melange that runs my TrueNAS storage.

Pools

Pool Capacity Type Drives
mine 43 TB raidz 8TB ssd x7
safe 5.2 TB raidz 1 TB ssd x7

NOTE that there is an eighth 8TB drive matching the mine array in Bluto. Harvest it from there if one of the 7 dies.

Mine Drives

Unfortunately I opted for Samsung SSD 879 QVO drives. The ONLY 8TB SSD option available, for a long time now.

Problems:

  • They are not designed to survive lots of reads/writes.
  • Because they are so big, it is very hard to maintain them, with scrubs taking hours, and resilvers BARELY able to complete after days.

Yep, they suck. And now I am stuck with them. So I will keep getting new ones and returning the bad ones, until I can move to MVME drives on a new PCIe card.

Hardware

  • LSI 8-drive SAS board passed through proxmox to hive as "PCI Device":

Melange-LSI-board.png

  • 7 1 TB Crucial SSDs

Plugged in to SATA 1, 2, 3 and U.2 1, 2, 3, 4. NOTE: to get U.2 drives to be recognized by Melange ASUS mobo required a BIOS change:

Bios > advanced > onboard devices config > U.2 mode (bottom) > SATA (NOT PCI-E)

Hive history