@RadioAzureus
I'm currently researching a simple ready-made DAS to do jBOD.
I quickly came to the conclusion that they don't exist
Companies either ask too much for too little performance, or they ask a normal amount for a good performance on a server level.
Since I can build servers myself, all I need is a good 19 inch rackmount case a proper ECC ram motherboard which supports everything that I need especially high powered Network IO, to get transparant access to the ZFS Pools.
Since I will also want to run VMs not just jails, it means that the CPU needs at least 32 cores probably even 64, {of course an AMD Epyc candidate} and the memory needs to be at least 8 gigs per core at full extreme, I may want 16GB per core.
However the storage will still need a separate enclosure simply because the server itself will not be enough for that. The server cases I've seen can house at the most 16 HDD, insufficient for Mass massive Mass & Modular expandable storage.
So again I will need rackmount DAS enclosures.
The purpose of the server will be fourfold. Primarily it needs to hold the massive audio collection that I have. All important audio is a flac format which means that space is required. No puny eight terabyte hard drives will suffice not even in an array of 16 or 24 of them.
I choose to use ZFS pools simply because they're much more powerful in maintenance backup restore {Raid is NOT a backup} and pure management.
Secondary it needs to hold jails and VMS smoothly. The VMS I want to control using ProxMox. The jails will of course be native controlled in freeBSD
On the third level I need to do research on the server probably through VMS and jails in combination.
And on the final level I want the server to run defensive and protective software with which it interacts with real life data and scenes.
Such a machine does not exist ready-made. The reason for that is that the software and the hardware combination that I want to use is specific.
In these planning stages I never look at a budget. Otherwise your machine will be cut from the get-go. Instead I built a plan for a perfect machine and then at the end I cut and strip down based upon a budget.
Software used will be pure open source nothing closed and the reasons are obvious which I do not need to explain
I also want to see if GPU pass through is possible so that I can run software which needs dedicated GPU access on a hardware level
I will control the ZFS HDD pools through a jail which runs a dedicated ZFS management system.
From what I see here I will need at least three cases;
one for the server which will manage the jails and the VMS and the gpus
One case where the first set of HDDs will be stored.
The third case will be a backup server less power but sufficient enough so that I have high availability. That case can also store some extra hard drives
The network connections between the hard drive {jBOD} cases and the server will need to be fiber. The runs will be short because there will be in the same 19-in rack. I want to use a specific brand for the networking Hardware microTik, their performance to price ratio is just where I like it
For for uninterruptible power I want Matrix UPS and rackmount. There's also a specific brand that I want because I've seen their performance and it is fantastic CyberPower
The only sanfu is that the hard drives that I want are not available to the professional public yet those are 32 to 48 TB drives.
In this case the 32 TB is that decimal concoction that I don't like to use. So the raw unformatted space will be 31.25 terabytes (these are the binary based terabytes)
The 48 TB HDD will be in actuality 46.875 Raw unformatted hard disk space.
I want to run the server Rack in another room, not another building; that means that the fans should not run like the turbo fan on a jet, when a nominal load is applied on the servers.
So anything above 60dB is too loud. In prácticas there are just two Solutions
I isolate the room sonically. Since I have extensive Sound Engineering experience I know that's really not elegant. Just like you built a studio facility from the ground up you should also build a room in isolation when the building is being erected. You either pay too much for the isolation afterwards and get nominal performance, or pay a simple price and get a unsatisfying performance.
Just like in ear protection PPE, you need at least -24dB in noise reduction ratio, from the isolated server room. But that also means that the door needs to be shut 24/7
The room will stink.
So instead the hardware needs to be chosen carefully that it doesn't make too much noise
I like this plan of execution I will put it on paper literally and then play with it
Note:
1GB = 1024MB here