mastodontech.de ist einer von vielen unabhängigen Mastodon-Servern, mit dem du dich im Fediverse beteiligen kannst.
Offen für alle (über 16) und bereitgestellt von Markus'Blog

Serverstatistik:

1,5 Tsd.
aktive Profile

#s3

6 Beiträge6 Beteiligte1 Beitrag heute

Thanks to SeaweedFS, I've set up two replicas of the BSD Cafe's media. One is on a backup server (for disaster recovery purposes only, also containing the hourly zfs-autobackup backups), and the other is on a Raspberry Pi 4 running FreeBSD, which is one of my home backup servers - just one meter away from my desk.
I've also configured Nginx in a jail, so when I'm at home, the BSD Cafe's media is served directly from the local replica.
The performance is lightning fast.

#BSDCafe#SeaweedFS#S3

There's a lot talk about "ZeroDisk" infrastructure backed by S3. The pitch is "move your data from locally attached NVMe storage to S3 and your applications will scale easier and be more performant!"

Maybe I'm getting too old for this shit, but I swear to dog this is the 4th such cycle in my career:

1. NFS
2. iSCSI / Fibrechannel
3. Hadoop / HDFS
4. ZeroDisk with S3

Am I the only one that's like: "wait, move TBs of data to S3 from NVMe to increase performance? Are you high?"

It doesn't work, so you scale up. Now you're back to local NVMe "cache disks" running instances as expensive as the locally attached NVMe instances when you add those costs to your S3 bill. The performance is worse because of course it is.

It always comes back to the two hard problems in computer science: naming things, cache invalidation, and off-by-one errors. 😂

#zerodisk#s3#hadoop

OK, Minio has decided to drop all the useful GUI features from the open-source (CE) version, making them exclusive to the paid version. More, they'll only provide "security fixes for severe issues" and no new features/development.

Personally, I prefer software that doesn't offer a certain feature at all, rather than one that, at some point, removes it and reserves it for "paying" customers.
It almost feels like a betrayal, in my eyes.

It's probably time to move the #BSDCafe media over to Garage or Seaweedfs.

#S3#Minio#Garage

Ok #mastoadmin #selfhost #S3 aficionados. I don’t have any experience with object storage providers. I am looking to move my self-host mastodon account here from local storage on my 2007 #footimac to my account at leaseweb. Could you help me with the answers to their queries? I suggested, completely off the top of my head and without experience, i would need 1.5TB and low bandwidth. Not knowing if that makes any sense.

“ for a 1.5 TB provision with low bandwidth usage, we can provide an estimate once we have more context on access patterns, regions, and any specific requirements.”

Thanks for any help!
#askfedi #fedihelp
ping: @ai6yr

I don't know if anybody noticed #ZeroFS yet, but it seems there is a completely user space-implementation of #NFS and #blockstorage on top of #S3 #objectstorage: github.com/Barre/zerofs

Including a demo running #ZFS on top of it which essentially allows geo-redundant ZFS volumes: asciinema.org/a/728234 & github.com/Barre/zerofs?tab=re

I don't see no #FreeBSD port yet, but if that really works it would be absolutely awesome.

ZeroFS - The Filesystem That Makes S3 your Primary Storage - Barre/ZeroFS
GitHubGitHub - Barre/ZeroFS: ZeroFS - The Filesystem That Makes S3 your Primary StorageZeroFS - The Filesystem That Makes S3 your Primary Storage - Barre/ZeroFS