28 comments

[ 2.9 ms ] story [ 41.0 ms ] thread
Just wanted to share a quiet successful self hosting.
It's weird to me that "owning a computer that runs stuff" is now "self-hosting", just feels like an odd phrasing. Like there's an assumption that all computers belong to someone else now, so we have to specify that we're using our own.
Does this JBOD consist of SSD? HDDs in that amount can be rather noisy.
Neat. Depending on your use case it might make sense. Still I wonder what they use for backup? For many use cases downtime is acceptable, but data loss is generally not. Did I miss it in the post?
Getting into S3 myself and really curious about what Garage has to offer vs the more mature alternatives like Minio. From what I gather, it kinda works better with small (a few kilobytes) files or something?
What enclosure houses the JBOD?
Very cool! I replaced my mainboard on my framework and am trying to convert it to a backup for my nas.

Could you talk a little more about your zfs setup? I literally just want it to be a place to send snapshots but I’m worried about the usb connection speed and the accidentally unplugging it and losing data

i'd be stressed out while watering those plants.
I have an ancient Qnap NAS (2015) which is on borrowed time and I’m trying to figure out what to replace it with. Keep going back and forth between rolling my own with a Jonsbo case vs. a prebuilt like the new Ubiquti boxes. This is an attractive third option of a modest compute box (raspy, NUC, etc.) paired with a JBOD over USB. Can you still use something like TrueNAS with a setup like that?
Amazing, I will try Garage.

What brand of HDD did you use?

With the metadata only on the internal drive, isn't this a SPOF?
I really don't get it. Do they host it on Amazon S3 or do they self-host it on a NAS?
>>About 5 months ago I made the decision to start self hosting my own S3.

It is eleven nines of durability? No. You didn't build S3. You built a cheapo NAS.

I love Garage. It just works. I have Garage running on a few older Odroid HC2's, primarily for k8s Velero backup, and it's just set and forget.
10TB, you could just mirror 2 drives with that, seen people serving 10PB at home by this point I'm sorry to say
I'd rather go with an old Dell T30 and 2x10TB Seagate Exos in ZFS RAID1 mode (Mirror). This thing would make me nervous every day, even with a daily backup in place... While the Dell T30 would also make me nervous, you could at least plug the disks into any other device and are not wiring up everything with some easy to pull out cables ;)

However, garage sounds nice :-) Thanks for posting.

I'd like more ellaboration on the technical side. Not literally how to do the same and what commands to use, but more in the line of how are the ZFS pools configured, or if Garage is opinionated and configures it all by itself. Are there mirrors in there? Or it's just individual pools that sync from some disks to others?

I have 2 USB disks and want to make a cheapo NAS but I always doubt between making a ZFS mirror, making 2 independent pools and use one to backup the other, or just go the alternate route and use SnapRAID and then be able to mix more older HDDs for maximum usage of the hardware I already own.

Why are you calling it S3? That is a proprietary Amazon cloud technology. Why not call it what is it is, e.g. ZFS, file store, or object store? Let's not dilute terms.
Thanks for the lead on Garage S3. Everyone's always recommending minIO and Ceph which are just not fun to work with.
ZFS is RAM hungry, plus doesn't like USB connections (like the article implied). So, I've been eyeing btrfs as a way to setup my NAS drives. Would I miss something in that setup?
I’ve not heard of garage before but it looks quite interesting. I use s3 a lot for work but for homelab backups I’ve always just used borg on borgbase. Now I’m wondering whether I could use garage to pair a local node and AWS glacier for cheap redundancy of a large media library (I’m assuming that ~all of the reading is automatically done from the local node). TFA doesn’t really talk much about the actual experience of using garage - would love to hear more opinions from those who use it for self-hosting.

Edit: Realised you can’t use glacier since storage has to be mounted to the ec2 compute running the garage binary as a filesystem. So doesn’t really make sense as media library backup over just scheduling a periodic borg / restic backup to glacier directly.

Nice to see Garage mentioned. I was deciding between S3-compatible self-hosted alternatives and ended up choosing SeaweedFS. It seems to require less manual configuration compared to Garage
What do you use self-hosted S3 for? I feel like all the use cases I can think of would be better served by a network attached file system.
Not sure that framework adds anything here, I host around the same on a RPi5 and a few disks. Instead of ZFS I use lvm2, it's pretty good on the RPi5. ZFS eats up too much RAM for what I use it for there.
I do something similar with Minio although I still have most of my stuff on normal file system.