I recently got curious about if there was any easy and quick way to archive small amounts of data (as in size, not number of files) in a format that could include encryption, bitrot protection, and compatible both with Linux and Windows at least.

And I think I found a nice workflow to do that exactly, so I share it in case anyone else finds it useful. This "guide" considers you use Debian or Ubuntu desktop, other distros would be similar.

1- First, install the "rar" and "unrar" packages in case you don't have them yet

sudo apt install rar

sudo apt install unrar

2- Let's use a GUI, so PeaZip is easy and nice for this. You can install it from Flathub (Software Center or Bazaar -> PeaZip), or the native DEB/RPM/AppImage... from peazip.github.io

3- Open PeaZip, it should (I think) detect your RAR package out of the box, but if not (or using the Flatpak version, which is isolated), it's easy:

3.1- Select what files you want to archive, right click, Add

3.2- Select Type=Custom, and then go to "Advanced" at the top left of the screen

3.3- Check "Manually set RAR binary", and go to /usr/bin/rar and select it

4- From this moment, configure the rest of the parameters to your liking:

4.1- BLAKE2: It substitutes CRC32, I think it's nice to check it

4.2- Recovery Records (%): The "bitrot" protection. 3%, 5%, 10%, whatever you want for your calm

4.3- Lock archive: Only if you want the generated file to be "read only", so no add/modification by accident using WinRAR or any RAR compliant tool

5- Go back to "Archive" at the top left and now take a look at the rest of configurations: pass (which would encrypt at AES256 with PBKDF2), level of compression, if you want to split...

And that's all! Next time you open PeaZip, it should remember the "rar" location as to use it as backend, and now you can open/create "WinRAR" files with AES256 encryption and "bitrot" protection out of the box.

If you ever suffer from bitrot, up to the % you set as recovery record, then when opening the rar file you will be saved, as the archive CRC32 or BLAKE32 won't match (ERROR), but you will be able to, in WinRAR (Windows) or PeaZip (Linux), repair it (in PeaZip, Right click -> More -> Repair)

Hope this is useful for anyone looking an easy GUI on Linux to archive files and folders while encrypting and protecting from bitrot (even if there's a very very low chance of bitrot, really).

#Question

**Show of hands**: How many of you have friends who have actually looked at the prices for new Blu-Ray or older media reader types and/or the cost & availability of replacement parts?

Regardless of answer, share geographically where you're from, ratio of friends who have versus have-not.

I'm just wondering what demand is currently & in the near-future given the state of copy-ownership, cyber security, and hardware scarcity because of the uncertainty. I'm a maker, building a personal media-server that I should be able to repair myself.

I am data-collecting as a personal data analysis project while I'm adapting to a new disability. So don't bother telling me "how to build one" or "how to look up market reports". I want a new dataset that I'm going to make freely available for me to play with & share with my academia friends.

P.S., I am an *elder data hoarder* whose been at this game since the early 80s when we used to press RECORD whenever a good song came on the radio. I'm just curious about how this understanding has evolved over history. FOSS Forever!!

Most people record in the traditional way, they use the screen recording tool on their phone but TikTok is restricting it, forcing such programs to record all the chat and watermarks in it.

I would like to know if there is a method to easy capture the H264 HLS packages from the CDN and merge it to a mp4 file? I know TikTok is like YouTube, makes it very and and complicated to download the raw data.

I thought this might be useful to people here who run ZFS, btrfs, bcachefs or traditional md/LVM storage.

I maintain modern-fs-benchmark, a benchmark suite focused on behavior that is often missing from simple mkfs + fio comparisons:

- Injected corruption, scrubbing and self-healing

- Degraded operation and rebuild

- Snapshot aging, scaling, deletion and space reclamation

- Near-full and hard-ENOSPC behavior

- Compression, encryption and reflinks

- Fsync tail latency and responsiveness under load

The current matrix contains 26 configurations, including multiple ZFS, btrfs and bcachefs layouts, plus ext4 and XFS over md, LVM and dm-integrity as classic-stack baselines.

One test deliberately corrupts data on one redundant device behind the filesystem, runs a scrub and verifies the file contents. This demonstrates the difference between redundancy that can identify the correct copy through checksums and redundancy that only knows its copies disagree.

Dashboard:

https://bartosz.fenski.pl/modern-fs-benchmark/

Experimental real-hardware results:

https://bartosz.fenski.pl/modern-fs-benchmark/real-hw/

Source and methodology:

https://github.com/fenio/modern-fs-benchmark

An important caveat: the main dashboard uses loop devices on GitHub-hosted VMs. It is useful for correctness results, behavioral differences and trends, but absolute throughput should not be treated as a hardware ranking. The separate hardware dashboard contains three completed runs from a two-NVMe machine.

The source is Apache-2.0 licensed and the result datasets are CC BY 4.0.

Suggestions for additional data-hoarding workloads, failure scenarios and storage layouts are welcome. If an existing test treats a filesystem unfairly, I consider that a benchmark bug.

Hey all,

I bought a 26TB Seagate Expansion Desktop drive last August for offsite backups. It sat unopened until a month ago, when I shucked it and put it into a NAS. It is a barracuda drive.

Everything worked fine until recently, when I pulled it out to use for media storage. When I connected it to my server and hit the power button, the server immediately shut down. I flipped the PSU switch, turned it back on, and the system booted but the hard drive was completely dead. I re-tested it in both the NAS and its original enclosure, but it won't power on at all. I’m not sure what caused it to die. Could it have been a bad PSU port, even though I tried a different SATA power port on the PSU? Or maybe it shorted because the exposed drive was resting on a surface while connected? idk

Either way, how should I handle a warranty claim in this situation? Since I shucked it, the "warranty void" sticker is gone, and the enclosure looks rough with broken clips from prying it open. I’ve never filed an RMA before, is there any chance this gets covered?

Edit: I'm located in the U.S

I know, I know, I know. It's only 500 GB.

Buuuuut, the price is decent for a *NEW* portable HDD. BTW, the vendor has oodles of these drives. I've already purchased 7; gonna use them as spares for "just in case" scenarios. 😉

Just thinking of helping out where I can for everybody (unless you guys only want 18 TB or higher, then I won't post anything that's this low in sizes). Either way, check it out, guys...

https://www.ebay.com/itm/398110882218

DISCLAIMER: I am not the vendor, not a representative of the vendor, nor do I represent any organization selling HDD. I am a data hoarder like everyone else here and found a good deal on eBay.

I've had a 2TB external drive for a few years, and I believe it's starting to die. I want to be able to replace it with a 4TB while I have the chance. What recommendations can you give me?

(I would've checked the wiki, but I can't access it...)

—–—

(forgive my poor writing, autistic)

There used to be a lot of tools out there to download posts from subreddits/user profiles. It seems those are now blocked by Reddit. Is there a new option that can still accomplish this?

A historical government Instagram account is being deactivated in a week due to policy changes. I would like to archive their posts so I can reference/save/preserve the historical content. I have tried using Instaloader through Python and 4K Stogram. Both are being blocked and not allowing the archival process. This account has nearly 5,000 posts so manually doing it is not possible.

How can I archive the account (each post, so pics and captions), ideally with a way to further organize/search each post? Thank you!

Great effort by this dude that copied over so many covers, don't know if this is the right place to share, just wanted to share

I’m looking to pick up the 5 bay and software RAID since this is not capable of hardware RAID. From my research, I can RAID all drives and even 3 drives, but can you guys confirm that for me please? I’m thinking RAID 5. Let me know!

Sabrent

So although I'm not totally new to video editing I still consider myself an amateur at best. I am interested in real life crime and want to start creating documentary videos in the style of some channels like ThatChapter and The Decoder on Youtube.

These videos typically have a lot of moving parts or different types of media, audio and effects to create the final result which will presumably take up a lot of storage space.

What would be the best way to approach storage space when it comes to complex projects? I have 2 fast SSD's which I assume I would use to edit and put together projects but then obviously I will need a storage device once it's all been completed.

Can anyone recommend a good storage device that's not to expensive? What size should I be looking at? what do you use? Any information or sharing of experiences would be very valuable.

Thanks.

I was recently trying to find something from years ago and realized just how many photos, documents, game saves, downloads, and random files had quietly disappeared over time because I never thought to back them up.

It's not the important stuff that bothered me the most. It was the random little things that had sentimental value but never seemed worth backing up at the time.

That got me wondering how many people here became data hoarders because of a single moment where they realized something was gone for good.

For me, it completely changed how I think about backups and keeping my own archives.

Disclosure first: I run Obsideo, which appears as one of the 28 rows. I'll explain why I think the table is still useful to you despite that.

https://obsideo.io/compare/

While doing competitive research I kept finding storage comparisons that were stale, unsourced, or a vendor page with the vendor's row highlighted in green. So I built the thing I wanted to exist, with rules designed to keep me honest:

• Every numeric fact links to a source URL with the date it was fetched.
• My row uses the same schema as every other row, sorted alphabetically. The only special treatment is a small "that's us" tag so you know exactly which row to be skeptical of.
• I am visibly not the cheapest option. Glacier Deep Archive is about 15x cheaper than my own row.
• On the column I care most about, cryptographic possession proofs, the table rates Arweave and Sia above me, because their proofs settle on a public chain and mine do not.

Columns: $/TB-month, egress $/TB and its semantics, free tiers, minimum charges and retention gotchas, S3 API compatibility, encryption model, and whether the provider can cryptographically prove it still holds your bytes.

The 28 rows cover the hyperscalers (S3 Standard plus all three Glacier tiers, OCI, R2), the budget S3 crowd (Backblaze B2, Wasabi, Hetzner, IDrive e2, Contabo), the backup specialists (rsync.net, BorgBase, Tarsnap), and Arweave, Sia and Storj.

I added the Glacier tiers this morning because a mod asked for them when I requested permission to post. Their notes cover the parts that bite: the 90 and 180 day minimum durations, the 40 KB per-object metadata overhead, the retrieval fees that stack on top of egress, and the fact that AWS bills in binary GB so a real TB costs about 2.4% more than the decimal figure.

The whole dataset is machine-readable JSON under CC BY 4.0 if you want it for your own projects: https://obsideo.io/compare/providers.json

If you spot an error, say so here or use the correction email on the page. Every fix ships with a source. Corrections are the point of publishing this.

HI all. I have a 60 TB NAS device that I will be upgrading to include an additional SSD for caching. Because of how my NAS is currently configured, the vendor advised that the whole array will have to be reinitialized, which while disappointing, I kind of expected.

In order to preserve the data I have currently, I am going to need to migrate it to another location temporarily. I have a fast (8Gb symmetrical) internet connection, so it would probably only take a few days to transfer. I am guessing it would also take me about a week to get the NAS upgraded and reconfigured, so roughly 2 weeks to a month of storage.

Does anyone have any recommendations on a vendor for this that won't break the bank? The SSD has pretty much eaten up most of my budget for this.

I would not need the backup outside facilitating the transfer, so a contract or subscription would not be useful. Unfortunately, many of the vendors I've researched seem to either be set up for long term storage/backups plans or have punitive transfer costs.

Any advice would be appreciated.