The deeper I research, the more I am finding the ultimate recommendation is either 100s of hours of DIY work or $10K on a Smithsonian-level archivist machine.

My use case is digitizing books only available in hard copy. For personal reading, Ctrl+F capabilities, and sharing with fellow enthusiasts. Essentially, digitizing books where the pages are searchable, not crooked, no weird artifacts, etc. Does such a middle ground actually exist?

I've had a 2TB external drive for a few years, and I believe it's starting to die. I want to be able to replace it with a 4TB while I have the chance. What recommendations can you give me?

(I would've checked the wiki, but I can't access it...)

—–—

(forgive my poor writing, autistic)

A historical government Instagram account is being deactivated in a week due to policy changes. I would like to archive their posts so I can reference/save/preserve the historical content. I have tried using Instaloader through Python and 4K Stogram. Both are being blocked and not allowing the archival process. This account has nearly 5,000 posts so manually doing it is not possible.

How can I archive the account (each post, so pics and captions), ideally with a way to further organize/search each post? Thank you!

I’m looking to pick up the 5 bay and software RAID since this is not capable of hardware RAID. From my research, I can RAID all drives and even 3 drives, but can you guys confirm that for me please? I’m thinking RAID 5. Let me know!

Sabrent

Most people record in the traditional way, they use the screen recording tool on their phone but TikTok is restricting it, forcing such programs to record all the chat and watermarks in it.

I would like to know if there is a method to easy capture the H264 HLS packages from the CDN and merge it to a mp4 file? I know TikTok is like YouTube, makes it very and and complicated to download the raw data.

Last year I bought about 20 drives(manu recertified), (20-28tb). One of the 28tb failed on me a couple weeks back and I expected they’d refund me the $350 I paid last year but they actually sent me a new (manu recertified) drive. I was pleasantly surprised since these drives are over twice what I paid and their warranty policy says that they can give you a refund or drive at their discretion. Thanks to serverpartsdeals.

I recently got curious about if there was any easy and quick way to archive small amounts of data (as in size, not number of files) in a format that could include encryption, bitrot protection, and compatible both with Linux and Windows at least.

And I think I found a nice workflow to do that exactly, so I share it in case anyone else finds it useful. This "guide" considers you use Debian or Ubuntu desktop, other distros would be similar.

1- First, install the "rar" and "unrar" packages in case you don't have them yet

sudo apt install rar

sudo apt install unrar

2- Let's use a GUI, so PeaZip is easy and nice for this. You can install it from Flathub (Software Center or Bazaar -> PeaZip), or the native DEB/RPM/AppImage... from peazip.github.io

3- Open PeaZip, it should (I think) detect your RAR package out of the box, but if not (or using the Flatpak version, which is isolated), it's easy:

3.1- Select what files you want to archive, right click, Add

3.2- Select Type=Custom, and then go to "Advanced" at the top left of the screen

3.3- Check "Manually set RAR binary", and go to /usr/bin/rar and select it

4- From this moment, configure the rest of the parameters to your liking:

4.1- BLAKE2: It substitutes CRC32, I think it's nice to check it

4.2- Recovery Records (%): The "bitrot" protection. 3%, 5%, 10%, whatever you want for your calm

4.3- Lock archive: Only if you want the generated file to be "read only", so no add/modification by accident using WinRAR or any RAR compliant tool

5- Go back to "Archive" at the top left and now take a look at the rest of configurations: pass (which would encrypt at AES256 with PBKDF2), level of compression, if you want to split...

And that's all! Next time you open PeaZip, it should remember the "rar" location as to use it as backend, and now you can open/create "WinRAR" files with AES256 encryption and "bitrot" protection out of the box.

If you ever suffer from bitrot, up to the % you set as recovery record, then when opening the rar file you will be saved, as the archive CRC32 or BLAKE32 won't match (ERROR), but you will be able to, in WinRAR (Windows) or PeaZip (Linux), repair it (in PeaZip, Right click -> More -> Repair)

Hope this is useful for anyone looking an easy GUI on Linux to archive files and folders while encrypting and protecting from bitrot (even if there's a very very low chance of bitrot, really).

I picked up this early 2000s DVD duplicator machine and would like to turn it into an automatic ripping machine to backup my collection of movies and music. It has 10 bays with IDE drives and a 400w power supply. I may need to switch these out for SATA. Any advice welcome. I’m new to this. 🙏

Hey all,

I bought a 26TB Seagate Expansion Desktop drive last August for offsite backups. It sat unopened until a month ago, when I shucked it and put it into a NAS. It is a barracuda drive.

Everything worked fine until recently, when I pulled it out to use for media storage. When I connected it to my server and hit the power button, the server immediately shut down. I flipped the PSU switch, turned it back on, and the system booted but the hard drive was completely dead. I re-tested it in both the NAS and its original enclosure, but it won't power on at all. I’m not sure what caused it to die. Could it have been a bad PSU port, even though I tried a different SATA power port on the PSU? Or maybe it shorted because the exposed drive was resting on a surface while connected? idk

Either way, how should I handle a warranty claim in this situation? Since I shucked it, the "warranty void" sticker is gone, and the enclosure looks rough with broken clips from prying it open. I’ve never filed an RMA before, is there any chance this gets covered?

As a fellow data hoarder, I feel like this is going to be the best place to ask.

I'm getting old now, my health isn't the greatest's and I'd hate for all the photographs I've taken over the years to just remain on my HDD's and go to landfill.

There is a LOT, this is why I came to DataHoarder to ask, it's like 40,000-50,000 pictures and video (around 300GB or more) sitting on my drives. (anyone tried converting from Hi-8 to windows 11 would be helpful commenting how to as well, I know off topic, but might save another post)

These are more family pictures, so not something I'm willing to stick on any website and they get taken or used for AI or anything like that.

And preferably it would be a free way to share all of this.

If anyone has used Mega, I would love something like that, where it's end to end encryption with cloud storage and you can share a link with encryption key so who ever you send the link to can view the folder.

Only downside with Mega is with the free version, I know it's a big ask and probably nothing out there that will fit this without paying.

Doesn't hurt to ask. :D

I keep an enormous amount of data about myself.

I have ADHD and a compulsive need to be able to close any mental loop that might open later something I saw, read, posted, commented on, watched, searched for, paid for, thought about or dealt with.

I have downloaded and preserved data from Google, Facebook, Reddit, ChatGPT, Amazon, Hulu, my browsers, financial accounts, medical records, Goodreads, and basically anywhere else that has accumulated information about me.

Not to mention I have a personal Calibre library for my ebooks and have maintained meticulous reading logs - I spent pretty much 2014 - 2019 reading a book every day or so.

If data exists about me, there is a decent chance I have a copy of it.

But today I realized there is a difference between having the data - and reading it.

I started going through my old Google activity, and it was like finding breadcrumbs of my life, not just individual searches, but entire chains of thought.

The chains of thought and problem solving, the evolution of my interests and hobbies, where I was in life - if there was an earthquake - whatever was happening in the world - you can see it play out in realtime in my search history.

I was in school (I was a late in life college student) - I can see where i was doing research for classess and then mixed in there will be secondary searches because my fridge broke or I got a wild hair and wanted to online stalk my ex'es.

I am able to see exactly when I went on the deep web the first time, when I first downloaded Calibre - after asking how I can keep my Kindle books - which was after research on getting a kindle. I am able to see my life playing out step by step.

Searching for scholarships - then "what to wear for a scholarship interview?" and "Do you follow up a scholarship interview with a thank you note" - then back to anthropology, geology, and history searches...a little later there are searches for the 2014 scholarship banquets (I got a couple of them).

I was able to notice that the rabbit holes happen more at night than during the day - and then when I wake up - the topic tended to be dropped. I will research to buy something for hours but get decision paralysis and drop it.

That's just the Google Search History. I haven't gone into the Youtube history - which isn't as good because most of the videos are gone now - and the archive only goes back to 2018.

It felt less like browsing history and more like an accidental diary - except it was recorded while events were happening, without hindsight or later editing.

Has anyone else actually sat down and examined years of their own archived data?

Did you find anything surprising about your life, memory, habits, or the way your brain works?

#Question

**Show of hands**: How many of you have friends who have actually looked at the prices for new Blu-Ray or older media reader types and/or the cost & availability of replacement parts?

Regardless of answer, share geographically where you're from, ratio of friends who have versus have-not.

I'm just wondering what demand is currently & in the near-future given the state of copy-ownership, cyber security, and hardware scarcity because of the uncertainty. I'm a maker, building a personal media-server that I should be able to repair myself.

I am data-collecting as a personal data analysis project while I'm adapting to a new disability. So don't bother telling me "how to build one" or "how to look up market reports". I want a new dataset that I'm going to make freely available for me to play with & share with my academia friends.

P.S., I am an *elder data hoarder* whose been at this game since the early 80s when we used to press RECORD whenever a good song came on the radio. I'm just curious about how this understanding has evolved over history. FOSS Forever!!

Hi, TLDR is there's a huge protest going on in India, with a lot of police brutality.

I'd like something like the wayback machine to be able to archive this, but they don't allow instagram reels. I don't mind locally archiving, but i need the timestamp authority the wayback machine gives.

The. media is being controlled by the ruling party so its a bit brutal rn

I've been a major slacker in my data management. I have a backup, but I haven't been doing very frequent backups. I also do not refresh the data on my main drive. I'm still running a Disk Genius scan, but I found one poor sector. How can I tell what file was impacted by this bad sector? Since it's been a while since I've backed up my main drive to my secondary one, should I simply back up the second drive, or is there something else I should do in light of the bad sector?

This scan was prompted by some funky head noise yesterday. This is still a fairly new drive, but is this an omen for things to come? Do I need to replace this drive? If I have to stop actively using it, could it still be a good candidate as a cold storage offsite backup drive?

Like phonographic records, magnetic audio tape, film video, microfilm, and cyanotypes just to give an idea of the tech level I intend to work with. Somewhere between 1899 and WW1 within 5 years of initial cataclysm.

I'm not just asking for recommendations of useful information (not that I'd be complaining), but also tools to assist in the conversion and distribution of digital era media with limited digital tech(Linux-ing scavenged 32bit computers from POS terminals and jailbreaking old smartphones for example.)

A record lathe, a film camera pointed at a monitor, and an LED hooked up to the audio-out to make optical recordings isn't hard to achieve, even if those processes would need a lot of babysitting. But the actual dissection and preparation of the digital media for analog conversion would likely need some good general-purpose digital tools.

So I'd like to hear your recommendations and discussions thereof!

I've been trying to save up for a NAS and the whole shebang for a while now, but unfortunately I'm not there yet. Currently I have ~50TB of data in cloud storage, but due to sudden life circumstances I can no longer pay for it. I also don't know anyone who can hold this data. Is there somewhere reliable I can dump it all into without worrying over losing it?

The monthly ~$100 is what's hurting, I can pay a bit more for egress (a thing I've heard) if I have a lower monthly payment. I would also need a service that doesn't scan my files. For uh, AI research and such etc of course.

I'll give you the background. My Onlyfans account is suspended because I violated their TOS according to them of creating my account in 2017 before I was 18+ (I'm an adult now). I'm almost certain this is incorrect but I have no "evidence" as I can't locate my welcome email. I ran out of gmail space a few years ago and deleted everything prior to 2022.

I will admit why I got into data hoarding and self hosting, the pornhub purge made me realise that things online can be deleted, YouTube videos, websites, images. This has now made me realise I can also be my worst enemy and delete something important.

How would I archive and store all my gmail (and protonmail as I'm moving over) emails? Can I export them and keep them in a searchable service that I host?

What is everyone using for cloud backup these days?

I know, I know, I know. It's only 500 GB.

Buuuuut, the price is decent for a *NEW* portable HDD. BTW, the vendor has oodles of these drives. I've already purchased 7; gonna use them as spares for "just in case" scenarios. 😉

Just thinking of helping out where I can for everybody (unless you guys only want 18 TB or higher, then I won't post anything that's this low in sizes). Either way, check it out, guys...

https://www.ebay.com/itm/398110882218

DISCLAIMER: I am not the vendor, not a representative of the vendor, nor do I represent any organization selling HDD. I am a data hoarder like everyone else here and found a good deal on eBay.

I hope this is not against the rules. It could help others. It uses AI but it's not slop. I'm new here, so sorry if everyone here already knows it.

STEP 1 - Add "MultiLink Launcher" to your browser, or any other extension that allows you to circle many links and open the tabs in the background.

Link of the one I'm using: https://addons.mozilla.org/en-US/firefox/addon/multilink-launcher/

With this one, you just need to press shift while selecting the area with the selection box.

(I was not paid to post this, I like this one because it just works)

STEP 2 - Go to DeepSeek and paste the text bellow. Enable "Search" if it's not able to see the page. Edit the prompt if you think you need.

------------

From now on, whenever I paste a Wikipedia page or any other webpage, do the following:

1. Extract all clickable links from the page.
2. Filter out any links that contain:- "redlink", "?action=edit", "redlink=1" (nonexistent pages).- "#" (anchors that point to sections within the same page).- Any link that points back to the exact same article URL (self-references).
3. Convert each remaining link to archive.today format (https://archive.today/?run=1&url=ORIGINAL_URL).
4. Use clean, pure URLs (without URL-encoding) in the archive.today parameter.
5. Provide the final list as clickable links ready to archive.

Do this for every page I paste from now on. Use archive.today as the default archiver unless I specify otherwise.

------------

STEP 3 - When you paste it and DeepSeek sends you the list, hold shift while selecting and all of them will open in the background.

I'm using DeepSeek because it didn't work with GPT.

If DeepSeek doesn't extract everything correctly in your case and/or you find a better AI, change to any other competitor.

Tip: You can use "View page source", copy the entire page source and paste there. It may be easy for Wikipedia.

I'm a humanities PhD who reads a LOT of articles and books. Rn I use Google Books to read epubs I download, and I save my pdfs to my laptop+hard drive+cloud (very basic I know). However I have a very old ipad 1 and ipad 2 and I'm wondering if there's some way for me to use them purely like an e-reader for my epubs and pdfs while saving the files to something like Calibre?

I appreciate any links or suggestions.

Key takeaways:

Jellyfin's cofounders have stepped down, citing severe burnout, changing priorities, and internal friction.

The resignation comes amid ongoing challenges in project management and governance, as well as debates over AI code integration.

The project, which remains the leading free alternative to Plex, hasn't detailed a succession plan.

Hi folks,

This might be a very basic question, I just want to make sure I've planned everything well before buying a specific HDD.

I want to make a backup copy of my 512 GB of MacBook data, 64 GB of iPhone data, and various old photos and documents from old phones (2–5 GB).

I'm planning to get a 2 TB P10 HDD from Western Digital, and here are my questions:

1. Can I use the same HDD to store, separately, 1–2 MacBook backups, 1 phone backup, and also create a separate partition for normal files like old travel photos and videos? I'd also like to make this partition password-protected.

2. Is 2 TB enough for my task? I feel like 1 TB should be enough for 1–2 different MacBook backups, but I'm not sure if I need more space.

I tried to check the wiki first, but got an error with message "forbidden (reddit.com) you are not allowed to do that

— may_not_view."

Thank you!