all 38 comments

[–]AutoModerator[M] [score hidden] stickied commentlocked comment (0 children)

Hello /u/rrybwyb! Thank you for posting in r/DataHoarder.

Please remember to read our Rules and Wiki.

Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.

This subreddit will NOT help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[–]Far_Marsupial6303 44 points45 points  (0 children)

Voyager 1 & 2 have analog golden records and there are are many duplicates on Earth.

[–]SupermarketFit9015 59 points60 points  (3 children)

Yup. Ceramic Tablets. https://en.m.wikipedia.org/wiki/Memory_of_Mankind Also, in a bit more modern way: https://nanofiche.com/

[–]rrybwyb[S] 23 points24 points  (1 child)

This is why I love reddit thank you

[–]camwow13151TB raw HDD NAS, 60TB raw LTO 11 points12 points  (0 children)

  • Piql Film. Commerical operation which does archival work for various places and stores them in the Arctic. It's what GitHub Arctic archive is stored on.

  • Project Silica by Microsoft. Storing data on glass plates. Updates on this have been slow and there will probably never be a consumer version if it ever launches. But they have made slow but sure progress.

  • QR codes on paper. A few projects like Paperbak or this GitHub. I saw one that got it up to a couple megs per page with a custom code pattern, but can't find it now.

  • The most practical "inert" storage format remains discs though. Widely available. Widely understood. And billions if not trillions of drives out there in the world that will be able to read them long into the future. M-Disc was a run at replacing the organic degradable media in DVD-R with a much harder inorganic substance. They are very durable although their longevity claims are simulated. It's important to note that all BD-R is made with inorganic media too (except for LTH discs made from old DVD manufacturing) and so the benefit of M Disc with Blu Ray is much less. Sony's 128gb BD-XL is the largest BluRay ever made. They were made for the first gen of their now defunct optical disc archive system. The ArchivalDisc format reached up to 500 gigs a side with a roadmap to a terabyte or more, but has seemingly died with the Optical Disc archive. It saw no wide consumer release.

[–]Misaria 7 points8 points  (0 children)

The Intuitive Machines IM-1 mission made their historic lunar landing as part of NASA’s Commercial Lunar Payload Services (“CLPS”) initiative.

The content curated with various foundations around the world, is continuing to be revealed as part of the NanoFiche launch sequence. Notable contents released so far:
David Copperfield’s Magic Secrets — the secrets to all his greatest illusions — including how he will make the Moon disappear in the near future.

Then why did you send it to the moon?!

[–]stilljustacatinacage 38 points39 points  (3 children)

Also, most of the information at the Library of Alexandria is believed to have survived, as a lot of what was kept there were copies of documents kept elsewhere. Similarly, original works stored at the Library usually had copies somewhere else as well.

There's really no way to know exactly how much was lost, but the general consensus these days is that it wasn't as great as a catastrophe as we've been led to believe.

[–]nemec 19 points20 points  (0 children)

Apparently many books that came into the city on ships were seized and had copies made. Alexandrians were the original ebook pirates.

[–]volthunter 6 points7 points  (1 child)

alexandria was fucked up long before it had a minor fire in the left wing, frankly the biggest problem it had was right wing governments taking all it's funding, it only had like 3 employees by the time of the fire and they just did not have the ability to preserve anywhere near as much as they would have with a full staff of 200+ people, they did what they could but most of it had rotted or molded by the time the fire even arrived.

[–]stilljustacatinacage 3 points4 points  (0 children)

I remember hearing it had fallen into disrepair but I didn't know it was that bad.

Thankfully, that's in the far distant past and nothing like that would ever happen today.

[–]jbtronics 7 points8 points  (0 children)

A big problem is that to save large amounts of data requires high data densities. Sure stone tablets are very durable, but just for putting Wikipedia on stone tablets (in a readable), you will probably need unimaginable large spaces to store all of them. And Wikipedia is just a fraction of human knowledge.

Therefore you need higher data densities, which automatically needs that the information needs to become somehow smaller. And you easily reach a point where you need very advanced technology to retrieve the data. Stuff like synthetic DNA in glass or laser engraved glass cubes are pretty durable, but without computers, micro technology and advanced machinery, it's just pretty useless.

Things like micro film are quite nice, as you just need pretty easy optics to read them (and you can at least recognize by eye, that these might be data storage devices). But the data density is also quite limited.

[–]fliberdygibits 16 points17 points  (2 children)

Github just recently added a HUGE repository of open source software to the Arctic World Archive:

https://archiveprogram.github.com/arctic-vault/

There are other such efforts for saving data. Oreo for example has their own vault.

Edit - I said "recently".... but it was 4 years ago. Time has been wonky the last few years:)

[–]drashna220TB raw (StableBit DrivePool) 3 points4 points  (0 children)

Pretty sure it wasn't actually the burning that was the issue, but the decline of intellectualism and education, and that let the library decay until ....

The problem isn't the actual preservation, but the culture around it, basically.

[–]Halos-117 9 points10 points  (7 children)

Nothing is permanent. 

[–]Catsrules24TB 1 point2 points  (0 children)

I mean even if the HD/SSD doesn't die, there is the risk than in 50 years the format won't be read by any application or the HD/SSD cannot be connected anywhere.

Try to connect easily an HD from the 1980 somewhere today without digging for old HW that dies.

PATA/IDE was released in the 80s and you can buy IDE to USB adapters for like $20 on amazon. I think you can still buy SCSI controllers and cables as well fairly easily as well.

As long as you stick with a popular standard I think you are fine for 50+ years easy. From what we have seen standards have become backwards compatible for the most part. For example USB is fully backwards compatible almost 30 years and it will still work. (Although you may need some adapters)

I think CDs are pritty backward compatible as well. I can buy a Blu-Ray drive today that will play a CD just fine. (I am not 100% on this as there was alot of different kinds of CDs back in the day.

Realistically I think most people will be upgrading storage and things over time. I went from Floppies, to ZIP disks, to CD, to DVDs, to Hard drives to Flash memory over my life time so far.

[–]rrybwyb[S] -5 points-4 points  (4 children)

I'd say dinosaur bones fared pretty well.

[–]Xinil 7 points8 points  (0 children)

Technically they aren't the real 'bones' left over though, they're the fossilization of bones. Like a cast.

[–]cody_vagabond 0 points1 point  (0 children)

Why does 20.000 alive at any time sound so little

[–]AshleyUncia 3 points4 points  (0 children)

Someone doesn't know how fossils work.

[–]Several_Fan9272 2 points3 points  (1 child)

I convert old offline books into digital variants and have multiple backups because I put a lot of time and energy into it. Besides an upload to internet archive for sure.

If fallout comes, we all have more problems than unreadable media. Besides the fact that there are a lot of media stored safty in a mountain.

Ceramic can break easy, plastic can melt easy. Stone is good imho.

[–]rrybwyb[S] 4 points5 points  (0 children)

I'd agree those living through a fallout wouldn't have much use for it, I was mostly thinking when things stabilize and we rebuild a new civilization. Stone does seem like the best but also most difficult media.

I think that was the whole idea behind the georgia guidestones.

[–]Steuben_tw 4 points5 points  (0 children)

I'm not going to say the mantra... but the mantra. <insert pic of ancient aliens guy with the hair>

The media itself while of consideration, is a minor factor. Assuming the physical media has suitable internal redundancy, localized failure can be functionally ignored. Mechanisms and proof of such is left as an exercise for the reader.

Raw physical accessibility follows from the mantra. The mechanisms for such application is left as an exercise for the reader.

This leaves what is the most important question. How to encode it such that it is
- allow for bootstrap translation, from the starting assumption of the reader knows there is knowledge written there. But has no other context about it. Example, Rosetta stone. While not created as such it contained enough information to allow the translation of the remaining text on the stone, and boot strap the translation of other documents in that language.
- encoded with information, or series of formats, that allows for recreation of decoding techniques/devices of higher complexity information. Example, text information on how to reconstruct a record player to retrieve stored audio information.
- marked such that it can be easily indicated that there is knowledge here. Example, the message in "Contact", by Carl Sagan. Think of it as the inverse problem that Sandia National Laboratories faced.

[–]lunatisenpai 3 points4 points  (3 children)

m disc is another way.

Very long term digital storage for archives. Sadly the main company with the patent is selling normal blu rays with the same name, that degrade in like, five years, hoping the tech becomes more widespread now that the patent expired.

[–]the_lost_carrot 2 points3 points  (2 children)

One of the key problems with digital records, is over time we lose the ability to read the records because we no longer have the technology to access the archive. So not only do you have to archive the discs themselves, but also keep working readers archived as well. Which is significantly harder.

Similar situation as losing languages over time. Sure we have written records but we have no idea what it means.

[–]AshleyUncia 4 points5 points  (0 children)

One of the key problems with digital records, is over time we lose the ability to read the records because we no longer have the technology to access the archive. So not only do you have to archive the discs themselves, but also keep working readers archived as well. Which is significantly harder.

Similar situation as losing languages over time. Sure we have written records but we have no idea what it means.

People always bring this up but I disagree.

Firstly, optical discs are literally the most mass produced physical media in our history. These are not obscure or esoteric. We've literally produced billions of them between CD, DVD and BD, including music, movies, software, video games and plain bulk storage. As a result there will be long term archival demand for a device that can just read these. I'll remind that I can buy a USB 3.5" floppy drive off Amazon and it'll be at my door tomorrow.

There are other more obscure or esoteric physical formats that are far harder to preserve just due to their nation, but we've made so many 12cm discs over so many years.

Then there's the data formats. Obscure and closed formats are a problem but so much media and information is actually stored in formats that are not only ubiquitous but their decoding is also well documented. I've seen people code their own JPEG decoders as college projects based just on the documentation. Not to mention so much source code that already developed open source decoders.

We've gotten ahead of this problem mostly by accident, by pure virtue of 'Everyone uses these formats, these formats refuse to die, and copies of the decoder software is on a million gits.

JPEG is almost 32 years old and it refuses to show any sign of dying despite so many technically superior replacements developed. It's 'good enough' and anyone can open a JPEG even one from 1992, with any list of modern tools including the basic image viewer in modern Windows. JPEG will probably outlive us all.

[–]michaelmalak 2 points3 points  (0 children)

I am doubtful that USB-A and exFAT are going anywhere anytime in the next quarter or maybe half a century. For longer term, refreshing to modern media will prevent have to perform archeology in the future. But the period in which that is necessary is flattening out exponentially:

  • 1971 8" floppy

  • 1976 5.25" floppy

  • 1981 3.5" floppy

  • 1982 Bernoulli

  • 1990 CD-R (and DVD/Blu-Ray drives will read them today)

  • 1994 Zip disc

  • 1995 Jaz disc

  • 1999 USB-A (and can still be read today)

That's it. For the past 25 years, there has been no new media formats sufficiently different from what has come in the past. And two of the older media formats, CD-R and USB-A can still be easily read today.

I think USB-A will persist.

[–]ushred 0 points1 point  (0 children)

Whenever I hit the lotto, I plan on printing all my pdfs to microfilm and burying with me in my mausoleum. My magnum opus.

[–]FFM 0 points1 point  (0 children)

This popped up on my RSS feeds yesterday

"World's Largest Online Corpus of Translated Cuneiform Texts" https://aicuneiform.com/

[–]DoaJC_Blogger 0 points1 point  (0 children)

Group 47's DOTS optical tapes are supposed to be able to last hundreds to thousands of years without climate control.

[–]Catsrules24TB 0 points1 point  (0 children)

How about a clay tablet QR code that will link them to Wikipedia? :)

Realistically I am less about making something that last 1,000 years and more about making copies of it. End of the day nothing is permanent, but if you can replicate it easily you can get very close to being permanent.

The printing press was a game changer. We are no longer dealing with single copies of things or spending hundreds of man hours making hand written copies of information. We have now scaled up to thousands if not tens of thousands of copies via the printing press

Now that we have hit the digital age making copies is super easy and will be a perfect copy to the original and you can switch seamlessly between media. Your 10TB library of books, you can backup for $100 and 5 minutes of your time. That is something that was unheard of no too long ago. In 10 years when we have whatever the new storage is you can copy your books again to the new media and so on.

Now sure digital data does require a lot of overhead to read. And I could see world destruction scenario where we don't have any more technology to read the digital data. That 10TB drive is useless if you don't have access to a computer that can read it. But we have so much technology laying around, I think survivors could figure out how to reverse engineer the technology fairly easily.

[–]PiedDansLePlat 0 points1 point  (0 children)

Things that makes me sad : burning down of alexandria library many times, smashing of artefacts by talibans in museums, destruction of the afghan massive buddhas, ongoing destruction of Armenians heritage monuments while no ones care at all, millenium old buildings getting taken down…