Reproducibility is a huge issue in academia and in the software engineering world.
As an anecdote, we were trying to reproduce results for a c++ algorithm for which we had the source code, on the same machine, same compiler, only 2 years after its original creation. Impossible. Our best guess is that some os/hw patch / firmware update had an impact on the random number generation, but we never managed to figure out what exactly caused the discrepancies that we were observing.
It's been some time, but I am 99% sure that we were linking with the correct version of libc, because we never used the system GCC (in CentOS they provide the very old 4.8 version), so we explicitly specified the compiler and the libc that we wanted to use.
That might not even matter, because if you think you're using one version of gcc, but you're using another. I experienced this multiple times over the summer with scl and gcc.
The way some video game studios do this is simply put a whole computer into the archive with all the software on it, so all the hardware and software are captured in time.
Video games built on consoles have this benefit in that they are locked to a hardware iteration, granted there may be some server communication now but historically arcades and consoles capture the hardware snapshot as well.
I prefer PC gaming as consoles are essentially locked in time in hardware but that does lend better to archival purposes.
My professor requires the software, data and makefiles to reproduce any figure in a published paper. Then the figure would be erased with software reproducing it.
The motivation was kind of selfish. The professor would update his textbooks every 5 or 10 years and noted how hard it was to recover old figures.
> For now, though, Olive is available only to a limited group of users. Because of software-licensing restrictions, Olive’s collection of vintage software is currently accessible only to people who have been collaborating on the project. The relevant companies will need to give permissions to present Olive’s re-creations to broader audiences.
What do you do when the original company no longer exists?
Depends on what the EULA for the product said and what happened to the company.
Companies of any value tend not to just disappear; they get bought by other companies who thus inherit their IP rights.
Sometimes after a while it can be hard to determine who owns a piece of IP. This can happen with old video games, for example, since the studios and publishers have split and merged so much over the years. At times it's a matter of interpretation who owns a property, and it can end up in court.
TLDR there's almost always someone ready to take your money; not always easy determining who it should be.
> Depends on what the EULA for the product said and what happened to the company.
The EULA to dBASE III stated that the grant of license lasted for fifty years. If, after fifty years, you were still using dBASE III, you would no longer be using it legally and had to return your copy to Ashton-Tate.
All you dBASE III users out there -- you've got maybe 15-20 years left!
I find this especially relevant. Recently I found an old textbook that was amazing. Lots of great detail on nearly impossible to find subjects.
I emailed the professor (now near retirement) for the answers to the solutions as I'm no longer a student and the book has been out of print since before I was born. He told me he didn't have it anymore as it was on an old computer on an operating system that doesn't exist anymore.
All the code, example answers lost to time.
It made me wonder just how common this phenomena is.
Agreed. If there are 100 problems in a book and I work all 100, how am I to know if I did it right? If I get one wrong (which I assuredly will), how am I to see what I did wrong?
Some teachers are awful too and the only way to learn is to get your hands on a solutions manual and reverse engineer your understanding. It can be a very frustrating experience.
Reminds me, if you haven't been to Paul Alan's Living Computer museum I'd highly recommend it. You can play chess against a real working PDP-8 which is pretty impressive.
This is one of a few similar projects. The government Archives offices of most countries have to not just preserve digital records but also the software necessary to read them. Mick Crouch is the legend in New Zealand who does a pile of this work: https://www.radionz.co.nz/news/national/346630/outdated-tech...
We are not alone in our quest to keep old software alive. For example, the Internet Archive is preserving thousands of old programs using an emulation of MS-DOS that runs in the user’s browser...
And also then goes on to refer to other Living Software Preservation initiatives.
36 comments
[ 2748 ms ] story [ 3203 ms ] threadAs an anecdote, we were trying to reproduce results for a c++ algorithm for which we had the source code, on the same machine, same compiler, only 2 years after its original creation. Impossible. Our best guess is that some os/hw patch / firmware update had an impact on the random number generation, but we never managed to figure out what exactly caused the discrepancies that we were observing.
But there are quite a few Amiga emulators now.
I prefer PC gaming as consoles are essentially locked in time in hardware but that does lend better to archival purposes.
The motivation was kind of selfish. The professor would update his textbooks every 5 or 10 years and noted how hard it was to recover old figures.
What do you do when the original company no longer exists?
Companies of any value tend not to just disappear; they get bought by other companies who thus inherit their IP rights.
Sometimes after a while it can be hard to determine who owns a piece of IP. This can happen with old video games, for example, since the studios and publishers have split and merged so much over the years. At times it's a matter of interpretation who owns a property, and it can end up in court.
TLDR there's almost always someone ready to take your money; not always easy determining who it should be.
The EULA to dBASE III stated that the grant of license lasted for fifty years. If, after fifty years, you were still using dBASE III, you would no longer be using it legally and had to return your copy to Ashton-Tate.
All you dBASE III users out there -- you've got maybe 15-20 years left!
I emailed the professor (now near retirement) for the answers to the solutions as I'm no longer a student and the book has been out of print since before I was born. He told me he didn't have it anymore as it was on an old computer on an operating system that doesn't exist anymore.
All the code, example answers lost to time.
It made me wonder just how common this phenomena is.
If the goal is education, the solutions should be published too.
Some teachers are awful too and the only way to learn is to get your hands on a solutions manual and reverse engineer your understanding. It can be a very frustrating experience.
https://www.youtube.com/watch?v=ZHU4nzIsaIM&t=5m38s
The Paul Allen who is the co-found of Microsoft and one of the richest people in the world.
This is one of a few similar projects. The government Archives offices of most countries have to not just preserve digital records but also the software necessary to read them. Mick Crouch is the legend in New Zealand who does a pile of this work: https://www.radionz.co.nz/news/national/346630/outdated-tech...
We are not alone in our quest to keep old software alive. For example, the Internet Archive is preserving thousands of old programs using an emulation of MS-DOS that runs in the user’s browser...
And also then goes on to refer to other Living Software Preservation initiatives.
https://www.softwareheritage.org/