> We estimate that the scrolls we have in Naples contain more than 16 megabytes of text. Some members of our papyrology team say that revealing this text will be the greatest revolution in the classics since the Renaissance
Amazing achievement, let's hope the Italian government allows for additional excavation of the villa.
they likely would, Pompeii and Herculaneum are _still_ being excavated after two centuries, it's not like things are still.
But we have only read 5% of this scroll and there are a ton more already excavated, it will probably take years before we manage to process what we already have.
There’s more to processing than scanning, it has has to be reviewed, transcribed and translated by linguistics experts, and then analyzed and studied by academics and researchers who can put in context and integrate it with what we currently know about history, cultural, philosophy, etc of the time.
The biggest bottleneck is getting the experts to read it. You need a decade or so of graduate level education and interpreting things takes apparently quite a long time.
I doubt it. Most universities have some professor in this area and a few graduate students. There is very little else for them to read (the entire of all classic books we have fits on a shelf), and most of them can read the original language. They will read this as soon as it is available just because it they don't have much else to read that is a primary source material. Thus everything new is of great interest because there is so little to work with.
The Oxyrhynchus Papyri was discovered in the 1800s, has been fully digitized and experts expect it to take I think 150 additional years before they can all be read to the level of scholarship that's required
Thanks for the link. However the problems there do not seem to apply here. There the problem seems to be lots of little fragments that need to be fit together to figure out the scroll. Here the scrolls are complete in one piece, so we have a much better idea of how the parts fit together (not perfect since this is layers that have to be combined, but close). There just getting the text is hard, here we mostly have the text (though we will need to error correct, they are at least readable)
The big problem is that the Villa of the Papyri is underneath modern buildings. That doesn't mean that excavation without demolition is impossible (see the Scavi underneath the Basilica of Saint Peter), but it makes things far more difficult.
If the prospect is very high to multiply by several times the total remaining classical works, I doubt that the money will be particularly hard to find ?
David W. Packard (HP heir) has been trying to throw money at doing this for years, so the money isn't as much of an issue as you'd think. The larger issue is that the locals don't want digging underneath their buildings, no matter how careful the excavators are. Also, all the money that would be necessary to excavate has made the project a target for the mafia who wants to get their share.
> the money isn't as much of an issue as you'd think. The larger issue is that the locals don't want digging underneath their buildings, no matter how careful the excavators are
This sounds like the money IS a huge issue. How expensive can it be to buy out the locals? We're talking about priceless cultural artifacts
This is the coolest thing I've read this year. It reads like science fiction. Who would even imagine it's possible to read text from a 2000 year-old rolled up burnt-crisp paper?
It’s a 270 year archaeological and technological culmination. The scrolls were dug up in 1752. It took the collective developments of the Industrial Revolution, the sciences all our engineering and manufacturing prowess to discover, preserve and scan the scrolls. Then the final cherry on top of the current AI revolution that can create inferences and connections that are beyond the human mind to even understand. And out pops 2000 year-old wisdom of the ancients.
It is a bit fitting that it turns out the scroll is about the relationship between enjoyment and abundance.
It looks like, from what we can gather, the author decides that should something be hard to get, that doesn’t lead to greater enjoyment. But, it seems that the archaeologists have found an awful lot of joy in how “rare” access to these scrolls is!
One other thing that was required: the patience not to ruin it.
So much has been lost to well-meaning archaeologists who dug up and threw away things that they didn't think were important. They tried cleaning and preservation techniques on artifacts without testing, sometimes ruining them in the process. They ripped things out of context, and "restored" them based on guesses that were sometimes flagrantly wrong.
Of course they couldn't be expected to know everything that would come in the future, so blame can sometimes perhaps be muted. But it's especially positive that they extricated these particular objects very carefully and just waited for a way to extract information that they could hardly have hoped for.
Speaking of "reading like sci-fi", what's that book where they scan an entire library of books, descructively, by feeding them into a "book chipper" like device that chops the books up into little pieces, vacuums those pieces up and scans the pieces as they flow through, reconstructing the original text by putting the scanned results together like so many jigsaw puzzles? It was a subplot of the book, but I can't for the life of me remember what book it was.
FYI it seems ChatGPT could have answered this for you.
> The book you're describing sounds like "Rainbows End" by Vernor Vinge. In this near-future sci-fi novel, set in 2025, one of the subplots involves a project called the "Library Project," where the UCSD (University of California, San Diego) library decides to digitize its entire collection. The process is somewhat as you described: books are destructively scanned by being shredded into tiny pieces, which are then scanned and digitized, with the text being reconstructed from the scans. This process is a part of the broader themes of the book, which include the effects of technology on society and the concept of "wearable computing" and augmented reality. Vernor Vinge, a retired San Diego State University professor of mathematics, computer scientist, and Hugo Award-winning author, is well-known for his works in the science fiction genre, especially for exploring the concept of the technological singularity.
I'm not surprised ChatGPT can answer it - I'm not sure why, but _Rainbows End_ is one of the most commonly-asked about SF books like that. Everyone remembers the book-tornado doing shotgun sequencing, but they can never remember its name or anything else that happens. I guess that's the problem with having a technology whose mental image is so compelling but also mostly disconnected to the rest of the book. (I know I can't tell you much about the rest without rereading the WP entry.)
Rainbow's End, and Vernor Vinge in general, probably also fall in that category of referenced often, yet not actually read. Somebody actually reads the book, finds the one cool quote or example everybody likes, that idea gets repeated a huge amount, and most people don't actually read Rainbows End. Yet you hear about it so much tangentially, you feel like you have (or must have).
I'm definitely in that camp, I read it ~10 years ago, and honestly can't remember anything about it but the book scanning.
Similarly, a friend recently read Ghost Fleet and I decided to pick it up and read it. The first chapter seemed familiar, and every once in a while there were "scenes" that I absolutely remembered having read years prior, but I had no memory of the overall plot.
It wasn't able to for me, I put it into ChatGPT 4 before I posted this and it was pretty sure I was talking about Diamond Age, and then went on to floss me about how "literally shredding and scanning books isn't a part of the book, but it fits the vibe" (my summary of it's answer).
Aside: I remembered search history so I went over to make sure it was in Chat GPT and not Perplexity, but I've looked at both of those and can't seem to find a record of asking either one about shredding and scanning books. I could have sworn it was GPT 4. Now I wish I could find out. I did just ask Bard and it provided a list that included The Diamond Age, but did not include Rainbows End, though I'm quite sure that isn't where I looked before.
Vacuuming up an entire library of books, chopping them into little pieces, reconstructing the original text by putting together the little pieces like so many jigsaw puzzles?
That's not a sci-fi novel, that's OpenAI's business model!
I’m now wavering a bit on my earlier dismissal of people freezing their bodies for an indeterminate future revival. I could probably get into a science fiction story with this premise:
Instead of relying upon machinery, some zillionaire has their body dry frozen and stashed in a lunar south pole crater, with a foundation funding interstellar propulsion research to move the body to the coldest stable points discovered along the way towards the Boomerang Nebula (1° Kelvin) and research to revive back from burnt-crisp state.
The foundation incites all sorts of advancements along the way like working out practical fusion and ever more exotic energy generation, AGI, gravity manipulation, Drexlerian nanotech, Dyson swarm, star wisps, self-modifying bodies and so on, in its quixotic quest to fulfill its mandate.
I kinda wanna write an horror story about people freezing their bodies or heads only to be revived in the future bat shit insane from the excruciating experience of existing for several decades in a sort of limbo...
Yeah big influence... I may need to change my idea further before writing anything otherwise it's too close to plagiarism. Black Mirror got away with it tho with the Cookie episode...
I remember first reading about Herculaneum Papyri more than a decade ago, and pondered about them being read one day. After all, research into virtually unwrapping these scrolls had been ongoing since 2007 (https://en.wikipedia.org/wiki/Herculaneum_papyri#Virtual_unr...), but I certainly did not expect it to happen so soon. Exponential technology acceleration once again proves itself true.
When I first came across this project on HN (early last year), I was taken aback by how impossible the project looked and how smart were people working on this. Despite seeing a few intelligent names behind the project, I subconsciously believed that this would at least take 5-10 years before a breakthrough.
Today I sit with the same amazement, taken aback again, appreciating how ridiculously awesome this is. Congratulations to the winners and everyone involved!
So many things that look insane are becoming a reality. You look at those scrolls burnt to a crisp and the idea of reading them is nonsense.
The fact I have a computer writing flowery alt text descriptions of my photos with unnerving accuracy is something I would not have predicted for another 20 years. But, here we are...
That would be like explaining a baking recipe by starting with protons and electrons.
State-of-the-art machine learning architectures aren't actually that complex. Diffusion models and transformers can be explained to a bright high schooler. I'm sure Archimedes and Euclid would have no problem understanding them.
What they might have a problem understanding (or even imagining) is the mind-boggling amount of computation required to make those systems do anything useful. Getting Llama to produce a single token of text takes more calculations than all of humanity did by hand during all of Classical Antiquity.
I think the quartz sand metaphor was to illustrate how advanced our silicon-based technology has become, not just the ML parts.
Imagine all the stuff... transistors, Turing/Von Neumann machines, lithography, theoretical computer science, OS and compilers, the Internet... and lastly there's modern day machine learning that builds on top of all the above.
The base level stuff isn't exactly protons and electrons, but given the nanometer scale of our chips, it's not that far away from the truth, and we (humanity) has somehow built amazing stuff on top of that.
The basic of concept how such a thing is powered (electricity) is so far removed from anything people did in ancient times that it would be hard to get them to understand that neither gods nor magic are invovled.
Smart "intellectual" people would certainly be willing to challenge basically everything they assume about nature, but I don't think your run of the mill farmer would be able to do that.
Electricity isn't much different from water. The concept of a water mill has been around a long time. So understanding the functional ideas wouldn't be all that difficult. As far as Gods I think you will have a tough case minimizing their involvement even today.
It's simple, really; we flatten the rock, write on it with fire and acid, put lightning inside it, teach it many things, and make it speak to us from afar. See? No magic at all.
> That would be like explaining a baking recipe by starting with protons and electrons
It would be like explaining a baking recipe just talking about wheat and flour and heat. The point is that from first principles, ML is a huge jump. From first principles, baking is not.
Kudos for caring about alt tags. Blind user here. While we are at it. I was also thinking how I could make good use of the new vision models. And after a while...
The fact I have a computer generate spoken narration for my MPD playlist with descriptions of album art included just blows my mind. 2023 was indeed a fucking milestone.
That's awesome. GPT vision is unreal, to me. It's neat that you can finally get the computer to describe the album covers, something that no-one would have thought to bother with previously as it seems so trivial. A lot of album covers are surreal, so you're really going to put GPT to work there!
My grandma was blind, and I just spent 6 months looking after a guy who was blind (but has now had surgery and beat me in the eye test at the doctor's!), so I think about blindness a lot when I design.
It's all about incentives. $1 million is a lot of money. The vast majority of hard problems don't have much brainpower dedicated to them, because the bang/buck ratio doesn't work out. Machine learning, math, and adjacent fields already have many careers that pay very well, so getting top-notch experts to dedicate their attention to what might be a futile endeavor is difficult.
And this isn't only about the monetary value itself, but also the fact that a large cash prize attached to a challenge boosts the prestige of finding a solution. Nobel Prizes come with about a million bucks on top of them, after all.
I'm quite confident that if someone offered $100 million for deciphering the Voynich manuscript or Linear A, we'd have a solution within 3 years.
Not to be argumentative, but $1M isn’t very much money, certainly not for a project of this scope. It’s a testament to the creativity, competence, and dedication of those involved they’ve gotten this far with such little funding. Hopefully their early success will attract more resources to this very worthy project.
Most of the developers are. They might not have the right background and so it might take an extra year or two to get up to speed with the difficult areas of this project. However most developers I know have the "smarts" to switch to a different complex area and figure it out. Sure most of them are just doing standard CRUD apps that move a bit of data - but that is because that is what we need a lot of not because they can't do something else.
Problem is determining which candidates who were preselected for cramming Leetcode for comp are actually any good. Can't see how going for handsomely paid tech folks is any better than enthusiasts from academia.
What do you mean by "of this scope"? The winning solution was produced by students and interns who coordinated over the Internet, in less than a year. The problem isn't scope, the problem is attracting lots of bright individuals to work on such a task (for free). And offering a substantial monetary incentive to the winner is probably the best way to do that.
And yes, $1 million is very substantial for an individual. And the cool thing about offering it as a prize (from the point of view of the organizers, that is) is they only have to pay one person or team, although potentially thousands ultimately contribute to the solution, directly or indirectly.
That's not at all what they did. They explicitly made endpoints to doll out the prizes, to ensentivize collaboration. That tactical aspect of the the whole project and how they set it up is worth highlighting on its own.
I think most of all this is a testament to just how much raw talent and intellectual potential is locked up in the winner-takes-all dynamics and shortsightedness of the stock market. Imagine the exploits and results in a world where everyone had the baseline resources and opportunities for extra funding for pursuing niche interests.
“Any sufficiently advanced technology is indistinguishable from magic.”
Absolutely insane the level of wizardry being applied here to turn a lump of blackened, charred scrolls into readable text.
Having only cursory knowledge with machine learning are some of the techniques used in the article only recently discovered or have they been around for a while?
Is it due to us having reached an inflection point with these types of algorithms that they have become more popular and thus we are seeing new ways to apply them to old problems?
There has definitely been a virtuous cycle between GP-GPU processing capability, algorithms, libraries and software that use that hardware, and researchers working with those tools.
Well, that could go lots of ways. Maybe some rich trillionaire buys you and spawns you into an endless horror simulation. They might be into torture and get off on it.
("No real humans harmed.")
But if the future can reverse the light cone, nobody is immune to that fate.
Who knows what the future holds. These are just sci-fi flights of fancy.
I remember learning about ancestor simulations by the vile offspring in accelerando, but reversing the light cone is quite chilling - is there any sci-fi novel that deals with that you would recommend?
The part that I do not understand there is: why would anyone/everyone else want you to be alive again? And do not understand me wrong, I would very much be interested to talk to people from various ages. Specific ones, but also commoners. But why should someone want to restore thousands of random people from (e.g) 1284 on their own cost? That only works if those people have big stashes of money that are legally still theirs. And while I understand that some may want to keep ownership after death, I think it is super dangerous to have something like that. Just image, 10% of the world today still belonging to Dschinghis Khan. That cannot be good.
But that'll depend on things going smoothly and non-evil, non-dictators winning in the end. It'd be horrific if evil and malicious entities won and decided they just wanted to fuck with everyone.
Because death is the enemy, and the Jean Le Flambeur series by Hannu Rajiemi touches on this in pretty good ways. Won't spoil the plot, though.
It does put into perspective though, how distracted and selfish our species can be; oh, let's fight each other because of skin colour, sexuality, ethnicity, religion, fighting wars over resources, etc. Meanwhile people are getting cancer, have disabilities like blindness and paraplegia and generally just...dying, especially when it comes early, after a hard life. It's just so sad and disappointing that we have the resources to give everyone a pretty decent life while we work on solving these bigger problems...but we just don't.
One aspect of archaeology that I really find fascinating is the practice of leaving certain artifacts unexplored. The original discoverers of the scrolls tried to unroll a few, apparently found it was impossible without completely destroying the scroll, and then just left the rest undisturbed. Rather than pushing forward and destroying everything, they left these as a mystery for a future age. Two centuries (!!) later we can finally begin to understand these, with the aid of technology that would be utterly unthinkable to those people who very thoughtfully restrained themselves.
The feeling you get when you’ve gone into one of those aircraft hanger-size buildings and then you see some of the information they’ve gotten with ground tests ( radar, mercury, etc ) is wild. The site is huge.
One of the suppositions is that the main chamber contained a model of his entire kingdom, replete with rivers of mercury.
So yes. Archaeology is a bit destructive, and sometimes the destruction can go both ways. Proceed with caution.
> Rather than pushing forward and destroying everything
In the early days they wouldn't have accomplished anything by pushing forward, so it doesn't take all that much restraint.
I'm more impressed by people in, say, the 1990s or early 2000s. They might've had a shot but there was still too much risk, so they restrained themselves until it was a safer bet.
Yeah, I can't give the King's men much credit here. They destroyed a lot of scrolls, and it was only because they weren't getting much of anything that they stopped and abandoned excavations or focused on digging out sculptures they could show off (many now in the Getty Museum - great museum, but I did feel a bit melancholy thinking about the scrolls while I was there in 2019).
In one of the Futurama episodes, Fry eats one of Farnsworth's mini mummies and Farnsworth is upset because he wanted to eat it. Fry said it tasted like jerky I think.
One aspect of that time period is they absolutely idolized the romans. A lot of education at the time consisted of learning latin and at the same time people were well aware that only a fraction of the classical texts had been preserved. I find it very believable that they understood the significance of preserving and potentially unlocking these scrolls.
It looks like there are two main bottlenecks to reading more: the need for manual intervention in segmenting the scanned scrolls, and the cost in scanning new scrolls.
Yes. Now it can be done, but costs too much. Once they get a scanning unit near the scrolls, it will be much cheaper. The data reduction will probably get cheaper, too.
Scanning unit? Seems like the scanning was done using a synchrotron beamline. Maybe there is a suitable beamline at Elettra. I haven't looked closely why the synchrotron is needed. A Sigray instrument might work here, or even something simpler.
The 2019 scans were done at 7.91 micrometer resolution with 88KeV monochromatic x-rays. Synchrotrons like DLS can also use their uniquely coherent x-rays to do diffraction imaging but I see no evidence they've tried that with Vesuvius scrolls. (Because the object is too thick?)
That scan is 5.5 terabytes of .tif files. The 2023 scan apparently is at 3.24 micrometer resolution and four separate scans of 53/70/88/105KeV each, which should produce a vast, data processing-chokingly wad of data. If all x thousand scrolls need to be scanned at that detail then the Vesuvius Challenge people are going to be juggling a lot of hard drives.
As for scanning: $30mm doesn't seem like a ton of money to scan 800 scrolls with untold history and other works, compared to other uses of that amount of money I could name now. Maybe someone will donate that cost and perhaps all the scrolls can be transported at one time or in a few bigger groups to be closer to the particle accelerator. Another million bucks and I bet you could build a climate-controlled container to take them all at once, or something. If I had $30mm I would definitely donate to this cause, it seems like one of the best uses of that kind of money I can think of. That would bypass the need to research and develop a bench top scanner or another solution. You could even crowdfund this!
As for segmentation: get some sort of collective solution going, like the Seti@Home did, but for people who are bored as hell, instead of them scrolling Reddit or Twitter all day. Maybe do it like a CAPTCHA so you get it done for free? I'd segment for a few hours a month if I had the ability to do so.
This is a cool project that has taken a community to build to this point, why not try and open and expand the collective of humans working to understand the scrolls? Get millions of people involved and you don't need to rely on technological crutches and development, though that is not the worst way to go either.
Funding is a huge one as well. Funding is the wheel that drives the project (source, have been hanging around the project people for a little while).
If you know anyone that would help chip in for the Phase 2 of the project (scaling up, please let Nat know! (not directly affiliated with the project management team, just pointing to him as a great contact for that.... <3 :')))) ) )
It seems "weird" none of the mega rich has committed a few million dollars for this, it looks like a very good way to build a legacy while benefiting humanity, and e.g. Bezos would probably find a million dollars behind the couch pillows.
it's almost nauseating to me that every month or so our nation deminstrates it is capable and willing to collectively chip in enough money to turn one random nobody into a near-billionaire, muvh of which gets promptly vaporized on drugs and tacky status symbol purchases for themselves and maybe some immediate family, when the same money would fund a hundred Vesuvius Challenges a year at several times the scale of this project.
Bezos funded the reading of the Archimedes palimpsest, didn't he? I guess this would be up his wheelhouse then. Unless, of course, he is only willing to finance of the decryption of his own property...
Over 2000 years ago a chap called Philodemus sits in the library of a luxurious villa owned by a rich guy who likes collecting art and writing. He writes his thoughts on pleasure, and the relationship between the quantity of something and the pleasure that might derive from it. The scroll goes on the shelves with the others. He writes lots. At some point later the villa is covered by lava from mt vesuvius.
2000 years later we scan the carbonised scrolls with (basically) magic rays and use thinking machines to reconstruct what Philodemus wrote.
I wish we could tell him. Sounds like he was a thinker, he would really appreciate it.
I have too wild imagination sometimes. I picture him with a shocked look on his face, similar to what one of the modern 'thinkers' would have if they forgot to clear their browser history and somehow someone restored it in the future.
That recovery is much easier though, it is using the device as intended.
And of course, rm just unlinks, doesn’t actually delete, so even going a step further and recovering deleted content is hardly magic.
This is more like if, sometime in the future, they somehow successfully reconstructed a snapshot of our computers’ volatile memory by examining the power supply, or something ridiculous like that.
We’ll lose a lot of digital data simply because we won’t have the means to read it. CD-readers aren’t manufactured anymore in volume. It’s easy to imagine society in 40 years not having any CD readers handy but having a bunch of CDs they want to read. Now multiply that by all the funny storage formats we’ve created over the years.
No need for a CD reader if you have a CT scanner and software that converts those ridges into bits. The bigger question is how well preserved those CDs will be.
I’m almost certain it is impossible to actually do what I said. But then again, I bet anybody 2000 years ago would say the same of reading scrolls that have been consumed by a volcano!
Your comment prompted me to go in search of something I'd seen several years ago: something about an advertisement in Pompeii for prostitutes, or something like that. Anyway, I couldn't find exactly what I went in search of, but I did stumble upon this oddly specific, yet interesting, Wikipedia entry:
... and what would he think of us, 2000 years later thought has led us to amazing advances in technology that would be inconceivable to him. But the sort of things the people of his day thought about, virtue, happiness, how to live the right way, not a lot of progress has been made. He might be surprised by that. In his time at the dawn of written thought-for-thoughts sake, they might have reasonably expected that soon people might think their way to a golden age of happiness and contentment. But 2000 years later we have learnt that you dont seem to be able to think your way to happiness.
I think we have learned not that you can’t think your way to happiness, but that for the sake of the consumer economy and worker productivity it’s best that you don’t.
Epicureans were atomists (https://en.wikipedia.org/wiki/Epicureanism#Physics), so if you explained it to him, he might not be nearly as shocked as most people of the era would be. Epicureans also tended to invoke extremely insubstantial 'images' composed of especially tiny gossamer arrangements of atoms as explanations for things like dreams, and you can see how well that would work as an analogy with using X-rays to look at subtle changes in the arrangement of atoms in charred scrolls. (These are covered in https://en.wikipedia.org/wiki/De_rerum_natura - if you have some time, I highly recommend reading Stalling's rhyming translation. You'll be shocked and admire the rationality & scientificness of Epicurean materialist atomist explanations of the world, even where they get it totally wrong.)
It's a testimony to the power of mind equivalent to Einstein's 'Gedankenexperimenten'. The only reason they got some of it totally wrong is because they lacked the scientific apparatus to test their hypothesis, but they were on the right track.
Eh. The Epicurean arguments are heavily empirical; Lucretius throws in a lot of examples or familiar observations. I'm not sure how many I would describe as purely 'thought experiments'.
In the case of atoms I think it's pretty clear that they lacked direct proof, they only had indirect ways of experimentation and I think to be able to reason about the 'indivisible' at a time when nothing that you could physically look at (this was well before microscopes) was indivisible is more of a mental than an empirical thing.
Apparntly the bad news is that the remaining scrolls most likely contain yet more Epicurean philosophy, maybe largely from not-top-rated guys like Philodemus. (Apparently it's possible that the library actually is, or incorporates, Philodemus' personal library.) https://twitter.com/DrFrancisYoung/status/175453630645602754...
That’s quite premature, but even if we are looking at a personal library containing only personal writings, you’d be looking at a massive increase of information on the ancient world, like a neural map of a single ancient mind that contained all their experiences and thoughts.
The worse case would be that it was 800 copies of the same scroll waiting to be sold off to other libraries.
It traces the story of a Renaissance humanist who tracked down and translated the Epicurean philosopher/poet Lucretius' De Rerem Natura, which Greenblatt describes as portraying a strikingly modern way of seeing the world.
In particular Lucretius and the Epicureans denied the existence of supernatural causes, were opposed to religious fear, and posited the ideas of atomism and biological evolution. Of course they're better known for their approach to living life, which Greenblatt shows is more sophisticated than sometimes caricatured, and which he portrays as a breath of fresh air compared to the oppressive moralism and hypocrisy of the Church at the time. (Jefferson and many of the American Founders described themselves as Epicureans.)
He goes on to imply that Epicureanism was influential and widespread in the ancient world but suppressed by the early Church, so that we now know little of it.
Anyone, one of the tantalizing parts of the book is where he describes the carbonized and unreadable Herculaneum scrolls, since they were the private library of a wealthy patron of the Epicureans. I think he thinks being able to read the scrolls will really change our understanding of the ancient world.
And remember: if they hadn't been carbonized, they would have crumbled to dust. That's why we only have the texts that managed to get copied. (Anthony Doerr's Cloud Cuckoo Land is a novel about the survival and 21st century rediscovery of an imaginary Greek play, and ... I'll let you read it yourself - https://www.anthonydoerr.com/books/cloud-cuckoo-land)
(Apologies for any errors above, as basically all I know about this subject is what I read in the book!)
You might also be interested in the Charvaka school of ancient India [1], which is a close counterpart to Epicureanism. The Charvaka school was likewise influential and widespread, and it likewise become obscure over time, for reasons I don't know.
It's interesting reading for a layperson, but as with any other pop-history book, one should read this with a heaping plate of salt at hand. (I'm... not sure what that metaphor actually means or if this is an appropriate way to extend it.)
Things are always more nuanced than can be laid out in a sweeping narrative format and the compression required can lose some critical information, even with the best of intentions. There's also just getting things wrong, which most non-historians do and many historians will do on topics that aren't their expertise.
I'd read this criticism from AskHistorians (not infallible, I know)
The "grain of salt" reference relates to some antidote, which contained a grain of salt. The reduction to "handle with care" is modern.
So the extended metaphor makes no literal sense according to the Pliny text, but it makes sense according to our interpretation of it, which is what matters.
I realize citing Wikipedia risks some serious error, but my impression is that by late antiquity (after AD 200), the main philosophical systems in the Roman world were Christianity and Neoplatonism (itself heavily influenced by Christianity) and to a lesser extent Stoicism. Stoicism, Epicureanism, and Middle Platonism were more characteristic of Classical Antiquity (200 BC-200 AD). The Wikipedia page on Epicureanism[0] supports this impression: "By the late third century CE, however, there was little trace of its existence.[7] With growing dominance of Neoplatonism and Peripateticism, and later, Christianity, Epicureanism declined."
Probably true, but there are more rooms in the Villa yet to be excavated. What we have is essentially a bookshelf in a larger library. If it is sorted by alphabet, it might be representative, but what if it is sorted by topic?
I was ridiculously excited when I first read about this in October (if I remember correctly) last year, when a few of the first results were beginning to pop out. I found the methodology fascinating. First of all the digital unwrapping of the scrolls, then the recognition that crackling in the paper was the sign of ink, and finally putting together a model to detect it, piece by piece. I need to look into the final repository to understand what exactly they did, but they seem to have used a TimeSFormer. I'm confused by this choice as I thought it was for video. How did they apply this to images? In the end though, what a wonderful day for archeology. These young minds deserve a huge round of applause for what they have achieved.
my understanding is that the scan they did on the scrolls returned the layers themselves. Like so:
```
xxxxxxxxxx <- The surface of the scroll
xxxxxxxxxx
...
xxxxxxxxxx <- The bottom of the scroll
```
So, by tiling the image on the surface you get data that is size_x * size_y * n_layers. So, it can be seen as a video stream with size_x * size_y * 1 channel * n_layers where the layers replace the temporal dimension.
It's a cut through the scroll, with the time dimension in this video representing the location of the cut along the scroll lengthwise.
As you can see from the mess it's far from trivial to find the surface of any of the sheets in the scroll, often they layers are blended together messes.
You may be thinking of the scans they used of an unwrapped sheet, those were as you describe and were used to help figure out methods for the real challenge.
I was recently reading the Greek Myths series by Stephen Fry and he makes a point of how there are so many stories we know of but have been lost from ancient texts. Stories and authors that were famous enough to be mentioned by multiple other authors but which themselves have been lost. This collection of scrolls could contain some of those lost stories and the possibility of that is terribly exciting.
I want Aristotle's treatise on Comedy, and if I'm allowed to be terribly greedy, just one more play by Aeschylus.
This is the most exciting thing in the world to me right now, these scrolls, along with the thought that there might be literally thousands more still in the ground.
>stories we know of but have been lost from ancient texts
So many there's a lengthy list on Wikipedia about it. It's fascinating reading ancients casually referencing works that we otherwise know nothing else about. Without the careful, laborious copying (often imperfect) over the centuries most things would've been lost completely. There's also other works such as maps that did not survive, the Tabula Peutingeriana for example is thought to be a derivative work of one commissioned by Augustus of the known world at the time (to Romans) and of which there's a few mentions in some works by historians at the time.
A great example about lost work is that the insights we have onto Viking mythology was pretty much documented by a single guy, Snorri Sturluson. What we know about Norse mythology is just a tiny piece of their mythos, as they didn't have the habit of writing down their tales/legends/stories and most of it got lost after they converted to Christianism.
The general subject of the text is pleasure, which, properly understood, is the highest good in Epicurean philosophy. In these two snippets from two consecutive columns of the scroll, the author is concerned with whether and how the availability of goods, such as food, can affect the pleasure which they provide.
Do things that are available in lesser quantities afford more pleasure than those available in abundance? Our author thinks not: “as too in the case of food, we do not right away believe things that are scarce to be absolutely more pleasant than those which are abundant.” However, is it easier for us naturally to do without things that are plentiful? “Such questions will be considered frequently.”
It is wild to me, though, that if I have an SSD fail it's essentially unrecoverable, but a 2,000-year old, rolled-up, lava-burnt scroll of Papyrus can be read using Technology™! I love to see it!
I'm sure the original authors didn't expect to be incinerated by a volcano (and I'm also sure that the future legibility of their writings would be the very least of their concerns!), but it really bends the mind to imagine their reaction if they could have known how this would all unfold (unroll? Sorry...)
This is amazing, sci-fi-like-reality. I wonder if they pull off an auto-segmentation breakthrough if the techniques might apply in other areas, like automating neuron mapping (eg. see EyeWire).
217 comments
[ 755 ms ] story [ 4537 ms ] threadAmazing achievement, let's hope the Italian government allows for additional excavation of the villa.
But we have only read 5% of this scroll and there are a ton more already excavated, it will probably take years before we manage to process what we already have.
In the direction things are going ... maybe a few months :)
Maybe that's another AI application.
I found some conversation on the difficulty here https://www.reddit.com/r/AcademicBiblical/comments/16dj68i/h...
"ChatGPT, give me the highlights of these ancient Greek scrolls ..."
This sounds like the money IS a huge issue. How expensive can it be to buy out the locals? We're talking about priceless cultural artifacts
I wonder how far Italy will go once - if - they get rid of the mafia, it is like trying to drive a car with the handbrake on.
It looks like, from what we can gather, the author decides that should something be hard to get, that doesn’t lead to greater enjoyment. But, it seems that the archaeologists have found an awful lot of joy in how “rare” access to these scrolls is!
So much has been lost to well-meaning archaeologists who dug up and threw away things that they didn't think were important. They tried cleaning and preservation techniques on artifacts without testing, sometimes ruining them in the process. They ripped things out of context, and "restored" them based on guesses that were sometimes flagrantly wrong.
Of course they couldn't be expected to know everything that would come in the future, so blame can sometimes perhaps be muted. But it's especially positive that they extricated these particular objects very carefully and just waited for a way to extract information that they could hardly have hoped for.
Rainbows End by Vernor Vinge (ChatGPT helped with the search)
> The book you're describing sounds like "Rainbows End" by Vernor Vinge. In this near-future sci-fi novel, set in 2025, one of the subplots involves a project called the "Library Project," where the UCSD (University of California, San Diego) library decides to digitize its entire collection. The process is somewhat as you described: books are destructively scanned by being shredded into tiny pieces, which are then scanned and digitized, with the text being reconstructed from the scans. This process is a part of the broader themes of the book, which include the effects of technology on society and the concept of "wearable computing" and augmented reality. Vernor Vinge, a retired San Diego State University professor of mathematics, computer scientist, and Hugo Award-winning author, is well-known for his works in the science fiction genre, especially for exploring the concept of the technological singularity.
Similarly, a friend recently read Ghost Fleet and I decided to pick it up and read it. The first chapter seemed familiar, and every once in a while there were "scenes" that I absolutely remembered having read years prior, but I had no memory of the overall plot.
Thanks for reminding me about Rainbows End.
That's not a sci-fi novel, that's OpenAI's business model!
Instead of relying upon machinery, some zillionaire has their body dry frozen and stashed in a lunar south pole crater, with a foundation funding interstellar propulsion research to move the body to the coldest stable points discovered along the way towards the Boomerang Nebula (1° Kelvin) and research to revive back from burnt-crisp state.
The foundation incites all sorts of advancements along the way like working out practical fusion and ever more exotic energy generation, AGI, gravity manipulation, Drexlerian nanotech, Dyson swarm, star wisps, self-modifying bodies and so on, in its quixotic quest to fulfill its mandate.
Today I sit with the same amazement, taken aback again, appreciating how ridiculously awesome this is. Congratulations to the winners and everyone involved!
The fact I have a computer writing flowery alt text descriptions of my photos with unnerving accuracy is something I would not have predicted for another 20 years. But, here we are...
State-of-the-art machine learning architectures aren't actually that complex. Diffusion models and transformers can be explained to a bright high schooler. I'm sure Archimedes and Euclid would have no problem understanding them.
What they might have a problem understanding (or even imagining) is the mind-boggling amount of computation required to make those systems do anything useful. Getting Llama to produce a single token of text takes more calculations than all of humanity did by hand during all of Classical Antiquity.
Imagine all the stuff... transistors, Turing/Von Neumann machines, lithography, theoretical computer science, OS and compilers, the Internet... and lastly there's modern day machine learning that builds on top of all the above.
The base level stuff isn't exactly protons and electrons, but given the nanometer scale of our chips, it's not that far away from the truth, and we (humanity) has somehow built amazing stuff on top of that.
Smart "intellectual" people would certainly be willing to challenge basically everything they assume about nature, but I don't think your run of the mill farmer would be able to do that.
It would be like explaining a baking recipe just talking about wheat and flour and heat. The point is that from first principles, ML is a huge jump. From first principles, baking is not.
https://github.com/mlang/tracktales
The fact I have a computer generate spoken narration for my MPD playlist with descriptions of album art included just blows my mind. 2023 was indeed a fucking milestone.
My grandma was blind, and I just spent 6 months looking after a guy who was blind (but has now had surgery and beat me in the eye test at the doctor's!), so I think about blindness a lot when I design.
And this isn't only about the monetary value itself, but also the fact that a large cash prize attached to a challenge boosts the prestige of finding a solution. Nobel Prizes come with about a million bucks on top of them, after all.
I'm quite confident that if someone offered $100 million for deciphering the Voynich manuscript or Linear A, we'd have a solution within 3 years.
Make it $8m or $12m and FAANG employees can actually start to justify working on it seriously from a money perspective
And yes, $1 million is very substantial for an individual. And the cool thing about offering it as a prize (from the point of view of the organizers, that is) is they only have to pay one person or team, although potentially thousands ultimately contribute to the solution, directly or indirectly.
But it's not clear what current tech could help with. Machine learning can't be applied to something you don't have training data for.
Absolutely insane the level of wizardry being applied here to turn a lump of blackened, charred scrolls into readable text.
Having only cursory knowledge with machine learning are some of the techniques used in the article only recently discovered or have they been around for a while?
Is it due to us having reached an inflection point with these types of algorithms that they have become more popular and thus we are seeing new ways to apply them to old problems?
Imagine what we'll be able to do to brains, dead or alive, in 100 years.
And in 10,000, maybe we'll be reconstructing the light cone. Maybe that's what we are right now. (Not serious, but it's a fun thought experiment.)
("No real humans harmed.")
But if the future can reverse the light cone, nobody is immune to that fate.
Who knows what the future holds. These are just sci-fi flights of fancy.
(I agree with you).
Basically reverse time.
Not to make a low effort comment, but this.
But that'll depend on things going smoothly and non-evil, non-dictators winning in the end. It'd be horrific if evil and malicious entities won and decided they just wanted to fuck with everyone.
You raise your parents from the dead, they raise their parents, and so on and so forth.
Doesn't apply to raising random people from a thousand years ago, but it's a reason people today might be resurrected in a couple of centuries.
It does put into perspective though, how distracted and selfish our species can be; oh, let's fight each other because of skin colour, sexuality, ethnicity, religion, fighting wars over resources, etc. Meanwhile people are getting cancer, have disabilities like blindness and paraplegia and generally just...dying, especially when it comes early, after a hard life. It's just so sad and disappointing that we have the resources to give everyone a pretty decent life while we work on solving these bigger problems...but we just don't.
https://www.smithsonianmag.com/smart-news/archaeologists-reb...
He of the terracotta army. Not excavated yet for fear of damage, but I would so love to know...
One of the suppositions is that the main chamber contained a model of his entire kingdom, replete with rivers of mercury.
So yes. Archaeology is a bit destructive, and sometimes the destruction can go both ways. Proceed with caution.
In the early days they wouldn't have accomplished anything by pushing forward, so it doesn't take all that much restraint.
I'm more impressed by people in, say, the 1990s or early 2000s. They might've had a shot but there was still too much risk, so they restrained themselves until it was a safer bet.
It is a bit of miracle that they were preserved, and not just discarded.
https://en.m.wikipedia.org/wiki/Mummy_brown
https://www.nationalgeographic.com/history/article/mummy-eat...
It looks like there are two main bottlenecks to reading more: the need for manual intervention in segmenting the scanned scrolls, and the cost in scanning new scrolls.
The 2019 scans were done at 7.91 micrometer resolution with 88KeV monochromatic x-rays. Synchrotrons like DLS can also use their uniquely coherent x-rays to do diffraction imaging but I see no evidence they've tried that with Vesuvius scrolls. (Because the object is too thick?)
That scan is 5.5 terabytes of .tif files. The 2023 scan apparently is at 3.24 micrometer resolution and four separate scans of 53/70/88/105KeV each, which should produce a vast, data processing-chokingly wad of data. If all x thousand scrolls need to be scanned at that detail then the Vesuvius Challenge people are going to be juggling a lot of hard drives.
As for segmentation: get some sort of collective solution going, like the Seti@Home did, but for people who are bored as hell, instead of them scrolling Reddit or Twitter all day. Maybe do it like a CAPTCHA so you get it done for free? I'd segment for a few hours a month if I had the ability to do so.
This is a cool project that has taken a community to build to this point, why not try and open and expand the collective of humans working to understand the scrolls? Get millions of people involved and you don't need to rely on technological crutches and development, though that is not the worst way to go either.
If you know anyone that would help chip in for the Phase 2 of the project (scaling up, please let Nat know! (not directly affiliated with the project management team, just pointing to him as a great contact for that.... <3 :')))) ) )
2000 years later we scan the carbonised scrolls with (basically) magic rays and use thinking machines to reconstruct what Philodemus wrote.
I wish we could tell him. Sounds like he was a thinker, he would really appreciate it.
"You recovered... uh... everything?"
And of course, rm just unlinks, doesn’t actually delete, so even going a step further and recovering deleted content is hardly magic.
This is more like if, sometime in the future, they somehow successfully reconstructed a snapshot of our computers’ volatile memory by examining the power supply, or something ridiculous like that.
We’ll lose a lot of digital data simply because we won’t have the means to read it. CD-readers aren’t manufactured anymore in volume. It’s easy to imagine society in 40 years not having any CD readers handy but having a bunch of CDs they want to read. Now multiply that by all the funny storage formats we’ve created over the years.
On HDDs. On SSDs it'll lead to now-unusued space getting TRIMed which actually erases the blocks. Back to scraping the papyrus.
https://en.wikipedia.org/wiki/Erotic_art_in_Pompeii_and_Herc...
Priapus had it goin' on! Reading the Priapeia for the first time is a treat...
Maybe something along these lines?
https://en.wikipedia.org/wiki/Lupanar#Graffiti
The worse case would be that it was 800 copies of the same scroll waiting to be sold off to other libraries.
Everyone interested in this story should read Stephen Greenblatt's The Swerve (https://www.pulitzer.org/winners/stephen-greenblatt).
It traces the story of a Renaissance humanist who tracked down and translated the Epicurean philosopher/poet Lucretius' De Rerem Natura, which Greenblatt describes as portraying a strikingly modern way of seeing the world.
In particular Lucretius and the Epicureans denied the existence of supernatural causes, were opposed to religious fear, and posited the ideas of atomism and biological evolution. Of course they're better known for their approach to living life, which Greenblatt shows is more sophisticated than sometimes caricatured, and which he portrays as a breath of fresh air compared to the oppressive moralism and hypocrisy of the Church at the time. (Jefferson and many of the American Founders described themselves as Epicureans.)
He goes on to imply that Epicureanism was influential and widespread in the ancient world but suppressed by the early Church, so that we now know little of it.
Anyone, one of the tantalizing parts of the book is where he describes the carbonized and unreadable Herculaneum scrolls, since they were the private library of a wealthy patron of the Epicureans. I think he thinks being able to read the scrolls will really change our understanding of the ancient world.
And remember: if they hadn't been carbonized, they would have crumbled to dust. That's why we only have the texts that managed to get copied. (Anthony Doerr's Cloud Cuckoo Land is a novel about the survival and 21st century rediscovery of an imaginary Greek play, and ... I'll let you read it yourself - https://www.anthonydoerr.com/books/cloud-cuckoo-land)
(Apologies for any errors above, as basically all I know about this subject is what I read in the book!)
[1]: https://en.wikipedia.org/wiki/Charvaka
It's interesting reading for a layperson, but as with any other pop-history book, one should read this with a heaping plate of salt at hand. (I'm... not sure what that metaphor actually means or if this is an appropriate way to extend it.)
Things are always more nuanced than can be laid out in a sweeping narrative format and the compression required can lose some critical information, even with the best of intentions. There's also just getting things wrong, which most non-historians do and many historians will do on topics that aren't their expertise.
I'd read this criticism from AskHistorians (not infallible, I know)
https://old.reddit.com/r/AskHistorians/comments/ejfxe5/comme...
So the extended metaphor makes no literal sense according to the Pliny text, but it makes sense according to our interpretation of it, which is what matters.
[0] https://en.wikipedia.org/wiki/Epicureanism
In all seriousness though, I find this such an amazing project to follow regardless of the outcome(s)
First word discovered in unopened Herculaneum scroll by CS student - https://news.ycombinator.com/item?id=37857417 - Oct 2023 (207 comments)
The Vesuvius Challenge - https://news.ycombinator.com/item?id=35322809 - March 2023 (32 comments)
Vesuvius Challenge - https://news.ycombinator.com/item?id=35169869 - March 2023 (32 comments)
Can AI Unlock the Secrets of the Ancient World? - https://news.ycombinator.com/item?id=39261465 - Feb 2024 (1 comment)
and this tweet which presumably covers the same ground as OP:
The $700k Vesuvius Challenge prize has been won - https://news.ycombinator.com/item?id=39261933 - Feb 2024 (2 comments)
```
xxxxxxxxxx <- The surface of the scroll
xxxxxxxxxx
...
xxxxxxxxxx <- The bottom of the scroll
```
So, by tiling the image on the surface you get data that is size_x * size_y * n_layers. So, it can be seen as a video stream with size_x * size_y * 1 channel * n_layers where the layers replace the temporal dimension.
It's a cut through the scroll, with the time dimension in this video representing the location of the cut along the scroll lengthwise.
As you can see from the mess it's far from trivial to find the surface of any of the sheets in the scroll, often they layers are blended together messes.
You may be thinking of the scans they used of an unwrapped sheet, those were as you describe and were used to help figure out methods for the real challenge.
This is the most exciting thing in the world to me right now, these scrolls, along with the thought that there might be literally thousands more still in the ground.
So many there's a lengthy list on Wikipedia about it. It's fascinating reading ancients casually referencing works that we otherwise know nothing else about. Without the careful, laborious copying (often imperfect) over the centuries most things would've been lost completely. There's also other works such as maps that did not survive, the Tabula Peutingeriana for example is thought to be a derivative work of one commissioned by Augustus of the known world at the time (to Romans) and of which there's a few mentions in some works by historians at the time.
https://en.wikipedia.org/wiki/Lost_literary_work
The general subject of the text is pleasure, which, properly understood, is the highest good in Epicurean philosophy. In these two snippets from two consecutive columns of the scroll, the author is concerned with whether and how the availability of goods, such as food, can affect the pleasure which they provide. Do things that are available in lesser quantities afford more pleasure than those available in abundance? Our author thinks not: “as too in the case of food, we do not right away believe things that are scarce to be absolutely more pleasant than those which are abundant.” However, is it easier for us naturally to do without things that are plentiful? “Such questions will be considered frequently.”
It is wild to me, though, that if I have an SSD fail it's essentially unrecoverable, but a 2,000-year old, rolled-up, lava-burnt scroll of Papyrus can be read using Technology™! I love to see it!
oh good grief, even back then, we were limited to this value