Very nice implementation. I tried developing my own to practice Santhai(repeat thrice) to learn Upnishads and this tool would be at the center of my workflow. A locally installable version would be even great! Kudos. Dhanyosmi :-)
It was based on an existing TTS, IndicT5. I wonder how different is “Sanskrit Chanting” to languages it could already do, like Hindi. Is it largely the glyph—to-phoneme that needs relearning? Or pitch control? Or more?
This must be insanely difficult to get right. I was not expecting such an impressive result from a site that looks so vibe coded! The look is underselling how good this is.
Forgive my ignorance; I'm not a Sanskrit speaker (Malayalam is my first language) -- but I love the sound of Sanskrit.
I have lots of questions: what's the use case for this? Primarily religious / liturgical? It also seems that the fact that this tool works means that any arbitrary Sanskrit sentence can be translated into a chant by some sort of procedure (dare I say algorithm)? I'm terribly curious and fascinated by this!
The TTS quality seems to be poor. I just entered a single word "jaganmaatham" and it failed to pronounce it.
What's the point anyway? If you really love your traditions, slokas and chanting, please keep it as natural as possible, instead of plasticizing it to the core.
This is third level of mechanizing the sacred rituals. First - we lost the live chanting due to recorded recitals with human voice. Then we lost the experience of presence due to online streaming. And now even human voice is lost - the broken chanting is generated. So, combined all together, you have a streaming of the rituals which was performed by recorded chanting that never really involved a human reading the sloka.
Just because we can pollute the world, we need not do it.
Why does the visarga "echo" at the end of the verse? A mixed IAST - HK transliteration on the front page like "Bhāgavata-VāNi" does not inspire confidence either. Is it vibed?
People seem to be making all sorts of assumptions/conjectures about the project and confusing themselves without reading the paper explaining the project (linked to in the site itself);
From the introduction;
Classical Sanskrit recitation, parāyaṇa, is a chanted rather than a read register. A faithful synthesizer must hold long vowels, sustain a terminal visarga, articulate retroflex and aspirated consonants, render dense consonant conjuncts cleanly, and respect the metrical structure of the verse.
None of these is well served by general-purpose text-to-speech, and there is essentially no chant-domain training data available off the shelf. The problem is therefore doubly hard: it is low-resource, and the target prosody is a specialized melodic contour rather than ordinary read speech.
This report describes a system, Vāgdhenu, that solves the practical version of this problem well enough to ship two large deployments, and it documents the design decisions, the dead ends, and the one negative result that turned out to be the most useful finding. We do not claim a new model. We claim an honest account of what it takes to build a faithful Sanskrit chant pipeline on top of current open backbones, what works, and what is architecturally out of reach.
Our framing is that of an experience report. The evidence we offer is the comparative lineage across architecture families, a reproducible production system, two shipped artifacts at real scale, and a public release of code, weights, data, and a live demonstration. Formal listening studies are limited to expert evaluation, which we state plainly and treat as a limitation rather than a result.
18 comments
[ 0.23 ms ] story [ 34.1 ms ] threadI have lots of questions: what's the use case for this? Primarily religious / liturgical? It also seems that the fact that this tool works means that any arbitrary Sanskrit sentence can be translated into a chant by some sort of procedure (dare I say algorithm)? I'm terribly curious and fascinated by this!
What's the point anyway? If you really love your traditions, slokas and chanting, please keep it as natural as possible, instead of plasticizing it to the core.
This is third level of mechanizing the sacred rituals. First - we lost the live chanting due to recorded recitals with human voice. Then we lost the experience of presence due to online streaming. And now even human voice is lost - the broken chanting is generated. So, combined all together, you have a streaming of the rituals which was performed by recorded chanting that never really involved a human reading the sloka.
Just because we can pollute the world, we need not do it.
From the introduction;
Classical Sanskrit recitation, parāyaṇa, is a chanted rather than a read register. A faithful synthesizer must hold long vowels, sustain a terminal visarga, articulate retroflex and aspirated consonants, render dense consonant conjuncts cleanly, and respect the metrical structure of the verse.
None of these is well served by general-purpose text-to-speech, and there is essentially no chant-domain training data available off the shelf. The problem is therefore doubly hard: it is low-resource, and the target prosody is a specialized melodic contour rather than ordinary read speech.
This report describes a system, Vāgdhenu, that solves the practical version of this problem well enough to ship two large deployments, and it documents the design decisions, the dead ends, and the one negative result that turned out to be the most useful finding. We do not claim a new model. We claim an honest account of what it takes to build a faithful Sanskrit chant pipeline on top of current open backbones, what works, and what is architecturally out of reach.
Our framing is that of an experience report. The evidence we offer is the comparative lineage across architecture families, a reproducible production system, two shipped artifacts at real scale, and a public release of code, weights, data, and a live demonstration. Formal listening studies are limited to expert evaluation, which we state plainly and treat as a limitation rather than a result.
nb: Bhatta is Sanskrit for priest.
I just tried this
यं ब्रह्मा वरुणेन्द्ररुद्रमरुत: स्तुन्वन्ति दिव्यै: स्तवै-
र्वेदै: साङ्गपदक्रमोपनिषदैर्गायन्ति यं सामगा: ।
ध्यानावस्थिततद्गतेन मनसा पश्यन्ति यं योगिनो
यस्यान्तं न विदु: सुरासुरगणा देवाय तस्मै नम: ॥
Interestingly, the word ब्रह्मा which should say Brahmaaaa says baa. Please take a look.