Launch HN: Wondercraft (YC S22) – Use text-to-speech to create podcasts easily
“Hacker News Recap” (https://www.wondercraft.ai/podcasts/hacker-news-recap) a podcast produced using our platform, has been running for 4 months and currently gets close to 23k listens per month. We’ve made its analytics publicly available: https://op3.dev/show/f77aea62-97e5-5cce-92c6-9464e51c30c6.
Having previously attempted to start a podcast, we were well aware of the difficulties. Figuring out what equipment and software you need to buy is a daunting start. Editing is a lengthy and tedious process, technical difficulties often occur during recording, and planning logistics around recording is a hassle. As a result, content release is infrequent, which leads to lackluster growth.
At the same time, podcast consumption is experiencing exponential growth. There are 500M podcast listeners around the world, double in size compared to 5 years ago. Apart from the growth in listeners, podcasts are the medium that is most likely to influence behavior, which is the reason why the number of businesses having podcasts has grown 5x over the past 5 years. Finally, the last piece that led to the creation of Wondercraft is that text-to-speech models saw a big improvement about 6 months ago, with ElevenLabs releasing models with an output that is almost indistinguishable to humans (see HN thread here: https://news.ycombinator.com/item?id=34361651).
Wondercraft integrates realistic text-to-speech with an infrastructure that simplifies podcast creation. For example, you can integrate music, publish your podcast / create an RSS feed, generate a video for your episode, get assistance in the script generation, auto generate show notes and transcript and translate your podcast all together. All text based tasks (e.g. script assistance, show note generation, etc) are completed using a chain of custom prompts to LLM models. All text-to-speech is done through custom voices that are either synthetically generated or professionally cloned from Voice Actors, using the ElevenLabs platform. Tasks such as episode translation involve the use of both LLMs and ElevenLabs. Video generation runs using Remotion and the RSS feed is an XML creation and updating routine.
Since launching, we’ve had more than 13k users sign up to create their podcast. Use cases that we’re seeing include: businesses repurposing their blogs and generating video content for their socials; writers/bloggers/newsletters reaching audience through another medium; news outlets and publications adding a news rundown podcast in their lineup; businesses creating internal educational/cultural material; and podcast studios using Wondercraft to serve client needs faster.
Wondercraft is not a tool for fully AI generated content. Rather, we save people time by transferring content they’ve created (e.g. an article they’ve written) to another medium. This technology is best suited for news rundowns and narrational format podcasts (often used by businesses talking about a niche topic). And while interview and conversational formats will sound better person-to-person, the logistical and (often) sound quality issues remain, so we’re testing out an “Async Podcasts” feature, where an interviewee can respond to quest...
120 comments
[ 3.0 ms ] story [ 251 ms ] threadWhich language would you want it in?
[1] https://podcasts.google.com/feed/aHR0cHM6Ly9hcGkyLndvbmRlcmN...
Also, it's too bad it doesn't use PG's voice.
Also I played around with their podcast generation tool, where it neatly built a podcast from my blog posts. This is a good example of what Generative AI can do in the media domain. Congrats on the production launch! Keep up!
Great work Wondercraft team!
Full disclosure - I built pod-genie.
(there's a "start for free" button, but that could mean anything, and it wants me to create an account)
screenshot here: https://share.cleanshot.com/kmXRc3ng
NOTE: using zoom "command +" is NOT the same and does not constitute a valid test for this.
I am so happy that this exists, I was considering creating a podcast but it was too much effort involved and had to do and redo takes and other priorities.
Will be considering using Wondercraft and others if they exist entirely for this now.
You just need to add more than one section, and then alternate the voice you choose to talk.
Annotations for emotion are coming by the end of August.
It offers "Overdub", but they suggest limited use of it (replacing 1-2 words), not full podcast creation. The quality of the text-to-speech model they use is not at the same level as the ElevenLabs model we are using, so I think someone would struggle to create an engaging podcast using Overdub. I'd also think that this is not a direction that Descript would be heading to, as they have built a successful business as a "podcast editing" platform and catering to "podcast creation" would be a significant change.
In addition to this, given that we are a "podcast creation" platform rather a "podcast editing" platform, we have focused on integrating functionality that allows users to go end to end in creating a podcasts. Examples: publishing a podcast (RSS), generating a video automatically, providing a shareable podcast page, autotranslating the podcast to other languages and a lot more.
For substackers that already have a podcast, that’s a separate question. Ultimately it depends on if they think that they can use the time the put in for the recording and editing process to some other creative process and use Wondercraft for generating the audio. Haven’t seen that many existing Substack podcasts for this use case to become that prevalent.
https://speechcentral.net/2023/04/14/harness-the-power-of-az...
> podcast consumption is experiencing exponential growth
I find this so interesting! I know my personal podcast consumption has fallen off a cliff since the pandemic started. I pretty much only listen to podcasts when I commute, and I stopped commuting then. I assumed that everyone did that but I guess I was wrong.
I'd say these are some reasons for continued increase: - Commute has not fallen as much as we might think - More quality content is becoming available, bringing in more audience - Natural expansion from people enjoying the experience and sharing +++
Terms of Service: https://wondercraft-ai.notion.site/Terms-of-Service-fbfc043c...
Privacy Policy: https://wondercraft-ai.notion.site/Privacy-Policy-f35636350f...
Someone with speechify: https://speechify.com/
And who wants to write a spotify API write code can do this.
Providing all other features (e.g video generation, podcast publishing, auto translation and many other features we’ve added that allow for higher quality pod creation) increase the level of complexity for reproducibility.
Ultimately, we aim to keep building features that lead to higher quality pods, easier to build, and integration of ansiliary (video, translation, show notes) that will enhance our moat.
We have a small map of tweaks, and our users keep feeding us with more. The model performs great on its own most of the time though.
The AI image generation space has hundreds of players. Audio has dozens.
One likely outcome is that big tech will come to each of the "successful" companies with close peer competitors and offer to buy them. If they say no, they buy their competitor. Or build it internally.
You'll have to run really fast and hard to survive. I think it's totally doable, though, and this is a very interesting attack gradient.
Best of luck! It's exciting times.
According to Butler v. Target Corp., it was held that although lyrics to a song are copyrightable, the underlying voice is not. As such, there is no copyright protection available to the infinite number of words or phrases a person might utter in their distinctive voice.
Additionally, the synthesized audio can be considered derivative, as it transforms the the "audio" into something entirely different than original, and so falls under 17 U.S.C.A § 103.
So, I'm not sure what you mean when you say there are plans for tighter controls. Care to back that up?
Disclaimer: I am not a lawyer and this is my personal opinion.
What's the difference between using an AI voice and Bill Hader or Jimmy Fallon doing a celebrity impersonation on his show and monetizing that?
I get your point on people liking authentic stories from people and that’s the value of podcasts. There’s many different formats of podcasts and interviews/conversations are just 20% of overall podcasts. I agree with you that for the time being those formats are best done person to person. But for all other podcasts (e.g news rundowns, narrations etc), podcasts generated on Wondercraft on a daily basis are proving that as long as human creativity is there podcasts created using TTS and other AI tools can be very engaging and appealing for many. That is ultimately how the flooding of such content is regulated as well, people will only listen to content that has thought behind it so creators will not find much value in “auto generated” podcasts.
1. Vim Boss - the auto-generated description fails to mention the post author is a top Neovim contributor. It is hard to tell who Bram is just from the description. It also said “the deceased iconic software Vim” (Vim is not dead…) The music feels inappropriate.
2. The Future of the Vim Project - “In an exciting movement towards the next stage of Vim project’s evolution”? What is exciting about having to deal with Bram’s death? Why would listeners care about FTP servers and websites? What does “in a paradoxical fusion of continuity and change” mean? A human would have made a segue between the two, but the robot couldn’t.
3. MS Teams channels cannot contain MS-DOS device names - “sailing through the sea of digital collaboration”? Why did it start with buzzword bingo? Why would anyone care about specific numbers re the Teams limitations? What are MSD-OS device names? (Bad pronunciation aside, a human would have provided some examples, considering they’re mentioned in the article title.) The AI summary doesn’t match the post title and what the comments focused on.
4. My Overkill Home Network - what value is there in naming all the random components in the author’s network? That’s a word salad that is difficult to parse and listen to.
The AI butchered four out of ten stories, and it didn’t do a great job of respecting a deceased person (it felt so happy about the changes in Vim). I’d rather not listen to it do world news.
PS. your podcast needs a transcript. And the last sentence felt cut off.
Definitely will add transcript. The HN Recap has been a side thing for us while we have been building the Podcast Creation platform, but we will do better.
In any case, it's clear that this podcast is not for you and that's ok.
Appreciate you taking the time to give us thoughtful feedback.
Wrote some stuff here about comparison to Descript:
https://news.ycombinator.com/reply?id=37089928&goto=item%3Fi...
As the prices decrease, due to model improvement, best/worst practice guides, and promotion of successful use cases may act as an additional mechanism to prevent such cases.
Realistically though, given that we’re lowering the bar of podcast creation to effectively the level of blog creation there might be an increase in slop content. I think that’s a necessary problem when you lower the barrier, but there will always be proper curation in the aggregator level. I think HM is the perfect example. Internet has made blogging so easy and there is so much slop. But it goes unnoticed given the curation.
If the creator can't be bothered to read the script, it would be a waste of time for anybody else to listen to it.
It's not that the creator can't be bothered, but that the tool unlocks features that are just not feasible for a creator. Think of Hacker News Recap for example - a 20' episode has been generated every single day for the past 122 days. That's extremely hard for a person to do. So the consistency that this enables is one feature.
Automatic translation and video generation are other features that using this method of podcast creation lead to. So it's not necessarily that the "creator can't be bothered to"... there's inherently more value in some use cases to create a podcast this way over the traditional method.
Might be cool to have a feature that read out the source too, like someone would if a human was reading a quote from a book. Hard to control for everyone's different annotation style though I'd imagine.
Thanks for kind words!
There is so much written content currently confined in written format and we have built an app that makes it very easy to convert it to engaging audio. Paul Graham essays is a prime example.
If that necessarily means there is also some “fake” podcasts, that no one will listen to anyway, I think it’s a fair exchange.
So although I understand your position, no, we are by no means making the world worse.
Hopefully the creators can either parlay a pseudo-success here and transition to something else, or, if AI drastically improves in the coming years, provide a more worthwhile service.
A text-to-speech can help creating english audio tracks for those producing original content in other languages