Just minutes ago, I compared two transcripts for the same video and they were the exact same. Also on YouTubeTranscript.com swearing was redacted with [_], which is something I've only ever seen on youtube captions.
The simplest explanation is often the most probable one.
Why would you reach for a cluster of machines working in parallel, when you could retrieve the already auto-created transcript from YouTube servers?
Also, other comments have pointed out that the transcripts are identical with the ones created by YouTube, which would be unlikely to happen if this service was creating transcripts of their own.
Apparently not. I compared the result of the linked site to a Whisper transcription of the same video. While the word-by-word accuracy of the two transcriptions was about the same, the Whisper transcription was punctuated nearly perfectly and therefore much easier to read.
The burning hate I feel for all information to be locked away in a YouTube video. This will solve that real world problem. I love reading (or, skimming) through a long read.
Not sure if you know that, but YouTube has a transcript feature available for years now. It's somewhat hidden in the interface, but let's you search with ctrl-F (or command-F) in the transcript
I use this for city council meetings to figure out who said what. It's not easy, but it's better than nothing. YouTube doesn't appear to do so well with multiple speakers.
> I feel for all information to be locked away in a YouTube video.
Google Search actually indexes transcripts of a video and shows you some YouTube results based on that even though the title/description of the video doesn't match the search query.
I had a huge backlog of tech videos, so I wrote me this (also to play a bit with Haskell, the base idea can be replicated easily in any language though): https://github.com/rberenguel/glancer
The only thing I have in my "someday" list of tasks for Glancer is the possibility of adding/using the whisper binary to get captions when/if unavailable. Aside from that I just keep it more or less working by using it myself (and to be fair on this one, I wish I wrote it in another language, Haskell can be a bit finicky to build if you do it sparingly).
Any addition that is on the "view" layer (the generated HTML) is very easy to add, just needs to go into the template file, at some point I might tweak that area but currently have no outstanding idea/requirement. The rest (i.e. the bulk of the code) is just a very bare-bones parser for captions that should be pretty stable and need no additions (crossing fingers here).
I've published almost 1,800 video diaries and this is a game changer for me. I've been wanting to do more with the back catalog, but don't have transcripts.
I am not a fan of this pattern - if I'm understanding correctly, you would have to part with all of yt-dlp's niceties like playlist/channel handling, quality selection, file naming, logging config etc.
Why not just use the whisper cli on yt-dlp CLI's output for videos with bad or no subtitles?
Sure you could do that too. yt-whisper uses yt-dlp underneath so there might be a way to pass arguments to the inner yt-dlp instance. Or if not you can modify the source directly, it seems to be a simple wrapper. Or again you can do what you were saying, using the Whisper CLI. All good options, I just mentioned this one since it's easier if I just want to download a video with subs.
Behind the scenes yt-dlp is downloading the subs in .vtt format than using ffmpeg to convert those to .srt. Depending on your situation the original .vtt format might be fine.
Or even better, yt-whisper, which uses OpenAI's Whisper speech to text. I guess it'd be better to first check whether the video has captions first before Whispering, so maybe both your command and this one could be used together.
I apologize for the question, but I am not entirely clear where "split_sentences" is. Is it a separate script? I have been looking for something with that sort of functionality for a while, very often for this very purpose, splitting transcripts.
Sorry for the late answer, but yes, it would have to be a separate script or command, it is purely fictional, I made it up because it made more sense for the joke to have it, and people might have pointed out that my grep would have filtered out too much context, so I had to add this.
I'm sure there are many unix-y tools for this purpose, but I don't know of them. If you're looking for something that's installed everywhere, maybe a very big awk or sed regex with multiline wizardry could do the trick for most easy-to-parse latin languages and you'd just have to copypaste it around. It prolly becomes harder for regexes once you start working with right-to-left languages like Arabic, and languages with different ponctuation, so it might not be i18n-friendly.
What I've wanted it search by transcript of past videos I've watched. With something like this it seems reasonable to imagine having a set up where every video you navigate to gets transcribed and test is indexed for later search
This UI and Youtube's UI for transcripts are really nice. When I'm looking for a particular piece of information I can just Ctrl+F and click on the match to play from there. Youtube used to auto-generate subtitles, now it also formats subtitles as transcripts. I wish offline media players had this functionality, if I get distracted for a few seconds I don't have to watch those seconds again, I can speedread over the past couple lines.
Maybe this is a bit off topic, but does anyone know the legal footing of having a business with another businesses name in it? For instance, this tool uses the word "YouTube" in its name, though it is used as only a part of it, and it is not a competitor. I've always wondered how this works.
Broadly speaking, it would be trademark infringement if it is used in a way that may confuse others about the source of the product. It doesn’t necessarily have to be a specific product that Alphabet has a direct competitor for.
Not sure about YouTube but WordPress does not allow the use of the name. WP in your (e.g.) domain name is ok. WordPress is not.
I'd imagine it's very similar for others. Often a company will pursue a violation if only to be consistent in showing the courts they actively defend their copy right.
FFS Relax. It was an oversight on my part. It's minor at best in larger scheme of things. Maybe you're having a tough day? God bless you. But this is nothing to go to the mat over.
You could have just said, "Oh. Maybe you're confusing trademark and copyright?". The last thing the world and HN needs is another high-strung belligerent asshole. That doesn't help anyone, or anything, sans your ego. It's not a good look.
That is your most minor mistake. The much larger one is that you are claiming that the law supports the trademark policy you link to. It doesn't. Everyone remains free to use a trademark belonging to wordpress in order to refer to wordpress.
You are not free to use any such mark - the WordPress Foundation would be on very solid ground in telling you to stop using their graphical logo. But they can't stop you from using "WordPress" in the name of your for-profit company, which you'll note is quite explicitly contrary to their stated policy.
Most corporations regularly search for such domains, and submit cease-and-desist. I received one related to an eBay-related domain, but in my case, I hadn't built a business around it so it was easy enough to just take the site offline.
> is a legal doctrine that provides an affirmative defense to trademark infringement as enunciated by the United States Ninth Circuit, by which a person may use the trademark of another as a reference to describe the other product, or to compare it to their own.
Hook this up to a language model, and maybe a user could instantly get the one sentence worth of information that the YouTube video creator buries in 10 minutes of monetized noise.
And also save yourself time when the creator teases that they provide the info, but it turns out they don't, they're just trying to get views.
No snark intended, but i just gave up with the dross. And even some of them, of late, are getting a bit crafty.
But, creators get one chance from me now - give me decent content, or even with the fancy chapters, you're not getting my eyeballs past two minutes.
What I have found is that leaving the decent stuff on, what auto-plays after is 'generally' of similar quality. A quick set of back-buttoning and bookmarking has fairly often got me some interesting results.
Good idea, but I don't follow anyone on YouTube. I was thinking about searching the Web for a bit of info, the search hits include YouTube videos (but no finer resolution than "this entire video").
A search engine could, narrow in on the few sentences AV in the video that it thinks correspond to what I was searching for, and summarize that, and also link me to the AV start timepoint in case I also want to watch the video.
This might change the economics of some YouTube video content creation.
I've never seen this before now, but I just got a Google search result video page with a kind of table-of-contents index on one of the video hits just now. (These TOC entries don't correspond to the marked segments on the timeline. I don't know whether this is something YouTube is doing, or something the content creator did.)
Is this what you mean? (Pardon if I'm not familiar with the latest Google Search features; I've mostly been using DDG lately, so don't have occasion to see all the features that exhibit only occasionally.)
YouTube created that problem by incentivizing longer videos. And now we have videos with tons of fluff.
Similarly Google incentivizes longer webpages, so now we have recipes that start with a novella about grandma’s cooking before showing the actual recipe.
It used to be nice to see a video’s thumbs up to thumbs down ratio to know if you’ve been click baited or not before watching the whole video. But that signal has been removed now too.
dismiss cookies, have a video ad follow me down the page, and read why this cake conjures up memories of the author's childhood, before reaching the actual recipe
so that
I feel connected to the author, before fully committing to mixing ingredients
That "user story" is like a tragically misinterpreted comment by someone at a prospective customer, speaking of a special time with their grandmother, but garbled through N layers of field sales, marketing, product managers, engineering hierarchy, and Agile task management.
Including the part about declining more cookies offered (to save room for grandma's lasagna).
Are you sure Google prefers longer pages? I find (annoyingly) that Google likes the search version of my page for lots of things. E.g. a page called "best x of the y" the page for searching comments on that page called "best x of y search" where the only text is the title and a search input, will rank really well
Try to search for recepies :) I also see long novels which seem to disguise the ridiculous amount ads which google seems to like as well (these are mostly provided by no other than themselves!).
I blame it on automated advertising. When you had to work to get someone to pay you you made good content. Now anyone can get paid as long as they're digestible. It's created the interesting situation where the average quality of demonetized content is far high than monetized content.
That is definitely true. I actually try and make my videos as short as possible but I noticed that over time the longer ones are definitely prioritized by the algorithm, yet I get lots of comments saying how people appreciate my very short videos.
I am not so sure because YouTube keeps track of watch time. If no one watches past 2 minutes, then I think that would also be penalized, though I have no insight into the algorithm so I am not sure.
Do you know if YouTube measures wall time or percent of video watched? If percent, then a hack might be slow-mo the content and encourage audience ti watch at 2x speed.
I think it is percent of video watched, because if you check out the analytics in YouTube Studio, it says how many people are still watching by a certain point. So your hack makes sense, but I'm not sure it would work because it is VERY hard to keep anyone's attention on YouTube. The moment it's something even slightly less than interesting, the vast majority of people go onto the next video.
I put something like this together to collect transcripts for uni videos. It’s dumps all transcripts into a directory, with URL links, so I can just search the whole directory to find the keyword I need.
Sadly enough, I have the same issue with written content: BS websites add a ton of fluff to their texts as their deplorable approach to SEO and making some space for ads.
"Streaming your phone screen to a TV is something many people at some point want to do. But seeing the picture of your smartphone on a television or other device can be a daunting task. Here we list multiple ways how you can achieve the goal of sharing a mobile screen of an Android or an iOS device on a different device. It works for any manufacturer, like Samsung Smart TVs or Apple TV."
(goes on for another 15 paragrpahs before presenting a non-solution)
It's hard to put in words the amount of hate I feel for the authors of such pages. I'm desperately looking forward to the day Google comes up with better models for detecting useful content and those trash piles can burn in hell.
Or Google has sorted the results by how many advert placement sites you'll have been exposed to on that page before it's predicted you'll stop reading, so having the paydirt right at the end looks great, and it doesn't matter if it's fool's gold.
It sucks because time on page plus how much you scroll and once you find your answer you don’t click on any more results signals to Google that you were satisfied.
With youtube dl you can download the subtitle tracks which should have timestamps. Though last time I checked they were broken (showing the whole test on the first timestamp) but perhaps they fixed it
That's doing speech recognition on the YouTube video's audio and then embedding the result as subtitles? Is the idea that this is superior to YouTube's own automatic subtitles? Though if the youtube video actually has manually crafted subtitles from the creator, as a lot of popular science content does, it seems a shame not to just use those subtitles directly and avoiding doing speech recognition. Or just rely on YouTube's automatic captions which are pretty decent in my experience.
Thanks for the link! This site actually has a database of youtube transcripts unlike OP. Shame you can't search fixed strings, like two words in exact order. Though it seems genuinely useful for learning pronunciation as advertised.
Pretty nice. The sliver of content still worth watching on YouTube doesn't have repetitive stuff or padding to make it to the 10 min mark though.
If you go to the homepage with clear cookies it's just endless amounts of utterly dogshit cookie cutter content. Same clickbait thumbnails with a person pulling an idiotic expression. Even the videos masquerading as educational are entertainment at best. If I had kids I'd do everything in my power to keep them away from YouTube.
Why it is hard-coded to English? When I try to transcribe a video in any other language it throws the error:
> No transcripts were found for any of the requested language codes: ('en',) For this video ([...]) transcripts are available in the following languages: [...]
It even knows what language is available, so why no dump that instead?
Probably because it’s a hackathon style project that was slapped together and isn’t intended to support every use case. I’d recommend reaching out to the author with your feedback
143 comments
[ 3.3 ms ] story [ 210 ms ] threadhttps://youtubetranscript.com/?v=dQw4w9WgXcQ
Why would you reach for a cluster of machines working in parallel, when you could retrieve the already auto-created transcript from YouTube servers?
Also, other comments have pointed out that the transcripts are identical with the ones created by YouTube, which would be unlikely to happen if this service was creating transcripts of their own.
This will work as long as YouTube doesn't change anything. And since when has YouTube changed anything?
Google Search actually indexes transcripts of a video and shows you some YouTube results based on that even though the title/description of the video doesn't match the search query.
I’m considering a master keyword list to index against any text that comes in.
Any addition that is on the "view" layer (the generated HTML) is very easy to add, just needs to go into the template file, at some point I might tweak that area but currently have no outstanding idea/requirement. The rest (i.e. the bulk of the code) is just a very bare-bones parser for captions that should be pretty stable and need no additions (crossing fingers here).
I’ve seen vosk used on device and it’s decently quick too on a recent Apple chip.
To make transcripts easier to access might create more problems than it solves.
Granted I can't make a bullet-proof argument; there's no clear way to quantify that ratio.
Why not just use the whisper cli on yt-dlp CLI's output for videos with bad or no subtitles?
To get youtube subs in .srt format this gave me some limited success:
Behind the scenes yt-dlp is downloading the subs in .vtt format than using ffmpeg to convert those to .srt. Depending on your situation the original .vtt format might be fine.https://github.com/m1guelpf/yt-whisper
I'm sure there are many unix-y tools for this purpose, but I don't know of them. If you're looking for something that's installed everywhere, maybe a very big awk or sed regex with multiline wizardry could do the trick for most easy-to-parse latin languages and you'd just have to copypaste it around. It prolly becomes harder for regexes once you start working with right-to-left languages like Arabic, and languages with different ponctuation, so it might not be i18n-friendly.
Related Stackoverflow : https://stackoverflow.com/questions/33704443/python-regexp-s...
I'd imagine it's very similar for others. Often a company will pursue a violation if only to be consistent in showing the courts they actively defend their copy right.
They may not like it, but they don't have the power to disallow you from using their name to refer to them. That's allowed.
The law is on their side.
No, they don't.
> It's copyright.
No, it isn't. It's trademark. There is no such concept as copyright in a single word.
> The law is on their side.
Again, no, it isn't.
What was the point of your comment? Why talk if you're not worried about whether what you're saying is true or false?
Otherwise: https://wordpressfoundation.org/trademark-policy/
FFS Relax. It was an oversight on my part. It's minor at best in larger scheme of things. Maybe you're having a tough day? God bless you. But this is nothing to go to the mat over.
You could have just said, "Oh. Maybe you're confusing trademark and copyright?". The last thing the world and HN needs is another high-strung belligerent asshole. That doesn't help anyone, or anything, sans your ego. It's not a good look.
That is your most minor mistake. The much larger one is that you are claiming that the law supports the trademark policy you link to. It doesn't. Everyone remains free to use a trademark belonging to wordpress in order to refer to wordpress.
You are not free to use any such mark - the WordPress Foundation would be on very solid ground in telling you to stop using their graphical logo. But they can't stop you from using "WordPress" in the name of your for-profit company, which you'll note is quite explicitly contrary to their stated policy.
> is a legal doctrine that provides an affirmative defense to trademark infringement as enunciated by the United States Ninth Circuit, by which a person may use the trademark of another as a reference to describe the other product, or to compare it to their own.
We want to partner with you on a topl that autogenerates clips of any video based on the topic start and end
"Error: transcripts disabled for that video"
Why?
The extension I made to export the transcript was based on this YouTube functionality, I should update the instructions now.
https://chrome.google.com/webstore/detail/youtube2anki/boebb...
[1]: Searching YouTube videos with transcript - https://needgap.com/problems/88-searching-youtube-videos-wit....
And also save yourself time when the creator teases that they provide the info, but it turns out they don't, they're just trying to get views.
No snark intended, but i just gave up with the dross. And even some of them, of late, are getting a bit crafty. But, creators get one chance from me now - give me decent content, or even with the fancy chapters, you're not getting my eyeballs past two minutes. What I have found is that leaving the decent stuff on, what auto-plays after is 'generally' of similar quality. A quick set of back-buttoning and bookmarking has fairly often got me some interesting results.
A search engine could, narrow in on the few sentences AV in the video that it thinks correspond to what I was searching for, and summarize that, and also link me to the AV start timepoint in case I also want to watch the video.
This might change the economics of some YouTube video content creation.
Is this what you mean? (Pardon if I'm not familiar with the latest Google Search features; I've mostly been using DDG lately, so don't have occasion to see all the features that exhibit only occasionally.)
Similarly Google incentivizes longer webpages, so now we have recipes that start with a novella about grandma’s cooking before showing the actual recipe.
It used to be nice to see a video’s thumbs up to thumbs down ratio to know if you’ve been click baited or not before watching the whole video. But that signal has been removed now too.
recipe reader
I want to
dismiss cookies, have a video ad follow me down the page, and read why this cake conjures up memories of the author's childhood, before reaching the actual recipe
so that
I feel connected to the author, before fully committing to mixing ingredients
Including the part about declining more cookies offered (to save room for grandma's lasagna).
Or maybe just repeat the same content a few times.
Helped a lot with take home exams.
"Streaming your phone screen to a TV is something many people at some point want to do. But seeing the picture of your smartphone on a television or other device can be a daunting task. Here we list multiple ways how you can achieve the goal of sharing a mobile screen of an Android or an iOS device on a different device. It works for any manufacturer, like Samsung Smart TVs or Apple TV."
(goes on for another 15 paragrpahs before presenting a non-solution)
It's hard to put in words the amount of hate I feel for the authors of such pages. I'm desperately looking forward to the day Google comes up with better models for detecting useful content and those trash piles can burn in hell.
I’m just not convinced the preambles are needed.
Any chance timestamps could be added?
Often enough I'd rather read than watch. Reading in faster. Having corresponding visuals would be a big plus.
https://github.com/ggerganov/whisper.cpp/blob/master/example...
for my purposes I changed the output from subtitles to txt (so I could pipe the result into chatgpt)
Tell us more :)
See my comment on how to just download the subtitles YouTube provides with `yt-dlp` here: https://news.ycombinator.com/item?id=34040342
https://filmot.com
Edit: after reading other comments it seems this may be using an undocumented api to retrieve the data.
If you go to the homepage with clear cookies it's just endless amounts of utterly dogshit cookie cutter content. Same clickbait thumbnails with a person pulling an idiotic expression. Even the videos masquerading as educational are entertainment at best. If I had kids I'd do everything in my power to keep them away from YouTube.
> No transcripts were found for any of the requested language codes: ('en',) For this video ([...]) transcripts are available in the following languages: [...]
It even knows what language is available, so why no dump that instead?
https://demo.robomotion.io/designer/shared/6j984jBCQqYVBCaQk...