Every time you watch a youtube video you are downloading the youtube video to disk. It is just to prevent the lawyers from exploding that we all pretend that deleting it afterword means it never was downloaded.
But yes, everyone should be not deleting the videos they've downloaded.
Technically watching a video only streams video chunks into memory. But of course there are tools pretending to be a youtube client to stream it to a file.
The simplest, best, most reliable, less fragile system is just storing the file on disk as it comes. But streaming software bends over backwards to avoid this simple solution for the lawyers. It always re-evolves with each new streaming mechanism.
In fact when youtube started the entire file would be downloaded to /tmp/. And it was this way for a long time. Then the lawyers heard about it and instead youtube would download the file then delete it and read from the filehandle of the deleted file. Then flash went away. And the replacement video streaming services would send chunks that would be on disk and then the lawyer pacification process repeated and now everything is only stored "in ram" but often, and on many systems, that isn't true either. But it's enough to keep the lawyers calm.
There are technical reasons to choose streaming vs on demand download without involving lawyers. I'm sure regular user would prefer to save bandwidth when opening a 1 hour documentary and only watching first minute.
You've misunderstood. It's entirely technically and easily possible to use the current streaming model of only downloading the file bit by bit (as if there is any other way) but instead of wasting RAM and making things more complex just add each bit to the file on disk as it downloads. You've set up a false dichotomy.
to the layman download means the whole video is stored in its entirety on my disk. and possibly to lawyers too. that is not happening with streaming videos. youtube videos in particular most likely never hit the disk. not even the cache. when i am watching youtube then i am not deleting the video after it is done. the "downloaded" segments disappear automatically as i watch. so there is no delete step that i could skip in order to keep the file. rather, actually downloading a video requires an entirely different operation.
Yeah what the other person said - the Tdarr instance was for my other media and I figured, might as well use it across the board. It was less work to just add another library to Tdarr and let the server go brrrr than to work out how to get ytdl-sub to do that, especially when the library was already in the hundreds of GB.
`--recode-video` is probably the better solution if starting from scratch.
One of the things I wish I could solve better, was a way to search for and show decent search results that you could then pipe into `yt-dlp`. Every method of doing this I've seen is basically a "hack" and often breaks or doesn't work at all. Anyone have a better solution to this that lets you basically build a frontend/proxy to Youtube or lets you Search, Show results and Download what you want to see lateR?
Since youtube api won't help with this someone needs to build a video index and a good search algorithm on top. Would be nice to be able to search through indexed subtitles too.
What hacks have you found? I guess my first thought is some sort of snippet to run in the browser console, or an extension, that you can just run when using youtube itself that copies the yt-dlp command to downloads all the page's search results to your clipboard.
copy(
'yt-dlp ' +
[...document.querySelectorAll('ytd-video-renderer a#video-title')]
.map(a => {
const u = new URL(a.href);
return `"https://www.youtube.com/watch?v=${u.searchParams.get('v')}"`;
})
.join(' ')
)
Podsync will download videos from a playlist and then publish an XML feed of videos it's downloaded. You can set it up so that you interact with it by just adding videos to a (public or unlisted) playlist.
It's intended to be used as a youtube-to-podcast-player tool, but seems like it fits your use, too.
It's rate-limited but other hacks to scrape Youtube without the API will also be rate-limited as well unless you try to trick Google via unapproved hostile methods such as commanding an army of residential ip zombies and aggregate it.
Fundamentally, the index of Youtube videos lives in Google's servers so you're beholden to Google to get results from it. If the issue is that the Google's official results from search queries are not surfacing the videos you think are actually there, it means you'd have to build a duplicate (massive) "shadow" index to return those missing videos. To build such a beast, you're back to hitting the brick wall of rate-limits again.
Due to the nature of youtube updating so often all methods utilizing youtube's search would break often, but in the age of coding agents I don't think it matters as much anymore. Tell that to claude code and it will do it in 15 minutes. Being annoyed with youtube's search interface regressions I've basically built something similar by having an alternative frontend to better sort by date ranges, view count etc. It has already broken twice in last 6 months but fixing it is trivial by pointing a coding agent at it.
i use freetube to search. i can select videos that i want to watch with a single click into a playlist and then export that playlist and feed it to yt-dlp. since my internet is often slow, that is the main way i watch videos. i don't even open them directly in freetube, but wait until yt-dlp is done downloading.
I was messing around with the new coding agent in Xcode and built an app that would let me put in a bunch of channels I subscribe to, then basically made a YouTube RSS app around that. It would fetch new videos and show the thumbnails, times, descriptions, etc. If I wanted to watch something it will download it with yt-dlp on the backend. Watched videos would get cleaned up periodically, but videos marked as favorites would stick around.
It worked decently well. However, I started running into API limits when it would refresh to fetch updates. Things could likely be tweaked to avoid this, but I haven’t revisited it yet.
I didn’t make a generic search, but did allow pulling up one-off videos to download and favorite them.
I'm using a bash script ("youtube-search") that makes use of yt-dlp, mpv, fzf, rofi/dmenu and gnu-grep. I forgot where I got it from, but it has been working fine for years and years now. As a "bonus" you don't get to see the awful thumbnails, though, this can also be a demerit at times.
I've always downloaded entire YT channels I enjoyed. I now have free/forever access to tons of content that now sits behind paywalls on topics I care about.
Not the poster you're replying to, but my archiving rig uses my personal fork of "tt-rss" to pull in the RSS feeds for the channels I care about and a script to query the database. That script uses yt-dlp to download the videos and subs, then marks them downloaded in the database. It's a bunch of glue-and-tape scripting code but was easy to hack together in an afternoon. Tweaking yt-dlp to run at a velocity that didn't get my IP address put into "you must login" hell was the most difficult part. The only long-term care-and-feeding has been keeping yt-dlp updated in the face of the arms race.
> Tweaking yt-dlp to run at a velocity that didn't get my IP address put into "you must login" hell was the most difficult part.
YouTube is pretty hassle-free in that regard, at least for my IP region.
I have a script that downloads sequentially, and there’s an optional variable interval in between—though I don’t think I’ll actually need that. I once downloaded the entire contents of a YouTube channel that had over 400 GB of audiobooks. After a while, YouTube throttled the speed to 1/2 MB/s—which didn’t bother me, but everything still downloaded successfully. That was already two years ago, though.
A few days ago, I spent two consecutive days nonstop downloading playlists from YouTube Music, but that didn't trigger anything either.
I stick a random delay between downloads, never download streams in parallel, and always download when nobody is using YouTube (ideally when nobody is home or everybody is asleep).
I never did get throttled-- I just stuck in "you must login" hell. We don't login to YouTube in our household, so that effectively cut of my wife and daughter. My wife couldn't have cared less but I learned that being able to stream music videos while getting ready for the day or bed is mission-critical for my daughter. (I've asked her to identify channels I can sic the archiving rig on but, heretofore, she hasn't done it. I keep telling her those videos she likes could disappear at a moment's notice...)
I regret not archiving all the videos from the youtuber Myles Power (pseudoscience-debunker). He was one of my more favorite YouTubers but a few years ago he nuked his entire channel and all the videos on it (I suspect because his employer didn't like him arguing with people on the internet).
I wanted to rewatch some of his videos recently and as far as I can tell most of his videos are now lost media. I should have downloaded them when I had the chance.
Most of my YouTube playlists say something like "15 unavailable videos are hidden", or about ~10% for a 5 years old playlist. The same ratio holds true for most bookmarks of YouTube videos I have.
There's videos from ~15 years ago that I consider gone for good - lost to the great copyright apocalypse - having been unable to find them anywhere on the today's internet.
I've had luck going to my liked videos, hitting the 3 dots under "Liked videos", selecting "Show unavailable videos", and copying the video watch?= ID into google. If the video is popular enough its text should pop up in a forum somewhere with some discussion at least where you'll find the right clues. Example: 9_1Qn370IIY
Same experience. I have years of notes and many link to specific youtube video sources (with time stamp). Unfortunately those URLs don't even give a title of a video, so tracking down removed videos can be hard. However, I've had some luck using LLMs! (obviously only when I can remember the context of a quote or some details about the video, even if vague). Once you know the video title it can often be found on unofficial youtube mirror sites.
I don't download YouTube videos, but my grandmother's cousin does. I'm trying to get her to stop. Anyway, she has a strategy of downloading the 720p version of videos if the content is something that doesn't merit the full 4K resolution. Typical cases would be commentary consisting of mostly someone talking, comedy, or old TV shows.
...what? Why? Do you feel the videos she likes should be allowed to just vanish into the mists of time? To me that sounds like saying 'my sister takes pictures at her daughters' birthdays and I'm trying to get her to stop'.
> ...what? Why? Do you feel the videos she likes should be allowed to just vanish into the mists of time? To me that sounds like saying 'my sister takes pictures at her daughters' birthdays and I'm trying to get her to stop'.
Anything, even good things, can be done to excess.
If you're grabbing lots of things because they're rare, yeah.
If you're grabbing 720p of things you actually watched, then at 4 hours at day and 1.5Mbps an entire year of recordings would be less than a terabyte. So I'd estimate this as a $1-5 per month hobby and the time/effort shouldn't be too bad either. If they reach small NAS territory then that's a useful thing to learn.
However, it's satisfying to be able to smugly watch/listen to content that becomes unavailable due to it being old or unpopular or even complicated by rights issues.
Just yesterday, I was watching Digging The Greats on YouTube, discussing De La Soul's Three Feet High and Rising. He can't even recreate the beat/mix on YouTube as it would get flagged for copyright. It was unavailable for streaming/download until 2023 due to licensing issues.
My go-to example of disappearing media is the third season of Monkey Dust that ran into problems with music licensing and so it was never available on DVD and will never be screened again. (Available through nautical methods)
I didn't used to think this was so obvious, but I'm so annoyed with the absolute frequency of ads on chromecast that I'm about to try and force my chromecast to look at some local jellyfin server or whatever and just pre-download every video I want to watch.
That being said, up until literally a week or two ago, I had a data cap of 1.3TB/mo. It'd take me a while to hoard much data after all of my normal data usage. If you stream a lot of video, 1.3TB is shockingly little.
YouTube has among the worst linkrot. Stuff gets deleted , hidden, or channels deleted for even the tiniest of supposed violations or reasons.
Same for downloading content. Over 15+ years, there have been so many tools that purport to download YouTube videos and they either don't work or get patched or full of bugs or malware. It's surprisingly hard to do, especially at any scale. more of an art than science. understandably, YouTube does not want people just downloading their content easily without paying for premium.
That is the worse with Youtube, not that you don't have access to the video anymore but that you don't even have the title anymore so if you don't have a good memory, you have no clue of what piece of knowledge you lost from your library.
Yeah but how often do you really go back to look. The only time is when I want to show someone else something, never for myself. It also means I already have a memory of it and that's good enough.
in my case, it is for example play list of music videos. Sometimes I hear a very nice unknown music as series soundtrack, sometimes you manage to find the name of long forgotten loved song. And usually, in the rush of the daily activity, it is simple to "save to playlist" while watching it in youtube.
Then, usually you play the list by itself from random position and order. So I quite often listen to them, but for a playlist of maybe 50 entries, i will just noticed that things disappeared when looking at the "hidden entries" thing.
Yeah. If the video was sufficiently popular, you can do a Google search for the video ID, and some websites with the link will hopefully have additional information like the title. This is unlikely to work for more obscure videos though.
That's the thing though, it was never yours. Just a corner in Google's library that they let you curate. You don't have to do that. It was never a good deal.
A ton of youtubers (the ones doing it for a living, content creators, whatever you call them) hide or delete old videos that didn't age well for a variety of reasons (too much shilling, bad jokes, false speculation, more or less accidental misinformation). In addition to removed content if the account was deleted or banned.
There used to be tons of videos from around 2008-2010 of a french folk festival I always went to. I remember watching all videos of those events and see if I spotted anyone I knew.
Those were definitely not copyright claimed by anybody. But 3/4 of them are gone by now when I tried some nostalgia - youtbe -spelunking recently . I assume youtube silently deletes videos if they are never watched? Or maybe they are still there, but not easily findable anymore.
I was going to suggest searching on DailyMotion as it was the Made-in-France Youtube concurrent and was quite popular in these years but apparently they've gone full tiktok and removed old videos… sigh.
Downloading your favourite stuff is absolutely what you should do, but it doesn't solve the bigger problem.
Many from my generation, who grew up during an era of information scarcity, have huge stashes of hoarded data. But what can we do with it? There is no way to legally share it, so we take it with us in our graves.
I went down an IA hole a month or so ago, and discovered someone uploading random Jaz + Zip drives images, that appeared to be backups from random businesses and people in the late 1990s There were diary entries, letters to a lawyer about divorce, business accounting data, invoices, and period-era porn, that if i were to guess, was organized to be offered on BBSes. tl;dr: encrypt that data at rest, you never know where it will end up.
honestly, for stuff that old i kinda like the idea of seeding it anyway... i know that is a naïve PoV in the modern era, but i kinda miss the days of the internet being innocent enough that you got a real slice of someone's life sometimes.
I have mixed feelings about that stuff (which I've seen there too). There's historic value in it and I think it should be preserved. It also feels a bit icky and wrong for it to be publicly available so soon after its creation.
I suppose you can distribute YouTube videos the same you distribute Linux ISOs. Hell, something like IPFS (RIP(?)) would work even better for random videos than it ever did for Linux ISOs.
> There is no way to legally share it, so we take it with us in our graves.
I think about this. How can we give back interesting stuff we've archived over the years? Or release it on death?
I feel I should either start planning and sharing now, or risk passing on short notice with no way to way to give anything back, taking my data to the grave.
I just hope someone in 2100 will want to see my meme archive.
> Cooyright is just too long and too unreliable. What we need at least is exemptions from Copyright for archivists, otherwise a lot of stuff will simply be lost in the coming decades.
What we need is compulsory licensing and a more reasonable timeframe to enter the public domain.
I did so with regards from Tales from the crypt; the
early seasons were great, so I have them locally.
Or, at the least the better ones; some are not so good.
For this purpose I also kept list, in .yml files, for
the most recent URL. Not just on youtube but also dailymotion
etc...
Interestingly there are some surges of URLs suddenly being
eliminated. Naturally we know the copyright mafia is trying
to hinder us, the people here, but it is interesting how that
works. Because ... it sometimes works. And then it does not
work. Which is quite strange to me.
For instance, you can often still find new videos on youtube
here, even full movies. Sometimes you can download them; then
suddenly they are gone, but they were up before that for months
or even years. So it is really really strange to see some videos
suddenly vanishing, others being around for decades literally.
Even when you'd assume these have ... "copyright issues".
I have a nightly job that looks at all my youtube playlists, and downloads them to disk. It also sends me an email whenever a video that I haven't watched becomes unavailable so I can watch the local version. It took about 2 days to setup, but probably 30 minutes with AI today.
would be interested to have a look if you happened to have a repo setup or a blog post explaining! prob won't necessarily setup something myself but always been curious about this kind of thing
It's really as easy as asking Opus 5.5 and/or DeepSeek 4.1 (if Opus has moral issues) to set this up. I have the same. I've got a Download playlist which synchronises everything automatically. It had some issues where YouTube detected ytdl and throttled the download or limited video quality, so I set up a container with a full browser and fake browser fingerprint attributes, then downloaded at 1.5x (that was the limit before it throttled again). Just spar with Opus a bit if you encounter these issues.
Read the comments and combined with my personal experience, made me wanna have a full on offline library, and in a better case, "decentralized" libraries of such things, although at the very least videos prolly won't work all that well.
Hi, maybe it is 'wrong-quoting', but i want to add...
Quoting: "Made me wanna have a full on offline library, in a better case..."
hm...
1st thought: "Go, buy a 'modern'-Jukebox" ?
Think of it as 'an 21.Century cyber-Interieur' fitting an 1980s-Sci-fi-movie... maybe build one DIY...showing 'cat-pictures' on other days... there are already some arcade-cabinets, showing up sometimes... which i also think, some gave an eye more than two times...
Hint: There was a Video about a guy using "infra-sounds" and a kind of "micro-Styropor" (i didn't remember his original saying) to form animated 3d-objects as a display-type.
I agree with the sentiment (and have several TB of archived Youtube videos) but I can't help but think "Keep this on the down-low!". I feel the same way every time someone mentions Youtube RSS feeds (which drive my archiving rig). Keep quiet or they'll take them away!
TBF when I wrote the post I wasn't planning for it to reach any kind of sizeable audience. That said, I feel like yt-dlp is mainstream enough that talking about ways to make it suit your needs probably won't ruin everything?
Tough balance, and not one where I have any real confidence in my own answer.
Yep. W/o yt-dlp the whole thing is pretty meaningless.
I guess the RSS side does provide some value standalone. I used to as read/unread pointers before I started actively archiving, so there was value in that. Beyond posting a couple of private videos for sharing purposes I've never actually used a Youtube account for any of the community engagement stuff (like / subscribe / bleeeeech). My feed reader served the "subscribe" function fine (which is why I assume Google would love to kill the RSS feeds).
I'm angling on having enough "timeless" stuff banked-up that when they do go away I can just watch what I have cached. The kind of stuff that I like to watch (basically amateur "maker" stuff) is such that it'll still be interesting in 5, 10, 20 years.
I have avoided any kind of "community" or participatory-type Youtube engagements specifically because I expect it all to get walled-off at some point.
I'm using a GUI called simply "media-downloader". On launch it updates yt-dlp and your chosen JS runtime. It has a separate tab for downloading playlists.
Nice, I'll have to try that. My strategy up until now has been to embed the playlist index in the filename, via `-o "%(playlist_autonumber)02d-%(title)s [%(id)s].%(ext)s"` (or %03d for playlists of 100 videos or more). Works reasonably well for playing the videos in proper order, but the info is only in the filename. Embedding the metadata looks like a better solution if you want a media player to be able to organize the files.
>The corporate internet is hostile to art and the things you love
Agreed. I mourn the deletion of legendary Hair cake video from FilthyFrank every now and then. But at least we have AI slop videos or in better case videos with "The inevitable rise and fall of XXX" title" with human narrator reading AI written script. But hey at least everyone censor word fck and sht.
The other year I came to the same conclusion so I built a web frontend for yt-dlp with queue support. I have 'profiles' that I can pick from at the time of download that allow custom yt-dlp configs to be active at any given time, which routes videos to different locations and jellyfin being one of those locations.
In addition to what's included in the post, I'll recommend Tube Archivist as a self-hosted solution. Utilizes yt-dlp, you can configure download speeds to avoid getting temporarily blocked, handles subscriptions and playlists. I've been enjoying it!
Pretty good tip! This thread inspired me to set up Tube Archivist and use their provided plugin to hook it into Jellyfin (which I already had set up). Now I have a self-hosted backup for the YouTube videos I care most about.
Around 2018, someone had done a lot of work and there were videos like "The Adventures of Tyrion the Imp (Season 1)" in Youtube. They had taken all Tyrion's storyline scenes from all the episodes, and put them together in one video. And they had done these for all of the Game of Thrones main characters, so there were lots of these videos.
Using Youtube titles for filenames is an exercise in wild and crazy non-ASCII characters. Make sure your filesystem, OS, and client tooling can handle it.
just fyi, youtube premium lite is $7.99 a month (subscribe via web, not App store), removes in-video ads and allows downloads. at that price it’s just worth it for me.
Backing up videos seems increasingly a consideration, it's disappointing to see videos I've organized and paid for via Youtube Premium to support creators and invest in organizing meaningful playlists.
But also? Let things die. Let them languish half-remembered for years until they're gone forever. (Until they're not and then are again.) Let things go. What's that, your 'tism won't let you? Learn to. Grow. (Is that effectively impossible for some? Sure. But clearly that's a different problem. If you're reading this, most likely you can accomplish it.) I'm glad we have the Internet Archive and all those amazing things. But I'm convinced that just because it is technologically possible to personally save everything forever, it is in most cases entirely unnecessary and probably ultimately unhealthy.
I'm sorry, but that's a terrible perspective. Just in the last few months, I've run into issues in finding original texts for archaeological records from Iran and Iraq site digs from the 19th century. The archaeologists published books with artifact photographs, but it's extremely difficult to find the books because they're out of print. Because of wars and looting [0], many of the physical sites and structures are gone. Hundreds of thousands of artifacts have been looted. There used to be web sites that also had the images, but those sites are now gone. The sites have also been removed from archive.org, too. Luckily on Anna's Archive, I found a digital scan of one of the books, but it's partially corrupted. There is serious money being spent by powerful people to erase history. I can't see how anyone would be ok with that.
[0] an interesting and unknown fact is that immediately after the start of the U.S. gulf wars "professional looters" came in with heavy equipment and dug up some sites 10 meters down. Apparently, you can see the damage from satellite photos, but I haven't checked.
Who do you think is preserving human knowledge? I used that as an example because the people involved are long gone, and universities and governments no longer seem to care enough to preserve it.
There's a difference between data and knowledge. Knowledge is what's extracted and made intelligible from data. Production and storage of knowledge was so expensive and scarce that if you find something from Iraq 3000 years ago there's a high likelihood there'll be some knowledge in there.
Most stuff produced today is not only not knowledge, as of now the majority may not even be human. If you're living in the metaphorical Wall-E garbage mountain filtering and disposal are much more important skills than accumulation
Exactly. Yes, keep some stuff that you cherish but this idea of data hoarding everything is a little odd ball.
Back in 2001 the Taliban destroyed the Buddhas of Bamiyan statutes. The only people who didn't get to upset were the Buddhists. That is because if the Taliban did destroy them, maybe a flood would, or an earth quake, or eventually just erosion. It doesn't mean just accept reckless destruction but also is a lesson as accept that everything passes with enough time.
Dont strangle life and hold everything in place but let it flow like sand or water. Some sticks, most doesn't.
170 comments
[ 0.31 ms ] story [ 60.7 ms ] threadBut yes, everyone should be not deleting the videos they've downloaded.
In fact when youtube started the entire file would be downloaded to /tmp/. And it was this way for a long time. Then the lawyers heard about it and instead youtube would download the file then delete it and read from the filehandle of the deleted file. Then flash went away. And the replacement video streaming services would send chunks that would be on disk and then the lawyer pacification process repeated and now everything is only stored "in ram" but often, and on many systems, that isn't true either. But it's enough to keep the lawyers calm.
Yes, that's exactly what it means.
`--recode-video` is probably the better solution if starting from scratch.
Since youtube api won't help with this someone needs to build a video index and a good search algorithm on top. Would be nice to be able to search through indexed subtitles too.
It's intended to be used as a youtube-to-podcast-player tool, but seems like it fits your use, too.
Not sure what you're exactly asking for. Google/Youtube does provide an "official" API for youtube searches:
https://developers.google.com/youtube/data/reference/rest/v3...
It's rate-limited but other hacks to scrape Youtube without the API will also be rate-limited as well unless you try to trick Google via unapproved hostile methods such as commanding an army of residential ip zombies and aggregate it.
Fundamentally, the index of Youtube videos lives in Google's servers so you're beholden to Google to get results from it. If the issue is that the Google's official results from search queries are not surfacing the videos you think are actually there, it means you'd have to build a duplicate (massive) "shadow" index to return those missing videos. To build such a beast, you're back to hitting the brick wall of rate-limits again.
That's kinda the nature of YouTube downloaders/scrapers including yt-dlp. It's not exactly a public API that YouTube's offering to support.
A script that streams clipboard changes.
Next i run a bunch of user services that do:
`await-clipboard.sh | grep --line-buffered -z -e "youtu" | ...`
I just use youtube like normal, but instead of clicking a video i right-click copy to clipboard and a mpv+sponsorblock window pops up
It worked decently well. However, I started running into API limits when it would refresh to fetch updates. Things could likely be tweaked to avoid this, but I haven’t revisited it yet.
I didn’t make a generic search, but did allow pulling up one-off videos to download and favorite them.
Something along these lines: https://github.com/Benexl/yt-x
All automated for years
I have a script that downloads sequentially, and there’s an optional variable interval in between—though I don’t think I’ll actually need that. I once downloaded the entire contents of a YouTube channel that had over 400 GB of audiobooks. After a while, YouTube throttled the speed to 1/2 MB/s—which didn’t bother me, but everything still downloaded successfully. That was already two years ago, though.
A few days ago, I spent two consecutive days nonstop downloading playlists from YouTube Music, but that didn't trigger anything either.
I never did get throttled-- I just stuck in "you must login" hell. We don't login to YouTube in our household, so that effectively cut of my wife and daughter. My wife couldn't have cared less but I learned that being able to stream music videos while getting ready for the day or bed is mission-critical for my daughter. (I've asked her to identify channels I can sic the archiving rig on but, heretofore, she hasn't done it. I keep telling her those videos she likes could disappear at a moment's notice...)
I wanted to rewatch some of his videos recently and as far as I can tell most of his videos are now lost media. I should have downloaded them when I had the chance.
There's videos from ~15 years ago that I consider gone for good - lost to the great copyright apocalypse - having been unable to find them anywhere on the today's internet.
I often get a wave of videos I've watched years ago pop up as recommended and not marked as watched.
I saw a similar thing some years back: playlists I had created began to be missing videos.
Been scraping ever since…
...what? Why? Do you feel the videos she likes should be allowed to just vanish into the mists of time? To me that sounds like saying 'my sister takes pictures at her daughters' birthdays and I'm trying to get her to stop'.
> ...what? Why? Do you feel the videos she likes should be allowed to just vanish into the mists of time? To me that sounds like saying 'my sister takes pictures at her daughters' birthdays and I'm trying to get her to stop'.
Anything, even good things, can be done to excess.
If you're grabbing 720p of things you actually watched, then at 4 hours at day and 1.5Mbps an entire year of recordings would be less than a terabyte. So I'd estimate this as a $1-5 per month hobby and the time/effort shouldn't be too bad either. If they reach small NAS territory then that's a useful thing to learn.
Just yesterday, I was watching Digging The Greats on YouTube, discussing De La Soul's Three Feet High and Rising. He can't even recreate the beat/mix on YouTube as it would get flagged for copyright. It was unavailable for streaming/download until 2023 due to licensing issues.
My go-to example of disappearing media is the third season of Monkey Dust that ran into problems with music licensing and so it was never available on DVD and will never be screened again. (Available through nautical methods)
That being said, up until literally a week or two ago, I had a data cap of 1.3TB/mo. It'd take me a while to hoard much data after all of my normal data usage. If you stream a lot of video, 1.3TB is shockingly little.
What are you trying to archive? Is it the words the person is saying, or the arrangement of his freckles?
Same for downloading content. Over 15+ years, there have been so many tools that purport to download YouTube videos and they either don't work or get patched or full of bugs or malware. It's surprisingly hard to do, especially at any scale. more of an art than science. understandably, YouTube does not want people just downloading their content easily without paying for premium.
yt-dlp -U
Then, usually you play the list by itself from random position and order. So I quite often listen to them, but for a playlist of maybe 50 entries, i will just noticed that things disappeared when looking at the "hidden entries" thing.
That's the thing though, it was never yours. Just a corner in Google's library that they let you curate. You don't have to do that. It was never a good deal.
I wish they at least stored the title of the video
Like tears in the rain.
https://www.youtube.com/watch?v=NoAzpa1x7jU
In this day and age will AI be born a replicant but dies a human?
This is literally why I built joyscroller for myself hahaha give a try, fork it if you want. https://github.com/sergiotapia/joyscroller
Those were definitely not copyright claimed by anybody. But 3/4 of them are gone by now when I tried some nostalgia - youtbe -spelunking recently . I assume youtube silently deletes videos if they are never watched? Or maybe they are still there, but not easily findable anymore.
Many from my generation, who grew up during an era of information scarcity, have huge stashes of hoarded data. But what can we do with it? There is no way to legally share it, so we take it with us in our graves.
I think about this. How can we give back interesting stuff we've archived over the years? Or release it on death?
I feel I should either start planning and sharing now, or risk passing on short notice with no way to way to give anything back, taking my data to the grave.
I just hope someone in 2100 will want to see my meme archive.
What we need is compulsory licensing and a more reasonable timeframe to enter the public domain.
For this purpose I also kept list, in .yml files, for the most recent URL. Not just on youtube but also dailymotion etc...
Interestingly there are some surges of URLs suddenly being eliminated. Naturally we know the copyright mafia is trying to hinder us, the people here, but it is interesting how that works. Because ... it sometimes works. And then it does not work. Which is quite strange to me.
For instance, you can often still find new videos on youtube here, even full movies. Sometimes you can download them; then suddenly they are gone, but they were up before that for months or even years. So it is really really strange to see some videos suddenly vanishing, others being around for decades literally. Even when you'd assume these have ... "copyright issues".
Quoting: "Made me wanna have a full on offline library, in a better case..."
hm...
1st thought: "Go, buy a 'modern'-Jukebox" ?
Think of it as 'an 21.Century cyber-Interieur' fitting an 1980s-Sci-fi-movie... maybe build one DIY...showing 'cat-pictures' on other days... there are already some arcade-cabinets, showing up sometimes... which i also think, some gave an eye more than two times...
Hint: There was a Video about a guy using "infra-sounds" and a kind of "micro-Styropor" (i didn't remember his original saying) to form animated 3d-objects as a display-type.
(weekend:Modus)
2nd - https://www.youtube.com/watch?v=q5MumB7WY9k
regards... (-:
But you just mentioned the RSS thing ... Doctor, heal thyself!
Ssshh, you just did it again!
Tough balance, and not one where I have any real confidence in my own answer.
and yt-dlp I guess?
I guess the RSS side does provide some value standalone. I used to as read/unread pointers before I started actively archiving, so there was value in that. Beyond posting a couple of private videos for sharing purposes I've never actually used a Youtube account for any of the community engagement stuff (like / subscribe / bleeeeech). My feed reader served the "subscribe" function fine (which is why I assume Google would love to kill the RSS feeds).
I have avoided any kind of "community" or participatory-type Youtube engagements specifically because I expect it all to get walled-off at some point.
> This is the only yt-dlp wrapper that allowed me to properly maintain the Playlist structure to any extent
I have the same requirement and it's possible to do it with the default yt-dlp:
yt-dlp --embed-metadata --parse-metadata "playlist_index:%(track_number)s" "PLAYLIST_URL"
Agreed. I mourn the deletion of legendary Hair cake video from FilthyFrank every now and then. But at least we have AI slop videos or in better case videos with "The inevitable rise and fall of XXX" title" with human narrator reading AI written script. But hey at least everyone censor word fck and sht.
My arguments line for the extension looks something like this: /C C:\Users\[user]\youtube-dl\yt-dlp.exe -v -P "D:\Media\Videos" -f "bv[vcodec!=av01]+ba/b" --write-subs --embed-subs --sub-langs "en.*" --compat-options no-keep-subs --merge-output-format mkv [HREF]
At some point, all those videos were removed.
[0] an interesting and unknown fact is that immediately after the start of the U.S. gulf wars "professional looters" came in with heavy equipment and dug up some sites 10 meters down. Apparently, you can see the damage from satellite photos, but I haven't checked.
Most stuff produced today is not only not knowledge, as of now the majority may not even be human. If you're living in the metaphorical Wall-E garbage mountain filtering and disposal are much more important skills than accumulation
Oof, this so much - I've tracked down some early and mid 20th century books about a hobby and that was tough and expensive.
Back in 2001 the Taliban destroyed the Buddhas of Bamiyan statutes. The only people who didn't get to upset were the Buddhists. That is because if the Taliban did destroy them, maybe a flood would, or an earth quake, or eventually just erosion. It doesn't mean just accept reckless destruction but also is a lesson as accept that everything passes with enough time.
Dont strangle life and hold everything in place but let it flow like sand or water. Some sticks, most doesn't.
I'd say most Buddhists are closer to that than to Boomer Californian eat your veggies to cure cancer LSD Buddhism.