After grooveshark died I moved to soundcloud. There will certainly be a bunch of indie / nieche artists floating around. The culture will still exist, but it'll be fun to watch the vacuum get filled by some other service
Yea how many people delete source content after they've uploaded. I wouldn't be surprised a lot of people do that. General population doesn't think it's worth to simply buy more space either online or on disk. It can be expensive to do so even for people like me who realize that disk on the whole is cheap compared to losing the data.
That isn't the point. It is published in spot. The amount of breakage between SC going down and that art being uploaded to a new site ... at most I would think 10% or less would make the transition.
Soundcloud has some of the best damn music. It'd be awful if it disappeared. I'm surprised nobody, including Soundcloud themselves, have developed tools to remix, sample, dj, etc. the music library on Soundcloud. They have tons of great stuff to sample/remix etc.
I'm not terribly surprised. The rights management around that is incredibly expensive and very complex. I also have vague memories of some startup circa 2011/2012 that did live DJing that ended up dying pretty quickly
That's not actually true within the US. Each song sample needs to be licensed individually. This becomes more complex when a song you want to remix contains samples of other songs. In general, this has become prohibitively expensive, which is why most modern songs only have a few "samples". Any company that does remixing as suggested above would have to manage the licensing in some way or pass on the risk to the users while still risking lawsuits from the music industry.
This seems to be the most likely outcome to me. Bandcamp and Soundcloud have always had a huge overlap in functionality. I've always much preferred Bandcamp anyways.
As a user of both they've always seemed like two completely different services to me. One is streaming, the other a store. One a social sharing based platform, the other mini-sites for each artist with terrible discovery. Bandcamp would need to change a lot to replace SoundCloud's use case.
NB: Not shitting on Bandcamp, it's great and I use it.
Maybe Bandcamp should buy them out. Seems like there's a lot they could gain by having a major music platform like Soundcloud integrated into their marketplace.
$80k? Even at Hetzner, which is one of the more expensive hosters w.r.t. transfer, this costs less than $1100.
If you directly run traffic agreements with ISPs, and peer directly, you can get below half of that.
Where are you getting those moon prices? AWS? GCP? Never use their prices to get a fair estimate, AWS and GCP's prices are orders of magnitudes off from a fair price. Unless you're in Silicon Valley, running systems yourself at a traditional datacenter will always end up cheaper. (The issue behind that being that Amazon and Google have to pay far higher wages than you, and you can cut out a middleman)
I'd be very surprised if SoundCloud paid anything near the standard GCP pricing. It's much more likely that at their scale they pay the rates I mentioned.
That said, if they pay the rates you mentioned, then it's no wonder the company fell apart.
You can buy a dedicated server ($50-200/mo) hooked up to a 1Gbps line ($1-2k/mo). Assuming you fully saturate the link, 900TB will take 83 days to download. Of course you can also rent a bigger line, or more of them. And this doesn't consider storage costs. But it's certainly less than $80k.
Edit: I think you could even rent at a datacenter that peers with amazon, hook your server with the files up to a VPC via ipsec, then move files to s3 or glacier via a server in the VPC. Not sure if you could avoid the PUT costs, but you would avoid amazon bandwidth charges with the peering, I think (not 100% sure).
Yes, but looks like transfer in is free (other than paying for the pipe). So in the scenario we are discussing, you could get 900tb into AWS fairly cheaply.
And how much do you need to spend on HDDs and how many do you need for 900TB of data?
WD 10TB Gold drives on newegg are $414 * 90 = 37260, now you want at least a 25% raid redundancy... $46575... now, you need how many U of space to store all those drives? It's not just something you can throw in a 1U host. Even if you can get 125 drives in servers 12 at a time, you still need at least a 3U * 10, 30U, so that's a pretty expensive hosting proposition, beyond the $50K for drives alone
This might be an application where the cost of a tape drive + many tape cartridges will be far less than the cost of HDDs. LTO-6 tapes are ~$4/TB and the drive is a few $K.
Tapes are also more reliable than HDDs for long-term archival storage.
A chassis design that holds the HD's vertically[1] would half the space; down to 12U instead of 30U, which is slightly easier to stomach. However, that's less than half of Soundcloud's reported 2.5 PB[2], though I have no idea how much of that 2.5 PB consists of downsampled copies which wouldn't need to be stored.
S3 transfer inbound is free, from anywhere. You'd use several dedicated servers consuming a queue of urls to warc package and push into S3, no vpc or IPSec tunnel required (random S3 key prefix ftw to prevent creating bucket hotspots).
Then you'd hope someone came along with a big chunk of AWS credits to use snowball to migrate your bucket(s) of data to the Internet Archive when they could safely accept said data.
He's been active on Reddit and IRC. He claims to be storing it in GSuite after ripping it with Google Compute Engine.
Since incoming traffic is free and outgoing traffic to other Google services is free, bandwidth costs would be minimal (just the size of the requests, not the responses).
Blender was developed by Neo Geo for internal use. When they were acquired, the developer tried to sell Blender as a commercial product. During bankruptcy proceedings, the Blender Foundation was founded and bought the source code to release as open source.
Unfortunately, I think the time to back up soundcloud was before anyone could have known we needed to backup soundcloud. A lot of my favorite artists that I discovered there have a third of their original catalog at best left up because of copyright claims, etc. Who decided free songs by hobbyist artists should be banned even from audibility simply because they contain a fraction of a sample of copyrighted materials?
The most egregious example to me was when Madlib released a remix of a Kanye West song that he had produced and it was taken down for copyright by UMG (a shareholder in Soundcloud). That's when I knew the sun had set on Soundcloud as the open creative community it had started as.
In a similar vein, soundcloud was a hotspot for DJ mixes (not remixes) for many online hobby DJ communities, but copyright takedowns eventually stopped that as well.
What's the alternative? Seems like it would take considerable expenses to challenge the copyright claim if Soundcloud refused to take down the song and UMG sued.
Any info on how to backup your liked songs and subscribed artists in a nice way? I've just saved the HTML of the page, so I can always retrieve them...
> How do you persuade people who have been using your services free to start paying $5 or $10 a month?
I've starting paying for stuff like music services, apps and newspapers just to try to keep stuff alive. I realized I would happily pay $500 for a phone but never wanted to pay for a $2 app.
There is so much sh*tty content out there I'm actually enjoying having ad free access to a lot of good stuff. I still dont really like paying but if I dont no one will. I think I'll start paying $5/mo for soundcloud too.
I've never had this issue, and I have to say as someone who listens to longer tracks(mixes on the order of 1hr+) I really enjoy their seeking functionality. It's much more thumbfriendly than any other app I've seen, but then again I haven't really looked at many other apps.
As a corollary to your point about paying money for a free service, I recently decided to help fund Riot/Matrix.org development on Patreon (currently $5 a month). Both are currently presented as a free service, and I recall them stating eventually they would have paid-for integrations and bonuses for corporate users, but predominantly most of the users are on the matrix.org instance using the free service. Needless to say though, it's been a damn good app / backend most of the time, and has made my life much better than before, when I would connect to a handful of various services to accomplish the same goal. I think the reason I didn't see contributing money to be as big of an issue, is that the work is 1) open sourced, which is almost as if I can have some part of ownership in it (don't take this too literally) and 2) I pay $5 for a vps to keep my personal website / email up. If I'm willing to part with $5 for email (which some days could be thought of as not helping my life), I might as well do it for another application / ecosystem I use everyday that does help me in many ways.
Overall I think that to an extent you can't just expect that most people will pay for something that would otherwise be free, or has been free for a long time. You end up gaining a bunch of users from the "lower pool" that will only be there as long as it's a free ride. But a certain class of users will pay for something if you ask for it, because it has made their life better in some way, and they want to ensure it continues in the future. There's an interesting parallel here to Craigslist / Kijiji, where most seasoned users will put a price on items they just want to get rid of. They do this because a very large portion of troublesome users who troll around for free stuff will outright ignore the posting. This actually makes it easier to get rid of things, because you don't have to deal with fielding fifty calls of people who might pick it up but then never show, or who just call you to ask if you have anything else for free that can go with it (and subsequently waste your time from giving unwanted items to people who will actually, you know, come get them from you).
It does make you wonder if the idea of a buffet-style, everything-is-free-forever ends up tainting the user pool, especially with regards to sites / applications that deal with art / multimedia. Sure, there's piracy out there, but companies like soundcloud don't really have the corporate backing behind them to scale infinitely for more users. Maybe from the outset they should have charged a $5 yearly membership or something. They may have had less users, but at least then they'd have something. Or perhaps I just don't understand their business model. Who knows?
Its a weird world where the biggest tech players are drowning in cash and the rest rely on goodwill, donations and volunteers. In-between there are VCs. :)
SoundCloud only takes card directly, not through PayPal/similar, which is good for them, but makes the decision harder for me since cancelling would be harder.
Their "9 plays to own" model with higher compensation for repeats sounds really interesting, although I wonder if the base level of .2 cents is still high enough that spamming enough can earn some money. On Soundcloud spamming is a major issue even without directly earning any money from it so I imagine this would just make it worse.
While I don't know for sure, I suspect that on Soundcloud I listen to part of multiple thousands of songs a month that I dislike and don't want to support. Some of these I don't want to spend money on but for a sufficiently low to me price I wouldn't care and some of which I actively want to not pay any amount for.
IMO first play should be free until you indicate that you like the song. There should also be a way to note that you have listened and don't want to play the song again (if there isn't... hopefully they have that already). However that would be easily defeated by the same artist posting the same or very similar content multiple times (and a block artist option wouldn't avoid the same artist posting under multiple accounts, which happens on Soundcloud). I think any manditory payment on the first listen is going to restrict the type of content that can appear on that platform and make it not the same kind of place as Soundcloud.
This is a problem in other content areas as well where money goes to those with the most appealing advertising almost independent of content quality. Well, it can be an major issue with anything people pay money for, but it is particularly unnecessary for easily copied content.
Also, they should really make sure that you can get a FLAC when you have fully paid not just a mp3. I would not use the service for this reason alone (unless they do actually do that and are just bad at describing it). The Bandcamp model works better for me, I just wish they had better discovery options.
I wish Soundcloud had a way for listeners to pay particular artists, first covering the Soundcloud fees and then the vast majority of the rest going to the artist.
I think the difference would be in how much server space each requires. Text and images take up a lot, but still relatively little compared to audio, which is dwarfed by video at the scale that this would take. It's an interesting idea, but someone always has to pay somewhere. Maybe something like integrating Mopidy into Mastodon/GnuSocial might work and could then piggyback off the already created software, but I'd think it would be closer to a reddit clone than a twitter clone.
I find it hard to believe if faced with the choice of letting SoundClound shut down or paying $5 a month, that the SoundCloud community would not be willing to pony up $5 a month. If that is true, that is super pathetic.
the "soundcloud community" is really the 2% of users who are heavily active, involved, and attract the other 98% of users who consume the community's output.
I'm sure the "community" would happily pay for the service. but the other 98% probably would not, because they just want to consume content with the least friction. payment is friction, even a $0.05 payment.
so they follow the path of least friction and go somewhere else, some other site that is currently in the early funding rounds, providing service for free to ramp up as quickly as possible. then, in three years, their investors will demand they monetize... rinse and repeat.
The thing is, SoundCloud took so much VC money that making a modest profit is no longer an option. The investors won't back off until they get their 10x payout or SoundCloud dies trying. I hate it when this happens.
People need to stop creating awesome services, for free. That is the issue. You set the precedent, and attract people because it's free, and this is the end result. No one wants to pay for it. Netflix isn't free, look how awesome it is. People will pay for SoundCloud once you lock it down, and put a subscription fee to use it.
I don't know if that's necessarily true. Youtube is to Netflix what Soundcloud is to Spotify. Netflix and Spotify are successful because they charge a small fee to allow users to consume high quality content. Youtube and Soundcloud are both free and allow users to consume community-generated content. This is a bit of a rhetorical question, but why is Youtube so successful when Soundcloud isn't?
No. It's successful as a profitable product otherwise you wouldn't have so many content creators get paid a lot of money for creating videos. It's ad revenue sustains itself, and those that create on it quite well.
You have any numbers to support that profitability claim? YouTube wasn't profitable when Google acquired them, and it wouldn't surprise me if they still were not profitable now. I'm sure they make substantial ad revenue, and it's entirely possible they are profitable. But running servers and content creators getting paid are not proof of that - Google has more than enough money to subsidize the endeavor.
Google also seemingly hasn't been trying very hard to make Youtube profitable. Spotify has a free tier, but you only get the "standard" 160 kpbs bitrate, as well as ads. To get the "extreme" 320 kbps bitrate you need to subscribe. Youtube could have easily restricted 720p and 1080p to paying customers, but didn't. I think now it's too late for Youtube to reverse their decision on that without some backlash.
Spotify also has other restrictions on the free tier, though (for example, you have to have a premium account to run Spotify on a Fire TV Stick (or any other Amazon device AFAICT)). Google/Alphabet might be able to get away with imposing similar restrictions on certain YouTube integrations without too much backlash.
Actual YouTube-based advertising revenue is notoriously incredibly low. Most creators will ultimately make more money from Amazon affiliate links or sponsorships than Adsense. In terms of actual numbers, I've often hears that the Social Blade estimates are well above what actually ends up with creators.
Youtube not only is not profitable as far as anyone knows, but has vastly reorganized its funding model for creators and most now make pennies on the dollar from what they did before.
Youtubers themselves were screaming about this recently, and almost always with any algo/payout change, and that is pre-Youtube red renegotiations.
Humans are a very visual-oriented animal would be my best guess. Videos vs. audio on the internet is a very different animal.
I've never really used SoundCloud because the ui is confusing and haphazard and it just doesn't feel like Spotify, which I pay for. Spotify makes sure and shows you the album art etc. My recollection of SoundCloud from when I tried it in the past was some sort of waveform you clicked on to listen and visualize the music.
Soundcloud is a very different platform to Spotify though. I wouldn't pay to subscribe to Soundcloud because not all of the artists I like would be on there.
Soundcloud was more of an independent artist platform, and I think Soundcloud might have been able to get artists to pay for some services like sponsored songs, pay to let users download their tracks, artist page perks.
But it's hard to know if that would have worked. Especially in retrospect.
Radio stations still exist and they survive primarily on audio advertisements. That's also without any of the internet fingerprinting which can be used to cater advertisements and potentially make Soundcloud's advertisements more lucrative.
That sounds like the perfect setup for a peer-to-peer system like the original file sharing programs. Bring back Napster / LimeWire etc. for user-generated content!
People have money, especially $5-10 a month, I don't want to hear it. If you want to get your music out there, or you want to consume others music. Bands used to create demo tapes, and distribute them for FREE. I'm sure that costs more than $5 a month.
You can scrape together one hour of minimum wage. This is how the economy works. I'm tired of the freeloader generation ever since Napster. People need money to live, expecting everything free is nonsense.
> What's a paid service that facilitates access to unknown artists?
Other people have been mentioning Bandcamp. Seems like signing up as an artist is free, and they market themselves as a way to discover and support new music. Am I missing something, or isn't that the kind of service you're talking about?
Not the denigrate Bandcamp but I think the thing Soundcloud has that a Bandcamp-like-system doesn't have is the ability to create a "music scene" - sure, Bandcamp is helpful for artists, allowing them to sell stuff to people who are already familiar with them. The key of soundcloud afaik is being able to share a simple link to anything you've done.
That's the line of thinking that began destroying Soundcloud's image. I used to be a heavy user and stopped when they started playing ads because I knew a subscription model must be in the works. Now they've completely backpedaled and it's usable again.
SoundCloud could easily exist just by asking artists that want to host more than 5 songs a fee, or for some extra features on their profile. Just small stuff. If they would be dealing just with sound instead of sound-that-is-music.
Serving a service like SoundCloud isn't technically challenging or expensive. It's dealing with all of the legal stuff of people uploading music that's under license, people uploading songs that have uncleared samples in them and all that bullshit.
It's proabably ran by 5 engineers working on the service itself, 25 maintaining the DMCA platform and 270 lawyers.
They did that. It apparently wasn't enough. When I signed up a few years ago, I did a thing where I wrote and recorded a song a day for a month. A few days in, I had to start handing Soundcloud money for a Pro account so I could upload more songs. And when I forgot to renew in 2015, my stuff temporarily disappeared.
IDK what they do nowadays. I only release a new song every couple of months.
> SoundCloud could easily exist just by asking artists that want to host more than 5 songs a fee.
They do that. If you want to hsot mroe than a few hours of music and additional stats you need to pay $10 month. I happily do that and it's a perfectly reasonable business model in my opinion.
The problems, as you explained, started when Soundcloud tried to become a general and major label streaming service. A rather bad one compared to Spotify & Co.
It's downright silly to go after such a crowded market when you have rather little to offer.
My guess is that there are more than enough artists, labels and users who actually want to pay and use the service to deliver music to their audience and that this was a profitable niche Soundcloud occupied, but the chase for growth made them lose focus.
No! I don't create for money, I create for the sake of creation! It is a sacred act to me! No sarcasm, no joke. I acquire money in order to create more effectively, I don't create in order to gather the most money of us all.
This attitude that we must all live like neat little economic machines is seriously depressing.
Well to be fair to your take on things, you probably create out of your own pocket and with passion. Soundcloud chose to be a business when they took millions in investor funding on board.
Gah, now I wish I did. I've been meaning to start blogging for years. I had a lot of fun in a drink-n-chat site a while ago, but the environment isn't quite right for long conversations. An opportunity, I suppose...
Yeah having a tone-deaf CEO who used the company like a piggy bank and gave no direction certainly didn't help. He truly didn't understand what he had.
Glad I've had a script running for the last 6 months that has been polling + backing up my soundcloud favorites. This is stuff that, if SoundCloud went under, I would never be able to find nor listen to again. It really is depressing to think how much music culture disappears with SoundCloud.
I'm doing the same with my YouTube stuff, but not because I think it's going anywhere anytime soon.
Also, you can give it a SoundCloud user or a playlist, and it'll download it all. And if you use --download-archive, you can re-run it later and it'll only download the new songs.
I have a cron with no scripting, just the youtube-dl command, that pulls down new videos from an YouTube channel every week. It's awesome.
Seriously, when the shit hits the fan, it is data troves like this that will re-ignite culture and humanity. So many things from my youth that we highly prevalent are totally gone to the sands of time. Remembering via downloading is to internalize your own memories. Vendor your own ephemeral existence.
That's exactly it. With the internet, you have to take your memories into your own hands. Everything is ephemeral. Even if you think you're paying for it, it can disappear.
This really shows the impact of technology on culture in modern times, you can see different cultures and countries adopting different practices due to their technology (which in retrospect is how technology in history has always worked) such as Wechat in China and its payment practices to how Soundcloud influenced so much of modern day unsigned-label musicians and the Soundcloud Rap/Trap community.
Also would not want to see Soundcloud disappear, I had a brief EDM and trap phase with Soundcloud filled with vivid memories
Think the issue with most SoundCloud musicians is that they either dont have the resources to constantly make music videos or dont have enough creativity or want to study how to make viral videos on Youtube but instead need to focus on their music.
Thats true but ultimately the people on SoundCloud and Youtube are a different crowd as well, Soundcloud allows annotations and is more specifically built for music, youtube doesnt have the same features
People™ should learn about how to properly self-host their stuff, apply adequate licenses that allow for remixing, etc. If "this music culture you're a part of" really matters to you, and grows larger than the initial toe-dipping, becoming self-sufficient should be one of the main objectives of your craft. Being part of a culture should also imply caring for its heritage, should it not?
Sure, this subculture would have probably never existed without a platform to grow on. But the going-away part is actually a large scale problem, not only regarding SoundCloud. This applies to other ~corporation~ startup backed platforms as well.
I am not a professional music producer, but I do produce music as a hobby. I'm also a sysadmin, so I know full well how to self-host everything myself. But it's just such a pain it's not worth it for me. So much easier to just upload it to Soundcloud and let them worry about serving it and maintaining it.
Now, if a sysadmin like myself won't bother, I really doubt your average musician with relatively weak or non-existant sysadmin skills is going to bother self-hosting. Professional musicians might hire someone to do it for them, but most music producers aren't professional.
That said, I stopped uploading my music to Soundcloud ever since they dropped groups. That was the main way I shared my music and discovered new music myself. Soundcloud is not mostly just a static music storage service for me now, and without an easy way to discover new music, it's not even worth the bother for me to upload anything there anymore.
I'm now hunting around for a good Soundcloud replacement.
I made a thing to share an s3 bucket. The files in the dir get listed with temporary download links and I use HTML <audio> tags to get the player to work.
The current version makes you authenticate with a username and password or google login as I made this to share some songs with someone who wanted to license them from me.
I am hacking on a branch this week that will support publicly sharing a directory. If anyone wants to hack on this, I'd love it. It's pretty minimal right now but it's open source and it works, so ¯\_(ツ)_/¯
Discovery happens through unique marketing (v. v. hard) or when fans and artists collect into scenes.
So for most artists, putting up a custom server to distribute their creative work is a waste of time unless they're involved in a network of people who cross-promote their output, online and by word of mouth.
This usually works best informally when it's motivated by genuine enthusiasm and not pushy marketing narcissism and aggression.
SoundCloud failed to understand this, and apparently became a scene of sorts, in a limited way, for some genres only, by accident.
It could have assured its future by doing a lot more to build and support scenes arounds artists and genres.
Instead it became a nerd's idea of the ideal music hosting platform - too much file-led design, not enough social intelligence.
What happened to the subscription service? I tried giving them money--multiple times--and it seemed like SC would forget my subscription after a few months each time. I eventually gave up.
Sounds like an awesome use case for something like Filecoin [0] (IPFS). Move all the tracks to decentralised storage, stream with something like webtorrent [1] and research some kind of service fees via filecoin's token...
That's the difficult part. :P maybe current comments could be stored in json files and loaded with the song. New comments could update the json on IPFS:
Haha yeah... I kind of like the world writable comments file. Kind of like the original internet guestbooks with just a Name and Comments field.
I'm sure there's some blockchain based commenting thing out there... but the flat file feels so quaint. I might take a stab at this as a way to play around with IPFS.
> I'm sure there's some blockchain based commenting thing out there...
Now that you name it, I totally forgot that Steem has a pretty good commenting system, and probably they're storing the entries on-chain. So maybe the answer is adding Graphene to the mix (Filecoin + Webtorrent + Graphene 2.0 as Blockchain-based distributed DB):
We've been actively working on pushing out a new version since we heard the news about SoundCloud. In the past weeks, there has been a lot of activity and discussion over the SSB network.
Expect an announcement posted in the next day or two.
It might just be me, but as I don't think so: 'Lola' sounds super trashy and kinky to me, if I saw a link to lolashare.tld I would assume either erotica or spam. Consider searching for a more audioey name!
Seriously. When I hear "Lola" I think of either the popular song about a crossdresser, or "loli" which is anime codeword for a specific type of pornography. I don't have any good associations with the name and absolutely would not feel comfortable talking to my friends about "lolashare.com".
Lola is a popular female name in Europe and it's etymology originates from the Virgin Mary. We chose it because it's the name of our very awesome dog ( hence the dog wearing headphones logo )
Yes, agreed. If music doesn't have some copyright infringement grunginess to it, it's not for me.
Everyone knows that the best music is made by self-taught DJs and garage bands.
This already happened (probably many times over). I had success with the original mp3.com 17 years ago. They made certain business decisions that got major labels angry and various details not important, they shut down.
What matters is that tons of stuff disappeared. I learned that I can't trust these types of platforms because they are for-profit and may screw us all over or make stupid decisions. I also can't trust non-profit options if they aren't really stable. I trust Wikimedia to stick around, and archive.org and some others (although everyone should donate to keep them strong!), but other, I dunno.
Instead of fully embracing SoundCloud, I've basically stayed distrusting and my creative publishing actually suffered a lot (although my concerns are part of what led me into understanding free culture, free software, etc. and why I'm aware of Hacker News now etc)
Like the few on here who remember how great mp3.com was, I too lament the loss of its huge array of excellent indy music. Hopefully the archive will be fully restored some day[0,1,2]. Digital antiquities indeed.
Take warning: download and archive a copy of every digital asset you care about. I highly recommend the excellent utility youtube-dl[3]. I rely on it daily for copying obscure youtube videos that could disappear at any moment. Fool me twice...
Does it really need to be $10-15/month, per the example though? I mean would $12-15/year be sufficient? I don't know what their staff overhead is though, it sounds like they have a lot or people on staff.
215 comments
[ 3.1 ms ] story [ 250 ms ] threadNB: Not shitting on Bandcamp, it's great and I use it.
There's plenty of reason... now said transition could be more costly than the buyout though.
https://www.theverge.com/2017/7/17/15986952/archive-team-bac...
Consider donating to the Internet Archive.
> Archive Team plans large scale backing up of Soundcloud soon, but seriously, please donate money to the Archive. http://Archive.org/donate
https://twitter.com/textfiles/status/885665255266955264
Edit: my info is dated. Archive Team backed off. Smoke if you've got 'em.
https://www.reddit.com/r/DataHoarder/comments/6oi6fd/xpost_r...
https://www.reddit.com/r/DataHoarder/comments/6n1pap/soundcl...
Edit: I was mixed up. I was thinking of what it would cost SoundCloud to transfer all that music. I guess storing it would be much cheaper...
If you directly run traffic agreements with ISPs, and peer directly, you can get below half of that.
Where are you getting those moon prices? AWS? GCP? Never use their prices to get a fair estimate, AWS and GCP's prices are orders of magnitudes off from a fair price. Unless you're in Silicon Valley, running systems yourself at a traditional datacenter will always end up cheaper. (The issue behind that being that Amazon and Google have to pay far higher wages than you, and you can cut out a middleman)
Still, it's quite impressive to be able to manage that much data.
That said, if they pay the rates you mentioned, then it's no wonder the company fell apart.
Edit: I think you could even rent at a datacenter that peers with amazon, hook your server with the files up to a VPC via ipsec, then move files to s3 or glacier via a server in the VPC. Not sure if you could avoid the PUT costs, but you would avoid amazon bandwidth charges with the peering, I think (not 100% sure).
WD 10TB Gold drives on newegg are $414 * 90 = 37260, now you want at least a 25% raid redundancy... $46575... now, you need how many U of space to store all those drives? It's not just something you can throw in a 1U host. Even if you can get 125 drives in servers 12 at a time, you still need at least a 3U * 10, 30U, so that's a pretty expensive hosting proposition, beyond the $50K for drives alone
Tapes are also more reliable than HDDs for long-term archival storage.
[1] https://www.supermicro.com/products/system/4U/6048/SSG-6048R... [2] https://aws.amazon.com/solutions/case-studies/soundcloud/
Then you'd hope someone came along with a big chunk of AWS credits to use snowball to migrate your bucket(s) of data to the Internet Archive when they could safely accept said data.
Also, I was thinking that gsuite would be the cheapest option since it has "unlimited" storage.
Since incoming traffic is free and outgoing traffic to other Google services is free, bandwidth costs would be minimal (just the size of the requests, not the responses).
By honoring SC's request Archive Team has allowed the indie Library of Alexandria to burn...
That's what pisses me off about VC. Everything's a fucking product...
https://en.m.wikipedia.org/wiki/Blender_(software)
The most egregious example to me was when Madlib released a remix of a Kanye West song that he had produced and it was taken down for copyright by UMG (a shareholder in Soundcloud). That's when I knew the sun had set on Soundcloud as the open creative community it had started as.
https://news.ycombinator.com/item?id=12990346
There are still people interested in archiving in #soundbutt on EFNet but no plan as there is no place to store all the data. :(
I continue to be interested in helping with these efforts but multiple petabytes of online storage is not trivial ...
[1] http://www.billboard.com/articles/news/dance/7866215/deadmau...
> "I could turn [it] around... But why..."
Looks like he's got everything figured out... except for the business side of things.
I've starting paying for stuff like music services, apps and newspapers just to try to keep stuff alive. I realized I would happily pay $500 for a phone but never wanted to pay for a $2 app.
There is so much sh*tty content out there I'm actually enjoying having ad free access to a lot of good stuff. I still dont really like paying but if I dont no one will. I think I'll start paying $5/mo for soundcloud too.
But definitely agreed on the ability to hold state on the song you're currently listening to.
Overall I think that to an extent you can't just expect that most people will pay for something that would otherwise be free, or has been free for a long time. You end up gaining a bunch of users from the "lower pool" that will only be there as long as it's a free ride. But a certain class of users will pay for something if you ask for it, because it has made their life better in some way, and they want to ensure it continues in the future. There's an interesting parallel here to Craigslist / Kijiji, where most seasoned users will put a price on items they just want to get rid of. They do this because a very large portion of troublesome users who troll around for free stuff will outright ignore the posting. This actually makes it easier to get rid of things, because you don't have to deal with fielding fifty calls of people who might pick it up but then never show, or who just call you to ask if you have anything else for free that can go with it (and subsequently waste your time from giving unwanted items to people who will actually, you know, come get them from you).
It does make you wonder if the idea of a buffet-style, everything-is-free-forever ends up tainting the user pool, especially with regards to sites / applications that deal with art / multimedia. Sure, there's piracy out there, but companies like soundcloud don't really have the corporate backing behind them to scale infinitely for more users. Maybe from the outset they should have charged a $5 yearly membership or something. They may have had less users, but at least then they'd have something. Or perhaps I just don't understand their business model. Who knows?
D: Not affiliated with them.
I'm liking what I'm seeing so far on http://resonate.is and am hopeful that those lessons will finally be learned.
While I don't know for sure, I suspect that on Soundcloud I listen to part of multiple thousands of songs a month that I dislike and don't want to support. Some of these I don't want to spend money on but for a sufficiently low to me price I wouldn't care and some of which I actively want to not pay any amount for.
IMO first play should be free until you indicate that you like the song. There should also be a way to note that you have listened and don't want to play the song again (if there isn't... hopefully they have that already). However that would be easily defeated by the same artist posting the same or very similar content multiple times (and a block artist option wouldn't avoid the same artist posting under multiple accounts, which happens on Soundcloud). I think any manditory payment on the first listen is going to restrict the type of content that can appear on that platform and make it not the same kind of place as Soundcloud.
This is a problem in other content areas as well where money goes to those with the most appealing advertising almost independent of content quality. Well, it can be an major issue with anything people pay money for, but it is particularly unnecessary for easily copied content.
Also, they should really make sure that you can get a FLAC when you have fully paid not just a mp3. I would not use the service for this reason alone (unless they do actually do that and are just bad at describing it). The Bandcamp model works better for me, I just wish they had better discovery options.
I wish Soundcloud had a way for listeners to pay particular artists, first covering the Soundcloud fees and then the vast majority of the rest going to the artist.
I'm sure the "community" would happily pay for the service. but the other 98% probably would not, because they just want to consume content with the least friction. payment is friction, even a $0.05 payment.
so they follow the path of least friction and go somewhere else, some other site that is currently in the early funding rounds, providing service for free to ramp up as quickly as possible. then, in three years, their investors will demand they monetize... rinse and repeat.
Youtubers themselves were screaming about this recently, and almost always with any algo/payout change, and that is pre-Youtube red renegotiations.
I've never really used SoundCloud because the ui is confusing and haphazard and it just doesn't feel like Spotify, which I pay for. Spotify makes sure and shows you the album art etc. My recollection of SoundCloud from when I tried it in the past was some sort of waveform you clicked on to listen and visualize the music.
Soundcloud was more of an independent artist platform, and I think Soundcloud might have been able to get artists to pay for some services like sponsored songs, pay to let users download their tracks, artist page perks.
But it's hard to know if that would have worked. Especially in retrospect.
(1) Video content engages a wider audience and commands more focus than audio content
(2) Video advertisements dropped into video content are more effective than audio advertisements.
But that's a guess with no empirical base.
You can scrape together one hour of minimum wage. This is how the economy works. I'm tired of the freeloader generation ever since Napster. People need money to live, expecting everything free is nonsense.
The creation of new music has always involved exposing penniless people to it and no current music subscription service comes remotely close to that.
One alternative might be integrating peer-to-peer with a music discovery system.
Edit: craigslist and meetup are closest thing to "mass culture websites" and they each get a small minority of users to pay for their operations.
Other people have been mentioning Bandcamp. Seems like signing up as an artist is free, and they market themselves as a way to discover and support new music. Am I missing something, or isn't that the kind of service you're talking about?
Serving a service like SoundCloud isn't technically challenging or expensive. It's dealing with all of the legal stuff of people uploading music that's under license, people uploading songs that have uncleared samples in them and all that bullshit.
It's proabably ran by 5 engineers working on the service itself, 25 maintaining the DMCA platform and 270 lawyers.
IDK what they do nowadays. I only release a new song every couple of months.
(shameless plug: soundcloud.com/bphogan)
They do that. If you want to hsot mroe than a few hours of music and additional stats you need to pay $10 month. I happily do that and it's a perfectly reasonable business model in my opinion. The problems, as you explained, started when Soundcloud tried to become a general and major label streaming service. A rather bad one compared to Spotify & Co. It's downright silly to go after such a crowded market when you have rather little to offer.
My guess is that there are more than enough artists, labels and users who actually want to pay and use the service to deliver music to their audience and that this was a profitable niche Soundcloud occupied, but the chase for growth made them lose focus.
This attitude that we must all live like neat little economic machines is seriously depressing.
YouTube is also making zero money, so if that is what they were trying to be, they've succeeded. Difference is, they don't have Google backing them.
https://www.buzzfeed.com/ryanmac/inside-the-storm-at-soundcl...
I'm doing the same with my YouTube stuff, but not because I think it's going anywhere anytime soon.
I used this one to download all of my soundcloud likes and some tracks/likes of other users, was pretty fast/painless
Also, you can give it a SoundCloud user or a playlist, and it'll download it all. And if you use --download-archive, you can re-run it later and it'll only download the new songs.
I have a cron with no scripting, just the youtube-dl command, that pulls down new videos from an YouTube channel every week. It's awesome.
Can you share who your soundcloud favorites are ?
Also would not want to see Soundcloud disappear, I had a brief EDM and trap phase with Soundcloud filled with vivid memories
Personally I've been working slowly on an self-hosted Tumblr clone, but that doesn't have the concept of albums.
Sure, this subculture would have probably never existed without a platform to grow on. But the going-away part is actually a large scale problem, not only regarding SoundCloud. This applies to other ~corporation~ startup backed platforms as well.
Now, if a sysadmin like myself won't bother, I really doubt your average musician with relatively weak or non-existant sysadmin skills is going to bother self-hosting. Professional musicians might hire someone to do it for them, but most music producers aren't professional.
That said, I stopped uploading my music to Soundcloud ever since they dropped groups. That was the main way I shared my music and discovered new music myself. Soundcloud is not mostly just a static music storage service for me now, and without an easy way to discover new music, it's not even worth the bother for me to upload anything there anymore.
I'm now hunting around for a good Soundcloud replacement.
The current version makes you authenticate with a username and password or google login as I made this to share some songs with someone who wanted to license them from me.
https://github.com/napcs/s3server
I am hacking on a branch this week that will support publicly sharing a directory. If anyone wants to hack on this, I'd love it. It's pretty minimal right now but it's open source and it works, so ¯\_(ツ)_/¯
You could probably even do it with Jekyll and S3 (or similar) if you really wanted.
Discovery happens through unique marketing (v. v. hard) or when fans and artists collect into scenes.
So for most artists, putting up a custom server to distribute their creative work is a waste of time unless they're involved in a network of people who cross-promote their output, online and by word of mouth.
This usually works best informally when it's motivated by genuine enthusiasm and not pushy marketing narcissism and aggression.
SoundCloud failed to understand this, and apparently became a scene of sorts, in a limited way, for some genres only, by accident.
It could have assured its future by doing a lot more to build and support scenes arounds artists and genres.
Instead it became a nerd's idea of the ideal music hosting platform - too much file-led design, not enough social intelligence.
[0] https://filecoin.io/
[1] https://webtorrent.io/
https://flyingzumwalt.github.io/ipfs-tutorials/curriculum/fi...
It's possible but far from efficient. Those are the pain points where decentralisation doesn't really cut it.
I'm sure there's some blockchain based commenting thing out there... but the flat file feels so quaint. I might take a stab at this as a way to play around with IPFS.
Now that you name it, I totally forgot that Steem has a pretty good commenting system, and probably they're storing the entries on-chain. So maybe the answer is adding Graphene to the mix (Filecoin + Webtorrent + Graphene 2.0 as Blockchain-based distributed DB):
https://steemit.com/steem/@steemitblog/steem-developer-updat...
[0] https://github.com/LolaShare/LolaShare
Expect an announcement posted in the next day or two.
https://en.wikipedia.org/wiki/Lola_(given_name)
What matters is that tons of stuff disappeared. I learned that I can't trust these types of platforms because they are for-profit and may screw us all over or make stupid decisions. I also can't trust non-profit options if they aren't really stable. I trust Wikimedia to stick around, and archive.org and some others (although everyone should donate to keep them strong!), but other, I dunno.
Instead of fully embracing SoundCloud, I've basically stayed distrusting and my creative publishing actually suffered a lot (although my concerns are part of what led me into understanding free culture, free software, etc. and why I'm aware of Hacker News now etc)
Take warning: download and archive a copy of every digital asset you care about. I highly recommend the excellent utility youtube-dl[3]. I rely on it daily for copying obscure youtube videos that could disappear at any moment. Fool me twice...
[0] https://www.theregister.co.uk/2003/12/03/mp3_com_archive_is_...
[1] https://entertainment.slashdot.org/story/04/04/19/2318226/mp...
[2] https://archive.org/post/1004359/mp3com-archive
[3] https://rg3.github.io/youtube-dl/
https://en.wikipedia.org/wiki/Digital_dark_age