That was an absolutely hilarious "demo." I know it was for real but it was still the sort of thing that makes you just shake your head and laugh. I don't want to be the one paying the S3 bill afterwards though :-)
Fun, old school massive data transfer as a service. For those of you too lazy to do the math, filling up one of these trucks to capacity (100PB) would run your 500,000 USD per month, ~17k per day (purely for transit).
Edit: I assume that you'd only get charged for the time your vehicle is in transit, though the pricing info doesn't make that super clear. Also, as pointed out, list rates may differ from bulk rates.
I guess anything media related is way bigger. I thought of media archives of TV stations, but those are (if digital already) cold storage with only a low-res preview live.
Any retail chain has that scale of data in surveillance tapes. Order of few mb/s * 10's of cameras per location * 100's of locations * 1000's of seconds per day * 100's of days per year => order of 10^15 bytes per year. So far it hasn't been economical to collect and analyze these tapes. But it is approaching feasibility, and AI is reaching the point it could give useful output on that massive input. Patterns of how shoppers interact with merchandise. What can you change to sell a few percent more items?
Those names assume a decent amount of technical understanding. A lot of times the people who will end up paying big bucks for these services don't know what transactional E-mail is, so calling it SES or Amazon Transaction E-mail wouldn't make a difference. So, they go with a "cool" name.
It's such a rarely needed service that I can't imagine naming it AWS Data Center Mover would make any difference at all in terms of usage. The number of customers who could make use of this thing is tiny, it doesn't matter what it is called.
I started reading this thinking it was joke, I was very surprised when i realised its a real service. amazing. What kind of applications use so much data and are at the same time for them its cost effective to move them to the cloud?
Oh, no no, I agree with you. Just like Backblaze built their own solution because all other cloud providers were stupid expensive in comparison.
But if you're a CTO or CIO who just wants to shovel the responsibility to someone else, its a solid product at AWS. They're the new "No one got fired for buying X".
Will they let you snowmobile your data back out if you want to switch to another cloud provider later? Or is it a one way street, and you pay thru the nose if you want to load your exabytes back out?
As he says in the talk this truck is for 100 Pb, you'd need 10 of them for the aforementioned Exabyte (Eb); which I imagine would nicely equate to a train.
If this data is valuable though wouldn't it need to be securely transported; Mad Max: Fury Road springs to mind...
Increasingly the film Johnny Mnemonic is becoming more and more preposterous; it was 320 Gb in the film. I think the book was 320Mb.
38 comments
[ 2.4 ms ] story [ 88.8 ms ] threadhttps://en.wikiquote.org/wiki/Andrew_S._Tanenbaum
[0] https://en.wikipedia.org/wiki/Snow_Crash
Edit: I assume that you'd only get charged for the time your vehicle is in transit, though the pricing info doesn't make that super clear. Also, as pointed out, list rates may differ from bulk rates.
According to FAQ, billing starts when it leaves AWS DC and ends after data ingestion is complete.
So roughly minimum (list) price (1 day transit one-way) for transferring that 100PB would roughly be: (100PB/1Tbps * 2 + 2 days) * (($0.005/GB * 100PB)/month) ~= 337k. ~$0.00337/GB
I mean - I totally believe there are people that do have that much, I just don't know who they are.
Fake Edit: Film?
https://aws.amazon.com/blogs/aws/aws-snowmobile-move-exabyte...
I guess anything media related is way bigger. I thought of media archives of TV stations, but those are (if digital already) cold storage with only a low-res preview live.
But if you're a CTO or CIO who just wants to shovel the responsibility to someone else, its a solid product at AWS. They're the new "No one got fired for buying X".
They just specifically asked for money to help establish a second copy in Canada.[1]
It would be great publicity for AWS among a demographic not far from their target... AND it would probably benefit AWS itself in some way eventually.
1: https://blog.archive.org/2016/11/29/help-us-keep-the-archive...
EDIT: "a few"?? One trip?
Wow.
If this data is valuable though wouldn't it need to be securely transported; Mad Max: Fury Road springs to mind...
Increasingly the film Johnny Mnemonic is becoming more and more preposterous; it was 320 Gb in the film. I think the book was 320Mb.