This seems more about capacity planning your application when running in the cloud.
I was hoping for some insight when you're hosting your own private cloud, that seems quite a bit more tricky. It's easy to prepare to scale up/down your deployment when all the hardware is already there, but when you're the one running the actual cloud and need to do the same, you can't just do an API call and suddenly have another 100 U of servers and switches racked, cabled and provisioned.
So Nutanix and hypergrid are trying to address this, though I’m not sure how well they succeed, but the payment model of hypergrid is enticing: they deploy a cluster for you, and you only pay for what you use, so if you want to have flex scaling you can do that... I’d really look at their offering if you’re looking for a solution for on prem elasticity with a lower cost to enter...
I am not associated with either of these companies in anyway other than looking for a solution to the same problem you mentioned.
Well if you want to service huge spikes you can run a hybrid env. with on prem. handling base load and cloud absorbing spikes or you have to bite the bullet and overprovision on prem/private cloud based on you specific business req.
> Perhaps surprisingly for engineers who work in mission-critical business applications, occasional spikes of 90%+ of our users being entirely unable to use the sole application of our company was an entirely acceptable engineering tradeoff versus sizing our capacity against our peak loads.
Yeah, agreed - but that paragraph was worded in such a way as to convey "screw the users for spiking use, such that the application is now unavailable, and now ALL business halts..." -- Or did I misinterpret that?
The thinking is probably that if usage spikes and some people can't get access to the game and they know that this is because of spiking usage, then this just builds buzz and demand -- like hip restaurants with visible queues.
So in this case the business demand on the engineers was presumably to make sure that 10% of users get good service during the spike while the others are gracefully shown a "Sorry we are too busy right now " message.
Whether or not this is evil depends on the pricing model and other factors that determine whether those bounced user had a reasonable expectation of service.
Depends what happens as to whether it's a problem or not.
Maybe it fails to handle the load, the users get a "failure to authenticate" message or similar, and they try again. If their peaks are really sharp and short, that's probably just fine, because that second attempt almost invariably works.
I just read it as "the compute required to reach 100% uptime would cost more per minute than we lose per minute that we can't access the app." I.e., an entirely business-wise consideration, even if phrased in terms of engineering tradeoffs.
I think you're parsing that statement wrong: he's saying that engineers who are used to building mission-critical apps would likely be surprised about how acceptable downtime was for their non-mission-critical app (a game).
COMPOSITE HACKS
• If Truly you Are In Need Of A PROFESSIONAL LEGIT HACKER Who Will Get Your Job Done Efficiently With Swift Response, Congratulations, You Have Met the Right HACKERS
We are a group Of Professional HACKERS , a product of the coming together of Legit Hackers from the Dark-Web, (pentaguard ,CyberBerkut , RedHack , Black Hat, Anonymous ) we have been existing for over 12 years, our system is a very loose and decentralized command structure that operates on ideas rather than directives. you can also find us on the dark web at :http://my7cic3ax7oznkvu.onion (Tor Only)
Frankly speaking, I always give a 100% guarantee on any job i am been asked to do, because we have always been successful in Almost all our jobs for over 12years and our clients can testify to that . To hack anything needs time though, but we can provide a swift response to your job depending on how fast and urgent you need. Time also depends on what exactly you want to hack and how serious you are. Enough time with social engineering is required for hacking. So if you want to bind us in a short time, then just don't contact us because We can't hack within one hour,sorry. Basically, time depends on your luck. If its good luck, then it is possible to hack within one hour but, if its in the other way round, it would take few hours. I have seen FAKE HACKERS claiming they can hack in 1hr , but there is no REAL HACKER who can say this (AVOID THEM).
Please Note : we have only one contact email : compositehacks@gmail.com we will be happy to have you join over 2000 satisfied clients around the world to use our services. We provide prove of job before payment We offer services like:
Hacking Whatsapp account giving you access to the person's whatsapp messages and history .
You can check out our Latest Whatsapp Hack video https://www.youtube.com/watch?v=7_LtFUVMcxY
Initiating Bank Wire Transfers at a resonable fee and completely untracable .
Hacking any smart phone giving you access to all activities on the phone like , text messages , call logs , instant messenger chats and other information.(you can use this to spy on your spouse to know if he/she is cheating on you)
Hacking Facebook , Instagram , Twitter and every other social network Accounts.
Hacking Websites to deface , retrive information, edit information or give you admin access .
Hacking into school's websites (server) to change grades without any trace . .
Hacking any email service provider like Gmail , Yahoo, Comcast , Aol , Hotmail any others .
Location Tracking.
Hacking and selling credit cards , amazon , walmart , paypal , bank logs .
Selling of untracable phones (even the pentagon can not track our phones). .
Selling of Tutorial packs for Beginner Ethical Hackers
You can also contact us for other Cyber Attacks And Hijackings, we do almost All.
Contact us: compositehacks@gmail.com
If you are a small startup and do not have strict regulatory or other special req. run on something simple like DO, Vultr etc. and save yourself pain and $.
How do you work on Digital Ocean or some other cloud without VPC? I haven't been able to figure this out. Sure, if I just have 1 or maybe 2 servers it's fine. More than that what are you doing? Mesh networking like ZeroTier? iptables on every machine? It just seems like a lot more work than setting up a VPC.
Not to say it's as robust a strategy as a VPC, but DO does have something called a cloud firewall. It supports the idea of tags that apply to groups of servers.
The problem on DO is not outside tradfic but insode. when you enable networking everyone in the same DC network can access open ports on your machines. That elastixsearxh or redis you use needs ssl and pw protection otherwise you have a big problem
You can configure the cloud firewall so that only VMs in your account with a certain tag can communicate, even over the internal network.
Public network + firewall feels dirtier than private network, but in reality they are the same thing: a network that’s only accessible to your VMs, to the extent that you trust the provider’s software to enforce that boundary.
Going serverless would increase your costs significantly. Have you seen how much AWS charges for Lambda use? Where did this myth of serverless saving you money come from?
Going from autoscaling in EC2 (with a mix or RI for baseline load and spots for peak) to Lambdas has cut our service costs down by half. This is largely due to better utilization rates.
I keep hearing this from people who don’t say they’ve built out Serverless stacks. But I keep hearing from people who switched that they’ve been able to cut costs. So in my limited experience this has so far proven not to be true in practice.
I think that you still need capacity planning for "serverless" architectures as well. You need to forecast growth of usage and costs for accounting and budgeting purposes. Does your serverless usage scale linearly with new customers? Or new widgets on the platform? Great, if we're planning on adding 10,000 widgets to the platform next quarter how much will our serverless bill go up? We still need to think about these things.
Also, and this may be my lack of experience, there seems to still be a big requirement for more traditional cloud hosting for databases in a serverless architecture. You have to store that state somewhere.
For general compute yes. But you still need to scale your persistent data stores. That is why AWS is investing in things like Aurora. Also you need to understand where to optimize on a cost basis by not just profiling code, but comparing costs, to usage, to performance gains in reduced resources needed.
35 comments
[ 0.26 ms ] story [ 92.3 ms ] threadI was hoping for some insight when you're hosting your own private cloud, that seems quite a bit more tricky. It's easy to prepare to scale up/down your deployment when all the hardware is already there, but when you're the one running the actual cloud and need to do the same, you can't just do an API call and suddenly have another 100 U of servers and switches racked, cabled and provisioned.
Still a nice article though!
I am not associated with either of these companies in anyway other than looking for a solution to the same problem you mentioned.
I think we found the Pokemon Go engineering team.
That paragraph reads to me “screw the users!” - and for them to say that around “mission critical” seems they don’t understand the critical mission...
The business constraints often include cost. They also may be arbitrarily far from 100% uptime.
So in this case the business demand on the engineers was presumably to make sure that 10% of users get good service during the spike while the others are gracefully shown a "Sorry we are too busy right now " message.
Whether or not this is evil depends on the pricing model and other factors that determine whether those bounced user had a reasonable expectation of service.
Maybe it fails to handle the load, the users get a "failure to authenticate" message or similar, and they try again. If their peaks are really sharp and short, that's probably just fine, because that second attempt almost invariably works.
https://www.digitalocean.com/community/tutorials/an-introduc...
Public network + firewall feels dirtier than private network, but in reality they are the same thing: a network that’s only accessible to your VMs, to the extent that you trust the provider’s software to enforce that boundary.
[1] http://tinc-vpn.org
Also, and this may be my lack of experience, there seems to still be a big requirement for more traditional cloud hosting for databases in a serverless architecture. You have to store that state somewhere.
Serverless is more server and its funny.