Mine as well. I understand that Slack is widely used and I appreciate seeing their post-mortems discussed on HN but I don't consider image uploads issues with no technical explanations news-worthy and valuable enough for HN.
A service might be unavailable due to an intentional downtime for maintenance. This is often hidden by various redundancies but certain bottlenecks may remain.
You can announce downtime for a certain capacity of a service ahead of time. Which is essentially planned maintenance with some capacity hit, but when it's unplanned it's called disruption. Also, generally disruptions come with a bigger capacity loss, even if you don't lose the service outright.
These terms are not limited to cloud infrastructures and not new either. Computation clusters use these terms for at least 12-13 years (from my experience) or for even longer.
99.9% uptime is still more than 40 minutes downtime per month. According to their status page they are at 99.93% uptime for the current quarter even with the current incident.
Uptime has nothing to do with anything in the real world. It's a number you put in an SLA of how much downtime is acceptable before they start paying you back money. And 99.9% still means 43 minutes of downtime every month. And even after that it's a calculation of risk. What does full redundancy cost vs paying back the fees for a say 24 hours of downtime? A lot of the time paying back money is way way cheaper then actually investing in technical redundancy.
Well, I wouldn't use such a clone. When Slack is down, I actually feel relieved. I know I can turn off Slack any time I want, but the reality is that companies expect one to be online all the time (except during breaks of course) in regular working hours. I try to keep Slack as an async communication tool, but stakeholders just don't care about that. Also, I have a bunch of channels I cannot mute, so there is always something going on on such channels (which brings anxiety and discomfort).
So, when Slack is down, it's actually a nice "everybody is offline: either take some time off or work focused on whatever you need to work on"... which is a nice thing to experience from time to time during regular business hours.
You could break that expectation. I personally turn off notifications except for @-ing my name or @channel, and check DMs hourly. It has not been a problem, well, people don't DM me as much because I don't reply. Half the time they figure out the answer by themselves anyway.
Ideally you could discuss that the notifications are making you anxious and less productive and your employee could accommodate that. If your employer is not interested in helping you become more productive then maybe look somewhere else? You don't have to settle. Your mental health is paramount.
Reading people's experiences in their companies makes me feel a) sad that there's so many people that have to endure this kind of work environment, b) so fortunate that I can't identify myself with any of this.
If I text someone and they reply within a day, that's fine to me, and it's fine to any of my colleagues. If it takes more than a day, I'll ping them again, and everyone can still chill.
Actually a clone wouldn't help much, because Slack itself is not really that great, even when it is up. There are better alternatives, which do not cause high CPU load every time one switches a channel, render Markdown properly (seriously, what is it with all the "enterprise service providers" being unable to use a decent markdown parser!?) and have have better integration with other open source tools.
What I really wish is some glue layer kind of service that will sync slack with email or teams or something like that so I can do without any one service.
I'm a bit baffled that a company with a communication tool like Slack does not communicate about these incidents _through_ slack itself. Why can't there be a little service notification somewhere in the screen? I know it wouldn't help much when the entire service is down, but when parts fail won't it be helpful to at least indicate this to the user?
Or might that be due to potential negative brand marketing that springs into existence when users see such a notice inside their application?
When Slack is down, Slack can't tell you when it is down. It's why status pages are often on other domains/systems etc, so the status page remains up while everything else is on fire.
While it of course won't work in every case, in this case Slack wasn't down, you just couldn't attach files in some situations. This is something Slack easily could have communicated as soon as you tried to attach a file. Now it look like it worked and then times out after a couple of minutes and deleted your message
If it's on a different domain and servers, I don't think it will be an issue.
If they have it on an API call to (making it up) api.slack.com/status it might very well go down when things go wrong, making it useless.
However if they physically host it elsewhere ideally on a different cloud provider, with a different domain, say, slackstatus.com/api-status that is completely separate from the actual services, which can both query the actual service with a call from outside and can be updated manually with physical persons at Slack, and the client checks that domain, I think it can work.
But in this case Slack was not down. Parts of the service were frustratingly lagging, like uploading a picture or using reactions. Circle CI does have this sort of warning on their sidebar. There's so many parts to a big software product that it would definitely useful to know if some part of it was having issues.
It makes perfect sense from a user perspective but I suspect the company isn't interested in making mere users aware of ongoing issues via the service itself.
Documenting on a webpage allows a historical record of the incident long after the incident is over. I agree that an in-app notification would also be a nice feature.
That feels like spam to me. Tell me image uploads aren't working exactly when I try to upload an image and no sooner. Or possibly keep some global in-app feature status page I can check on demand, but I don't want notifications about services and/or features I'm not currently using.
If all you want is messaging, use irc, matrix or an xmpp system. The real value of slack is all the integrations and ecosystem built on top of it. That is much harder to integrate with an arbitrary client. It could be done, they could publish "enriched messaging" standards or similar and breakout capabilities that clients could support, but just supporting vanilla messaging at this point would be a severe degradation of slack's capabilities.
I can't work out why you wouldn't develop a native app anyway - all this scaffolding in a Web UI to imitate native controls (like menus) seems completely backwards to me. Seems just lazy, but in an odd way because writing native apps isn't rocket science or difficult.
It's not like they're implementing thousands of native controls or user interface components - a listview with an edit box at the bottom...
I am a fan of native apps but I do have to admit it is nice that slack is -exactly- the same on any platform you access it from and that will continue to be the case without any effort from their developers. Different ports of native apps invariably start drifting unless lots of care is taken to make sure they don’t, and that does not happen to always be a priority for companies.
This is true and a valid use case I think. Slack has abstracted enough of their UI to be re-usable cross platform that any re-write would likely be a regression.
Look at 1Password and the amount of shit they get on HN with the beta version. Rewrites are hard and they take a tooooooon of time to do correctly and require a lot of engineering work to keep the product consistent across platforms.
Do I wish that electron apps were better optimized? Yes, however, I also can accept the tradeoff for apps that need to work "everywhere".
For the most part, Slack works just fine. Their problems are less the UI/UX and more to do with infrastructure. Slack rewriting to a native app would have a tiny (if any) effect on these outages.
> I can't work out why you wouldn't develop a native app anyway
Really? One code base, one language, write features once. I think it's more about eng resourcing (headcount, onboarding, roadmap parity / feature drift, etc) than whether making a native app is hard.
Anecdotal, but I feel like the React Natives and Electrons have made it so you see less "Sorry we're only on Mac", and "We're only on Android, iOS coming soon!" from apps
There's the problem, nobody's sorry for offering only these static 100MB chat clients taking 2GB+ of RAM once launched. These apps are technically ridiculous, especially since all they do is embed a website. I mean, if all your company's willing to deliver is website, why even bother with the apps... But that's all fine right? We'll just upgrade to 64GB and 128GB machines soon!
We are seeing a bit of a backlash nowadays to "SPA everything // webdevs will save the world" naive techno-utopianism. Turns out that nail actually has some funny curves and the hammer isn't enough!
If you're a JS developer and don't know (or enjoy) other languages, the most lucrative choice is to keep using JS and advocating for it whenever possible.
If they've already got many JS developers onboard, it's normal that their opinion will be biased and they wouldn't want to switch to another language and essentially make their own job obsolete (except for the minority that also happens to be equally-proficient in whatever desktop programming language is chosen).
I've been working at web-based startups for over 10 years now, and I know VERY few devs who only know JS. Most are also proficient (or at least have working knowledge of) whatever other languages we're using. Usually JVM-based like Java, Kotlin, Scala or something else like Ruby or Elixir.
Everywhere I've been, we always "choose the right tool for the job". Recently, making apps that can run across every OS and in the browser, the right tool for the job has been JS (well, TypeScript these days, but same thing).
> It's not like they're implementing thousands of native controls or user interface components
This is not true in any way. Slack also have workspaces, channels, notifications, video calls, file sharing, admin tools and probably even more features. It's not just IRC.
Maybe writing a web-based app is lazy... except when you have to write native apps for macOS, Windows, Linux, Android, and iOS, and some people still need access via a browser. And each one has different ways of displaying images and videos and doing calls and handling file access. Now you have 5+ apps that you're maintaining, each with their own dedicated team since each one is unique. Want to roll out a new feature? Cool, now you have to write it 5 times across 5 teams. Good look coordinating that.
I know there are technologies that let you share code across all of the different native clients. But a webview wrapped in i.e. Electron handles most of it for you! Why would you do it any other way except to appease people who complain about bloat?
This is a bad argument that is factually incorrect in some ways.
Slack already has three different clients - a web one (which includes the Electron desktop wrappers), one for Android, and one for iOS.
They've already demonstrated that they have the engineering resources and coordination to develop and maintain three completely separate clients (albeit poorly) - so adding a fourth one (native C++ codebase using Qt that would work well on Windows, Mac, and Linux) would not be the Herculean engineering effort required to go from one to five, and your implicit assertions that (1) they currently only have a single client and (2) that a different client would be required for each of Windows, macOS, and Linux are simply false.
> But a webview wrapped in i.e. Electron handles most of it for you! Why would you do it any other way except to appease people who complain about bloat?
Because (1) performance (2) accessibility and (3) stability - the things that users actually need. Slack's performance is extremely bad and you get people constantly complaining about it; their accessibility is janky and suboptimal because they're reinventing desktop UI controls on the web; and their applications have repeatedly broken (such as the disastrous input box rewrite[1]) because they're trying to do things with the web platform that it wasn't meant to do. (in case you're wondering how using a desktop client would help - you expose a "lite" version of your functionality in the web application and put the full functionality in the desktop tool)
You're using "appease" as marketing-speak for "fix the very real problems with their web application that people constantly complain about". Slack should fix their application because it isn't serving the users well. Performance problems are functionality problems.
As it stands, Slack is showing us that they aren't even pretending to care about their users - they're just trying to make a buck selling to large organizations.
It’s also important to remember that writing native apps doesn’t inherently inherently give you a big performance boost. With the type of app Slack has, I would expect the default implementation in a native app to be pretty slow as well. You’d have to do a significant amount of further optimization to make it competitive, imo. And to be honest, I imagine if someone applied that same amount of optimization and effort to the electron app, they could make the performance much better there as well.
Slack: the best tool for the job! (when the job is firing off gifs and rocket ship emojis to your coworkers instead of whatever it is that keeps the lights on at your company).
It's still a good solution for downtime issues, since at the very least you can schedule your own server's maintenance at a time when nobody will be impacted if it goes wrong.
I know a bunch of SaaS and other services have been hit, but at this is like the 3rd major slack outage this month. And typically my colleagues and I need to search third party sites to get any notification of what’s happening.
I like the idea of Matrix, but - can you get simple, thin, GUI clients for it like you have for IRC? IIRC, most GUI clients for it feel like something running inside my web browser...
Seems to be more on the "glossy" and "web client" end of the spectrum in general but probably there is some reasonable compromise to be reached from the proliferation of different clients.
I haven't had much occasion to use it (I dipped into a gaming group that used Matrix but quickly fell out of it) but https://github.com/poljar/weechat-matrix seems mostly adequate if you are a weechat user and just need the text chat features. Feels just like IRC.
95 comments
[ 2.0 ms ] story [ 153 ms ] threadHave you read the status entry? Among other things, calls is also affected.
These terms are not limited to cloud infrastructures and not new either. Computation clusters use these terms for at least 12-13 years (from my experience) or for even longer.
Multiply that out by 1000s of providers.
We deal with issues because something is screwed up with their APIs badly enough that service is degraded all the time.
I think it’s going to be the new normal
Could you be more specific? — "An incident at Slack"
Could you be more specific? — "An outage at Slack"
Could you be more specific? — "..."
Would rather see something more specific:
"File Upload & Emoji Service Degradation at Slack" ( — insert emoji memes ).
Arguably, title is a bit misleading whether it warrants front page news for this community.
Big companies could pay monthly for "slack redundancy" from a third party.
So, when Slack is down, it's actually a nice "everybody is offline: either take some time off or work focused on whatever you need to work on"... which is a nice thing to experience from time to time during regular business hours.
Ideally you could discuss that the notifications are making you anxious and less productive and your employee could accommodate that. If your employer is not interested in helping you become more productive then maybe look somewhere else? You don't have to settle. Your mental health is paramount.
If I text someone and they reply within a day, that's fine to me, and it's fine to any of my colleagues. If it takes more than a day, I'll ping them again, and everyone can still chill.
Or might that be due to potential negative brand marketing that springs into existence when users see such a notice inside their application?
When Slack is down, Slack can't tell you when it is down. It's why status pages are often on other domains/systems etc, so the status page remains up while everything else is on fire.
If they have it on an API call to (making it up) api.slack.com/status it might very well go down when things go wrong, making it useless.
However if they physically host it elsewhere ideally on a different cloud provider, with a different domain, say, slackstatus.com/api-status that is completely separate from the actual services, which can both query the actual service with a call from outside and can be updated manually with physical persons at Slack, and the client checks that domain, I think it can work.
It sounds more like laziness than complication to me. But that typifies Slack dev culture—“just use duct tape”
And in an absolute worst-case infra collapse, someone there could manually edit/upload a new one...
/feed subscribe https://status.slack.com/feed/rss
Like they used to.
Then it became just another crappy messaging app.
[0] https://cancel.fm/ripcord/
[0] https://twitter.com/anno0770/status/1349187069793460225
It's not like they're implementing thousands of native controls or user interface components - a listview with an edit box at the bottom...
Look at 1Password and the amount of shit they get on HN with the beta version. Rewrites are hard and they take a tooooooon of time to do correctly and require a lot of engineering work to keep the product consistent across platforms.
Do I wish that electron apps were better optimized? Yes, however, I also can accept the tradeoff for apps that need to work "everywhere".
For the most part, Slack works just fine. Their problems are less the UI/UX and more to do with infrastructure. Slack rewriting to a native app would have a tiny (if any) effect on these outages.
Really? One code base, one language, write features once. I think it's more about eng resourcing (headcount, onboarding, roadmap parity / feature drift, etc) than whether making a native app is hard.
Anecdotal, but I feel like the React Natives and Electrons have made it so you see less "Sorry we're only on Mac", and "We're only on Android, iOS coming soon!" from apps
There's the problem, nobody's sorry for offering only these static 100MB chat clients taking 2GB+ of RAM once launched. These apps are technically ridiculous, especially since all they do is embed a website. I mean, if all your company's willing to deliver is website, why even bother with the apps... But that's all fine right? We'll just upgrade to 64GB and 128GB machines soon!
If they've already got many JS developers onboard, it's normal that their opinion will be biased and they wouldn't want to switch to another language and essentially make their own job obsolete (except for the minority that also happens to be equally-proficient in whatever desktop programming language is chosen).
Everywhere I've been, we always "choose the right tool for the job". Recently, making apps that can run across every OS and in the browser, the right tool for the job has been JS (well, TypeScript these days, but same thing).
This is not true in any way. Slack also have workspaces, channels, notifications, video calls, file sharing, admin tools and probably even more features. It's not just IRC.
Maybe writing a web-based app is lazy... except when you have to write native apps for macOS, Windows, Linux, Android, and iOS, and some people still need access via a browser. And each one has different ways of displaying images and videos and doing calls and handling file access. Now you have 5+ apps that you're maintaining, each with their own dedicated team since each one is unique. Want to roll out a new feature? Cool, now you have to write it 5 times across 5 teams. Good look coordinating that.
I know there are technologies that let you share code across all of the different native clients. But a webview wrapped in i.e. Electron handles most of it for you! Why would you do it any other way except to appease people who complain about bloat?
Slack already has three different clients - a web one (which includes the Electron desktop wrappers), one for Android, and one for iOS.
They've already demonstrated that they have the engineering resources and coordination to develop and maintain three completely separate clients (albeit poorly) - so adding a fourth one (native C++ codebase using Qt that would work well on Windows, Mac, and Linux) would not be the Herculean engineering effort required to go from one to five, and your implicit assertions that (1) they currently only have a single client and (2) that a different client would be required for each of Windows, macOS, and Linux are simply false.
> But a webview wrapped in i.e. Electron handles most of it for you! Why would you do it any other way except to appease people who complain about bloat?
Because (1) performance (2) accessibility and (3) stability - the things that users actually need. Slack's performance is extremely bad and you get people constantly complaining about it; their accessibility is janky and suboptimal because they're reinventing desktop UI controls on the web; and their applications have repeatedly broken (such as the disastrous input box rewrite[1]) because they're trying to do things with the web platform that it wasn't meant to do. (in case you're wondering how using a desktop client would help - you expose a "lite" version of your functionality in the web application and put the full functionality in the desktop tool)
You're using "appease" as marketing-speak for "fix the very real problems with their web application that people constantly complain about". Slack should fix their application because it isn't serving the users well. Performance problems are functionality problems.
As it stands, Slack is showing us that they aren't even pretending to care about their users - they're just trying to make a buck selling to large organizations.
[1] https://news.ycombinator.com/item?id=21589647
https://www.salesforce.com/news/press-releases/2021/07/21/sa...
Centrally controlled, heavy and bloated - nope, nope, it's just not it.
They just added voice calls via web UI. Not E2EE yet but if you're on an encrypted VPN then that's kinda moot anyway.
Seems to be more on the "glossy" and "web client" end of the spectrum in general but probably there is some reasonable compromise to be reached from the proliferation of different clients.
https://element.io/