Ask HN: What startups are working on hard, technically challenging problems?
In the article, "Silicon Valley's Youth Problem" [1] the author mentions Meraki (now Cisco-Meraki) as an example of a startup working on advances in technology rather than the latest web app.
Do you know of other companies that fit the description?
Follow up: Are they (you?) hiring?
[1] http://www.nytimes.com/2014/03/16/magazine/silicon-valleys-youth-problem.html
176 comments
[ 3.3 ms ] story [ 209 ms ] threadPalantir — and specifically its CEO — immediately disclaimed involvement or interest in both that plan, or anything of its general type.
How do you justify to yourself slandering a company by claiming nearly the exact opposite of what happened?
They did apologize for this and as you say, disclaimed involvement or interest in such a plan. [2]
[1] https://wikileaks.org/IMG/pdf/WikiLeaks_Response_v6.pdf
[2] http://www.forbes.com/sites/andygreenberg/2011/02/11/palanti...
But also, the branding of the presentation does not reliably indicate the origin of the specifically offensive bullet points (most notably the "Potential Proactive Tactics" slide), nor whether the contents ever progressed past trial-balloon status.
In particular, coverage by Greenwald [1] (working from more email thread context for which I can't find a current online source) identifies HB Gary principal Aaron Barr as the verbatim source of some of the most-aggressive anti-Greenwald language.
So I can see that someone at Palantir was coordinating with the other entities and leading the document-prep. But they also cut-and-pasted material from the potential contract partners, including vague proposals outside Palantir's focus, that may never have been approved or presented.
I'd ascribe those bullets to Palantir itself if that deck was in fact ever presented to a client. We don't know if that's the case. If instead that text just bounced around as a discussion draft (including their more-aggro partners), but went nowhere, and was eventually categorically disavowed... then it's a stretch to say that the company or its leadership actually advocated those steps.
[1] http://www.salon.com/2011/02/15/palantir/
"So apparently, if Palantir’s new version is to be believed, a 26-year-old engineer went off on his own and — without any supervision or direction — participated in the development of odious smear campaigns intended for two of the nation’s deepest-pocket organizations (Bank of America and the Chamber), potential clients which the emails repeatedly emphasize would be very lucrative. I’ll leave it to others to decide how credible that version is, but I will note that several facts undermine it: ..."
"The leaders at the very top of Palantir were aware of the Team Themis work, though the details of what was being proposed by Barr may well have escaped their notice."
The number of companies using this device to solve real problems is growing. Jeremy Howard just started an interesting one - http://www.enlitic.com
Even if you use the same language for both, the style of code & algorithms are very different.
"For some time now, I have been following the "startup scene" and frankly, I am left with a sense of dismay. How many of the startups actually do anything of any real value to mankind? It seems to me that the startup ideas just keep getting more ridiculous and stupid by the day and I think I would go as far as to call the whole thing deeply broken.
I am not going to name any specific startup, but I would like to ask the readers of Slashdot a question.
I know this is not how the world works, but I am still curious to know what kind of ideas would prosper if the primary aim of a startup was not to make as much money as possible as quickly as possible. So, if your startup idea would be judged by the amount of good it would to mankind, what would it be?"
http://socialimpact.eu/
of which I am not affiliated with nor won't endorse here in any way. Sadly, in Germany at least, startups that aim for maximum positive impact and less so profit, are called 'social startups' which outside of Germany probably has a completely different connotation.
The news websites I usually frequent, are not very full of news; they are rather SV & VC company theory megaphones. Avoiding those websites sometimes leads one to people with a bit different entrepreneurial mindset.
This having said, would you work for such a company? And which compromises would you accept (on the ethics-, but also wage-scale)?
Ethics, that is harder. I guess if you look hard enough you can find problems with anything, but that's probably just the way the world is. If it does more good than harm, it's ok in my book.
- cure for cancer
- cure for malaria
- cure for aging
- cheap fossil fuel extraction from low-quality deposits
- safer nuclear fission
- nuclear fusion
- lower-cost space travel
- space elevator
- space colonisation
- intelligence augmentation
- safe artificial intelligence
- desktop nanofactories
- nano-machines
Since when did this become some sort of measure of the worth of a tech company?
Sounds like misguided hippy shit to me.
Bill Gates, Larry Ellison and Steve Jobs didn't set out to change the world and "do something incredibly important for mankind", despite what the message might have become in later years. They all set out to do things they were interested in, pursuing technology for its own sake, as most people were back in the 1970's.
These days startups seem to need to feel that to justify their existence they need to be "changing the world" or "doing something important for mankind" or "giving back to the community". There's no need to justify the existence of a business. Do it for the cash, do it for fun, do it to scratch your sense of ambition, do it because you think it's a good idea, even if some pompous git stands on a high horse and looks to the sky and proclaims "this business is not changing mankind for the better, I am dismayed at the trivial nature of this endeavour, I deem it of little value".
Perhaps you should rejoice in the fucking incredible explosion of energy and creativity and effort that the entire world is putting into trying to find uses for the Internet.
Just relax with your hippy ideals. Have fun.
But that doesn't need to be a bad thing. Paying lip service to "real" progress, especially when it concerns poverty/environment/democracy etc, may actually lead to actual progress down the road.
At first it was pretty rational to present yourself in a way that gets you that 15 minutes. Now, I don't know, but HN is full of startups trying to revolutionize something instead of incrementally "disrupting" a set of incumbents.
On the other hand, two other popular startup mantras "making products that people love" or "fixing a problem that people have" are quite easy to spin to be worthy and good.
Too many companies making incremental BS apps or IT pipeline tech that delivers cat pictures 0.1 ms faster. And both groups ("we're bringing Utopia to Earth", "we'd mug you for cash") are still doin it cause it looks like it makes money, or people advise them they need to say these things to make money, or it'll get chicks / dudes, whatever - no matter what they say out loud. "Silicon Valley" is pretty spot on in that regard.
It's just a pendelum swing. In a little while we'll be back to "greed is good" while we help people 'connect' with high school friends they never actually liked.
I don't give a shit about how world-changing a business is, but I do care that companies should be driven for more than just making money. Most companies aim to be profitable, but if that's the only goal then they're primed for corruption (even on a minor scale). Who cares so long as profits keep growing, dog eat dog, right?
There's a difference between 'Can I do something?' and 'Should I do something?', I see no harm in wanting companies that consider the latter.
Any Musk startup - Tesla (electric vs. oil consumption), SpaceX (building space "colonies"), SolarCity (alternate energy), Paypal (payments).
You also have Uber (limiting cars on the street & oil consumption), AirBnb (better utilization of current buildings rather than building additional hotels). Even stuff like meerkat, etc could potentially be used in lieu of expensive meetings across country (further travel & ancillary costs).
I do agree that "change the world" is an overprevalent mission statement & too broad to be useful, but many are solving problems in a way that might not be obvious at first.
Communication methods that people laugh at (AIM instant messaging) can be reappropriated into something useful (hipchat, slack) years later.
That's a story one-side uses and in SF that can certainly be the case.
But, in some cases, I think people would rather stay in places that are less "developed" or taken over by hotels and stay at local BnBs.
We started on building fast-start multitenant access to single GPUs and approaching peak on those (full-GPU barnes hut, 10X over Keshav's work). We're now focusing on distributing, and as we are more interested on running on many GPUs for scale out, focusing on communication avoiding. This makes a path to giving companies time on 1000 GPUs (think Pixar-levels of compute) rather than shipping small 8 GPU boxes with infiniband. Via elasticity and time sharing, the analyst hour pricing is unprecedented.
The titan guys run on 20,000 GPUs for similar astronomy codes, so doable. We're making it in more accessible, big-team, and analyst-focused ways. E.g., load, interactively analyze with smart defaults & streamlined common paths, export/report, and share.
I found the Graphistry webpage lacking in answering the question "which specific problem does this solve?" Infoviz is too broad/vague.
There are countless startups which were perceived as having little value only to be praised and hugely successful years later, yet nothing changed– only people's perceptions.
I guess my point is that before asking a question like that, we would have to define what you constitute as "doing anything of real value to mankind". And who's to say your definition of value is the right one anyway?
(I'm not affiliated with 'em, just think they're pretty rad)
Databases:
- PipelineDB
- Snowflake (Computing)
Internet of Things / Communications:
- Helium
Robotics:
- Pneubotics
- Kuka, namely the research department
Autonomous Systems / "Self Driving Car" et al.:
- Kiva
- Anki
Computer-Vision / VR based:
- Jaunt
- Oculus VR (especially the 'research' department)
Agriculture:
- Blueriver http://www.bluerivert.com
(there are many more super-interesting companies in this area!)
Computing:
- Mill Computing; though quite dubious
- D-Wave
and than there is Microsoft Research working on super interesting stuff in programming languages, computer architecture (FPGAs).
Additionally, I believe really challenging problems will alwyas be coming from creative people, companies in that area; such as Pixar, architecture, and design (keywords, just to give a start: generative {design, art, ...}).
Hope this helps!
Funfact: in the northern parts of Norway, calling a policeman a "horses penis" is not illegal, as that is a somewhat common thing to call another person. Yes, this was tested in court in 2008.
[1] http://norvig.com/mayzner.html
We are hiring for a variety of positions you can check out here: http://hire.jobvite.com/CompanyJobs/Careers.aspx?nl=1&k=JobL...
If you (or anyone) is interested in a role on the remote sensing team (satellite/drone suff) or the Climatology team, you can reach out to me directly at skhalsa@climate.com
http://techcrunch.com/2015/03/19/kryptnostic/
It's a shame Google isn't focused more on this, too. They should be having a Google X lab just for that, and invest at least as much as they currently invest in quantum computing. They have a lot to gain from it. Infringing on people's privacy is currently Google's biggest PR issue, and it's not going to go away. It will only become a bigger issue in the future. Without this, Google could perhaps return to being almost as liked as it used to be (there's still the issue of bullying others in the search engine, of course).
It's not just doing the computations in an untrusted cloud environment, although that's a big promise. I would say that an even bigger part will be the eventual ability to run computations on multi-party data sets. If you can provide a provably secure zero-knowledge service that still manages to compute results from multiple sources of opaque data, you will have every single financial institution and insurance giant banging on your door.
http://robots-everywhere.com/portfolio/navcom_ai/ (2007)
"our mission: build the next generation of A.I. algorithms"
http://vicarious.com/
The USA shouldn't have such a terrible health care system. Let's fix it. They are hiring all sorts of talent: https://www.hioscar.com/jobs
Fully cloud based, heavy aurora/mesos shop, kafka, hbase, redshift, mysql, python, flask, and an abundance of data analytics.
Nothing wrong with that. But using today's technology in web and mobile to build a highly-usable customer experience, is not what OP meant by hard technical problems.
Algorithms and ML are all heavily used in analyzing member data to improve the lives of people.
We're engineering systems that give us real-time feedback on the insurance system as a whole, rather than the usual "30-60 days". Building a claims system from scratch is not an easy feat.
If you'd like to learn more about what we're doing i'd be happy to demo it for you.
Don't be fooled by our pretty and simplified website. It's all of the hard engineering efforts that you don't see that make the simplified experience possible. :)
Development is in Berlin, Germany, and we're hiring.
http://www.quobyte.com
Probably the biggest effort we're making is on Cloud Foundry, an opensource PaaS. Developing scalable production-grade systems for managing and running 12 factor apps is hard. Superficially it looks easy. Once you do anything at scale, it stops being easy, which is where we come in.
We also have teams working on Hadoop, GemFire, antirez is on Redis and Disque, the Spring team works for us and I've kinda lost track of the rest.
I work for Pivotal Labs, the agile development wing founded in 1989 from which the whole company takes its name.
We're hiring across all divisions. Email me: jchester@pivotal.io.
I think we'd like to think we're working on the ugly bits of infrastructure people don't care about.
This includes a distributed file system optimized for speed and storing machine state like Github, software defined networking for IP migration across metal, and other abstractions for making devops easier.
We're looking for people who want to think about hard computer science problems like managing stateful systems more intelligently (think auto-failure detection and recovery and less I/O intensive WAN replication strategies).
We have to make Large scale Simultaneous Localization And Mapping (SLAM) easily computable across existing mobile devices to bring consumers hyper-precise (cm precision) geo-reference. This is actually super hard but also pretty awesome.
Yes we are hiring. Specifically CV experts.
[1]http://www.visidraft.com
[2]http://en.wikipedia.org/wiki/Simultaneous_localization_and_m...
[3]http://en.wikipedia.org/wiki/Six_degrees_of_freedom
In the long run, it is a data tool that will eliminate the need for data warehouses.
It turns out the hard problem is not running the queries fast, but keeping the cache accurate and up-to-date. Our cache coherence service is probably the piece of code we're most proud of.
And, yes, we're hiring in SF. :) Reach out to me, harry@periscope.io
http://www.skymind.io/ http://deeplearning4j.org/
We are building a platform that enhances the workflow of clinical trials thus making it easier, faster and cheaper on drug companies and safer for the participants involved. We help the researchers using the data collected from the trial to adapt the future stages of the trial thus helping avoid serious adverse effects or making them known to researchers in real time if they are occurring at present.
Now here is the cool part, the above is just the surface. Our team is really passionate about data science, machine learning and artificial intelligence and its applications in real world. So we do something called adaptive clinical trials where we run analytical models on the data that comes in and can forecast when the trajectory of a trial needs to be altered. This means you can catch any serious reactions to drugs, faster.
All in all, to answer the main question, our solution helps keep the costs of clinical trials low and reduces error rate. Being able to run these trials fast and keeping the costs low, allows not only for drugs to get out to the market faster, but also helps reduce the costs of drugs(due to the reduction of costs to process).
I also only explained the application of our tech in clinical trials, but our software is so flexible that it can be applied to any industry such as Consumer Insights, Depression analysis studies, etc.
Not sure if I adequately answered your question.
http://deepmind.com/