I Am Eric Ries, Author of the Lean Startup. AMA

214 points by eries ↗ HN
I'm writing a new book & trying to use lean startup ideas myself in writing it. The new book is only available via Kickstarter, and the campaign ends in 56 hours, so I thought I'd stop by and answer questions about the new book, lean startup, or anything else.

Kickstarter URL: bit.ly/theleadersguide

EDIT: 1:05pm. I need to sign off for a bit. Thanks for asking such great questions. I'll try and stop by later in the day to pick up any stragglers that come in.

114 comments

[ 3.1 ms ] story [ 173 ms ] thread
What's the fastest you've launched a startup?
When I was working on IMVU, we almost killed ourselves launching in only six months. At the time, we thought that was pretty impressive because our previous startup had taken almost 5 years. But by today's standards, we were incredibly slow.

This may sound pedantic, but it kind of depends on what you mean by "launch" and what you mean by "startup." If you take something like CapTable.io, it only took a few weeks to get the initial version up and running although most people probably don't consider it "launched" at all.

I was talking about time to paying customers. Your distinction isn't pedantic at all - there's a big difference between something that requires physical R&D & a services platform. I'm doing biotech & I think 6 mo is incredibly fast.
Of course. The key is to learn as quickly as possible within the constraints of the medium you're working in. I've worked with startups that launched an MVP in days for $10 and ones that have spent more than a year and $10M+ to make the MVP.

But here's a spooky though I'll leave you with. Often times, when startups are looking at their tools they will say: given the tools I have, the fastest I can build an MVP is X. But if you really take the criticality of learning seriously, you might say: given my desire to learn quickly, what tools can I use to go faster?

And that's where a lot of breakthroughs happen, when you choose tools and platforms not based solely on their technical capabilities, but by their speed of iteration. (It's probably why Facebook was built on PHP.)

Are there examples of lean startup ideas going wrong or being misunderstood and leading startups straight to failure?
tons! I think about this all the time, since I feel a responsibility to try and talk about lean startup in such a way that prevents misunderstanding.

I would say the two most fatal misapplications are:

1. "up and to the right" disease. here you split-test everything and just do whatever moves the numbers. pretty soon you are selling porn or psychic hotlines.

2. "no vision, no problems" error. It's like trying to do science without a hypothesis. In lean startup we emphasize that people trying to predict the future are often wrong, so it's best to experiment and pivot as you learn. But some people interpret this to mean that the future is unknowable, there's no point in having any kind of vision, and you should just ship something and see what happens. the problem with this plan is you are guaranteed to succeed - at seeing what happens. after-the-fact rationalization will prevent any learning, because if you can't fail you can't learn. having a big expansive vision is really helpful because it provides lots of falsifiable hypotheses for testing.

3. "minimum viable crap" sloppy execution. Some people think MVP means just throw garbage at the wall and see what sticks, especially since the M makes people think lean startup is for doing something small. but the truth is if you're doing something small, you don't need MVP or lean startup. you only need an MVP if you're trying something large. further, part of the MVP process is to learn what customers actually value in terms of quality, so we can build something that they perceive as excellent. shipping crap isn't the goal, and people that go on TechCrunch with garbage and then claim "but it's an MVP!" are doing it wrong. the hard truth is that spending more time "perfecting" a product in the absence of feedback often makes the product worse, not better.

The struggle for me seems to be knowing how much is too little and how much is too much. Do you try to err on the side of doing too little at first?
Well, that's a bit like saying "how much science should I use?" There's not really such a thing as "too much science" more like "bad science" or "too expensive science." The key, to me, is to pick an experiment that is well tuned to your circumstance: the right cost, timeline, hypothesis, and clear action for next steps.
Why do you think that 'the establishment' is so hard to innovate within?
It's actually very simple: most established organizations adopt processes designed to eradicate innovation. If you study management history it's pretty easy to see why they did this, since there were huge gains in the 20th century to be had by eliminating variability in both manufacturing and human resources. Consistency, standardization, and commodification all paid huge dividends.

Unfortunately, not all sources of variability are bad. Think about the antibiotic craze as an analogy. It was a major discovery that bacteria cause disease. But it was also a major discovery that certain bacteria are beneficial. Loading up your system with antibiotics 24/7 is actually detrimental to long-term health, even though it's awfully helpful during an appendectomy.

Is it the same as the 'Agile' approach that is so prevalent in software industry these days that aims to deliver software reliably on time?

How do you differentiate good variability from bad ones in software development?

Now _that_ is a good question. Most agile systems are designed to insulate management from the volatility inherent in software development (and to tamp it down a little bit). They aren't really designed to exploit the positive variability.

Here's a classic example: let's say I have a story card that says "build a feature that lets 10000 customers buy a widget from our store." In most classic agile systems, the engineering team will do their best to understand the customer requirement and see that it's built appropriately.

Now let's say that 0 customers show and buy the widget. Who's fault is this? In traditional agile, it's the Product Owner's fault, not the engineering team.

But exploiting positive variability would say: the effort required to build this feature requires knowing in advance how many customers want to buy the widget. The engineering effort is totally different if the answer is 0, 10, 100, 10000, or 1000000 customers. So rather than build the feature as specified, let's do an experiment to try and assess customer demand first, then build in response to that demand.

That means that sometimes a story will take 10X longer than you originally planned and sometimes it will take 1/10th as long. But in the end, you'll get a better business result. That's positive variability.

I understand and appreciate your approach that the best way to work on growth-engine-topics using lean startup way is by utilising fully dedicated teams in sandboxes. But if you were working for a corporate-client (as a methodology-champion), who is not in the position to assign even one dedicated team yet (instead: 14 volunteers (working in their normal full-day job) distributed across 5 sandboxes), how would you facilitate the work of the sandbox-teams?
Well the first thing to think about is: are you in a position to tell your client the truth, which is that this is not going to work. A giant part-time committee isn't going to accomplish this kind of work.

If you can tell the truth, try to win the argument now, before it's too late.

But not everyone is so lucky. If for whatever reason, you can't tell the client the truth, you're not totally doomed. What I would look for is an opportunity to make a trade with the various middle managers involved in this situation. Try to ask for fewer, but more dedicated, resources. In most corporate situations, nobody ever asks for less money, smaller teams, less authority. But you'd rather have a dedicated team of 5 than 14 volunteers.

Thank you very much for this advice. Until I can play this card how I act currently as methodology-champion is that I pre-think/pre-work/"pre-cook" every working step for every sandbox-team. So the volunteers do not need to start from zero - they get everything prepared, comment it and thus can get good quality results out of their work - even on a slow pace do to long intervals between meetings. What do you think about this? Can this work for the first BML-feedback loop per sandbox?
I hate to be a downer, but I'm not very optimistic that this will work. The limiting factor is that you can't learn for another human being, they have to do it themselves.

Maybe you can ask a few of the volunteers to join you for an extra-curricular set of meetings, like over a weekend, to try and give them a tiny taste of acting like a real startup.

Thank you so much for your honest advice. I will try to include this into my work and talk to my client. Great that you do AMAs these days. I very much appreciate it!
What books do you recommend, for people who are very new to entrepreneurship and stratups?
TBH, don't read books, go start something. Then, when you're totally baffled by what's happening, use books to try and understand why.

Now, since you're probably not going to take my advice, I think a new book that you'll find helpful would be Startup Opportunities https://www.amazon.com/Startup-Opportunities-Know-When-Quit/...

I also recently curated a list of classic startup books on Product Hunt: http://www.producthunt.com/ericries/collections/classic-star...

I just looked at the collection and realized Founders at Work isn't in there, which is an oversight.
Thanks a lot Eric, I will surely take your first advise (with a small deviation), in fact I read a lot and sometimes feel overloaded with information and not knowing what to do with it. I guess I'll restrict my reading time to 15-20 minutes a day apart from the reading I have to do while researching on a particular problem. I guess this would be right for me.
I'm a huge fan, Eric! Thank you for doing this. My question is of a more personal nature. When you were in your mid-20s, what were your career goals? Have they changed (if so, how drastically)?
Drastically is an understatement! I was 25 when I co-founded IMVU. My goals at that time were to become an excellent technical founder, CTO, and maybe even a startup CEO someday.

Looking back, I think if YC had existed, I almost certainly would have applied. But nothing like that existed back then and so I wound up making my own mistakes and then writing about them.

"so I wound up making my own mistakes "

I've always thought that it's not entirely good idea to not make your own mistakes. While painful it provides a better gut than simply being told or reading about things and getting quick answers.

You know in traditional businesses there is a reason that even in many cases family members (in family businesses) spend time at the bottom before they are put into higher level positions. It gives you a chance to see exactly why and how things are done and to experience them and fully understand nuance. Things that can't be learned in school or passed by anecdote.

Hi Eric, our startup is hosting live video AMAs with entrepreneurs. Would you be interested in hosting a session at http://talkingnext.io/? We actually have an event scheduled for tonight with Raj Singh from Dronecast at 5PM EST if you want to check it out live.
Sounds cool. Email me (it's right on my blog).
How does Lean model work in case of marketplace? Should you first get good amount of sellers on board before opening the beta version as marketplace ?
Nope, that's almost certain to fail. Why should sellers join if there are no buyers? And if you do convince them, how can you ensure that they will have a good experience on launch day?

The only way to test a marketplace is to get a small number of highly-interconnected buyers and sellers to transact in low volume by hand. Think eBay and beanie babies or Facebook just on the Harvard campus. Read PG's http://paulgraham.com/ds.html for more.

In the case of the startup I'm working for, they will join because of the reputation of the founder. His father was such a successful entrepreneur that people will jump over anything with his name. Of course it will not prevent the business to fail miserably, but nobody will listen to me anyway - when I started working here I gave him a copy of your book, but I'm sure it is was stashed somewhere unread. :-)
Eric--for the above-average engineer (lets call him a 3X-5X), but not a 10X or 100X engineer--what advice would you give if they were interested in beginning a tech venture? How much does personal will play a factor compared to personal ability? Do they stand a chance to compete? Can you think of founders that have achieved great success despite lacking supreme talent? And, finally, to expand a little-- can you think of a character trait that is MOST important for a founder to possess other than great intelligence / clever execution?
There are so many assumptions baked into these questions that it's a little hard to answer. First of all, I'm not a fan of the "10X engineer" framing. I'm much more interested in the systems that companies can build to create 10X teams.

I am thinking of two conventional "10X engineers" right now that I've worked with in my career. One is extremely loud, brash, judgmental and basically scary. If you are brave enough to come to him with a question, and he thinks it's stupid, you will basically never live it down. The second is extremely humble, quiet, and gentle. If you come to him with a question, he probably won't answer it but will show up two days later with a fully-implemented solution that he created at 2am just to see if it was possible.

In most companies, the first 10X engineer tends to get promoted to a position of seniority, while the second is generally allowed to quietly leave the company when they get bored. And don't even get me started on all the incredibly talented people out there who our biased hiring processes can't ever identify as "10X."

If you ever get the chance to mingle with some of the truly famous founders, ask yourself if they strike you as the smartest people you've ever met. Now, many of us get star-struck when we meet people who are rich and powerful, and we rationalize whatever garbage comes out of their mouths as genius utterances, because deep down we're all still primates. But if you can get past that, you'll notice that a lot of really successful founders (and investors for that matter) aren't especially bright or thoughtful. But they do have other critical character traits that helped them succeed. Here's a PG classic on the subject: http://www.paulgraham.com/bronze.html

He also has a great essay about the importance of grit and determination but I can't quite remember the title.

very insightful answer-- thank you so much for your reply, i look forward to your new book!
And how would any of these 10x engineers feel about doing javascript a/b tests all day
With today's trends of massive series A rounds, how should entrepreneurs think about staying lean with so much pressure to go big and a prevailing winner-take-all mentality within the VC world? Moreover, what's your take on the series A mega-round?
Hilariously the HBO show Silicon Valley had a pretty decent take on this last night: just take less money. There's no law that says you have to slurp up as much dumb money as the market will throw at you.

But regardless of how much money you take, lean is about a disciplined process of decision making. Can you build a culture of high-tempo testing and make it stick not just for the founders but for all employees? That really has nothing to do with how much money you take.

I'd be curious what the equivalent idea of what you are doing (by posting here as AMA) would be if you weren't Eric Ries posting on HN. So for Eric Ries this is "lean" (or what used to be known as "gorilla marketing") but for someone who doesn't have name recognition what is the equivalent? [1]

[1] Simply recognizing that someone without name recognition doing something similar on HN is not assured of getting any attention.

Let's be honest: I almost didn't make the front page. My post got to about #25 on /newest with only like 9 upvotes. If it had rolled over to page two, I doubt I would still be answering questions right now. So no, I don't think this kind of technique is useful for marketing if you don't have name recognition.

However, there are many other ways to build rep in a community like HN without being famous. I bet if any of the highest-karma posters did an AMA they would get a lot of attention. Personally, I'd be fascinated to learn more about who they are.

My personal feeling is that the high karma that you are speaking of is not a good use of time (for that reason). I know it has helped tptacek and some others but it takes considerable time (and is a distraction) to comment on HN and essentially if you do it, you do it for fun and to learn. And if something comes from it then that's icing on the cake.

I actually picked up a considerable amount of side consulting by being a regular commenter on a well known blog. While I make money from that side consulting (near 6 figures), it's actually a drain on how I make money in other ways. It almost doesn't pay (but it's fun). [1] However the time it took me to earn enough of a reputation which led (in an indirect way) to the consulting (and contacts) was really a poor use of my time.

A better idea time wise, to jump start reputation, and build a rep (in a community like HN if that is what you are trying to do) would be to attempt to do things that are remarkable and get attention. Then people might talk about you and you will have the reputation that you seek that will bring other things that you need.

[1] I also get to meet many interesting people and contacts as well.

Being an active participant on HN has been very helpful to me professionally. HN karma, on the other hand, has not. The only thing that ever came from karma for me was a TechCrunch interview about HN.

There are great commenters who are very well-known who don't rank anywhere on the leaderboard. 'pbsd is a well-known cryptographer. 'tzs is the best commenter on HN. 'carbocation is a doctor/medical researcher.

Being engaged and available is important. The leaderboard is a really warped assessment of that. HN should get rid of it, along with the whole karma system.

An easy start: continue scoring comments, but stop revealing per-user karma totals.

I don't think anyone needs an AMA from me or Patrick McKenzie. The Ries AMA is interesting because he isn't a regular, and has interesting things to say.

Agree and would also get rid of grayed out comments that are down voted.

"I don't think anyone needs an AMA from me"

Actually I would find that fascinating.

I'm pretty sure HN has already asked me anything worth knowing about me. Except maybe "how much does NSA pay you to shill for them on HN". ($39.54/wk)
Matasano Security, the company you founded, was acquired by NCC Group for $13 million in cash. You probably saw a good chunk of that money, and one would assume you'd be well off enough to not work for $39.54/wk. Why do it anyway?
I can't tell if you're continuing the joke or genuinely missed it...

(although given your prior comment history, I'm guessing the latter)

I guess I just love my country.
True that, HN wasn't designed to be a forum, and there is virtually no point in having a karma system since this is as far as I know not a for profit site, and the quality of this site itself draws people so there is little point for providing karmas to keep people interested
Are there any particular skills or traits that you looked for in your startup co-founders?
Well, because I hadn't read the excellent book Founder's Dilemmas, I didn't have a clue about what to look for. Honestly, the biggest criteria was that they were willing to work with me!
What does your book writing process look like now? What did you learn writing The Lean Startup and how much of the teachings of the lean concept itself are applicable to book writing?

Cheers! /Martin

I think they are very applicable. During the writing process for TLS I spent an absolute metric ton of time testing, iterating, workshopping and trying to make sure that:

1) the value proposition for the book was right and 2) that the book actually lived up to that value proposition

I am convinced the book would not have been a blockbuster without that work.

Now the tools are so much better. Kickstarter allows me to do this testing and iteration in a much bigger and more public way - and that's just the start. Now that I have a 7000+ community of people who are going on the journey with me, I have a built-in place to test concepts and make sure that what I'm recommending is actually effective.

In THE LEADER'S GUIDE, will you also make available business tools you suggest for lean-startup project? A bit comparable to what Alex Osterwalder & strategyzer is offering it (Canvas, Test&Learning Cards, Progress Board, etc.)?
No, I will not. I am not yet sold on the tools approach to lean startup adoption. It's not to say I am opposed to it, but I haven't really seen it work in companies. I prefer prose: convincing people to try it and letting them build their own tools.
What do you think has changed the most for startups today since when you wrote "The Lean Startup"?
It's a whole new world. It reminds me a bit of 2007, but even more intense. And although I wasn't in Silicon Valley in 1999, it has some of those overtones, too.

But the biggest change is not in all that noise, it's in the fact that entrepreneurial know-how is widely available. When I first started blogging in 2008, there weren't that many startup blogs. Almost no VCs blogged. YC was just beginning and PG's essays were about many different topics, with startups appearing only rarely.

Now new founders are swimming in a sea of knowledge that was previously considered esoteric. I think we're only seeing the tip of the iceberg of what will happen to the global economy now that the genie is out of the bottle. (mixing metaphors a wee bit)

What is your experience with the NSF I-Corps program? Do you know of anyone who has gone through the program and then built a successful company afterwords?

Link for those who are unfamiliar. https://www.nsf.gov/news/special_reports/i-corps/

That's really Steve Blank's domain, but we just had lunch and he filled me in. It sounds absolutely incredible.
Thanks for the reply! I start the program next week and based on the paperwork and conversations I've had it seems like it will be a massive amount of work with potentially massive returns on my time investment.
In the Lean Startup you described Aardvark tested several different business concepts, before choosing one in the end. Do you know how they dealt with the possible need to pivot versus focusing the team's resources on one single product? Or have any other advice in terms of focus versus testing different products?
It was totally obvious that Aardvark was a better product than the previous ones they had tested. They could feel it in their bones once customers started using it. I do think it's possible to quantify that result, but it's almost always unnecessary if you are able to step out of your own reality distortion field.
Are you planning to setup a program for consultants, advisors or trainers to get certified on the-lean-startup-approach?
How important do you think is formal college education in the life of an entrepreneur?
I think a liberal arts education is one of the greatest gifts a parent can give their child (thanks, Mom & Dad!). That said, there's clearly plenty of people who are able to succeed without formal schooling. And, for that matter, there's plenty of people who got the fancy degree and didn't expand their minds at all while they were there.

I think the more important thing is to become deeply curious and well educated about how the world works. I don't see how to do that without a grounding in history, philosophy, psychology, literature, etc. but there are many ways to get that grounding besides formal schooling.

I hear people talk about Lean Startup methods at many established companies (where I work included). But I feel like we're deluding ourselves a bit, playing pretend startup. How applicable do you think the Lean Startup ideas are to a corporate environment? (One that purportedly wants to adopt these ideas) What features don't work at all? Who is doing good work to adapt these ideas for larger corporations?
There's plenty of "leanwashing" going on, that's for sure.

The key is to move from "pretend startup" to "real startup" - which is 100% possible inside an established company if the leadership wants it to happen. But it is not easy; it requires significant changes to many of the company's systems, including HR and Finance.

To know if it's likely to work ask yourself: 1. does the startup have the authority to operate autonomously or does it need endless approvals and permissions? 2. does the startup have a clear board that it is accountable to for both funding and pivot decisions? 3. is the statup cross-functional across all the functions required to build the product? 4. are the members of the startup full-time on just that one thing? 5. is the budgeting process metered (ie fixed rounds of funding) or entitlement based (ie annual appropriates with quarterly adjustments)?

If you don't have good answers to all five of these questions, you're probably playing startup more than real startup.

How important do you feel it is for a startup to move to, or at least fundraise in SV?
I'm conflicted. Personally, I think SV is a magical place and that's why I live here. OTOH, it's also a very fad-driven place and some people get distracted by the noise. Plus, there are clearly many other startup hubs where founders can thrive these days.

So, as a citizen of the USA: come here, help make us great As a citizen of the world: transform your city into a startup hub

I guess what I'm saying is there is some truth to the saying that "Silicon Valley is a state of mind" and also some truth to the saying "that sounds great but a lot of the money is on Sand Hill Road."

Is it investors that attracts startups to a city, or startups that attract investors to a city, or something else?

Everyone I've heard talking about transforming cities into startup hubs, always frames it as "make some good startups and everything else will come."

It's a classic two-sided market problem. If you just make great startups, won't they migrate to a better startup hub when they have enough traction to do so? I think it's about creating a true startup community where people want to stay and reinvest in the next generation. Brad Feld wrote a whole book about it, btw.
I work for a large aerospace company. How can we adopt lean startup ideas for hardware projects where the design iterations are much more expensive and lead times more severe?
Ask Corey Nelson: https://www.youtube.com/watch?v=rkdsYTlEGfQ

It all depends on what you are trying to learn. What has to be true in order for your new product or project to succeed? How can you find that out cheaply and quickly? And what if you chose tools for speed of testing rather than efficiency of production?

I've been amazed how many hardware and industrial companies have been able to adopt lean startup, even in situations I would have previously thought impossible.

Perfect timing. I'm bootstrapping my own startup (http://moonlighter.io) at the moment and had a couple questions about the MVP.

1) How can you quickly validate a business with very little immediately visible value to the user? Direct user interviews won't work here because the service is very data-driven (collecting filesystem events), so it'll require a decent amount of data collection from the user (I'll offer something like a 14-30 day trial to allow this). Since it has to be done over a longer period of time, and it includes collecting information that might be sensitive to some people, it's not very easy to fully validate the business. I've had a few friends using it, and I'll be sharing with a small beta user list soon, but otherwise I was wondering if you had any other ideas.

2) I've put off writing the payment processing code, focusing on the product itself. Especially considering the "trial" period necessary to see value, are there any downsides to releasing the MVP without allowing payments and then adding them in after release? (Other than no cashflow of course...)

Thanks! I'm actually reading through the lean startup now (after reading way too much of it's principles on the internet first). So it's neat to be able to communicate with the author directly like this.

That technique is actually very common. If you have a 30 day free trial, for example, you really don't need a payment processor for at least 30 days (and that's the optimistic scenario! I've seen startups that don't need payment processing for a lot longer, because nobody completes the trial)

Remember that not only does your product have to create value for customers but they have to realize that it will create value for them, and both assumptions are important to test.

Hello Eric,

I saw you speak some years ago right around the time your first book came out. I have a media background, and I noticed some parallels with what you described at IMVU and what I have seen in my industry.

Typically, the projects have involved large media companies building high-quality products/brands, such as television shows or websites. They are designed and built in near-stealth mode with limited opportunities for user testing or audience feedback, and sometimes (but not always) fail miserably when they are released to the world. Conversely, there are examples of media programs/products/brands being developed in a highly iterative/audience-focused approach and sometimes (but not always) leading to a hit or at least becoming self-sustaining.

My question is this: Generally speaking, can “lean startup” concepts be applied to media or other industries, or do the unique characteristics of those industries — for instance, high cost structures or dependence on industry-specific business models - make it difficult to really leverage the software-focused product development concepts you outlined?

I hope to develop a framework with which to approach product development in my own industry (“lean media”) and would greatly value any feedback/ideas/suggestions for further reading you may have.

Thanks!

Yes, I think the fundamental issues are the same as product development elsewhere: the key is to find product/market fit. Sometimes you swing for the fences and it works out great. Sometimes you do everything right and you still fail. It's about probabilities and whether taking a scientific approach can increase the odds that you build something customers want.
(comment deleted)