Ask HN: What motivates users to write Amazon reviews?
I'm in the process of developing a review-driven site, and I'm wondering how so many reviews get written on a site like Amazon when there's no incentive to do so (from what I can tell.) The incentive on a site like Yelp seems to be badges and awards given by other users to your reviews. How do you get people writing reviews on your site?
49 comments
[ 3.7 ms ] story [ 110 ms ] threadHowever: I think that the reviewer-to-reader ratio is tiny, and this is masked a bit by Amazon's absurd popularity.
And, to make matters worse, this absurd popularity is one of the driving motivators (cf above, "share one's opinion with the world", not "share one's opinion with the 200 people who happen to follow my micro-site.")
If anyone knows any way out of this besides increasing the number of users by several orders of magnitude, I'd love to hear it-- I, too, have a site that allows reviews, and only a tiny handful of reviewers (so far.)
Disclaimer: I have never run a reviews site so this might just be a wild idea.
What if you implemented a karma system like HN/Reddit/Digg and rewarded users for their relative karma score for particular comments to other users commenting on the same thing. For those who achieve a certain relative score, you can give them prizes, discounts, etc. I mention relative score since this would curb the incentive to game the system.
The problem then becomes how to encourage a greater % of your audience to contribute. Some people might be more willing to contribute if they could see that their contributions were valued. Can users rate a review (like Amazons X of Y people found this review helpful)? Some might be more willing if it increased their standing in the community - some people enjoy being seen as an expert - do you recognize people who take the time to leave reviews (perhaps magnified by review quality)?
Most of this will only really work if it is within a community, however. If lots of people just come and go then those tactics are fairly meaningless. If you have a niche site with a lot of repeat visitors that you can build a community around, this might be a good way to start that process.
I think most fundamentally, I find a lot of value in reading Amazon reviews written by others, and I feel like it would be useful for me to write my own reviews. I don't tend to review every product I possibly can, but rather, I usually just write a review if I have something interesting to say, or if I feel very strongly about an item, good or bad.
I like to think by doing this I can help other people make more informed decisions about what to buy.
Amazon could probably increase reviews 10 fold by creating an incentive program (e.g., coupon codes for reviewing products).
Or, though it's a little spammy, I wouldn't be opposed to receiving a Netflix/Ebay style email a few weeks after I order a product asking for me to give a star rating on it.
The fact that you're amazed at the outcome is a good indicator that your hypothesis is wrong.
1) They had an exceptional experience with the product and feel the need to react to that. 2) They are the type of person that likes to tell the world about their experiences.
Unfortunately, both of those are a very small subset of total purchases and, most likely, highly overlapping. Which means you won't get the proportionally accurate number of reviews in the middle range. And you won't get reviews from Luddites or online recluses.
If you put an incentive behind the review system, perhaps you'd have people gaming the system, but at least you'd have a better shot at hitting a wider demographic of product reviewers.
You are probably right though. Amazon, like Google, is very, very good at analyzing piles of data to make market decisions. They may well have already piloted review incentives. Regardless, I suspect they've already got numbers that back up their current process.
Another great example of how Amazon has succeeded with user generated content is Listmania--genuinely helpful product lists, all provided for free. I don't completely understand the psychology of why these are created, but I value the content greatly because I know that contributors are not compensated for their suggestions.
I'm a heavy user of Amazon in the UK (Prime membership and all), and I get regular emails asking me to review products I've previously purchased.
..I've never written a review, though.
I think there are a bunch of reasons Amazon reviews work so well:
1. The audience. If you want your opinion to be heard, posting your review on Amazon is the best way to go - just like selling your stuff on eBay makes sense because that's where the buyers are.
2. The high quality of the existing reviews. They set a standard which new reviews then attempt to match. That's the result of years of careful management of community expectations.
3. The "Top 1000 reviewer" badges. They're relatively subtle as badges go, but offer a powerful incentive for the best Amazon reviewers to keep on reviewing.
I'm sorry to burst your bubble. The well-respected consultancy User Interface Engineering has come up with the magic number of 1 review for every 1,300 purchases.
"While only one in 1,300 purchasers of the product writes a review, the number who indicate a review was helpful is even fewer. For the Harry Potter volume, which is Amazon's best selling product ever, it was about 0.0014% or about one in 7,300 purchasers of the product. The most helpful review garnered only 566 votes, even though it was written on the first day the book was released and Amazon has sold more than 2,000,000 copies since."
http://www.uie.com/articles/magicbehindamazon/
And I know that I for one usually don't upvote a review, even if I did find it helpful. I don't mean to be intentionally rude, I just somehow haven't gotten in the habit of doing that. So the number of votes on a review isn't an indication of the number of people who found the review helpful, but rather, the number of people who both found the review helpful and took the time to vote it up.
That said, yes, Amazon's immense customer base makes even tiny percentages of users contributing out to be useful. But they weren't always so large. I've heard that the main way they became the prominant online bookseller was precisely because they offered a review mechanism, at a time when other online bookstores did not, or offered a more feeble review system. Since it's so easy to add a nice review system to an online store today, that feature alone won't be enough anymore.
It's not the feature. I'm convinced it is is the sheer volume. Much like Arn from MacRumors says to monetize a website - first you need traffic. Traffic then monetization. Not monetization then traffic.
Target has the exact same software Amazon.com has - as the result of a 2000-era licensing agreement.
I had to sort by highest rated to even get a Harry Potter item with reviews:
http://www.target.com/Potter-Half-Blood-Prince-Widescreen-Du...
Here's the article I was paraphrasing:
"The secret to success on the internet can be boiled down to one simple accomplishment: building traffic.
That’s it. If you have a site that attracts a lot of visitors, you will be able to make money. On the internet, traffic equals power, which subsequently equals money."
-Arn, MacRumors.com
http://normalkid.com/2008/06/26/traffic-power-money/
About the only reason I can think of one might check reviews before buying is to see if there are any goofs, like chapters printed out of order or things like that, that might make you want to delay purchase until the second printing.
The Amazon review system is kind of annoying. There are three kinds of things I've seen people cover in reviews: content, presentation of content, and purchasing issues. For instance, I did a short review of a math book. The content was excellent. However, the conversion to ebook for the Kindle was unusable. Various mathematical symbols were not recognized during the OCR and were replaced with blank space.
Amazon provides no way for me the rate the content at 5 stars and the presentation at 1 star for the Kindle edition. (And it provides no way to review just the Kindle edition. The reviews for all the editions are collected together).
http://www.wplover.com/1243/wpquestions-a-humbling-experienc...
http://stevewatsononline.com/wp-questions-to-the-rescue?utm_...
That's what an Amazon engineer told me: the real name program and the top 1000 badges were designed to encourage this, even though it creates a reward for very shallow, positive reviews.
-People review for all sorts of reasons, but the largest reason students write reviews on RMSR seems to be simply to "give back to the community." In other words, they just like helping. However, keep in mind that my site helps students find suitable housing, so compared to product review sites (like Amazon), there's probably much more of a charitable motivation for RMSR.
-People like sharing and helping, but not that much. If the review form requires too much info, they'll just say "ahh, fuck it," and leave. RMSR's review form is still WAY too long if you ask me, but I just haven't had time to change it. That actually leads me to a piece of advice: try to get your review form nearly perfect from the outset. If you have a semantic site that arranges data in a meaningful way from the reviews, the review form becomes difficult to change, because every change requires some data migration of all your existing data to the new common format. Not to mention the extra logic you have to add to the site. E.g. if you add a criteria on which to rate, do all the existing reviews get a zero? Obviously not, so now you have to add in some if-statement for "N/A" and get fancy with your AVERAGE calculations.
-When we started, there was a lot of fear (some from us, mostly from landlords and school officials that were on board) that the site would just be a landlord-bashing playground for tenants. Thankfully, rather than site around and try to invent rules, incentives, policies, etc, we decided to simply address it as it became a problem. This was one of the best decisions we ever made, because here we are 3 years later, and it still hasn't become a problem. Out of a 4.0 scale (like report card grades), the average rating for rentals on the site is like a 3.5 or something. This brings up another interesting point: they say reviews tend to display the extreme ends of the spectrum (either really satisfied or really dissatisfied). FWIW RMSR probably still has way more A reviews than C, D, and F reviews combined.
-At one point, I tried integrating some game mechanics, by giving badges and stuff for the number of reviews a student has written. But we ended up getting rid of it mainly because it added complexity and no one seemed to care. No one cared most likely because RMSR is a site that students use only a couple times a year. If you only use a site once every 6 months, why does it really matter? Note that I could be totally off on this, because our "badge" implementation was half-assed at best, so perhaps I just didn't try hard enough.
-To motivate students to write reviews when we first started, I wrote a promotion engine, where if students from a certain area of schools signed up and wrote a review, they'd get a print-out coupon for a free coffee from a local coffee shop. In return, the review would get the coffee shop's logo placed on the review for all eternity, which would link to the coffee shop's website. I wrote this such that it could work with any local business. It worked really well, but by far the hardest part is getting businesses to give stuff away that is actually worth the students' time.
-Some students leave reviews because their landlords asked them to, so that's perhaps a motivator specific to us. I've even heard reports of landlords waiving rent late fees in return for writing reviews (though I haven't seen any indication that it affects the quality of the review or rating, which I was afraid of when I first heard of it).
Also, I think most people like to be help.
I almost always respond to these requests, because I find the reviews helpful in my buying process and that motivates me to contribute back.
1) That's where they bought it -- sometimes when I buy something at Amazon I get an email from them asking me to review it
2) Sharing one's opinion is its own reward
3) Lots of people visit Amazon, so your opinion is going to be meaningful. What's more, your review will appear on the page for the product itself.
4) If you use Amazon a lot, you look at the reviews before buying. This means you are aware that they exist -- you trust them, maybe. Having the chance to add to a corpus of reviews you use and respect is a powerful incentive.
I'm not sure a plain-vanilla reviews site will be able to compete successfully with Amazon reviews. Maybe find some niche, like IMDB (movies) or Harmony Central (musical instruments) or KVR Audio (music software).
I will share one trick that I use on my site UniversityTutor.com, to get more reviews. I saw this in an email that Google Checkout sent out:
1. Firstly, of course you should send an email asking the person to leave a review a week or two later
2. Do NOT require the person to login to leave the review (use a "one time login link"). Removing this hurdle can help.
3. Embed the actual review form RIGHT IN the email. With a submit button.
Basically all this is about reducing the hurdle to leaving a review as much as possible. The "archive" button is just to easy so if they have to leave the email or login you've already lost people.
Submitting forms doesn't work in all email clients so you'll have to also include the one time login link for anyone who can't submit the form right from their email. But it does work much of the time. To generate the HTML for the email form that works across most email clients, the easiest way I've found is to create a new form in Google Docs, and email it to yourself as a starting point to copy from. The HTML they generate is pretty well optimized from what I've seen.
I still don't have tons of reviews on that site though. So it is definitely tough to get people to engage.
Also - the simpler the review the better.
A pulldown will get filled out more often than a free form text field.
Radio buttons will get filled out more than a pulldown.
A simple thumbs up thumbs down will get filled out more often than 5 stars.
And only a thumbs up (or like) will get more than thumbs up or down.
When I moved from a 5 star thing to just up/down on BuyersVote.com it helped a bit with engagement.
So under my framework I'd say the major motivation is that the people contributing reviews are those that are passionate about the Content/Topic. And the simple reason why they get so many is because 1) ridiculous Amazon volume that somebody already mentioned, and 2) Amazon is the place where you voice CAN have the most impact (if you're one of the top).