Travis is a teenager living in a small town in the Northeast. He enjoys hunting and shooting, and keeps a rifle at home. But with several younger siblings around the house, he wanted to make sure his gun was safe. So he ordered a trigger lock on Amazon, to prevent the gun from firing.
"The reviews were great, five-star reviews," says Travis, who asked that NPR use only his first name to avoid scrutiny and possible legal attention. "[They] said it worked great, locked perfectly, the combination system worked great."
"The combination doesn't even matter; the lock just opens," Travis says. "It's cheap plastic, it will pull apart as soon as you give it any force."
Thankfully, he realized this immediately, went to a store, and purchased a proper trigger lock for his gun. Everyone at home is fine.
Travis rues the experience, and the stellar reviews that led him to purchase the faulty lock in the first place. He didn't realize it at the time, he says, but he's now certain that those glowing reviews were paid for. And that many of the people who gave the trigger lock excellent reviews may never have opened the package in the first place.
Travis is certain of this because he himself is now a prolific paid reviewer. He writes Amazon reviews for money, and he commissions others to do the same — for a company that approached him online. (Note: Amazon is one of NPR's financial sponsors.)
"I don't think it's right that people can write fake reviews on products," Travis says. "But I need the money."
NPR spoke with several people who write Amazon reviews for pay, from a college student in Puerto Rico to a stay-at-home mother in the Midwest. Such reviews are a problem on e-commerce sites, outside auditors say, and they proliferate in online channels set up for this purpose.
Much like Amazon itself is a marketplace for goods, a world of separate, shadow marketplaces exists where reviews for Amazon products are bought and paid for — private Facebook groups, Slack channels, subreddits and more.
According to outside auditors like Fakespot and ReviewMeta, more than half the reviews for certain popular products are questionable. Amazon disputes those estimates.
"Our approximation is that less than 1 percent of reviews are inauthentic," says Sharon Chiarella, vice president of community shopping at Amazon. She adds that "sometimes individual products have more suspicious activity."
"We have built a lot of technology to assess whether or not we think a review is authentic," Chiarella says. "The star rating, a lot of people think that's an average ... it's actually much more intelligent. It's a weighted calculation that gives more weight to reviews we trust more and less to reviews we trust less."
Amazon looks for suspicious patterns of behavior that might indicate a paid or incentivized review. Penalties for cheating can be harsh — in the past three years, Amazon has sued more than 1,000 sellers for buying reviews.
Chiarella says the lawsuits give the company the opportunity to subpoena bad actors to get data from them. "That allows us to identify more bad actors and spider out from there and train our algorithms," she says.
But this has led to a sort of digital cat-and-mouse game. As Amazon and its algorithms get better at hunting them down, paid reviewers employ their own evasive maneuvers. Travis, the teenage paid reviewer, explained his process.
He's a member of several online channels where Amazon sellers congregate, hawking Ethernet cables, flashlights, protein powder, fanny packs — any number of small items for which they want favorable reviews.
If something catches Travis' attention, he approaches the seller and they negotiate terms. Once he buys the product and leaves a five-star review, the seller will refund his purchase, often adding a few dollars "commission" for his trouble. He says he earns around $200 a month this way.
The sellers provide detailed instructions, to avoid being detected by Amazon's algorithms, Travis says. For example, he says, "Order here at the Amazon link. Don't clip any coupons or promo codes. [Wait 4 to 5 days] after receiving [the item]." This last instruction is especially important, Travis adds. "If you review too soon after receiving it'll look pretty suspicious."
Renée DiResta says these persistent efforts to game the system amount to a sort of whack-a-mole problem for Amazon. DiResta researches disinformation online as director of research at New Knowledge, and is a Mozilla Fellow on media, misinformation and trust.
As part of her research, DiResta said she wrote her own paid reviews through the same kind of marketplaces that Travis frequents.
"Being on the first page of Amazon is profoundly impactful for businesses," DiResta says. "Doing well on Amazon really makes or breaks brands."
She says the types of companies commissioning paid reviews are often Chinese brands selling on the Chinese e-commerce giant Alibaba. They're looking to penetrate the U.S. market.
"If you order from Alibaba, it's going to take six to eight weeks to arrive; it's not a great experience," DiResta says. "If you buy on Amazon, it feels like a protected transaction."
She adds that by using Amazon to migrate their products to the U.S. market, these sellers can take advantage of Amazon Prime's superior shipping and logistics, as well as the reputation and trust that comes with the Amazon brand. Not to mention the cachet of its user reviews.
"That's potentially deeply harmful to Amazon as a brand," DiResta says. "When people begin to realize what they're buying is cheap junk or won't hold up."
In the end, DiResta says, this problem may not have a solution. As Amazon keeps cracking down, paid reviewers will keep finding ways to evade the company's attempts. Customers can turn to outside review sites like CNET or Wirecutter to find transparent information. But as long as there's a business incentive to game them, online user reviews will remain muddy waters.
AILSA CHANG, HOST:
Time now for All Tech Considered.
(SOUNDBITE OF ULRICH SCHNAUSS' "NOTHING HAPPENS IN JUNE")
CHANG: Maybe this sounds familiar. You buy something online, and when it arrives, it's not quite what you expected. But the product had dozens of glowing reviews, like 5 out of 5 stars. Well, outside auditors say be careful. Unreliable reviews are all over e-commerce sites. They come from an underground economy where sellers pay for shining reviews. Reporter Ryan Kailath explains.
RYAN KAILATH, BYLINE: A brand new iPhone charger, like, from the Apple store costs almost 40 bucks. But Amazon has hundreds of cheaper options. That's where I got a knockoff charger recently for a third the price.
Plus free two-day shipping.
You know what this is? I've been waiting out for it. It's one of those cheap iPhone chargers, but for some reason...
PRINCE PATTERSON: Oh, the Amazon Prime ones.
PATTERSON: I just went through, like, three of those already, bro.
KAILATH: Prince Patterson drives for UPS.
Yours were good, or they were not good.
PATTERSON: They're so-so. They're a so-so charger.
KAILATH: That's the thing. These cheap chargers can range from just fine to terrible. The worst ones can fry your phone. So how do you find the good ones? In theory, user reviews help with this. If a hundred other people say the thing works great, it must work great, right? Unless...
Where you can get sellers, like the guys who make these cheap products.
PATTERSON: Mmm hmm.
KAILATH: I explain that some sellers will actually pay a few bucks for positive reviews.
PATTERSON: Now you've got me, like, wondering - that's what I look for. Before I buy anything off Amazon, I read the reviews. So now I'm wondering, like, damn, are these legit reviews?
KAILATH: Outside sites like ReviewMeta and Fakespot estimate that for certain popular products on Amazon like phone chargers, Bluetooth speakers, more than half the user reviews are suspect. Amazon disputes those estimates.
SHARON CHIARELLA: Our approximation is that less than 1 percent of reviews are inauthentic.
KAILATH: Sharon Chiarella is Amazon's vice president of community shopping. We should note here the Amazon is an NPR sponsor.
CHIARELLA: We have built a lot of technology to assess whether or not we think a review is authentic. And there's a lot that goes into that.
KAILATH: Amazon looks for suspicious patterns and scores incoming reviews for trustworthiness. Penalties for cheating can be harsh. In the past three years, Amazon sued more than a thousand sellers for buying reviews.
CHIARELLA: And when we do those lawsuits, we subpoena the bad actors to get data from them. That allows us to identify more bad actors and spider out from there and train our algorithms.
KAILATH: But as Amazon gets better at hunting them down, paid reviewers employ their own evasive maneuvers. I spoke with several online. One agreed to call me.
TRAVIS: Hey there.
KAILATH: Hey, Travis. What's up?
TRAVIS: Not much, just got out of school.
KAILATH: Travis is a teenager living in the Northeast. He asked that we use only his first name to avoid the attention and possible legal action from Amazon. Here's how it works. There are these sort of shadow marketplaces online set up just to buy and sell reviews - private Facebook groups, Slack channels, subreddits. Sellers congregate there, hawking all kinds of stuff.
TRAVIS: Ethernet cables, flashlights, protein powder, fanny packs.
KAILATH: If something catches Travis' attention, he approaches the seller, and they negotiate terms. Generally after he buys the product and leaves a five-star review, the seller will refund his purchase plus a few bucks for the trouble. Travis says he earns a couple of hundred a month this way, and the sellers provide detailed instructions to avoid detection.
TRAVIS: Order here at the Amazon link. Don't click any coupons. Review within four to five days after receiving. This one's pretty important because if you review too soon after receiving, it'll look pretty suspicious.
RENEE DIRESTA: It's sort of a whack-a-mole problem for Amazon in that the efforts to game the system persist.
KAILATH: Renee DiResta researches disinformation online. She explains that in this black market, Travis is like the low-level street dealer. The people who commission him are often companies selling products on Alibaba, the Chinese e-commerce giant. They want to penetrate the U.S. market using Amazon's reputation and the cachet of its user reviews to do so.
DIRESTA: If you order from Alibaba, it's going to take six to eight weeks to arrive. It's not a great experience.
KAILATH: As Amazon keeps cracking down, paid reviewers will keep finding ways to evade them. Customers can turn to outside review sites like CNET or Wirecutter to find transparent information. But as long as there's a business incentive to game them, online user reviews will remain muddy waters. For NPR News, I'm Ryan Kailath. Transcript provided by NPR, Copyright NPR.