Most travelers are skeptical of user-generated hotel reviews

When it comes to online hotel reviews, travelers don’t believe everything they read.

Far from it.

Asked what they thought of property reviews posted by guests online, more than 8 in 10 described them as only “somewhat reliable.” While many of the write-ups are legit, they added, they believe hotels sometimes manipulate the system by posting bogus reviews. Equal numbers of travelers (7 percent) said they thought online hotel reviews were either “very reliable” or “not reliable at all.”

No “be all, end-all”

“I use sites like TripAdvisor to get a temperature or general feel for a property,” says Nathan Kam, a communication consultant who works in the tourism industry. “But I don’t consider it a ‘be all, end all’ source for information. I take what I find there and cross-check it with my other social networks — friends on Facebook, and maybe check in with my followers on Twitter to see what they have to say — and always check with a travel professional or two who might have an opinion. It seems like more work, but it’s worth the time to ensure you don’t end up with something surprising upon check-in.”

Kam’s comments reflect a majority of the reader feedback to this poll of more than 700 readers of this site and Consumer Traveler, which was conducted last week in cooperation with the Washington-based Consumer Travel Alliance.

Some respondents said they use online reviews for research purposes, but not to justify a booking decision.

“I generally use hotel reviews only to verify quantitative information, especially for international hotels,” says Tom Logue, a marketing consultant. “Is there an airport shuttle, restaurant within walking distance, wireless in the rooms — things like that.”

If Logue sees comments that say the airport shuttle only runs every 30 minutes, then he knows there’s a real shuttle, “not an overambitious hotel manager stretching the truth on his website,” he adds.

Reading between the lines

Many poll respondents said they read the reviews with a skeptical eye, mindful that some reviews are authored either by hotel employees or rival properties.

“No one review will influence my decision, I think I’m experienced enough to read between the lines,” says Jack Vanesko, a retiree who lives in Ajijic, Mexico. “I look for a pattern of consensus, especially as to what is important to me. Is it near a train station? Is there access to the airport?”

Still, he’s been disappointed by the resulting booking decisions about 10 percent of the time, a number he nevertheless considers “acceptable.”

For some readers, open participation by the hotel in the review process sometimes legitimizes the reviews, if not the property.

“If a complaint about a hotel seems serious, I’ll look to see if the hotel responded,” says reader David Farnham. “If it didn’t, I’ll scratch that hotel from my list. If it did, I’ll read the response and then judge based on both the complaint and the response.”

Seeing stars

Others don’t bother reading the reviews, focusing instead on the number of stars a property has.

“I think the real indicator is to look for consistency in the reviews,” says Bryan Neft. “If there are 100 reviews and 95 are 5-star reviews, then you have a pretty good indicator that the place is reliably good. But, if there are evenly mixed reviews in all star categories, then you may have a place that is inconsistent. If there are a few low-star reviews, I will look at them to see if there are any real problems with the property, which is rarely the case.”

The guests who post to online review sites acknowledge they are imperfect.

“What I have tended to see is a mixture of both really positive and really negative reviews,” says Peter DeForest, an occasional poster to TripAdvisor. “Which makes, sense since you would need to feel strongly to make the effort to post a review. If you were ambivalent, why would you post?

What do the results mean?

Contrary to what some travel experts claim, user-generated hotel reviews have an important place in the universe of travel content, although it may not be the place these sites covet. Far from being definitive guides that speak authoritatively about the quality of a hotel or resort, their user-generated comments are read critically by travelers, aggregated and then weighted against multiple other criteria before a booking decision is made.

  • Vince Marano

    I certainly agree with the survey and voted the same way. Being 20 years removed from being a road warrior I try to do my due diligence when planning a trip. Two recent trips and hotel reviews come to mind. On a trip to California, I wanted to revisit Hearst Castle and the reviews were harsh about local hotels and especially no AC. At Hearst Castle the temp was in excess of 95 but returning to hotel, jacket and long pants were required in the evening because of the temp difference. Glacier National Park was another, read complaints about lack of amenities and creature comforts versus cost. This a National Park lodge and is open for 2 1/2 months per year. One of my most memorable vacations and was not a slave to my PDA.

  • http://xrrf.blogspot.com Simon HB

    This is just common sense, isn’t it? Everything you read on the web you should approach with an open mind and take an analytical approach.

    With some TripAdvisor reviews, you don’t even need to read much between the lines – some reviews contain such petty observations you know that they’re written with a red mist and are, at best, unreliable. For example, one hotel I was researching had a review which – amongst other complaints – speculated that he might have seen a woman in the hallway who could have been a prostitute, which was then spun out into a ‘what sort of hotel turns a blind eye to cascades of hookers’ complaint. Clearly, an unreliable witness.

    Hotel reviews are like any other review; the value in them lies in how much store you set by the reviewer.

  • Phil

    I post reviews of all hotels I have stayed in on TA which mounts up to a lot of reviews. When I read the reviews on TA I look at how many reviews a poster has posted, and I also look at the date of the post. I don’t think that reviews that were posted over say a year ago hold little or no weight any longer. Things change either for the good or bad and I think it is important to read reviews that are up to date. I also look at responses from hotel management regarding reviews, favorable or unfaborable. I did have a response from management of a Mercure hotel in Sydney regarding some negative thoughts I had about the hotel. Did not agree with management and what they had to say, but at least they did respond. Again, one must take these reviews with a grain of salt and I do try and cross check the reviews on TA with reviews from other sites. I have noticed however that lately when I post a reviewon TA it is sent to Virtual Tourist.com also, I don’t particularly like this, each web site should do its own work and have it’s own reviews by its members.

  • http://www.conferencesbydesign.com Karen Brown

    I use TripAdvisor and Google reviews quite a bit – with some filtering.
    Glowing reviews that start off with “we were comped an ocean front suite for our entire stay” are going to be a bit prejudiced, as are “I paid on Priceline and was treated rudely and put in the back with a dumpster view”. I also skip any review with complaints about the cost of parking or internet services.

    I do look for reviews that include traveler’s photos. An ocean view room that is 95% parking lot with a small sliver of blue to the far right is really evident in a photo. On the flip side, complaints of ‘cramped quarters’ with a photo that displays a fairly typical New York hotel room can show me that the poster probably doesn’t travel to large cities very often.

  • http://www.inspiredgiftgiving.com Marquita Herald

    I’m (also) a former “road warrior” of some 20 years in the travel industry. Having spent half my life in hotels traveling the world promoting Hawaii, these days I tend to be more than a little picky about where I stay when on the road again. I do still read reviews, especially Trip Advisor, but mostly watching for any serious red flags, but I would never pick a hotel, or destination for that matter, based solely on reader reviews.

  • Jonathan Yarmis

    I think your headline is wrong. Most travelers find user-generated hotel reviews interesting and worthwhile…and are smart enough to realize there are frequent attempts to game the system.

    I think less of hotels that do this. They don’t trust the independent reviews so they have to try to skew the balance…which only makes me think they’ve got something to hide. Do they really believe the “our people our great, our facilities are amazing” messages sound credible when the vast majority of reviews say otherwise?

  • BillC

    I usually look at the overall score and then read the low ratings.
    I want to see if the complaints are genuine or just nit-picky. If a hotel has a fairly good rating but the negative reviews are along the lines of – I found a dust bunny under the bed and they didn’t give me a full refund – then I feel the review is probably accurate.

  • Suki

    Tripadvisor is my travel bible and I usually select a hotel based on its user reviews. I have never been disappointed in this strategy. Nevertheless, I do read a lot of the reviews to get a feel for their “truthiness” as other commenters do. Some things that people complain about: fitness center, spas, concierge services don’t concern me as I don’t use them. It also gives me the confidence to book obscure small places that I might otherwise overlook (shout-out to Gobi Pension in Bergama, Turkey). Everytime I come back from a vacation, I pat myself on the back for having picked great places based on Tripadvisor. And I am not associated with TA in any way except as a big fan and contributor. I contribute reviews basically to give back–I benefit from the reviews I read and submit so others can get the benefit of my experience–good, bad or indifferent. TA does try to clamp down on fake reviews and like others, if I see the poster only has 1 contribution then I discount it. One thing I would like TA to clamp down on are the useless thank yous from management if somebody has a good time. They take up scrolling space and add nothing to my research.

  • Andrew

    “But I read it on the internet! It must be true!”

  • http://www.santafecheapskate.wordpress.com ChelseaGirl

    I’m surprised that people would look askance at traveler reviews; I think they are the best way to find out about a property and certainly better than just looking at the hotel’s Website. Few newspapers or magazines actually review properties, although supposedly they have checked out the ones they mention in travel articles. I never book anything without checking it out on Trip Advisor, and it’s saved me from staying in some places that I’m sure I would have been unhappy with. I find that generally, reviews of a property are either overwhelmingly good, overwhelmingly bad, or neutral (just “OK”). Even when the reviews are mixed, there is usually a majority of either good or bad comments. You can always spot the cranky people (e.g., the ones who stay at a property off a major highway and complain that there is no view; the ones who actually expect to get a good breakfast at Days Inn), and I don’t pay attention to them. If it’s a two-sentence review (like, “This place is great! I’d come back!”), I disregard that too, because there are no details and it may have been posted by someone connected with the property. If you use the site often enough, you know how to weed out the nonsense.

  • http://www.crystal-tours.com Steve Barofsky

    We are tour operator specializing in Italy land services including hotels and sell mostly to travel agents.

    HOTEL REVIEWS ONLINE should be taken with a grain of salt. In our pursuit of obtaining repeat business from our base market it is important that whatever the service we provide – be it transfers, sightseeing w/private guides with or without, shore excursions, etc. and of course hotels we need positive feedback because without it we don’t stay in business.

    It’s a good idea that clients get in touch with their travel agent for input or contact us for feedback and if possible in their hometown or state a referral to a local agent they can use.

    I’ve stayed in hotels, 2 to 5 stars that have been panned by the online reviewers to my astonishment and over the years have been told by individual travelers and travel agents to book for them hotels they have seen on Trip Advisor that are in the top 100 out of 1250 in Rome, for example, and nothing else will do and take that advice over hands on experience at hotels we have stayed at or inspected.

    In many hotels we have personal experience with I can call the General Manager, the Sales or Marketing people, the Reservation Manager, the Concierge, etc. and request a nice room with a view, etc. to make sure our clients get the best the hotel has to offer at the time of arrival.

    I don’t say I have stayed at or know every hotel in Italy (that’s impossible) but can reach out people in Italy “in the business” for evaluations of whether the hotel will work according to our formula of matching the traveler’s needs to their desires.

    We realize people want to be their own travel agents and research the internet to find their own accommodations that provide value, quality and satisfaction for their dream holiday. There are so many stumbling blocks on that path they should seek a professional’s advice and then make their decision.

  • http://www.sanibel-rentals.net Sylvia

    I think the article captures the feelings of most travelers…look and compare. Owning vacation rentals and using same world wide, I am just plain skeptival of totally anonymous reviews regarding this industry. I read them, talk to owners, look intensely at websites and also use Facebook and the vacation rental portal http://www.secondporch.com to see if I know anyone or of anyone who has stayed at a property. I put much more faith into reviews/comments/suggestions when there is a real person behind them, rather than a cute “handle” that reveals nothing.

  • Tom

    “This hotel is VERY clean, I have been to fancier places but not cleaner. I would recommend this to anyone who wants clean and nice lodging but does not need a fancy place. Very nice staff, extremely clean and well cared for. VERY good value.”

    This reviewer gave the place four stars even though three people had died in a fire and 18 were injured, in part, because the owners had chained the exit doors to keep street criminals from sneaking in the buy drugs. So believe Travel Advisor if you want, but not me.

  • Monica

    I post on TripAdvisor after I visit a hotel. I try to give an fair assessment of the pros and cons. In some reviews, I’ve written something as a “neutral” comment because it might be annoying to one type of traveler, but not another. Those I try to clearly point out. In some cases, it boils down to what type of traveler you are.

    I think most comments are easy to determine whether they were written honestly and fairly. I’ve had decent luck using sites like TripAdvisor as long as I keep an open mind.

  • BucksterSF

    I think a better story would be to discover who actually rated the reviews “very reliable.”

    Probably just people skewing an internet poll. Go figure.

  • http://2ndplan.com/blog/ Eugene

    I always find myself reading those review ratings for hotels. But I’m not naive enough to believe everything I come across. I think in the end if you go to a hotel expecting a bad exprience and horrible service then thats what you will most like run into. Regardless of a great review of the hotel or not.

  • http://travel.justmarvelousworld.com/ Liudmila

    I completly agree with those who doesn’t believe the reviews even if I read them. I discovered on my own experience that the reviews are often “paid” by the competitors first, and do not corrispond the real state of the things. These kind of reviews is possible to find relatively often about the Italian hotels.

  • Mike Z

    @Tom, the comments you posted had nothing to do with each other. A hotel can be very clean and yet not comply fully with local laws.

    Personally, I do as the people above have mentioned, I read the reviews and see whatthe bad ones say and if they have a legitimate complaint. One review complaining about no hot water I would dismiss, but several and I would be worried. I’ve posted about a hotel before that was a total dump and I had stayed there 3 times. Each time confirmed the bad image I had and so finally I wrote a review and covered every detail. Shortly after a “family” from New Zealand supposedly stayed there and wrote a review suggesting it was a 5 star hotel. If hotels want to manipulate ratings, they should do so in a less obvious manner. (though the glowing reviews amidst a pile of “this place is a dump” ones are pretty comical)

  • ptkdude

    I used TripAdvisor.com when I was looking for a hotel recently in London. I had some criteria, however. For example, there had to be at least a few one- and two-star reviews. Things go wrong at even the best hotels in the world, and Americans seem to complain about everything, i.e. “there was too much street noise”. You’re staying in one of the largest cities in the world; of course there’s street noise! If there were nothing but 3-, 4-, and 5-star reviews, I moved on.

    I also reviewed the poor reviews to see if the complaint was something I would care about. If not, the review had no bearing on my choice. The same went for the glowing reviews. I don’t care about the nice chocolate on my pillow, so I ignored those, too.

    Ultimately, I booked a room at a nice, affordable hotel which was pretty conveniently located to the Tube. It wasn’t fancy by any means, but I had a very enjoyable stay and now know where to stay the next time I go. Plus, they responded to nearly every poor review on TripAdvisor, which gave them plenty of bonus points in my book.

  • Mike Z

    Just a follow up, but I have reviewed this hotel before. Stayed there a few times and also have visited the bar they have at the hotel as well as attended parties thrown there. Its so easy to spot the fake ones, thought you guys would get a kick out of it. http://www.tripadvisor.com/Hotel_Review-g50133-d95203-Reviews-Airport_Plaza-Brook_Park_Ohio.html

  • BucksterSF

    Does TripAdvisor offer special “owner access for a fee” like Yelp does? I wonder how they treat “underwriters.”

  • http://www.darngooddigs.com/ darngooddigs

    We use user generated reviews on websites like Trip Advisor or Booking.com to do research for our website, Darn Good Digs, as well as for our own travels. But like most respondents in the survey and in these comments, we use them as a source of information – but not the definitive source. What we find particularly useful about these reviews is that they provide information about smaller properties that are otherwise missed in guidebooks or more traditional sources. Only through the collective power of millions of travelers could we possibly get reviews on nearly every b&b, guest house, hotel, or pousada around the world! We think user generated reviews can be a powerful research tool – as long as they are used wisely.

  • http://dreamtravelvacation.com Nancy

    When I want to know more about a hotel, I do read user reviews and see what dates they were posted. Also, it depends on what amenities they have..if they have what I am looking for. If there are ‘too’ many negative reviews, I don’t bother with that hotel. It’s more of following my instincts.

  • Cate B

    I work for a hotel that’s had some issues with TA. We do not allow anyone under the age of 21 to check into a room as we have a bar on property and have a zero tolerance policy for underage drinking and have refused to check in groups of young adults with one person in the group being 21 with the rest being 18-19. We cater to mostly business travellers and families and have gotten mostly very good to excellent reviews on TA.

    About 8 months ago we had a group of young adults try and check in. There were 8 of them with one being 21 and the rest of them being 18-19. They also had about 6 cases of beer and about 12 bottles of liquor with them that they had loaded onto a luggage cart. We refused to check them in and they made a big stink about it as they according to the oldest in the group “just wanted a place to party”. Another hotel in the area took them and they ended up all being arrested after the other hotel called the police to break up the party they threw in the room.

    About a week after this happened we started getting alot of bad reviews on TA which were posted by people who had just registered that week with the review being their first one. The reviews were ovious BS. There were things like “we had refused to check in a mother and baby at 2 am when they had a reservation”, “we kicked out a 76 year old woman at 1am for making to much noise”, “there were roaches all over the room” and other stuff like that. Our hotel is a 3 1/2 star property with managment that would never allow anything like that to happen. We contacted TA and explained the situation and it took them about a week to remove the 45 reviews like that that were posted. We have every reason to believe that the group we refused to check in was behind this and it was done out of retaliation.

    As a result of this I take TA reviews with a grain of salt. I look to see what the ratings of most of the reviews are and how long the person has been a TA member before I make my decision.

  • Brooklyn

    The fake reviews are easy to spot. The problem is that people have different expectations, especially in the case of hotels abroad; a backpacker might describe as a “palace” a hotel that a business traveller would hate and “the owners are friendly and helpful” can mean just that; it can also mean that they speak English! I tend to prefer reviews by non-Americans, especially if I speak the language of the country, because I’m not looking for the Holiday Inn experience wherever I go!

  • Steve

    I think the key is to read sites like Trip Advisor but take individual reviews with a grain of salt. A lot of complaints are easy to dismiss if I don’t care about them (for example, complaining that the onsite restaurant I probably wasn’t going to eat at anyway was bad, or that the bar closed too early). I also think a lot of people give bad reviews to cheap hotels because they’re expecting a Hilton room on a Super 8 budget. I’ve stayed at perfectly adequate Motel 6 and Super 8 properties that got bad reviews because another traveler found a speck of dirt in the bathroom or something like that.

    I mostly pay attention to comments about the safety of the surrounding neighborhood (though again, you have to take it with a grain of salt) and about big issues like bugs.

  • barbie45

    I would tend to favor TA and it’s sister cruise critic rather than a solo review by a so calledtravel writer from a particular publication. I believe that often that writer has been given a freebie or perks to induce him or her to write a favorable review. Also some of the writer’s obvious prejudices come out debunking the entire ship or hotel. An example would be consumer travel alliance which Chris writes for often. The reviewer I will omit name has subjected and entire cruise ship for her smoking views. Also what is the sense of a vegetarian writer trying to review food. I go along with Arizona War warrior on a grade of at least eighty percent.

  • Linda Snow

    I look for number of stars (at LEAST 4) and number of reviews (say, at least 10 or so). I generally ignore the best reviews (might be posted by hotel staff, or else by Pollyanna types who tend to love everything everywhere). Then I look at the worst reviews and their specific complaints. Some complaints tend to be about things I don’t care about. Others you can tell are just from people who are anal-retentive nit-pickers. I pay attention to the date of the review, also to the origin of the poster (Europeans have different standards than Americans, for example). I follow up by looking at the hotel’s website and get a feel for what the rooms are like and whether they’re worth the cost, whether the location is convenient, etc. If a place has a much lower price than the general market I tend to be skeptical. I’ve been using Trip Advisor as my main resource for probably 4-5 years on multiple trips (domestic and international). I spend a good bit of time and don’t make quick decisions. Using this method I can say I’ve really never been disappointed with my choices. I also have to say I prefer this site over “professional” reviewers such as Frommer’s and Fodor’s because the pros also tend to only stress the good, never tell you about the bad, and prefer more expensive properties.

  • http://www.skoosh.com Matt

    I feel that in some way the increased influence on, and integration with, our lives that social media has had steps can in some way be taken to make use of that to increase credibility of review sources. I’m not sure entirely of the answer (its something that is vexing me a great deal myself), but if we can harness the many linkages that we build up in the course of our online lives to help us in this way I believe this can give peer reviews a lot of power for the consumer when making a decision.

  • Randy

    The real problem with user reviews is that people’s experiences and expectations vary so much, and the review sites don’t provide a way to indicate what sort of room they had.  

    Many hotels have a variety of very different rooms.  Someone who is given a suite is going to rave about the room, while at the same property another guest hates his dank closet; yet their reviews won’t mention what sort of room they had.

  • http://www.emaxhotelmarketing.com/our-history.php Hotel Marketing Consultants

    Several years ago TripAdvisor partnered with Market Metrix to create a
    customer satisfaction scoreboard designed for the needs of hotel
    managers. The key metric used is the Customer Satisfaction Index (CSI),
    which is a new score that rates each TripAdvisor review from 0–100 based
    on 7 questions from the TripAdvisor survey.