Rating not increasing despite many 5 star reviews

Explain what mathematics causes an average to move down when a single lower number is added, but the average does NOT move up when two higher numbers is added? That’s what was demonstrated to me. What mathematical phenomenon is that?

Thanks, your math is appreciated and makes sense. I’ll use this template as the reviews continue, to validate Airbnb’s method

1 Like

I’m going to bookmark this post and hope I remember it next time someone asks about this. It’s not uncommon for people to have this complaint. I know I’m still smarting over the one star that was given accidentally years ago. I’ve literally had hundreds of reviews since and I’m still stuck at 4.98.

2 Likes

I could illustrate it to you with a white-board/chalk-board really easily, but the reason is this: When you have an average and you add a new value into that average, the impact of the new value is proportional to the difference between the new value and the average.

To take your example again: When your average was 4.91, your next review was a 4.00. The difference between 4.00 and 4.91 is 0.91. However, if you had instead received a 5.00, the difference between 4.91 and 5.00 is only only 0.09. Comparing those two differences is where you can see the impact: 0.91 is literally more than 10 times bigger than 0.09, which means it has 10 times more impact. Put another way, at that point in time, you would need 10 5-star reviews to “move the needle” as much as 1 4-star review. Back to your example, the single 4-star review dropped your overall rating by 0.03 from 4.91 to 4.88. However, if you had instead received 10 5-star reviews in a row, your rating would’ve increased by 0.03 from 4.91 to 4.94.

7 Likes

Brian, you illustrated it nicely. My prior question was for Ken. But I appreciate you breaking down the math.

It would take 400 five star reviews to get back to 5.0 after a single one star review. 4.98 is great!

2 Likes

I think so too. That one star just stung because it was an accident. I also have a 3 star and some 4 stars.

2 Likes

Well. Well, Well… you guys aren’t going to believe this. My next review came in for this property. And as I mentioned here, I’ve been watching it like a hawk to see what impact each review has. Get this! I got another 5 star rating, and my rating on this property is now a 4.86!!! It moved DOWN from 4.88!! There were no other reviews, just 5 stsrs for the last 3 guesrs, and my score went down. Now I KNOW there is no mathematical phenomenon to explain this. I’m pretty ticked so I called Airbnb. The first rep had me on hold a while and then the call suddenly disconnected. No call back. So now I’ve called back and am on hold with the rep. I’d really like to see how they explain this. SMH.

What say you to the fact that a 3rd 5-star review has sent my score down from a 4 88 to a 4.86? Something is going on and I’m going to get to the bottom of it.

OK, that’s strange. I’m curious.

2 Likes

Aren’t the ratings done on the last 12 months? You have a total number, but the last 12 months is what counts….how many fell off?

This, it’s a moving average over the last 12 month.
So if you gain a 5 star, but another 5 star moved out of the 12 month window, the average will stay the same.

I think it is a good system, it gives you a chance to increase and loose the low ratings.
Ofcourse now with COVID-19 this could also backfire because you have less reviews.

Due to being closed for 9 months my rating went up from 4.7 to 4.9. The main reason is skipping the low season with all the difficult guests.

2 Likes

I haven’t had a 4 star rating since summer of 2019. 110 straight 5 star reviews and my average is 4.98.

1 Like

I have 2 different ratings.
I can See a 4.77 average over 678 Reviews and a 4.92 over the Last 12 months.

Seems COVID is going to make me a superhost…. But I probably jinxed it now….

2 Likes

I do t think that sliding date period is for the listing rating, just for super host.

It’s exceptionally concerning to me that they identified this as a known bug in 2020, and now 4 years later I’m experiencing the exact same issue. Initially, I had two reviews: 5 and 4. That averaged to 4.5. I received a third review with a score of 5. The calculated average was then 4.67 ((5+4+5) / 3 = 4.67), which should round up to 4.7. However, my review score on AirBNB was stuck at 4.5.

I messaged support about the issue, and they informed me of this bug and that their engineering team would investigate (apparently they’ve been investigating for 4 years if this original post is true!!). In the meantime, someone on their end manually updated my score to the correct 4.7 value.

Now, I’ve received two more 5 star ratings, but my score is stuck AGAIN at 4.7 instead of 4.8 (5+4+5+5+5) / 5 = 4.8

So I messaged support again to tell them that my score was stuck at the wrong value for a second time. Now, they say they can’t manually update the score to 4.8, as they have no way of manually changing rating values. Then tell me how the first time they could update it from 4.5 to 4.7, and now all of a sudden there’s no possible way for them to update scores manually??!

This company is a complete joke. Every time I give them an opportunity to prove otherwise, they completely fail.

3 Likes

Can I ask why you’re using Airbnb if you think that the company is a joke? I don’t understand the logic. Please let us know.

Because VRBO is arguably worse, so there’s no other viable option. But since you asked, we’re taking it down and converting to a long-term rental next month. Officially had it with their horrible customer support.

But you can continue to enjoy their customer support!

Really? How do you suppose we kept successful STR business running in the days before Airbnb and VRBO?

In many years I think Ive called CS twice. I can handle my business myself; I don’t need to rely on customer support. You should try it.

1 Like

No one enjoys their customer non-service, but like Jaquo, I have had to deal with them very little. And believe it or not, occasionally they have been very helpful. (there is a Superhost number in Canada where I seem to get pretty good reps. Messaging with their farmed-out Filipino “support” staff requires multiple messages before they even understand what the issue is)

1 Like
{"found_math": false, "script_math_tex": 0, "script_math_asciimath": 0, "math_annotations": 0, "math_alttext": 0, "mathml": 0, "mathjax_tag": 0, "mathjax_inline_tex": 0, "mathjax_display_tex": 0, "mathjax_asciimath": 0, "img_math": 0, "codecogs_latex": 0, "wp_latex": 0, "mimetex.cgi": 0, "/images/math/codecogs": 0, "mathtex.cgi": 0, "katex": 0, "math-container": 0, "wp-katex-eq": 0, "align": 0, "equation": 0, "x-ck12": 0, "texerror": 0, "url": "https://airhostsforum.com/t/rating-not-increasing-despite-many-5-star-reviews/43505?page=2", "fetch_time": 1721728203000000000, "content_mime_type": "text/html", "warc_filename": "crawl-data/CC-MAIN-2024-30/segments/1720763518029.81/warc/CC-MAIN-20240723072353-20240723102353-00289.warc.gz", "warc_record_offset": 76633977, "warc_record_length": 9375, "token_count": 1597, "char_count": 6336, "score": 3.96875, "int_score": 4, "crawl": "CC-MAIN-2024-30", "snapshot_type": "latest", "language": "en", "language_score": 0.9756225943565369, "file_path": "/sailhome/yjruan/project/latent-lm/data/processed/finemath-4plus/finemath-4plus/train-00016-of-00064.parquet"}