Hotels Usability Study - Desktop - November 2017


We recently ran our first large-scale usability study for the hotel industry.

We benchmarked the ten biggest international hotel chains by running a large-scale usability test with more than 1,000 users.

If you own or run a hotel or any website that involves availability and booking, or you are just a fan of UX and customer experience, you will find the following data extremely useful. Enjoy!


We asked users to perform a typical scenario that included three tasks:

1. Search for availability and pricing for a room for two adults and two kids (five and six years old) for four nights in Barcelona (or any other city relevant to the hotel chain).

2. Go through the booking process until you reach the final confirmation button.

3. Find the address of the hotel.

For each task, we measured the completion rate, meaning how many users succeeded in finishing the task, along with the completion time. We also asked users to rate their experience for each task on a 1-7 scale from "very difficult" to "very easy".

We also included general questions about the aesthetics and delightfulness of the website.

Finally, we added the SUS (System Usability Scale) and NPS (Net Promoter Score) questionnares.


Task 1: Search for pricing and availability

The first task involved searching for prices and availability for a room for four people (two adults and two kids). The absolute winner was with an average completion time of 2 minutes and 20 seconds.,, and were pretty good as well with an average time below 3 minutes.,,,, and followed with completion times from 3 to 4 minutes. Finally, had an average completion time of 5 minutes and 42 seconds, indicating a serious issue with their search process.

Task 1 Average task completion time

Test completion rates show that has made the process fail-proof with a 97,12% completion rate. The rest follow close behind, while and had only about a 60% completion rate. This means that 40% of the people who tried to accomplish the task, did not succeed. The problem is even more prominent at, where only 33% of users managed to complete the task!

Task 1 Task completion rate

While time to complete and completion ratio are objective metrics, ease of use as rated by users is subjective and influenced by factors like aesthetics and the overall functionality of the website. In fact, since users don't measure their own completion times, this metric is more user-centric as it shows how users feel about the process.

Task 1 Ease of use

Task 2: Checkout

After finding room prices and availability, the next task was the booking (or checkout) process.

Again, had the fastest booking process, with an average time of 1 minute and 53 seconds. Very close behind was, which was eighth in time completion for the first task, along with, which was tenth in the previous task!

Task 2 Average task completion time

However, as the following graph shows, and also had very low completion rates, along with That means that it's only quick to checkout if you can figure out how.

Task 2 Task completion rate

Again, the final judge is the user. Users liked the checkout process of a lot, and didn't like those of,, or at all.

Task 2 Ease of use

Task 3: Find the hotel address

The third task we asked users to complete was to find the hotel address, a typical step after booking. had an average time of 25 seconds and was the leader of this task, with following at 29 seconds. For this task, and seemed to have the most problems, as it took about 1 minute and 15 seconds for users to find the address.

Task 3 Average task completion time

The above ranking is similarly reflected in the task completion rates. While 99% of users managed to find the hotel address on, only 83% could do the same on

Task 3 Task completion rate

Users rightly rated and highest on this task.

Task 3 Ease of use

Overall benchmarks

After completing the above tasks, users were asked to rate their overall experience based on the delight to use and website attractiveness or aesthetics.



We also asked them the NPS question, how likely they were to recommend the website to friends. The following graph shows the average of the NPS scores; although this is not the formal way of calculating NPS, it gives a clear picture as to how the hotel websites rank on this aspect.

Task 1 NPS

Finally, we asked users the 10-item SUS questionnaire that measures the perceived usability of the website. What was interesting here is that the SUS ranking was strongly correlated to the NPS ranking. In addition, the SUS scores reflect the overall ratings and completion times we recorded in the previous tasks.

Task 1 SUS

If you would like to measure your hotel's website, please contact us.

Take the next step

Start your user tests today and get better feedback

Create user tests using a better tool. No monthly fees. No credit card required to start.

Start testing

Book a live demo with us to see a better tool

Discover how powerful Userfeel is for doing user testing more effectively and ask us anything.

Book a demo call