Quantifying the User Experience: Practical Statistics for User Research

by Jeff Sauro, James R Lewis

Quantifying the User Practical Statistics for User Research, Second Edition, provides practitioners and researchers with the information they need to confidently quantify, qualify, and justify their data. The book presents a practical guide on how to use statistics to solve common quantitative problems that arise in user research. It addresses questions users face every day, including, Is the current product more usable than our competition? Can we be sure at least 70% of users can complete the task on their first attempt? How long will it take users to purchase products on the website?

This book provides a foundation for statistical theories and the best practices needed to apply them. The authors draw on decades of statistical literature from human factors, industrial engineering, and psychology, as well as their own published research, providing both concrete solutions (Excel formulas and links to their own web-calculators), along with an engaging discussion on the statistical reasons why tests work and how to effectively communicate results. Throughout this new edition, users will find updates on standardized usability questionnaires, a new chapter on general linear modeling (correlation, regression, and analysis of variance), with updated examples and case studies throughout.

Completely updated to provide practical guidance on solving usability testing problems with statistics for any project, including those using Six Sigma practices Includes new and revised information on standardized usability questionnaires Includes a completely new chapter introducing correlation, regression, and analysis of variance Shows practitioners which test to use, why they work, and best practices for application, along with easy-to-use Excel formulas and web-calculators for analyzing data Recommends ways for researchers and practitioners to communicate results to stakeholders in plain English

Genres: Design, Nonfiction, Research, Usability, Technology, Business, Science

356 pages, Kindle Edition

First published March 16, 2012

Reviews

[José Campos · Rating 3 out of 5]

Tough reading: this book requires strong statistics background to be fully understandable and useful to the reader. Good entry point for those who are looking for pointers into the quantitative side of user research. The main controversies regarding user research methods are robustly addressed, mostly based on recent developments in statistics that support ex. the validity of small samples in usability testing. There's also a good overview and comparison of questionnaires.

I missed a more practical and condensed set of guidelines for statistics laymen that one could use directly in everyday tasks.

[Amy · Rating 5 out of 5]

This book provides well-written instruction on the practical aspects of quantitative analysis in user research. Having a course or two of college-level stats is helpful for understanding the content. I appreciated the examples, the history and background for some of the conventions, and I was glad to see some controversial statistical issues handled in a very even-handed way. Also--I hope you like reading about confidence intervals because the authors evidently love writing about them (and calculating them, too).

[cazzy]

I hate statistics, so my rating of this book would be 0/5. But that's a silly thing to do. I just read this entire book for class and feel like it should count towards my Goodreads total. >:(

[Gabe · Rating 5 out of 5]

My artwork was used by the author on page 244!

[Elisa · Rating 4 out of 5]

It's a shame that I was just about finished my certificate program in applied stat when this came out. It's really all I needed to know to add great quantitative analysis to my UX research!

[Noelle · Rating 3 out of 5]

It's fairly decent, nice reference points for measuring user experience, but it is very math-y. So depends on the reality of what you need in a workplace, and how much you want to emphasise quantitative measures of success versus qualitative measures in your organisation.

In the reality of most organisations I've worked in, it's mostly qual, and in as far as you get with quant, you can do with the HEART framework.

I think is a good reference book to have in the bookshelf when you know that you will have to measure success in metrics... and perhaps if your role is focused on pure User Research.

I think some of these things mayyy just be a bit old school, but still very useful!

[Bogdan · Rating 4 out of 5]

Very good book on using statistics in usability. I don't have a lot of knowledge / experience in usability testing (so no opinion on that), but the book gives a very good overview of the statistical methods that usability researchers should use (and unfortunately often don't).

I also liked the numerous reminders about the formulas and what the Greek letters represent (Really useful to have reminders on what everything means when you don't work with stats / data analysis in a research setting or on a constant basis).

[Ejaz Asi · Rating 4 out of 5]

If you haven't taken or grasped some decent Stats courses, you will still learn but not as much as you would with understanding of statistics. Will also most likely require second reading for most of us.

[陈 元伟 · Rating 5 out of 5]

Scientific and systemic approach for customer development.

[Shanbao Tong · Rating 5 out of 5]

It is very good book more on statistics than user experiences, though it is focusing on how to analyzing the data of iUX.

[Christopher Prosser · Rating 5 out of 5]

A great book for understanding how to reason with small sample sizes in user research.