BookNotes: Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
By Jeffrey Rubin, Wiley, April 15, 1994, 978-0471594031
Jeffrey Rubin gives a “kind of” handbook. If you have never heard of usability testing, then this book is for you. It walks you through the general tests. The problem is that it has a dearth of real world examples. Basically, there’s only one, whereas usability testing is extremely complex. Usability testers may not be able to get ahold of enough (or any) subjects. There are other ways to test usability, such as, capturing live usability data from deployed applications. I had problems with the his assumption that user interface experts were highly-experienced generalists. This may be the case, but you can’t assume it. Most people are neither highly-experienced nor generalists.
[p12] In an even worse prostitution of this principle, customer contact has become institutionalized in many organizations, with designers requiring customer visits merely to complete a checkoff box on their performance appraisal form.
What is required is a systematic, structured, approach to the collection of information from and about users. Designers require training from expert interviewers before conducting a data collection session. Otherwise, the results can be very misleading.