Summary: 3 reasons you should never do User Testing just once: Doing regular, phased, or iterative usability testing gives you the benefit of gaining additional validation on design direction. Its primary function is to protect usability quality as designs progress or get distorted by internal constraints. Regular testing can help you establish maturity or UX culture and can teach you the important UX skill of user advocacy.
How Usability Testing Works in Agile/Lean Organizations
Usability testing is the process of getting behavioral “does it work?” feedback from users. Usability Testing follows a “Think Aloud” protocol, where users actually interact with a prototype or finished design while being observed. Lean UX means frequent testing, often with fewer users. The idea is to get continuous feedback flowing into sprints. So, why is frequent testing essential to good ROI of UX? There are 3 hidden reasons it makes sense to do regular testing:
#1 Iteration to protect quality and usability
Unless your design, product, and development teams are operating as a 5-star UX team, you’re probably getting a lot of stakeholder “noise” being added to your User Interface Design. Usability testing helps you re-orient to the “third-person” voice of the customer. Since usability testing is behavioral observation, it helps give you design insight into the probability of error, confusion, and (task) failure. The more you do usability testing, the more you can include users and keep focused on their behavior and system usability. But there’s another hidden benefit of regular testing…
#2 Usability Testing: Starting point of UX culture
Usability testing has a hidden benefit that is not apparent unless you do a lot of usability testing. The benefit is cultural absorption. Absoring user culture in user testing is done by observing users actually interact with your site, app or experience. As a result, your design conversations become data-driven and user-centered. The influence of user culture on company culture is a cornerstone of all top-performing UX teams.
Making contact with users is how UX is institutionalized and made systematic in your organization. User contact is #1 in the 5 Characteristics of UX Culture (VIDEO). Of course, regular field studies are the “deep mind” of UX maturity because they ‘get you out of the building’ (GOOB), but usability testing, we consider the bread-and-butter way to develop UX competency.
#3 Frequent user testing teaches you user advocacy
One of the under-noticed benefits of usability testing is exposure to user cognition. User cognition equates to how users think. Users have their own ways of thinking about features and functionality. The more you think like your users, the more you can advocate for them in requirements gathering, business, marketing, and development decisions.
User advocacy is gained from understanding how users think, walking in their shoes, taking their perspective on issues like:
- Feature creep (aka featuritis)
- Configuration behavior
- ‘Average user’ behavior
User advocacy typically runs counter to how your development team thinks. Development cultures are technological sub-sets of company culture. Dev groups typically assume, for example:
1) Users know more than they do;
2) That users can do what they normally do (or most of it);
3) That shortcuts are helpful;
4) That features are more helpful than they usually are…
These are all symptoms of a lack of user advocacy. Regular usability testing helps boost your team’s intelligence regarding user behavior, i.e., what users are likely to do and think about a feature or UI.
At Experience Dynamics, we have learned (by many thousands of hours spent with users) to detect and understand user rules, behaviors, habits, values, beliefs, attitudes, and patterns. Observing how your users think ultimately makes you a better decision-maker, stakeholder, product manager, etc. In short, user advocacy is critical to doing good UX.
Conclusion
Usability testing is typically believed to be valuable because it helps designers and developers vet usability problems. While this is true, it is less recognized that iterative, rapid (Agile or Lean) usability testing is even more valuable due to its hidden ROI. Frequent, phased, or iterative user testing puts you in closer contact with users and how they think, ultimately making your conversations more evidence-based.
Think of usability testing as more than a one-off event. It’s a way to quickly measure that you are staying on track with the usability of your design. Since designs start as prototypes and evolve to fully developed code, it is important to keep getting feedback at each stage, especially if internal needs, decisions, or opinions have taken a UI or functionality implementation from what users will likely expect.
