Research method
Prototype Testing
Use usability study tools or specific prototype testing tools such as Maze to set recruited participants specific tasks to complete on a prototype version of a page, functionality or website. This is usually conducted remotely (see remote usability studies) but can also be in a moderated setting.
When to reach for it
To validate that a proposed solution has the intended impact in improving the user experience. Identify any issues pre-development.
Strengths and limits
Pros
Gather qualitative data to support a design or functionality change before (or instead of) AB testing.
Prototype testing is beneficial when you can't AB test due to technical restrictions or traffic limitations.
Prototype testing tools tend to be relatively inexpensive.
Cons
Creating a prototype for testing can be time-intensive, depending on the functionality you're testing.
If you're going on to AB test as well running prototype testing will slow down the process of getting test results.
Technical issues with the prototype during the sessions can negatively impact the validity of the insights.
As with usability studies, you need to consider the wording used in your questions and tasks, to prevent leading participants and invalidating your insights.
Practical considerations
Tools
You can use any usability study method or tool to run prototype testing, such as remote, remote moderated, moderated, Userlytics, Usertesting.com, etc. You can also use a specific prototype testing tool, such as Maze.
Sample size
The same logic as usability studies applies here. Nielsen Norman says "The answer is 5, except when it's not" regarding usability study sample size. We use this as a guide; but one that should be considered rather than followed blindly. For example, if you're testing on multiple devices or with different user types, then you need to apply this rule to all of those segments. You may also want to add 1-2 additional "buffer" sessions to account for poorer quality participants, tech issues, no shows, etc.
Common tools
Go deeper
Recipes that use this method
A method earns its value when its signal corroborates others. Here is where this one does its work.
Last updated
.svg)
