24 Examples of Design Testing
John Spacey, July 10, 2022
Design testing is the process of validating or optimizing a design. This can be pursued at the level of a product, design element or design concept. The following are common methods of design testing with examples.
A/B TestingA/B testing involves preparing two designs and comparing measurable results such as conversions or click-through.
BenchmarkingBenchmarking is the process of comparing a design to a known best result. For example, comparing the conversion rate of a landing page to the best conversion rate that you have sustained in production. This is a type of A/B testing whereby B is the benchmark.
Multivariate TestingTesting multiple variables at the same time as opposed to simple A/B testing. For example, asking users to score design alternatives in 22 ways.
SurveysCollecting multiple variables by asking customers to fill out a survey after using a design.
Interaction DataAllowing users to use a design so that you can collect multiple variables such as user timings and flow. This can be analyzed using analytics and similar tools.
Parallel TestingTesting multiple variations of the same design at the same time. For example, testing 22 colors of a product to gauge customer reactions.
Massively Parallel TestingTesting a large number of variations. For example, testing thousands of link colors in production using millions of users.
Field TestingTesting a design in the real world. For example, testing a new snowboard design on a ski hill.
Throwaway PrototypeBuilding a quick, cheap and safe prototype to get a design in front of users or into the field.
Design ExperimentsConducting controlled experiments to test a design. For example, subjecting a chair that uses an unconventional material to stress testing to determine its durability.
Open-ended InterviewInterviewing users to gauge their feelings about a design with an open-ended question such as "how did you feel about the product?" This is a preferred interviewing method that allows the customer to tell you what they really think. Difficult to capture as data.
Ladder InterviewA ladder interview starts with an open-ended question and goes to great depth with followup questions based on responses. This can produce much insight but is difficult to analyze because each interview is completely unique.
Close-ended InterviewAsking survey type questions that have few options in an interview. For example, "how would you rate the product color on a scale of 1-5?" This allows for precise data capture but isn't nearly as insightful or useful as an open-ended interview.
Recall InterviewSeeing how much users can remember about a design after using it. Indicates things like brand awareness and product positioning whereby you want a design to stand out and be memorable.abilene paradox whereby people adjust what they say to conform to the group such that results are less candid.
User ObservationWatching users as they use your products or services. For example, giving people a smart watch and seeing if they can figure out how to use it intuitively without instruction.
Demographic StudyPerforming tests for a cohort based on demographics. For example, an observational study that identifies differences in how different age groups use a remote control for an air conditioner.
Psychographic StudyPerforming tests for a cohort based on how people think. For example, testing snowboard graphic designs with a cohort of consumers who like hip hop music.
Design ImmersionHaving the design team use the design in real world conditions to prevent naive design. This may resemble empathy training. For example, designers of a wheelchair who use the wheelchair design everywhere they go for a week. This tends to be amazingly fruitful in improving a design.
Test & IterateThe process of quickly and aggressively testing, changing and testing again.
Optimization MyopiaThere is much danger in using data to optimize things whereby you may miss the big picture. For example, spending months changing the color of a product based on a/b testing but missing the fact that the product is completely unusable and unreliable.Quality control is the process of confirming that an instance of a design conforms to requirements. For example, testing that a product performs its required functions.
Design TestingThis is the complete list of articles we have written about design testing.
If you enjoyed this page, please consider bookmarking Simplicable.
The steps in a design process.
The different between design-to-value and design-to-cost with examples.
A list of design objectives.
An overview of critical design techniques.
The definition of speculative design with examples.
The definition of design analysis with examples.
A list of common design goals.
The defining characteristics of modernism.
An overview of design management with examples.A comprehensive guide to design.
A list of creative hobbies.
A list of aesthetic things.An overview of game design with examples.
An overview of digital design with examples.
An overview of concept design with examples.
An overview of design function with examples.An overview of design composition with examples.
TrendingThe most popular articles on Simplicable in the past day.
Recent posts or updates on Simplicable.