All terms
Summative vs. Formative Evaluation
Iterative usability studies (formative) vs. final validation testing (summative) of a device's user interface.
Reviewed by Christian Espinosa, Founder, Blue Goat CyberLast reviewed May 5, 2026
Definition
Formative evaluations are exploratory tests during design used to identify usability issues. Summative (validation) evaluations occur on the final design with representative users in realistic conditions to demonstrate critical tasks can be performed safely and effectively. What the regulation says
Formative evaluations are integral to the human factors engineering process, allowing manufacturers to identify and mitigate potential use errors early in the development cycle, as outlined in FDA guidance `Applying Human Factors and Usability Engineering to Medical Devices`. Summative evaluations, often referred to as validation testing, are mandated by standards such as IEC 62366-1 `Medical devices - Part 1: Application of usability engineering to medical devices` to confirm the deviceWhat this means in practice
Per FDA HF guidance and IEC 62366-1, summative studies typically include at least 15 users per distinct user group. Findings from summative studies that surface new use errors must be addressed before market.Examples
- During the development of an insulin pump, a formative evaluation identified that the on-screen menu navigation was confusing to users, leading to a redesign of the user interface.
- A summative evaluation for a new surgical robot involved experienced surgeons performing simulated procedures in an operating room setting to confirm critical tasks could be completed without hazardous use errors.
- Prior to submitting a 510(k) premarket notification to the FDA, a medical device manufacturer conducted a summative human factors study for its novel infusion pump to demonstrate safe and effective use per FDA guidance.
Common pitfalls
- •Confusing formative testing with design verification; formative evaluations are for improvement, not formal verification.
- •Failing to adequately document formative evaluation findings and subsequent design changes, hindering traceability for regulatory submissions.
- •Conducting summative evaluations with non-representative users or in unrealistic environments, invalidating the study’s findings.
- •Underestimating the resources and time required for a robust summative evaluation, leading to rushed or poorly executed studies.
Frequently asked questions
Formative evaluations should be conducted iteratively throughout the design and development process, starting from early prototypes and continuing as the design evolves.
Cross-references
Part of
Related terms
Shared paths + categoryClinical & Trials
Human Factors Engineering(HFE)
Engineering discipline focused on safe and effective device use by intended users.
Risk & Usability Deep Dive
Standards
IEC 62366-1
Application of usability engineering to medical devices.
Risk & Usability Deep Dive
Quality & Risk
Use-Related Risk Analysis(URRA)
Analysis of use scenarios to identify potential use errors and their consequences.
Same category
Regulatory
Labeling
All written, printed, or graphic matter on or accompanying a device.
Risk & Usability Deep Dive · adjacent
Quality & Risk
Risk Acceptability Matrix
Pre-defined matrix mapping severity × probability combinations to acceptable, ALARP, or unacceptable risk.
Risk & Usability Deep Dive
Quality & Risk
Risk Management File(RMF)
Set of records and outputs from the ISO 14971 risk management process.
Risk & Usability Deep Dive
Latest in MedTech
Primary references
3 sourcesLink health: 3 verified· last checked 2026-06-20
FDA·2MDIC·1
- 1FDA Human Factors GuidanceVerifiedFDAfda.gov
- 2MDIC Case for QualityVerifiedMDICmdic.org
- 3FDA - Quality SystemsVerifiedFDAfda.gov
Inline markers like [1] jump to the matching reference above.