MedTech Terms
    The authoritative reference
    Back to Risk & Usability Deep Dive
    Quality & RiskQuality SystemStartup Lifecycle

    Summative vs. Formative Evaluation

    Iterative usability studies (formative) vs. final validation testing (summative) of a device's user interface.

    Reviewed by Christian Espinosa, Founder, Blue Goat CyberLast reviewed September 19, 2026

    Definition

    Formative evaluations are exploratory tests during design used to identify usability issues. Summative (validation) evaluations occur on the final design with representative users in realistic conditions to demonstrate critical tasks can be performed safely and effectively. Formative work often uses small groups, prototypes and think-aloud methods, and results drive design changes. Summative validation per FDA guidance and IEC 62366-1 typically uses at least 15 participants per distinct user group, tests the final user interface including labeling and training, and focuses on critical tasks. Use errors seen in summative testing must be analyzed for root cause and residual risk.
    What the regulation says
    Formative evaluations are integral to the human factors engineering process, allowing manufacturers to identify and mitigate potential use errors early in the development cycle, as outlined in FDA guidance `Applying Human Factors and Usability Engineering to Medical Devices`. Summative evaluations, often referred to as validation testing, are mandated by standards such as IEC 62366-1 `Medical devices - Part 1: Application of usability engineering to medical devices` to confirm the device

    What this means in practice

    Per FDA HF guidance and IEC 62366-1, summative studies typically include at least 15 users per distinct user group. Findings from summative studies that surface new use errors must be addressed before market.

    Examples

    • During the development of an insulin pump, a formative evaluation identified that the on-screen menu navigation was confusing to users, leading to a redesign of the user interface.
    • A summative evaluation for a new surgical robot involved experienced surgeons performing simulated procedures in an operating room setting to confirm critical tasks could be completed without hazardous use errors.
    • Prior to submitting a 510(k) premarket notification to the FDA, a medical device manufacturer conducted a summative human factors study for its novel infusion pump to demonstrate safe and effective use per FDA guidance.
    Common pitfalls
    • •Confusing formative testing with design verification; formative evaluations are for improvement, not formal verification.
    • •Failing to adequately document formative evaluation findings and subsequent design changes, hindering traceability for regulatory submissions.
    • •Conducting summative evaluations with non-representative users or in unrealistic environments, invalidating the study’s findings.
    • •Underestimating the resources and time required for a robust summative evaluation, leading to rushed or poorly executed studies.

    Frequently asked questions

    Formative evaluations should be conducted iteratively throughout the design and development process, starting from early prototypes and continuing as the design evolves.

    Cross-references

    Part of

    Related terms

    Grouped by theme
    Cited by

    Where this term appears across MedTech Terms.

    Learning paths (1)

    Latest in MedTech

    Sources

    3 sources

    Every citation below opens the original document. Each is graded against our source-tier hierarchy so you can see what rests on binding law versus commentary.

    Tier 2Regulator guidance and consensus· 2Tier 4Trade press and expert commentary· 1
    Link health: 3 verified· last checked 2026-06-20
    FDA·2MDIC·1
    1. 1
      FDA Human Factors Guidance
      Tier 2 Verified
      FDAfda.gov
    2. 2
      MDIC Case for Quality
      Tier 4 Verified
      MDICmdic.org
    3. 3
      FDA - Quality Systems
      Tier 2 Verified
      FDAfda.gov

    Inline markers like [1] jump to the matching reference above.