MedTech Terms
    The authoritative reference
    All terms

    Summative vs. Formative Evaluation

    Iterative usability studies (formative) vs. final validation testing (summative) of a device's user interface.

    Reviewed by Christian Espinosa, Founder, Blue Goat CyberLast reviewed May 5, 2026

    Definition

    Formative evaluations are exploratory tests during design used to identify usability issues. Summative (validation) evaluations occur on the final design with representative users in realistic conditions to demonstrate critical tasks can be performed safely and effectively.
    What the regulation says
    Formative evaluations are integral to the human factors engineering process, allowing manufacturers to identify and mitigate potential use errors early in the development cycle, as outlined in FDA guidance `Applying Human Factors and Usability Engineering to Medical Devices`. Summative evaluations, often referred to as validation testing, are mandated by standards such as IEC 62366-1 `Medical devices - Part 1: Application of usability engineering to medical devices` to confirm the device

    What this means in practice

    Per FDA HF guidance and IEC 62366-1, summative studies typically include at least 15 users per distinct user group. Findings from summative studies that surface new use errors must be addressed before market.

    Examples

    • During the development of an insulin pump, a formative evaluation identified that the on-screen menu navigation was confusing to users, leading to a redesign of the user interface.
    • A summative evaluation for a new surgical robot involved experienced surgeons performing simulated procedures in an operating room setting to confirm critical tasks could be completed without hazardous use errors.
    • Prior to submitting a 510(k) premarket notification to the FDA, a medical device manufacturer conducted a summative human factors study for its novel infusion pump to demonstrate safe and effective use per FDA guidance.
    Common pitfalls
    • •Confusing formative testing with design verification; formative evaluations are for improvement, not formal verification.
    • •Failing to adequately document formative evaluation findings and subsequent design changes, hindering traceability for regulatory submissions.
    • •Conducting summative evaluations with non-representative users or in unrealistic environments, invalidating the study’s findings.
    • •Underestimating the resources and time required for a robust summative evaluation, leading to rushed or poorly executed studies.

    Frequently asked questions

    Formative evaluations should be conducted iteratively throughout the design and development process, starting from early prototypes and continuing as the design evolves.

    Cross-references

    Part of

    A larger framework or document this term belongs to.

    Grouped by theme

    Primary references

    3 sources
    Link health: 3 verified· last checked 2026-06-20
    FDA·2MDIC·1
    1. 1
      FDA Human Factors Guidance
      Verified
      FDAfda.gov
    2. 2
      MDIC Case for Quality
      Verified
      MDICmdic.org
    3. 3
      FDA - Quality Systems
      Verified
      FDAfda.gov

    Inline markers like [1] jump to the matching reference above.