Locked vs. Adaptive Algorithm
Distinction between models whose behavior is fixed at release vs. those that continue learning.
Definition
A locked algorithm produces the same output for the same input every time after release. An adaptive algorithm changes its behavior over time as it is exposed to new data, either continuously or in scheduled retraining cycles.What this means in practice
FDA's PCCP framework lets manufacturers prospectively define and validate the boundaries of allowable adaptive changes so retraining does not require a new submission for each model update.Examples
- A diagnostic AI that learns to identify new patterns in medical images as it processes more patient scans is an adaptive algorithm requiring a PCCP.
- An insulin pump algorithm that adjusts dosing recommendations based on a patient's continuously acquired glucose data and activity levels is an adaptive algorithm.
- A risk stratification tool that uses a fixed set of patient demographics and historical health records to predict disease likelihood is a locked algorithm.
- •Failing to establish clear performance bounds and risk mitigations for adaptive algorithm changes can lead to regulatory non-compliance.
- •Treating an adaptive algorithm as a locked algorithm for validation purposes will result in insufficient oversight of its evolving behavior.
- •Not documenting the data used for training and retraining, along with corresponding version control, can create significant auditability issues.
- •Assuming all adaptive algorithm changes are minor and do not impact safety or effectiveness can lead to patient harm and regulatory scrutiny.
Frequently asked questions
Cross-references
Uses
Concepts or artefacts this term builds on.
Related terms
Grouped by themeEditor's picks
· Hand-selected related conceptsMedical device that uses artificial intelligence or machine learning to perform its intended use.
Guiding principles for the development of AI/ML-enabled medical devices.
FDA mechanism to pre-authorize specific modifications to AI/ML-enabled devices.
More in Software & AI
· Same categoryAAMI Technical Information Report providing guidance on applying Agile software development practices within an IEC 62304-compliant medical device software lifecycle.
Resilience of an ML model to inputs deliberately crafted to cause misclassification.
The detailed procedural section of a PCCP that specifies how planned modifications to an AI/ML model will be developed, validated, and implemented.
Systematic differences in model performance across demographic or clinical subgroups.
Primary references
3 sources- 1
MDCG Software GuidanceVerifiedMDCGhealth.ec.europa.eu
- 2
FDA - Software as a Medical Device (SaMD)VerifiedFDAfda.gov
- 3
FDA - AI/ML-Enabled Medical DevicesVerifiedFDAfda.gov
Inline markers like [1] jump to the matching reference above.