Back to AI/ML Devices Deep Dive
Model Drift Monitoring
Ongoing surveillance of input data and model outputs to detect performance degradation post-deployment.
Reviewed by Christian Espinosa, Founder, Blue Goat CyberLast reviewed September 19, 2026
Definition
Drift monitoring tracks data drift (input distributions changing) and concept drift (the relationship between inputs and outputs changing). For locked algorithms this triggers retraining; for adaptive algorithms it gates change-control under a PCCP. Monitoring methods include tracking input statistics against the training data, comparing outputs over time, and, where ground truth becomes available, measuring live performance metrics. Drift can come from new imaging equipment, changes in clinical practice or patient populations, or software updates in connected systems. Monitoring plans, alert thresholds and response actions should be part of post-market surveillance and documented in the device file. What the regulation says
The FDA expects robust drift monitoring for AI/ML-enabled medical devices, as detailed in its "Content of Premarket Submissions for Device Software Functions" and "Predetermined Change Control Plan for Artificial Intelligence/Machine Learning (AI/ML)-Enabled Medical Devices" guidances. The EU MDR, while not explicitly naming "drift monitoring," implicitly requires similar controls through requirements for performance, safety, and effectiveness throughout the device's lifecycle, particularly for software as a medical device (SaMD) under Annex I, General Safety and Performance Requirements. These regulatory frameworks emphasize the need for manufacturers to establish clear thresholds, monitoring strategies, and corrective action plans to address drift, ensuring the continued safety and performance of MedTech AI/ML systems.What this means in practice
FDA TPLC and PCCP guidance both expect documented drift monitoring with thresholds, alerts, and a corrective-action playbook.Examples
- A continuous glucose monitor (CGM) with an AI component detects a statistical shift in blood glucose readings from a new patient population, indicating data drift that may require model re-calibration.
- An algorithm assisting in dermatological lesion classification starts performing poorly on images captured by newer smartphone models, revealing concept drift as the visual characteristics of the input data have changed relative to the algorithm's training.
- A diagnostic imaging system using AI identifies a gradual increase in false negatives for a specific pathology, which, through drift monitoring, is traced back to a change in data acquisition protocols at several clinical sites.
Common pitfalls
- •Failing to define clear, measurable thresholds for drift detection can lead to ineffective monitoring and delayed corrective actions.
- •Assuming that a "locked" algorithm negates the need for drift monitoring overlooks potential shifts in real-world data that could degrade performance.
- •Neglecting to establish a predetermined change control plan (PCCP) for adaptive algorithms can result in regulatory non-compliance when model updates are necessary.
- •Underestimating the resources, including personnel and infrastructure, required to effectively implement and maintain a drift monitoring program is a common pitfall.
- •Over-reliance on automated drift detection without human oversight or expert review can lead to false positives or missed critical drift events.
Frequently asked questions
Data drift refers to changes in the distribution of input data, while concept drift signifies a change in the relationship between the input data and the target output, representing a shift in the underlying problem itself.
Related terms
Grouped by themeEditor's picks
· Hand-selected related conceptsSoftware & AI
Predetermined Change Control Plan(PCCP)
FDA mechanism to pre-authorize specific modifications to AI/ML-enabled devices.
Software & AI
Locked vs. Adaptive Algorithm
Distinction between models whose behavior is fixed at release vs. those that continue learning.
Software & AI
Total Product Lifecycle(TPLC)
FDA framework integrating premarket and post-market oversight across a device's life.
AI/ML Devices Deep Dive
· From this learning pathSoftware & AI
Explainability and Interpretability
Methods (SHAP, saliency maps, prototype explanations) that help users understand why a model made a given prediction.
Adjacent lesson
Software & AI
Model Card
Structured documentation of a machine learning model's intended use, performance, and limitations.
Adjacent lesson
Software & AI
AI/ML-Enabled Medical Device
Medical device that uses artificial intelligence or machine learning to perform its intended use.
Software & AI
Foundation Model (Healthcare)
Large pretrained model adaptable to many downstream clinical tasks via fine-tuning or prompting.
Cited by
Where this term appears across MedTech Terms.
Learning paths (1)
- AI/ML Devices Deep DiveLesson 5 of 9
Ecosystems (3)
Latest in MedTech
Sources
3 sourcesEvery citation below opens the original document. Each is graded against our source-tier hierarchy so you can see what rests on binding law versus commentary.
Tier 2Regulator guidance and consensus· 3
Link health: 3 verified· last checked 2026-06-20
- 1FDA AI/ML Action PlanTier 2 VerifiedFDAfda.gov
- 2FDA - Software as a Medical Device (SaMD)Tier 2 VerifiedFDAfda.gov
- 3FDA - AI/ML-Enabled Medical DevicesTier 2 VerifiedFDAfda.gov
Inline markers like [1] jump to the matching reference above.