Good Machine Learning Practice
Guiding principles for the development of AI/ML-enabled medical devices.
Definition
Good Machine Learning Practice (GMLP) describes guiding principles - jointly issued by FDA, Health Canada, and the UK MHRA - for developing AI/ML-enabled medical devices that are safe, effective, and high-quality.What this means in practice
GMLP principles inform FDA review expectations, including data management, model validation, and human-AI team performance.Examples
- A medical device manufacturer implements a comprehensive data governance framework to ensure the quality and unbiased nature of the training data used for its AI-powered diagnostic tool, aligning with GMLP principles for data management.
- During the validation of an AI/ML algorithm for detecting anomalies in medical images, a company performs extensive testing across diverse patient populations to demonstrate robust performance and minimize algorithmic bias, as recommended by GMLP.
- A change control process is established for an adaptive AI/ML-enabled insulin pump to manage algorithm updates and monitor real-world performance, ensuring consistency with GMLP expectations for continuous learning systems.
- •A common pitfall is failing to establish a robust data management plan that addresses data quality, integrity, and representativeness, potentially leading to biased or inaccurate model performance.
- •Misinterpreting GMLP as a static checklist rather than a set of guiding principles can lead to superficial compliance without true assurance of device safety and effectiveness.
- •Underestimating the importance of real-world performance monitoring and continuous learning for adaptive AI/ML models can result in undetected performance degradation over time.
- •Neglecting to involve multi-disciplinary teams including clinicians, data scientists, and regulatory experts throughout the device development process can lead to overlooked risks and inefficiencies.
- •Failing to adequately document the rationale for model choices, data curation, and validation strategies can hinder regulatory review and post-market surveillance.
Frequently asked questions
Cross-references
Governs
Things this term applies rules or requirements to.
Contains
Sub-elements or required artefacts of this term.
Related terms
Grouped by themeEditor's picks
· Hand-selected related conceptsSaMD & AI/ML Devices
· From this learning pathAbility of devices and systems to exchange and use information.
Software providing healthcare professionals with knowledge and patient-specific information.
Software embedded in or required to operate a hardware medical device.
Software not developed for medical device use, or lacking adequate development records, incorporated into a device.
AI/ML Devices Deep Dive
· From this learning pathStructured documentation of a machine learning model's intended use, performance, and limitations.
Medical device that uses artificial intelligence or machine learning to perform its intended use.
Methods (SHAP, saliency maps, prototype explanations) that help users understand why a model made a given prediction.
Large pretrained model adaptable to many downstream clinical tasks via fine-tuning or prompting.
Primary references
3 sources- 1
GMLP Guiding PrinciplesVerifiedFDAfda.gov
- 2
FDA - Software as a Medical Device (SaMD)VerifiedFDAfda.gov
- 3
FDA - AI/ML-Enabled Medical DevicesVerifiedFDAfda.gov
Inline markers like [1] jump to the matching reference above.