MLOps – DevOps for ML
Marco Parenzan (twitter: @marco_parenzan)
MLOps?!?!??!?!
What is DevOps
Devops
Agile
Alm
CI/CD
Microservices
Elasticity
Geo
redundancy
Build
& Test
Continuous
Delivery
Deploy
Operate
Monitor
&
Learn
Plan
&
Track
Develop
DevOps + ML = MLOps
© Microsoft Corporation
Reproducibility /
Auditability
MLOps Benefits
Validation
Automation /
Observability
• Code drives generation
and deployments
• Pipelines are
reproducible and
verifiable
• All artifacts can be
tagged and audited
• SWE best practices for
quality control
• Offline comparisons of
model quality
• Minimize bias and
enable explainability
• Controlled rollout
capabilities
• Live comparison of
predicted vs. expected
performance
• Results fed back to
watch for drift and
improve model
«The italian way »
.NET 5
INFRASTRUCTURE
.NET STANDARD
DESKTOP WEB CLOUD MOBILE GAMING IoT AI
WPF
Windows Forms
UWP
ASP.NET Xamarin UnityAzure ARM32
ARM64
ML.NET
.NET for
Apache Spark
Azure DevOps
Visual
Source Safe
Team
Foundation
Server
Visual
Studio
Online
Visual
Studio Team
Services
Azure
DevOps
Azure Boards
Offri valore agli utenti più
velocemente utilizzando strumenti
agili comprovati per pianificare,
monitorare e discutere il lavoro in
tutti i tuoi team.
Azure Pipelines
Compila, testa e distribuisci con CI/CD
che funziona con qualsiasi linguaggio,
piattaforma e cloud. Connettersi a
GitHub o qualsiasi altro provider Git e
distribuire continuamente.
Azure Repos
Ottieni repository Git privati
illimitati e ospitati nel cloud e
collabora per creare codice
migliore con richieste pull e
gestione avanzata dei file.
Azure Test Plans
Testare e spedire con sicurezza
utilizzandostrumentiditestmanualied
esplorativi.
Azure Artifacts
Crea, ospita e condividi pacchetti con
il tuo team e aggiungi elementi alle
pipeline CI/CD con un solo clic.
Maven
Target any cloud, on-prem or both and deploy to the servers you need
https://visualstudio.microsoft.com/vs/benefits/
https://visualstudio.microsoft.com/vs/pricing-details/
https://visualstudio.microsoft.com/vs/benefits/#azure
The operational pipeline
App developer
using Azure DevOps
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Build appCollaborate Test app Release app Monitor app
Data scientist using
Azure Machine Learning
Code, dataset, and
environment versioning
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Model validation
& profiling
Train model Validate
model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Model packaging
Simple deployment
across cloud and edge
Train model Validate
model
Deploy
model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Model
management
& monitoring
Model performance
analysis
Train model Validate
model
Deploy
model
Monitor
model
Retrain model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Train model Validate
model
Deploy
model
Monitor
model
Retrain model
Build appCollaborate Test app Release app Monitor app
Azure Machine Learning extension for Azure DevOps
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Train model Validate
model
Deploy
model
Monitor
model
Retrain model
Build appCollaborate Test app Release app Monitor app
Audit trail management and model interpretability
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Marco Parenzan (twitter: @marco_parenzan)

MLOps with Azure DevOps