Download as PDF, PPTX
Uploaded byShift Conference
Continuous Integration and Continuous Delivery for your serverless apps - Sebastien Stormacq (AWS)
The document discusses the evolution of development practices at Amazon, highlighting the shift from monolithic applications to microservices and the adoption of DevOps methodologies. It covers key components of modern application deployment, including continuous integration and continuous deployment strategies, and emphasizes the use of infrastructure as code principles. Additionally, it provides examples of leveraging AWS tools such as SAM and CDK for building and managing serverless and containerized applications.
More Related Content
Similar to Continuous Integration and Continuous Delivery for your serverless apps - Sebastien Stormacq (AWS)
![[CPT DevOps Meetup] Developing Modern Applications in the Cloud](https://cdn.slidesharecdn.com/ss_thumbnails/devopsdeveloping-modern-applications-in-the-cloud-no-notes-190718062311-thumbnail.jpg?width=640&height=640&fit=bounds)
Continuous Integration and Continuous Delivery for your serverless apps - Sebastien Stormacq (AWS)
- 1. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Continuous Integration & Deployment for Modern Applications @sebsto sebsto { "name": "Sébastien Stormacq", "role": "Developer Evangelist", "company": "Amazon Web Services”, "twitter": ”@sebsto”, }
- 2. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Development transformation at Amazon: 2001–2002 monolithic application + teams 2001 Lesson learned: decompose for agility 2002 microservices + 2 pizza teams
- 3. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Full ownership Full accountability “DevOps” Focused innovation Two-pizza teams
- 4. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Monolith development lifecycle monitorreleasetestbuild developers delivery pipelines services
- 5. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Microservice development lifecycle ??? developers delivery pipelines services
- 6. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Microservice development lifecycle developers services monitorreleasetestbuild delivery pipelines monitorreleasetestbuild monitorreleasetestbuild monitorreleasetestbuild monitorreleasetestbuild monitorreleasetestbuild
- 7. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. ListenIterate Experiment Innovation Flywheel Experiments power the engine of rapid innovation
- 8. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. What changes do you need to make to adopt these best practices? Serverless No provisioning/management Automatic scaling Pay for value billing Availability and resiliency Microservices Componentization Business capabilities Products not projects Infrastructure automation DevOps Cultural philosophies Cross-disciplinary teams CI/CD Automation tools DEV OPS Architectural patterns Operational Model Software Delivery
- 9. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Release process stages Source Build Test Production
- 10. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Release process stages Source Build Test Production
- 11. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Release process stages Source Build Test Production
- 12. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Pillars of releasing modern applications
- 13. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Pillars of releasing modern applications Infrastructure as code
- 14. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Infrastructure as code goals 1. Make infrastructure changes repeatable and predictable 2. Release infrastructure changes using the same tools as code changes 3. Replicate production environment in a staging environment to enable continuous testing
- 15. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Infrastructure as code Declarative I tell you what I need I tell you what to do Imperative
- 16. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Model function environments with AWS Serverless Application Model (SAM) • Open source framework for building serverless applications on AWS • Shorthand syntax to express functions, APIs, databases, and event source mappings • Transforms and expands SAM syntax into AWS CloudFormation syntax on deployment • Supports all AWS CloudFormation resource types https://aws.amazon.com/serverless/sam/
- 17. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. SAM template AWSTemplateFormatVersion: '2010-09-09’ Transform: AWS::Serverless-2016-10-31 Resources: GetFunction: Type: AWS::Serverless::Function Properties: Handler: index.get Runtime: nodejs8.10 CodeUri: src/ Policies: - DynamoDBReadPolicy: TableName: !Ref MyTable Events: GetResource: Type: Api Properties: Path: /resource/{resourceId} Method: get MyTable: Type: AWS::Serverless::SimpleTable Just 20 lines to create: • Lambda function • IAM role • API Gateway • DynamoDB table
- 18. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Model container environments with AWS Cloud Development Kit (CDK) Developer Preview • Open source framework to define cloud infrastructure in TypeScript, Python, Java, C#, … • Provides library of higher-level resource types (“construct” classes) that have AWS best practices built in by default, packaged as npm modules • Provisions resources with CloudFormation • Supports all CloudFormation resource types AWS CDK https://awslabs.github.io/aws-cdk
- 19. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CDK template import ec2 = require('@aws-cdk/aws-ec2'); import ecs = require('@aws-cdk/aws-ecs'); import cdk = require('@aws-cdk/cdk'); class BonjourFargate extends cdk.Stack { constructor(parent: cdk.App, name: string, props?: cdk.StackProps) { super(parent, name, props); const vpc = new ec2.VpcNetwork(this, 'MyVpc', { maxAZs: 2 }); const cluster = new ecs.Cluster(this, 'Cluster', { vpc }); new ecs.LoadBalancedFargateService( this, "FargateService", { cluster, image: ecs.DockerHub.image("amazon/amazon-ecs-sample"), }); } } const app = new cdk.App(); new BonjourFargate(app, 'Bonjour'); app.run();
- 20. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. import ec2 = require('@aws-cdk/aws-ec2'); import ecs = require('@aws-cdk/aws-ecs'); import cdk = require('@aws-cdk/cdk'); class BonjourFargate extends cdk.Stack { constructor(parent: cdk.App, name: string, props?: cdk.StackProps) { super(parent, name, props); const vpc = new ec2.VpcNetwork(this, 'MyVpc', { maxAZs: 2 }); const cluster = new ecs.Cluster(this, 'Cluster', { vpc }); new ecs.LoadBalancedFargateService( this, "FargateService", { cluster, image: ecs.DockerHub.image("amazon/amazon-ecs-sample"), }); } } const app = new cdk.App(); new BonjourFargate(app, 'Bonjour'); app.run(); CDK template
- 21. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CDK template import ec2 = require('@aws-cdk/aws-ec2'); import ecs = require('@aws-cdk/aws-ecs'); import cdk = require('@aws-cdk/cdk'); class BonjourFargate extends cdk.Stack { constructor(parent: cdk.App, name: string, props?: cdk.StackProps) { super(parent, name, props); const vpc = new ec2.VpcNetwork(this, 'MyVpc', { maxAZs: 2 }); const cluster = new ecs.Cluster(this, 'Cluster', { vpc }); new ecs.LoadBalancedFargateService( this, "FargateService", { cluster, image: ecs.DockerHub.image("amazon/amazon-ecs-sample"), }); } } const app = new cdk.App(); new BonjourFargate(app, 'Bonjour'); app.run();
- 22. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Pillars of releasing modern applications Infrastructure as code
- 23. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Pillars of releasing modern applications Continuous integration
- 24. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Continuous integration goals Source Build Test Production
- 25. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Continuous integration goals 1. Automatically kick off a new release when new code is checked in 2. Build and test code in a consistent, repeatable environment 3. Continually have an artifact ready for deployment 4. Continually close feedback loop when build fails
- 26. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS CodeBuild • Fully managed build service that compiles source code, runs tests, and produces software packages • Scales continuously and processes multiple builds concurrently • No build servers to manage • Pay by the minute, only for the compute resources you use • Monitor builds through CloudWatch Events
- 27. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Pillars of releasing modern applications Continuous integration
- 28. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Pillars of releasing modern applications Continuous deployment
- 29. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Continuous deployment goals Source Build Test Production
- 30. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Continuous deployment goals 1. Automatically deploy new changes to staging environments for testing 2. Deploy to production safely without impacting customers 3. Deliver to customers faster: Increase deployment frequency, and reduce change lead time and change failure rate
- 31. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS CodeDeploy • Automates code deployments to any instance and Lambda • Handles the complexity of updating your applications • Avoid downtime during application deployment • Roll back automatically if failure detected • Deploy to Amazon EC2, Lambda, or on-premises servers
- 32. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Progressive Deployment • Linear, Canary, Blue / Green
- 33. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Progressive Deployment with Lambda Enable in your serverless application template Resources: GetFunction: Type: AWS::Serverless::Function Properties: DeploymentPreference: Type: Canary10Percent10Minutes Alarms: - !Ref ErrorsAlarm Hooks: PreTraffic: !Ref PreTrafficHook Canary10Percent30Minutes Canary10Percent5Minutes Canary10Percent10Minutes Canary10Percent15Minutes Linear10PercentEvery10Minutes Linear10PercentEvery1Minute Linear10PercentEvery2Minutes Linear10PercentEvery3Minutes AllAtOnce
- 34. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy – Lambda canary deployment API Gateway Lambda function weighted alias “live” v1 Lambda function code 100%
- 35. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy – Lambda canary deployment API Gateway Lambda function weighted alias “live” v1 code100% Run PreTraffic hook against v2 code before it receives traffic v2 code0%
- 36. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy – Lambda canary deployment API Gateway Lambda function weighted alias “live” v1 code90% Wait for 10 minutes, roll back in case of alarm v2 code10%
- 37. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy – Lambda canary deployment API Gateway Lambda function weighted alias “live” v1 code0% Run PostTraffic hook and complete deployment v2 code100%
- 38. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy-ECS blue-green deployments • Provisions “green” tasks, then flips traffic at the load balancer • Validation “hooks” enable testing at each stage of the deployment • Fast rollback to “blue” tasks in seconds if case of hook failure or CloudWatch alarms • Monitor deployment status and history via console, API, Amazon SNS notifications, and CloudWatch Events • Use “CodeDeploy-ECS” deploy action in CodePipeline or “aws ecs deploy” command in Jenkins
- 39. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy-ECS blue-green deployment 100% Prod traffic
- 40. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy-ECS blue-green deployment Target group 2 100% Prod traffic Test traffic listener (port 9000)
- 41. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy-ECS blue-green deployment Green tasks: v2 code 100% Prod traffic Provision green tasks
- 42. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy-ECS blue-green deployment 100% Test traffic 100% Prod traffic Run hook against test endpoint before green tasks receive prod traffic
- 43. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy-ECS blue-green deployment 100% Prod traffic Flip traffic to green tasks, rollback in case of alarm 0% Prod traffic
- 44. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. CodeDeploy-ECS blue-green deployment 100% Prod traffic Drain blue tasks
- 45. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Pillars of releasing modern applications Continuous deployment
- 46. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Pillars of releasing modern applications
- 47. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Demo
- 48. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Takeaways 1. Manage your infrastructure as code 2. Frequently build and integrate your code to get a first feedback 3. Continuously release in production using canary releases with monitoring and automated rollbacks 4. Use canary releases to get both technical and business feedback
- 49. © 2019, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Thank you – leave your feedback ! { "name": "Sébastien Stormacq", "role": "Developer Evangelist", "company": "Amazon Web Services”, "twitter": ”@sebsto”, } @sebsto sebsto