Open Source Cloud, Virtualization and Deployment Technologies

Kyle Mestery
Office of the Cloud CTO, Cisco

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1

• Linux
Red Hat
Fedora
Ubuntu

• Hypervisor
KVM
Xen

• Virtual Switching
Open vSwitch


• Host Management
libvirt

• Infrastructure as a Service Orchestration
OpenStack
CloudStack
oVirt
Eucalyptus


• Platform as a Service
Cloud Foundry
OpenShift

• Cloud Orchestration
Aeolus
Heat APIs (open source implementation of Amazon Cloud Forms APIs)


• DevOps #ftw!

• Automation Options
Puppet
Chef


Applications! Yay to applications!

Automation DevOps at scale!

Cloud Foundry or OpenShift PaaS for the masses!

OpenStack or CloudStack or Eucalyptus or oVirt IaaS for the masses!

Linux (Fedora, Ubuntu, Red Hat, etc.)
At the heart of all of this …
Xen or KVM






Xen or KVM


What is OpenStack?


OpenStack Mission

“To produce the ubiquitous open source cloud
computing platform that will meet the needs of
public and private cloud providers regardless of
size, by being simple to implement and
massively scalable.”


OpenStack Technology
Today (Folsom release)
• Compute Service (Nova)
• Object Storage Service (Swift)
• Image Service (Glance)
• Identity Service (Keystone)
• Dashboard (Horizon)
• Network Service (Quantum)
Also Releases
• Load Balancer Service (proposed) • Cactus (Q1 2011)
• Database Service (proposed) • Diablo (Q3 2011)
• Heat API (AWS CloudForms compatible) • Essex (Q1 2012)
• Ceilometer monitoring and metering (proposed) • Folsom (Q3 2012)
• Grizzly (Q1 2013)


OpenStack Compute Key Features
REST-based API
Asynchronous eventually
consistent communication

Horizontally and massively
scalable

Hypervisor agnostic: support
for Xen ,XenServer, Hyper-V, KVM, UML and
ESX
Hardware agnostic: standard
hardware, RAID not required


OpenStack Object Storage Key Features
REST-based API Data distributed evenly throughout system
Scalable to multiple
petabytes, billions of objects

Account/Container/Object structure (not file
system, no nesting) plus Replication (N copies of
accounts, containers, objects)

No central
database
Hardware agnostic: standard hardware, RAID not
© 2010 Cisco and/or its affiliates. All rights reserved.
required Cisco Confidential 14

OpenStack Community


OpenStack Quantum


• Advantages of cloud computing
On-demand virtualized resources, self-service, lower cost
Resources managed by others

• Ability to create your own isolated private networks

• Extensible

• Challenge!!
Easy-to-use
Minus the complexity of the traditional data center Quantum
Should work with different networking infrastructure Network Service


• Compute service (EC2): virtual machines
App Svr
• Specify vCPU, Memory, Disk OS

• Launch instance (image, mem_size, disk) VM

• Suspend, clone, migrate

• Storage service (S3, EBS): virtual disks
• Specify storage amount, access rights
• Store object
• Create/attach block

• What to do about networks?
Simplistic implementation
Embedded in the compute component


2011 Design Summit
- community-driven merger of proposals

… more

NetworkService NaaS Core Design
NetworkServicePOC NetworkContainers
Citrix/Rackspace/Nicira Intel
NTT/Midokura Cisco

Quantum


• Compute service (EC2): virtual machines
App Svr
• Launch instance (image, mem_size, disk) OS

• Suspend, clone, migrate VM

• Storage service (S3, EBS): virtual disks
• Store object
• Create/attach block

• Network service (Quantum): virtual networks App Svr
OS
App Svr
OS

• Create/delete private network VM VM

• Attach VM to network resource
• Work with different networking environments


Quantum Virtual Network Service:
A first class citizen in cloud computing

Portal
(Horizon)
Applications Other
Services

Cloud Platform - Developer API

Compute Storage Network Identity
(Keystone)
(Nova) (Swift) (Quantum)

Servers Disks Networks Images
(Glance)

Folsom Release


Quantum Abstractions
 Virtual Networks:
 A basic dedicated L2 network segment
 Common realization is a VLAN
 Virtual Ports:
 Attachment point for devices connecting to virtual networks.
 Ports expose configuration and monitoring state via extensions (e.g., ACLs, QoS
policies, Packet Statistics)
 Subnets (new in v2):
 An IPAM construct to store CIDR
 Also allows to set the Gateway IP and host routes


Quantum Plugins & Extensions
 Plugin:
 Realization of the Quantum abstractions
 Supports different back-end technologies and vendors
 One plugin per Quantum deployment (there could be sub-plugins managed by
the main plugin)
 Examples: Linux Bridge Plugin, OVS Plugin, Cisco (Nexus)
 Extensions:
 API Extensibility for new or back-end specific features
 Example: Port-profiles, quality-of-service, etc.


Quantum Plug-in Architecture
Quantum Service API API Extensions

Quantum API & Extensions Framework

Quantum Plug-in Framework

Cisco Network Plugin

Cisco Device Managers

Cisco Compute & Networking Infra
• Switching portfolio (Nexus 3k/5k/7k)
• Unified Computing System
• Routing portfolio (e.g. ASR, CRS)


Plugins and Drivers
 Plugin:
 A plugin registers to handle all Quantum API calls (e.g., all network/port calls)
 Plugins may make decisions that are technology, but not device-specific
(e.g., mapping quantum network ‘HR’ to VLAN 100)
 There needs to be a master entity making/resolving decisions in a
deployment, that entity is the plugin
 Drivers:
 The plugin may use drivers to communicate the results of this decision to
different devices (e.g., it may configure the VLAN on a port on a virtual switch
port, and also tell the upstream physical switch to trunk that VLAN)
 Configurable components which can be shared/reused


Extending Quantum to support L3 Constructs
 Routing within the Further evolve Quantum to be a multi-tenant network service for
creating virtual data centers (application specific topologies + network
tenant (support multi- services)
tier topologies)
 Overlapping IP
addresses
 Support gateways –
Internet, VPN
 Support other L3
services –
LB, Firewall, Caching,
etc.
 Hybrid Cloud (Public +
Private)

Why is Quantum important to
OpenStack?


Current Infrastructure-as-a-Service has Challenges

Developer API
• Only provides basic Network
Connectivity.

Compute Storage • Difficult to create N-tier apps.
Service Services
User and
System • Limited ability for applications to
(VMs, Memory, (Block, Massive
Local Disk) Key-value Admin take advantage of network
store) services.

Servers Disks Accounts

Basic Network Connectivity


Network Services Enable Developer Solutions
Developer API

Network APIs

Compute Storage
Network
Service Services
Services
User and
(VMs, Memory, Lo (Block, Massive System Admin
(Subnets, Network
cal Disk) Key-value store)
Svcs, Security)

Virtual
Servers Networks Disks

Network Connectivity

 Create-network(“L2”)
 Attach-vm-to-network(vnet-a)
 Attach-service-to-network(vnet-b)


Open Source Is Where “Standard” Cloud Infrastructure Will
Be Defined
[O]pen standards [require] multiple
providers, access to code and data, [and]
interoperability of services. Whilst open
standards provide part of the solution, it is
critical…that a common reference model (i.e.
running code) is provided.
[T]he obvious solution is an open source
reference model as the standard. Potential
examples of such would be the OpenStack effort.
-Simon Wardley, CSC
From “A Question of Standards”
http://blog.gardeviance.org/2011/04/question-of-standards.html






Xen or KVM


X 1000 =


• Designed to assist with configuration and management of systems

• Automates deployment

• Automates configuration

• Automates management

• Written in Ruby

• How does it do this?
Declarative language
Puppet: Manifests
Chef: Recipes or cookbooks


• OpenStack automation can be achieved using both Puppet and Chef
Active development and community around both
Cisco is actively participating and contributing to Puppet at the moment
Chef integration is planned

• These technologies are critical to successfully deploying an OpenStack IaaS cloud at
any sort of realistic scale
Replicating configuration by hand is doomed to failure
Replicating things with custom scripts is doomed to not scale
Replicating things with Puppet/Chef allows for advanced, scalable configuration management


• What is Cisco doing around OpenStack and Automation?

• Working closely with Puppet Labs to enable Puppet manifests for deploying OpenStack
on Cisco equipment
UCS B-Series and C-Series Compute
Nexus Switches

• All of these manifests are available on the Cisco github
Allows partners and customers to fully take advantage of this advanced automation


• Demonstrate flexible VM communication using open source technologies

• Applications (running in tenants running VMs) should not know or care about underlying
technologies
Flexible, isolated network segmentation utilizing OpenFlow and GRE tunnels
Applications just want to communicate
Think the standard 3-tier web app deployment … but at huge scale
“If they have to think about infrastructure, we’ve failed.”

• All orchestrated by software
Hint: SDN


• OpenStack
Nova: Compute manager
Glance: Image management
Quantum: Network service

• Open vSwitch
An open source virtual switch
Uses GRE tunnels for tenant isolation (also possible to use VXLAN)

• Ryu Network Operating System
Open Source OpenFlow controller
Works with Quantum as a plugin to setup flows for VM communication


• OpenStack
Using devstack on Ubuntu 12.04
Nova, Glance, and Quantum

• Open vSwitch
Top of tree (pre 1.9 release)

• Ryu Network Operating System
OpenFlow Controller plus Quantum Plugin

• All of this is running as VMs on the Macbook Pro I’m using for the preso


OpenStack Control Node + Compute OpenStack Compute
1. VMs are started, VIFs are plugged in
2. Ryu sets up flows for VM1 to VM2
communication
3. Ryu sets up GRE for VM1/VM2 to VM3
communication
OpenStack 4. VM1 pings VM2
Components 5. VM1 pings VM3 over GRE
6. Application developer is very happy!

Nova VM1 VM2 VM3
OpenStack
Components
Glance
Nova
Quantum

Ryu Ryu
Controller Open Agent Open
vSwitch vSwitch

VXLAN


Open Source Cloud, Virtualization and Deployment Technologies

More Related Content

What's hot

Viewers also liked

Similar to Open Source Cloud, Virtualization and Deployment Technologies

More from mestery

Recently uploaded

Open Source Cloud, Virtualization and Deployment Technologies

Editor's Notes