Uploaded byJohn Burwell
Making Cloudy Peanut Butter Cups: Apache CloudStack + Riak CS
The document discusses the integration of Apache CloudStack and Riak CS to build a private cloud infrastructure with features like resource pooling, reliable workload management, and self-service provisioning. It outlines the architecture, deployment models, and improvements in CloudStack, emphasizing its use of commodity hardware and open-source principles. Additionally, it highlights Riak CS as a scalable, S3-compatible storage solution that enhances the capabilities of the cloud infrastructure.
More Related Content
Similar to Making Cloudy Peanut Butter Cups: Apache CloudStack + Riak CS
Making Cloudy Peanut Butter Cups: Apache CloudStack + Riak CS
- 1. MAKING CLOUDY PEANUT BUTTERCUPS: APACHE CLOUDSTACK + RIAK CS John Burwell (jburwell@basho.com | @john_burwell) Thursday, June 27, 13
- 2. Who Am I •Consulting Engineer @ Basho Technologies • Apache CloudStack PMC Member • Ran operations and designed automated provisioning for hybrid analytic/virtualization clouds • Led architectural design and server-side development of a SaaS physical security platform Thursday, June 27, 13
- 3.
- 4. Hopefully not ... Thursday,June 27, 13
- 5.
- 6.
- 7.
- 8. Composable Infrastructure • ResourcePooling • Rapid Elasticity • Self Service • Metering/Charge Back Thursday, June 27, 13
- 9. Doesn’t vSphere/ XCP/XenServer already dothat? Thursday, June 27, 13
- 10.
- 11. Storage • Reliable • Faulttolerant • Specialized hardware • IT managed provisioning • Static scale out model Increased TCO; Decreased organizational agility Thursday, June 27, 13
- 12. Cloud Workload • Reliable •Fault Tolerant • Commodity Hardware • Self-Service provisioning • Dynamic scale out model SDN Rack Rack Object
- 13. Storage App App Decreased TCO;Increased organizational agility Thursday, June 27, 13
- 14. Traditional Workload Cloud Workload The Chicken OrThe Egg? Thursday, June 27, 13
- 15. Got It ...Why Go Private? • Leverage existing infrastructure investment • Customization and Control • Regulatory/Security Requirements • Cost Thursday, June 27, 13
- 16. Open Source PrivateCloud + Compute Services Object Storage Services Thursday, June 27, 13
- 17. Make infrastructure boring. Thursday,June 27, 13
- 18. What Is ApacheCloudStack? §Open source software that deploys and manages large networks of virtual machines, as a highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform. §CloudStack is a Top-Level Project at the Apache Software Foundation. Thursday, June 27, 13
- 19. Apache CloudStack Users Thursday,June 27, 13
- 20. Infrastructure Model • ManagementServer Farm • Management and provisioning tasks • Zone • Collection of pods, network offerings and secondary storage • Pod • Collection of clusters in the same failure boundary • Cluster • A grouping of hosts and their associated storage • Hosts • Servers onto which services will be provisioned • Primary Storage • VM disk storage • Network • Logical network associated with service offerings • Secondary Storage • Template, snapshot and ISO storage Zone CloudStack Pod Cluster Host Host Network Primary Storage VM VM CloudStack Pod Cluster Secondary Storage Thursday, June 27, 13
- 21. Management Server Farm •MS is stateless. MS can be deployed as physical server or VM • Single MS node can manage up to 10K hosts. Multiple nodes can be deployed for scale or redundancy • RHEL/CentOS (5.4+), Ubuntu (10.0.4+), Fedora (16+) User
- 22.
- 23.
- 24. Got Scale? • Runningin production at 30,000 physical hosts, supported by only 4 management server instances • Even greater scale by using CloudStack in a Regional model • Remember: The separation of control, management and data planes is critical for cloud platform scale. Thursday, June 27, 13
- 25. Deployment Architecture • Hypervisoris the basic unit of scale. • Cluster consists of one ore more hosts of same hypervisor • All hosts in cluster have access to shared (primary) storage • Pod is one or more clusters, usually with L2 switches. • Availability Zone has one or more pods, has access to secondary storage. • One or more zones represent a cloud Pod 1 …. Cluster N L2 Host 2 Cluster 1 Host 1 Primary Storage Zone 1 …. L3 Secondary Storage Pod N Management Server Farm Internet Thursday, June 27, 13
- 26. Hypervisors • Xen /XCP (Ubuntu 12.04.2) • XenServer (6.1) • KVM (Ubuntu 12.04.2 / CentOS 6) • VMWare vCenter (4.1 / 5.1) Thursday, June 27, 13
- 27. Storage • ISCSI • NFS •Local Filesystem Storage • Ceph • S3-backed Secondary Storage • Swift-backed Secondary Storage Thursday, June 27, 13
- 28. Networking • VLAN andSecurity Group isolation • Load Balancer Support • Juniper SRX, F5, Nicira NVP and Open vSwitch integration Thursday, June 27, 13
- 29. 4.1: Hot OffThe Presses • AWS style regions • Event pub-sub framework (RabbitMQ implementation) • Advanced search within the UI • API Server request throttling • API Discoverer Service • Self-Service Password Reset • Users directly changing their API keys • EC2 query API • Cloudmonkey CLI • Autoscale (F5-specific) Much, much more .... Thursday, June 27, 13
- 30. 4.2: On-Deck • Midonetand BigSwitch SDN integrations • Enhanced Baremetal provisioning • VM I/O Throttling • Hyper-V 2012 Support • LXC Support • Cisco VSG integration • Cisco ASA 1000V • VM Affinity Rules • VM Affinity Rules • Zone-wide primary storage • Security group isolation in Advanced Network zones • Dedicating resources to domains and accounts • IP Address reservation w/o a vNIC allocation • vSphere DVS support • UI Plugin framework Thursday, June 27, 13
- 31. First A LittleRiak • Dynamo-inspired, masterless key-value store • Apache License • Always available for writes • Highly available reads • Secondary Indexes/Search • MapReduce • Operations Friendly Thursday, June 27, 13
- 32. ... Then ALittle Riak CS • Built on top Riak • Apache Licensed • S3-compatible API • Large object support and multipart upload • Multi-tenancy and per-user reporting • Operations Friendly Thursday, June 27, 13
- 33.
- 34.
- 35.
- 36.
- 37.
- 38.
- 39.
- 40.
- 41.
- 42.
- 43.
- 44.
- 45.
- 46.
- 47. Riak CS Roadmap •Keystone integration • OpenStack Storage API v1 (aka Swift) support • Performance improvements around large bucket operations Thursday, June 27, 13
- 48. The Complete PrivateCloud Management Network Hypervisor Cluster Hypervisor Cluster Shared
- 49.
- 50.
- 51.
- 52.
- 53. Apache CloudStack +Riak CS Roadmap • Now • S3-backed Secondary Storage • 4.2 • Partial support for using object stores as secondary storage • 4.3 • Integrated authentication • Complete support for using object stores as secondary storage Thursday, June 27, 13
- 54. Join Our Community •Learn more @ http://cloudstack.apache.org • Grab it @ http://cloudstack.apache.org/downloads.html • Follow us @cloudstack • Help from the cloudstack-users@cloudstack.apache.org mailing list or on Freenode @ #cloudstack • Contribute on cloudstack-dev@cloudstack.apache.org mailing list or on Freenode @ #cloudstack-dev Thursday, June 27, 13
- 55. Up And RunningWith Riak CS • Learn more @ http://basho.com/riak-cloud-storage • Grab a distribution @ http://docs.basho.com/riakcs/latest/ riakcs-downloads/ • Follow us @basho • Help from the riak-users@lists.basho.com mailing list or on FreeNode @ #riak • Contribute @ http://github.com/basho/riak_cs Thursday, June 27, 13
- 56.
- 57. Thank you! Slides available@ http://speakerdeck.com/jburwell Thursday, June 27, 13