![Stop thinking of VMs
{
"name": "hadoop_cluster_a",
"description": "A small hadoop cluster with hbase",
"version": "1.0",
"environment": "production",
"servers": [
{
"name": "zookeeper-a, zookeeper-b, zookeeper-c",
"description": "Zookeeper nodes",
"template": "rhel-5.6-base",
"service": "small",
"port_rules": "2181",
"run_list": "role[cluster_a], role[zookeeper_server]",
"actions": [
{ "knife_ssh": ["role:zookeeper_server", "sudo chef-client"] }
]
},
{
"name": "hadoop-master",
"description": "Hadoop master node",
"template": "rhel-5.6-base",
"service": "large",
"networks": "app-net, storage-net",
"port_rules": "50070, 50030, 60010",
"run_list": "role[cluster_a], role[hadoop_master], role[hbase_master]"
},
{
"name": "hadoop-worker-a hadoop-worker-b hadoop-worker-c",
"description": "Hadoop worker nodes",
"template": "rhel-5.6-base",
"service": "medium",
"port_rules": "50075, 50060, 60030",
"run_list": "role[cluster_a], role[hadoop_worker], role[hbase_regionserver]",
"actions": [
{ "knife_ssh": ["role:hadoop_master", "sudo chef-client"] },
{ "http_request": "http://${hadoop-master}:50070/index.jsp" }
]
}
]
}](https://image.slidesharecdn.com/introductiontoapachecloudstackbydavidnalley-141104145613-conversion-gate01/85/Introduction-to-Apache-CloudStack-by-David-Nalley-21-320.jpg)
!["servers": [
{
"name": "zookeeper-a, zookeeper-b, zookeeper-c",
"description": "Zookeeper nodes",
"template": "rhel-5.6-base",
"service": "small",
"port_rules": "2181",
"run_list": "role[cluster_a], role[zookeeper_server]",
"actions": [
{ "knife_ssh": ["role:zookeeper_server", "sudo chef-client"] }
]
},](https://image.slidesharecdn.com/introductiontoapachecloudstackbydavidnalley-141104145613-conversion-gate01/85/Introduction-to-Apache-CloudStack-by-David-Nalley-23-320.jpg)
![{
"name": "hadoop-master",
"description": "Hadoop master node",
"template": "rhel-5.6-base",
"service": "large",
"networks": "app-net, storage-net",
"port_rules": "50070, 50030, 60010",
"run_list": "role[cluster_a],
role[hadoop_master], role[hbase_master]"
},](https://image.slidesharecdn.com/introductiontoapachecloudstackbydavidnalley-141104145613-conversion-gate01/85/Introduction-to-Apache-CloudStack-by-David-Nalley-24-320.jpg)
![{
"name": "hadoop-worker-a hadoop-worker-b hadoop-worker-c",
"description": "Hadoop worker nodes",
"template": "rhel-5.6-base",
"service": "medium",
"port_rules": "50075, 50060, 60030",
"run_list": "role[cluster_a], role[hadoop_worker],
role[hbase_regionserver]",
"actions": [
{ "knife_ssh": ["role:hadoop_master", "sudo chef-client"] },
{ "http_request": "http://${hadoop-master}:50070/index.jsp" }
]](https://image.slidesharecdn.com/introductiontoapachecloudstackbydavidnalley-141104145613-conversion-gate01/85/Introduction-to-Apache-CloudStack-by-David-Nalley-25-320.jpg)
Introduction to Apache CloudStack by David Nalley
- 1. Introduction to Apache CloudStack David Nalley @ke4qqq [email protected]
- 2. #whoami Recovering sysadmin Apache CloudStack and Apache jclouds Work for Citrix Open Source Business Office VP Infra, Apache Software Foundation Intro to Apache CloudStack
- 3. Questions Intro to Apache CloudStack
- 4. A brief history of CloudStack 2008-2010 – Stealth mode startup (VMOps) 2009 – First production in public cloud 2010 – Released as open source (GPLv3) 2011 – Cloud.com acquired by Citrix 2012 – Transferred to the ASF (ASLv2) 2013 – Graduated as TLP Intro to Apache CloudStack
- 5. Cloud Infrastructure as a Service • Compute, Network, Storage Cloud requires: • On-demand • Self-service • Scalable • Measurable Intro to Apache CloudStack
- 6. What is CloudStack Orchestration platform for Infrastructure as a Service Focused heavily on compute Somewhat monolithic – by design Written in Java Intro to Apache CloudStack
- 7. Where do we dive in? Intro to Apache CloudStack
- 8. IaaS is Orchestration IaaS doesn’t really provide new services, it orchestrates existing services •Hypervisors •Storage •Network •Isolation •Accounting Intro to Apache CloudStack
- 9. CloudStack Hypervisor Support KVM XenServer VMware vSphere Hyper-V Oracle VM (reappearing in 4.5) LXC Baremetal Intro to Apache CloudStack
- 10. CloudStack Storage - Primary Local NFS iSCSI Distributed (GlusterFS, Ceph, etc) $anything_hypervisor_supports Intro to Apache CloudStack
- 11. CloudStack Storage - Secondary NFS Object Storage (S3 or Swift API) Intro to Apache CloudStack
- 12. Networking The bane of any cloud operators existence Intro to Apache CloudStack
- 13. Networking - Challenges Network guys are luddites (generally) We have scale issues Intro to Apache CloudStack
- 14. Scale VLANs – don’t scale Firewalls – don’t scale Loadbalancers – don’t scale Intro to Apache CloudStack
- 15. How we scale the network Amazon’s Security Groups In CloudStack we reuse the Security Groups terminology. SDN The interesting pieces aren’t in Layer 2-3, but 4-7, and still being developed. Intro to Apache CloudStack
- 16. Resources, hierarchy, failure domains Regions Zones (DCs) Pods Clusters Machines Intro to Apache CloudStack
- 17. Actual use UI is beautiful …..but….. API is where real people do work. Intro to Apache CloudStack
- 18. API Native CloudStack API http://cloudstack.apache.org/docs/api/ EC2, GCE APIs https://github.com/imduffy15/ec2stack https://github.com/NOPping/gstack Intro to Apache CloudStack
- 19. API Use an abstraction library (jclouds, fog, libcloud) Use tools that use abstraction libraries (knife-cloudstack, Intro to Apache CloudStack
- 21. Stop thinking of VMs { "name": "hadoop_cluster_a", "description": "A small hadoop cluster with hbase", "version": "1.0", "environment": "production", "servers": [ { "name": "zookeeper-a, zookeeper-b, zookeeper-c", "description": "Zookeeper nodes", "template": "rhel-5.6-base", "service": "small", "port_rules": "2181", "run_list": "role[cluster_a], role[zookeeper_server]", "actions": [ { "knife_ssh": ["role:zookeeper_server", "sudo chef-client"] } ] }, { "name": "hadoop-master", "description": "Hadoop master node", "template": "rhel-5.6-base", "service": "large", "networks": "app-net, storage-net", "port_rules": "50070, 50030, 60010", "run_list": "role[cluster_a], role[hadoop_master], role[hbase_master]" }, { "name": "hadoop-worker-a hadoop-worker-b hadoop-worker-c", "description": "Hadoop worker nodes", "template": "rhel-5.6-base", "service": "medium", "port_rules": "50075, 50060, 60030", "run_list": "role[cluster_a], role[hadoop_worker], role[hbase_regionserver]", "actions": [ { "knife_ssh": ["role:hadoop_master", "sudo chef-client"] }, { "http_request": "http://${hadoop-master}:50070/index.jsp" } ] } ] }
- 22. { "name": "hadoop_cluster_a", "description": "A small hadoop cluster with hbase", "version": "1.0", "environment": "production",
- 23. "servers": [ { "name": "zookeeper-a, zookeeper-b, zookeeper-c", "description": "Zookeeper nodes", "template": "rhel-5.6-base", "service": "small", "port_rules": "2181", "run_list": "role[cluster_a], role[zookeeper_server]", "actions": [ { "knife_ssh": ["role:zookeeper_server", "sudo chef-client"] } ] },
- 24. { "name": "hadoop-master", "description": "Hadoop master node", "template": "rhel-5.6-base", "service": "large", "networks": "app-net, storage-net", "port_rules": "50070, 50030, 60010", "run_list": "role[cluster_a], role[hadoop_master], role[hbase_master]" },
- 25. { "name": "hadoop-worker-a hadoop-worker-b hadoop-worker-c", "description": "Hadoop worker nodes", "template": "rhel-5.6-base", "service": "medium", "port_rules": "50075, 50060, 60030", "run_list": "role[cluster_a], role[hadoop_worker], role[hbase_regionserver]", "actions": [ { "knife_ssh": ["role:hadoop_master", "sudo chef-client"] }, { "http_request": "http://${hadoop-master}:50070/index.jsp" } ]
- 26. knife cs stack create hadoop_cluster_a
- 27. Prereqs Configuration management Automated provisioning Monitoring Intro to Apache CloudStack
- 28. Jevon’s Paradox Intro to Apache CloudStack
- 29. Rants Portability is a red herring – Config Management is a prereq Portability is pointless – moving data is the problem Scale is hard – expect to iterate, a lot. Failure is even harder – fail proactively Intro to Apache CloudStack
- 30. Next gen predictions Lots of people need IaaS Many people need workload orchestration (Kubernetes, Apache Mesos, etc) Intro to Apache CloudStack
- 31. Questions Intro to Apache CloudStack
- 32. Get Involved Web: http://cloudstack.apache.org/ Mailing Lists: cloudstack.apache.org/mailing-lists.html IRC: irc.freenode.net: 6667 #cloudstack Twitter: @cloudstack LinkedIn: www.linkedin.com/groups/CloudStack-Users-Group-3144859 If it didn’t happen on the mailing list, it didn’t happen. Intro to Apache CloudStack
Editor's Notes
- #16: SDN Providers: GRE Tunnels (OVS), Nicira NSX, Bigswitch, Midokura Midonet, VXLAN, Stratosphere, Nuage, OpenDaylight, Juniper Contrail,