Continuous Delivery with Maven, Puppet and Tomcat - ApacheCon NA 2013
19 likes16,896 views
The document discusses continuous delivery using tools like Maven, Puppet, and Tomcat, emphasizing agile development practices and the integration of development and operations (DevOps). It highlights key concepts such as continuous delivery and infrastructure as code, providing examples of configurations and automation strategies. The presentation also focuses on empowering developers through collaboration and the use of virtualization tools like Vagrant for managing deployments across different environments.
![manifests
ruby-like
ERB templates
exec { "maven-untar":
command => "tar xf /tmp/x.tgz",
cwd => "/opt",
creates => "/opt/apache-maven-${version}",
path => ["/bin"],
} ->
file { "/usr/bin/mvn":
ensure => link,
target => "/opt/apache-maven-${version}/bin/mvn",
}
file { "/usr/local/bin/mvn":
ensure => absent,
require => Exec["maven-untar"],
}
file { "$home/.mavenrc":
mode => "0600",
owner => $user,
content => template("maven/mavenrc.erb"),
require => User[$user],
}](https://image.slidesharecdn.com/2013-02continuousdelivery-apachecon-130228172025-phpapp02/85/Continuous-Delivery-with-Maven-Puppet-and-Tomcat-ApacheCon-NA-2013-28-320.jpg)
![Vagrant
Vagrant::Config.run do |config|
# Every Vagrant virtual environment requires a box to build off of.
config.vm.box = "centos-6.0-x86_64"
# The url from where the 'config.vm.box' box will be fetched
config.vm.box_url = "http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box"
# Boot with a GUI so you can see the screen. (Default is headless)
#config.vm.boot_mode = :gui
# Assign this VM to a host only network IP, allowing you to access it via the IP.
# config.vm.network "33.33.33.10"
# Forward a port from the guest to the host, which allows for outside
# computers to access the VM, whereas host only networking does not.
config.vm.forward_port "sonar", 9000, 19000
# Enable provisioning with Puppet stand alone.
config.vm.share_folder("templates", "/tmp/vagrant-puppet/templates", "templates")
config.vm.provision :puppet do |puppet|
puppet.manifest_file = "base.pp"
puppet.module_path = "mymodules"
puppet.options = ["--templatedir","/tmp/vagrant-puppet/templates"]
puppet.options = "-v -d"
end
end](https://image.slidesharecdn.com/2013-02continuousdelivery-apachecon-130228172025-phpapp02/85/Continuous-Delivery-with-Maven-Puppet-and-Tomcat-ApacheCon-NA-2013-41-320.jpg)
![Installing Maven
$repo1 = {
id => "myrepo",
username => "myuser",
password => "mypassword",
url => "http://repo.acme.com",
}
# Install Maven
class { "maven::maven":
version => "2.2.1",
} ->
# Create a settings.xml with the repo credentials
class { "maven::settings" :
servers => [$repo1],
}](https://image.slidesharecdn.com/2013-02continuousdelivery-apachecon-130228172025-phpapp02/85/Continuous-Delivery-with-Maven-Puppet-and-Tomcat-ApacheCon-NA-2013-47-320.jpg)
![New Maven type
maven { "/tmp/maven-core-2.2.1.jar":
id => "org.apache.maven:maven-core:jar:2.2.1",
repos => ["http://repo1.maven.apache.org/maven2",
"http://mirrors.ibiblio.org/pub/mirrors/maven2"],
}](https://image.slidesharecdn.com/2013-02continuousdelivery-apachecon-130228172025-phpapp02/85/Continuous-Delivery-with-Maven-Puppet-and-Tomcat-ApacheCon-NA-2013-48-320.jpg)
![New Maven type
maven { "/tmp/maven-core-2.2.1.jar":
groupId => "org.apache.maven",
artifactId => "maven-core",
version => "2.2.1",
packaging => "jar",
repos => ["http://repo1.maven.apache.org/maven2",
"http://mirrors.ibiblio.org/pub/mirrors/maven2"],
}](https://image.slidesharecdn.com/2013-02continuousdelivery-apachecon-130228172025-phpapp02/85/Continuous-Delivery-with-Maven-Puppet-and-Tomcat-ApacheCon-NA-2013-49-320.jpg)
Continuous Delivery with Maven, Puppet and Tomcat - ApacheCon NA 2013
- 1. Continuous Delivery with Maven, Puppet and Tomcat Carlos Sanchez @csanchez http://csanchez.org http://maestrodev.com
- 2. @csanchez Apache Maven ASF Eclipse Member Foundation csanchez.org maestrodev.com
- 3. How we got here
- 4. Agile planning iterative development continuous integration release soon, release often
- 7. Fear of change Risky deployments It works on my machine! Siloisation Dev Change vs. Ops stability
- 8. Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan
- 9. OPs requirements Operating System config files packages installed multi stage configurations dev QA pre-production production
- 10. Deployment How do I deploy this? documentation manual steps prone to errors
- 11. Cloud How do I deploy this? to hundreds of servers
- 13. DevOps
- 14. DevQaOps ?
- 16. DEV QA OPS
- 17. QA DEV OPS
- 18. Specs Packages DEV PROD Versions
- 19. Testability DEV QA
- 20. Metrics Logs DEV PROD Security updates
- 21. is not about the tools but how can I implement IT
- 22. Tools can enable change in behavior and eventually change culture Patrick Debois
- 23. everyone is intelligent enough every tool is cloud enabled every tool is DevOps(tm)
- 24. 3 key concepts
- 27. Infrastructure as Code it’s all been invented, now it’s standardized
- 28. manifests ruby-like ERB templates exec { "maven-untar": command => "tar xf /tmp/x.tgz", cwd => "/opt", creates => "/opt/apache-maven-${version}", path => ["/bin"], } -> file { "/usr/bin/mvn": ensure => link, target => "/opt/apache-maven-${version}/bin/mvn", } file { "/usr/local/bin/mvn": ensure => absent, require => Exec["maven-untar"], } file { "$home/.mavenrc": mode => "0600", owner => $user, content => template("maven/mavenrc.erb"), require => User[$user], }
- 29. package { 'openssh-server': ensure => present, } infrastructure IS code
- 30. service { 'ntp': name => 'ntpd', ensure => running, } declarative model state vs process no scripting
- 31. Follow development new best solutions practices tagging branching new releasing challenges dev, QA, production
- 32. Self servicing
- 33. Infrastructure always available virtualization & cloud empower developers reduce time-to- market
- 34. devs buy-in With great power comes great responsibility
- 37. Vagrant
- 38. Vagrant Oracle VirtualBox cmdline automation Easy Puppet and Chef provisioning Keep VM configuration for different projects Share boxes and configuration files across teams base box + configuration files
- 39. Vagrant base boxes www.vagrantbox.es anywhere! just (big) files
- 40. using Vagrant $ gem install vagrant $ vagrant box add centos-6.0-x86_64 http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box $ vagrant init myproject $ vagrant up $ vagrant ssh $ vagrant suspend $ vagrant resume $ vagrant destroy
- 41. Vagrant Vagrant::Config.run do |config| # Every Vagrant virtual environment requires a box to build off of. config.vm.box = "centos-6.0-x86_64" # The url from where the 'config.vm.box' box will be fetched config.vm.box_url = "http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box" # Boot with a GUI so you can see the screen. (Default is headless) #config.vm.boot_mode = :gui # Assign this VM to a host only network IP, allowing you to access it via the IP. # config.vm.network "33.33.33.10" # Forward a port from the guest to the host, which allows for outside # computers to access the VM, whereas host only networking does not. config.vm.forward_port "sonar", 9000, 19000 # Enable provisioning with Puppet stand alone. config.vm.share_folder("templates", "/tmp/vagrant-puppet/templates", "templates") config.vm.provision :puppet do |puppet| puppet.manifest_file = "base.pp" puppet.module_path = "mymodules" puppet.options = ["--templatedir","/tmp/vagrant-puppet/templates"] puppet.options = "-v -d" end end
- 42. manifests/base.pp package { jdk: ensure => installed, name => $operatingsystem ? { centOS => "java-1.6.0-openjdk-devel", Ubuntu => "openjdk-6-jdk", default => "jdk", }, }
- 43. Maven and Puppet
- 44. What am I doing to automate deployment Ant tasks plugin ssh commands Assembly plugin Cargo Capistrano
- 45. What can I do to automate deployment Handle full deployment including infrastructure not just webapp deployment Help Ops with clear, automated manifests Ability to reproduce production environments in local box using Vagrant / VirtualBox / VMWare Use the right tool for the right job
- 46. Maven-Puppet module A Maven Puppet module https://github.com/maestrodev/puppet-maven fetches Maven artifacts from the repo manages them with Puppet no more extra packaging
- 47. Installing Maven $repo1 = { id => "myrepo", username => "myuser", password => "mypassword", url => "http://repo.acme.com", } # Install Maven class { "maven::maven": version => "2.2.1", } -> # Create a settings.xml with the repo credentials class { "maven::settings" : servers => [$repo1], }
- 48. New Maven type maven { "/tmp/maven-core-2.2.1.jar": id => "org.apache.maven:maven-core:jar:2.2.1", repos => ["http://repo1.maven.apache.org/maven2", "http://mirrors.ibiblio.org/pub/mirrors/maven2"], }
- 49. New Maven type maven { "/tmp/maven-core-2.2.1.jar": groupId => "org.apache.maven", artifactId => "maven-core", version => "2.2.1", packaging => "jar", repos => ["http://repo1.maven.apache.org/maven2", "http://mirrors.ibiblio.org/pub/mirrors/maven2"], }
- 50. Examples
- 51. Infrastructure QA www httpd, tomcat, httpd postgres Jenkins tomcat1 tomcat Archiva db postgres
- 52. Tomcat cluster + postgres postgres database db.acme.com tomcat servers tomcat1.acme.com tomcat2.acme.com ... httpd www.acme.com
- 53. Puppet Modules required bundle install && librarian-puppet install mod 'puppetlabs/java', '0.1.6' mod 'puppetlabs/apache', '0.4.0' mod 'inkling/postgresql', '0.2.0' mod 'puppetlabs/firewall', '0.0.4' mod 'tomcat', :git => 'https://github.com/carlossg/puppet-tomcat.git', :ref => 'centos' mod 'maestrodev/maven', '1.x' mod 'stahnma/epel', '0.0.2' mod 'maestrodev/avahi', '1.x' mod 'acme', :path => 'mymodules/acme'
- 54. mymodules/acme/manifests/db_node.pp class 'acme::db_node' { class { "postgresql::server" : config_hash => { 'postgres_password' => 'postgres' } } -> postgresql::db{ "appfuse": user => "appfuse", password => "appfuse", grant => "all", } }
- 55. mymodules/acme/manifests/tomcat_node.pp class 'acme::tomcat_node'($db_host = 'db.local') { class { "java": distribution => "java-1.6.0-openjdk" } class { 'tomcat': } -> tomcat::instance {'appfuse': } -> class { 'maven::maven': } -> maven { "/srv/tomcat/appfuse/webapps/ROOT.war": id => "org.appfuse:appfuse-spring:2.2.1:war", } }
- 56. manifests/site.pp import 'nodes/*.pp' node ‘parent’ { class {'epel': } -> class {'avahi': firewall => true, } }
- 57. manifests/nodes/tomcat.pp # tomcat1.acme.com, tomcat2.acme.com, tomcat3.acme.com,... node /tomcatd..*/ inherits ‘parent’ { file {'/etc/motd': content => ”tomcat server: ${::hostname}n”, } class {'acme::tomcat_node'} }
- 58. manifests/nodes/qa.pp node /qa..*/ inherits ‘parent’ { class {'acme::db_node': } class {'acme::tomcat_node': db_host => 'localhost', } class {'acme::www_node': tomcat_host => 'localhost', } }
- 59. spec/hosts/db_spec.pp require 'rspec-puppet' describe 'db.acme.com' do let(:facts) { { :osfamily => 'RedHat', :operatingsystem => 'CentOS', :operatingsystemrelease => ‘6.3’} } it { should contain_class('postgresql::server') } end
- 60. spec/hosts/www_spec.pp require 'rspec-puppet' describe 'www.acme.com' do let(:facts) { { :osfamily => 'RedHat', :operatingsystem => 'CentOS', :operatingsystemrelease => ‘6.3’} } it { should contain_package('httpd') } end
- 61. Example code and slides Available at http://slideshare.csanchez.org http://github.csanchez.org http://blog.csanchez.org
- 63. Photo Credits Brick wall - Luis Argerich http://www.flickr.com/photos/lrargerich/4353397797/ Agile vs. Iterative flow - Christopher Little http://en.wikipedia.org/wiki/File:Agile-vs-iterative-flow.jpg DevOps - Rajiv.Pant http://en.wikipedia.org/wiki/File:Devops.png Pimientos de Padron - Howard Walfish http://www.flickr.com/photos/h-bomb/4868400647/ Compiling - XKCD http://xkcd.com/303/ Printer in 1568 - Meggs, Philip B http://en.wikipedia.org/wiki/File:Printer_in_1568-ce.png Relativity - M. C. Escher http://en.wikipedia.org/wiki/File:Escher%27s_Relativity.jpg Teacher and class - Herald Post http://www.flickr.com/photos/heraldpost/5169295832/