Using Docker for Testing
33 likes36,653 views
The document discusses the use of Docker for testing in software development, particularly in relation to Jenkins and CI/CD pipelines. It emphasizes the benefits of containerization, such as dependency isolation and ease of orchestration across various environments using tools like Kubernetes. Additionally, it outlines specific implementations and configurations for utilizing Docker with Jenkins to enhance build and deployment processes.
![Dockerfile
FROM centos
RUN yum -y install openjdk-8 mysql
ENV JENKINS_REMOTING_VERSION 2.52
ENV HOME /home/jenkins
RUN useradd -c "Jenkins user" -d $HOME -m jenkins
RUN curl --create-dirs -sSLo /usr/share/jenkins/remoting-
$JENKINS_REMOTING_VERSION.jar http://repo.jenkins-ci.org/public/
org/jenkins-ci/main/remoting/$JENKINS_REMOTING_VERSION/remoting-
$JENKINS_REMOTING_VERSION.jar
&& chmod 755 /usr/share/jenkins
COPY jenkins-slave.sh /usr/local/bin/jenkins-slave.sh
USER jenkins
VOLUME /home/jenkins
ENTRYPOINT ["/usr/local/bin/jenkins-slave.sh"]](https://image.slidesharecdn.com/usingdockerfortesting-151110133222-lva1-app6892/85/Using-Docker-for-Testing-26-320.jpg)
![Dockerfile
FROM centos
RUN yum -y install openjdk-8 mysql
ENV JENKINS_REMOTING_VERSION 2.52
ENV HOME /home/jenkins
RUN useradd -c "Jenkins user" -d $HOME -m jenkins
RUN curl --create-dirs -sSLo /usr/share/jenkins/remoting-
$JENKINS_REMOTING_VERSION.jar http://repo.jenkins-ci.org/public/
org/jenkins-ci/main/remoting/$JENKINS_REMOTING_VERSION/remoting-
$JENKINS_REMOTING_VERSION.jar
&& chmod 755 /usr/share/jenkins
COPY jenkins-slave.sh /usr/local/bin/jenkins-slave.sh
USER jenkins
VOLUME /home/jenkins
ENTRYPOINT ["/usr/local/bin/jenkins-slave.sh"]](https://image.slidesharecdn.com/usingdockerfortesting-151110133222-lva1-app6892/85/Using-Docker-for-Testing-35-320.jpg)
Using Docker for Testing
- 1. Using Docker for Testing Carlos Sanchez @csanchez
- 2. About Senior Software Engineer @ CloudBees Author of Jenkins Kubernetes plugin Long time OSS contributor at Apache Maven, Eclipse, Puppet,…
- 4. @YourTwitterHandle Docker Linux containers Union File System File System Users Processes Network
- 5. But it is not trivial
- 6. Docker Linux required but Docker Machine (formerly Boot2Docker) to the rescue OS X Windows
- 7. Docker Build once, run anywhere (kind of) Bare metal Virtual Machines Cloud Docker
- 9. developer oriented Dependency hell installation nightmares “it ran on my machine”
- 10. ops oriented no need to know internals of apps focus on OPs problems (scale, monitoring,…) clearer deliverables from dev
- 11. @YourTwitterHandle Docker delivery Docker image Docker infrastructure App System
- 14. Related projects
- 15. Docker Machine Provision Docker engines VirtualBox, replaces boot2docker ! Amazon EC2 Microsoft Azure Google Compute Engine OpenStack Rackspace VMware …
- 16. Docker Swarm Clustering for Docker containers Using the same API Integrates with Mesos / Mesosphere And planned Amazon EC2 Container Service (ECS) Google Kubernetes IBM Bluemix Container Service Joyent Smart Data Center Microsoft Azure
- 17. Docker Compose Orchestration of multi-container apps Based on Fig Defined by: containers configuration links volumes
- 18. Apache Mesos A distributed systems kernel Docker Containerizer Marathon & Chronos
- 19. Docker & Jenkins
- 20. What are we trying to solve Different projects, different requirements languages (Java, Ruby,…) tools (Maven, Ant, …) system libraries (OpenSSL, …) operating systems (Debian, Red Hat,…) external dependencies (MySQL, Postgres)
- 21. @YourTwitterHandle Initial solution Jenkins master slave 3 slave 2 slave 1
- 25. Dockerfile # A Debian based image FROM jenkinsci/jnlp-slave RUN apt-get update && apt-get install -y mysql && rm -rf /var/lib/apt/lists/*
- 26. Dockerfile FROM centos RUN yum -y install openjdk-8 mysql ENV JENKINS_REMOTING_VERSION 2.52 ENV HOME /home/jenkins RUN useradd -c "Jenkins user" -d $HOME -m jenkins RUN curl --create-dirs -sSLo /usr/share/jenkins/remoting- $JENKINS_REMOTING_VERSION.jar http://repo.jenkins-ci.org/public/ org/jenkins-ci/main/remoting/$JENKINS_REMOTING_VERSION/remoting- $JENKINS_REMOTING_VERSION.jar && chmod 755 /usr/share/jenkins COPY jenkins-slave.sh /usr/local/bin/jenkins-slave.sh USER jenkins VOLUME /home/jenkins ENTRYPOINT ["/usr/local/bin/jenkins-slave.sh"]
- 27. Docker plugin
- 28. Docker plugin As a plugin on demand slaves https://github.com/jenkinsci/docker-plugin
- 29. @YourTwitterHandle Jenkins master slave 3 slave 2 slave 1
- 31. CloudBees Docker Custom Build Environment Plugin
- 32. Custom Build Environment Avoid dependencies in Jenkins Containers are completely isolated Use any executor/slave
- 35. Dockerfile FROM centos RUN yum -y install openjdk-8 mysql ENV JENKINS_REMOTING_VERSION 2.52 ENV HOME /home/jenkins RUN useradd -c "Jenkins user" -d $HOME -m jenkins RUN curl --create-dirs -sSLo /usr/share/jenkins/remoting- $JENKINS_REMOTING_VERSION.jar http://repo.jenkins-ci.org/public/ org/jenkins-ci/main/remoting/$JENKINS_REMOTING_VERSION/remoting- $JENKINS_REMOTING_VERSION.jar && chmod 755 /usr/share/jenkins COPY jenkins-slave.sh /usr/local/bin/jenkins-slave.sh USER jenkins VOLUME /home/jenkins ENTRYPOINT ["/usr/local/bin/jenkins-slave.sh"]
- 36. Custom Build Environment Take advantage of all pre-built Docker images java, ruby, python, maven,…
- 37. Docker images are now a deliverable Docker images are part of the pipeline Build/test/deploy images Deliver as any other artifact even if not used to run production systems
- 38. More Docker!
- 39. @YourTwitterHandle Jenkins plugins Docker CloudBees Docker Custom Build Environment CloudBees Docker Build and Publish CloudBees Docker Hub Notification CloudBees Docker Traceability docker-build-step Docker workflow Kubernetes Mesos
- 43. Selenium Manage multiple combinations of browsers Any number of them Standalone or Selenium Hub even with VNC
- 46. Selenium Hub hub: image: selenium/hub:2.48.2 ports: - "4444:4444" firefox: image: selenium/node-firefox-debug:2.48.2 links: - hub ports: - "5901:5900" chrome: image: selenium/node-chrome-debug:2.48.1 links: - hub ports: - "5902:5900"
- 47. Kubernetes
- 48. Kubernetes Container cluster orchestration Docker containers across multiple hosts (nodes or minions) Higher level API Enforced state Monitoring of endpoints
- 51. Pod Group of colocated containers Same network namespace/IP Environment variables Shared volumes host mounted empty volumes GCE data disks AWS EBS volumes nfs glusterfs secrets
- 52. @YourTwitterHandle Pods Node client kubelet pods Master Node kubelet pods Node kubelet pods … … …
- 53. Pod kind: "Pod" apiVersion: "v1" metadata: name: "jenkins" labels: name: "jenkins" spec: containers: - name: "jenkins" image: "csanchez/jenkins-swarm: 1.625.1-for-volumes" ports: - containerPort: 8080 - containerPort: 50000 volumeMounts: - name: "jenkins-data" mountPath: "/var/jenkins_home" volumes: - name: "jenkins-data" hostPath: path: "/home/docker/jenkins"
- 55. Kubernetes Jenkins plugin As a plugin on demand slaves https://github.com/jenkinsci/kubernetes- plugin
- 58. Danke!