Slide 1

Slide 1 text

CloudOpen 2015 Integrating oVirt, Foreman And Katello To Empower Your Data-Center Utilization Yaniv Bronhaim Senior Software Engineer, Maintainer @ RHEV Red Hat IL, Raanana August 2015, CloudOpen Europe

Slide 2

Slide 2 text

CloudOpen 2015 Agenda ● Introducing Open-Source solutions ● oVirt, Foreman and Katello ● New third-party integration in oVirt 3.6 ● Using Foreman for Bare-Metal Provisioning ● Using Katello for displaying Errata (update) content information for hosts, Vms and Engine ● oVirt 3.6 Upgrade Manager ● oVirt 4.0 plans

Slide 3

Slide 3 text

CloudOpen 2015 Large scale, centralized management for server and desktop virtualization Provide an open source alternative to vCenter/vSphere Focus on KVM for best integration/performance

Slide 4

Slide 4 text

CloudOpen 2015 Focus #1 : Performance And Scalability Maintain a large amount of resources Data Centers Storage Linux Hypervisors Guests \ VMs Network

Slide 5

Slide 5 text

CloudOpen 2015 Focus #2 : User Intuitive Different type of users and requirements

Slide 6

Slide 6 text

CloudOpen 2015 Focus #3 : Secure and Recoverable It hurts to lose your VM in the cloud

Slide 7

Slide 7 text

CloudOpen 2015 Data Centers Storage Linux Hypervisors Guests \ VMs Network

Slide 8

Slide 8 text

CloudOpen 2015 oVirt Engine Redhat Enterprise Virtualization http://www.ovirt.org/Quick_Start_Guide

Slide 9

Slide 9 text

CloudOpen 2015

Slide 10

Slide 10 text

CloudOpen 2015 Host Deploy The Basic Of Utilizing The Hypervisor Client (Web Portal) Engine

Slide 11

Slide 11 text

CloudOpen 2015 Deploy Host Flow Client (web portals) Engine

Slide 12

Slide 12 text

CloudOpen 2015 Deploy (Configure) New Host

Slide 13

Slide 13 text

CloudOpen 2015 Host Deployment The process of preparing an operating system environment suitable to host virtual machines and to be managed by the ovirt back-end ● VDSM packages are installed. ● Clock is 'soft' synchronized. ● Management bridge created. ● Firewall rules applied. ● SSH trust obtained. ● PKI trust obtained. ● VDSM certificate issued. ● Services' boot state set. ● Host tuned for virtualization.

Slide 14

Slide 14 text

CloudOpen 2015 oVirt Node ● Standalone hypervisor – Small footprint < 100MB ● Customized 'spin' of Fedora + KVM ● 'Just enough' Fedora to run virtual machines ● Runs on all RHEL hardware with Intel VT/AMD-V CPUs – Easy to install, configure and upgrade ● PXE boot, USB boot, CD or Hard drive ● Upcoming – Using Atomic

Slide 15

Slide 15 text

CloudOpen 2015

Slide 16

Slide 16 text

CloudOpen 2015 /usr/libexec/qemu-kvm -name vm-f16-buildmachine -S -M rhel6.4.0 -cpu Westmere -enable-kvm -m 2048 -smp 2,sockets=2,cores=1,threads=1 -uuid a8ccdb60-8a42-44f5- 9669-d74c3b2eff43 -smbios type=1,manufacturer=Red Hat,product=RHEV Hypervisor,version=6Server-6.4.0.4.el6,serial=30353036-3837-4247-3831- 30394635324C_78:e7:d1:22:46:d8,uuid=a8ccdb60-8a42-44f5-9669-d74c3b2eff43 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/vm-f16- buildmachine.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2013-10-08T12:16:16,driftfix=slew -no-shutdown -device piix3-usb- uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-serial-pci,id=virtio- serial0,bus=pci.0,addr=0x4 -drive if=none,media=cdrom,id=drive-ide0-1- 0,readonly=on,format=raw,serial= -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1- 0,id=ide0-1-0 -drive file=/rhev/data-center/f79b0b28-c82f-11e0-8739-78e7d1e48c4c/5bab6470- 8825-4e3a-b408-ebcde93678b6/images/4c213cd2-c4d5-441b-a1ac-dfb1a6868699/11b3e132-50a5-481b- b48b-e3b1f2879e69,if=none,id=drive-virtio-disk0,format=qcow2,serial=4c213cd2-c4d5-441b-a1ac- dfb1a6868699,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk- pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/rhev/data-center/f79b0b28-c82f-11e0-8739-78e7d1e48c4c/5bab6470-8825-4e3a-b408- ebcde93678b6/images/02330fa2-d1ff-48e0-a843-842c2376756f/5a283126-4d27-4eef-86dd- fb538d8d08e4,if=none,id=drive-virtio-disk1,format=qcow2,serial=02330fa2-d1ff-48e0-a843- 842c2376756f,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk- pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=31,id=hostnet0,vhost=on,vhostfd=32 -device virtio-net- pci,netdev=hostnet0,id=net0,mac=00:1a:4a:23:12:13,bus=pci.0,addr=0x3,bootindex=2 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/vm-f16- buildmachine.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio- serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/vm-f16- buildmachine.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio- serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev spicevmc,id=charchannel2,name=vdagent -device virtserialport,bus=virtio- serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0 -spice port=5904,tls- port=5905,addr=10.35.16.4,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls- channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls- channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on -k en-us -vga qxl -global qxl-vga.ram_size=67108864 -global qxl-vga.vram_size=67108864

Slide 17

Slide 17 text

CloudOpen 2015

Slide 18

Slide 18 text

CloudOpen 2015 Prepare Virtual Environment

Slide 19

Slide 19 text

21 CloudOpen 2015 Live Migration • Dynamically move virtual machines between hosts ● No service interruption ● Applications continue to run • Migrate even I/O intensive workloads such as databases • Perform hardware maintenance without application downtime • Dynamically balance workloads between host systems

Slide 20

Slide 20 text

22 CloudOpen 2015 • Build a highly available enterprise infrastructure • Continually monitor host systems and virtual machines • Automatically restart virtual machines in case of host failure ● Restart virtual machine on another node in the cluster • Use live migration to “fail-back” a VM to it's original host when the server is restored High Availability

Slide 21

Slide 21 text

23 CloudOpen 2015 System Scheduler • Dynamically balance workloads in the data center. • Automatically live migrate virtual machines based on resources • Define custom policies for distribution of virtual machines • Define policies to optimize workload on a fewer number of servers during “off-peak” hours

Slide 22

Slide 22 text

CloudOpen 2015

Slide 23

Slide 23 text

CloudOpen 2015

Slide 24

Slide 24 text

CloudOpen 2015

Slide 25

Slide 25 text

CloudOpen 2015 Live snapshot Task Management Async Operations Live Migration Overcommit CPU, Memory, I/O Hotplug Thirdparty Integration Hosted Engine Live Storage Migration KSM Kernel Same-Page Mering NUMA SPICE Memory Ballooning OS support sVirt PCI pass through Quota Limit Resources Import Storage Domain VIRT V2V & P2V MoM AAA Progress Live Processes Iscsi , NFS Management Network Interfaces Management Cinder Templates Node Registration Events User Roles Kdump fencing PPC Support Discovery Hosts Provisioning Upgrade Management Expose Packages Information

Slide 26

Slide 26 text

CloudOpen 2015 Live snapshot Task Management Async Operations Live Migration Overcommit CPU, Memory, I/O Hotplug Thirdparty Integration Hosted Engine Live Storage Migration KSM Kernel Same-Page Mering NUMA SPICE Memory Ballooning OS support sVirt PCI pass through Quota Limit Resources Import Storage Domain VIRT V2V & P2V MoM AAA Progress Live Processes Iscsi , NFS Management Network Interfaces Management Cinder Templates Node Registration Events User Roles Kdump fencing PPC Support Discovery Hosts Provisioning Upgrade Management Expose Packages Information

Slide 27

Slide 27 text

CloudOpen 2015 Complete lifecycle management tool for physical and virtual servers. Initial Start Configure Monitor

Slide 28

Slide 28 text

CloudOpen 2015

Slide 29

Slide 29 text

CloudOpen 2015

Slide 30

Slide 30 text

CloudOpen 2015

Slide 31

Slide 31 text

CloudOpen 2015

Slide 32

Slide 32 text

CloudOpen 2015 Foreman Provision Foreman Configurator Foreman Management How it's being done by Foreman

Slide 33

Slide 33 text

CloudOpen 2015 Fedora CentOS RHEL Ubunto PXE Boot Foreman Provision Foreman Configurator Foreman Management Smart Proxy DNS DHCP TFTP

Slide 34

Slide 34 text

CloudOpen 2015 Puppet Chef Reports Passwords Keys Users Services Foreman Provision Foreman Configurator Foreman Management Configuration Management Provision templates Host groups Puppet classes Parameters

Slide 35

Slide 35 text

CloudOpen 2015 Foreman Provision Foreman Configurator Foreman Management Interface UI, API, Cli Rest API Web Interface

Slide 36

Slide 36 text

CloudOpen 2015 Remote Management ● Bare metal provisioning = Register servers to central management software ● Ability to locate the physical hardware and know its specification ● Configure and monitor the servers

Slide 37

Slide 37 text

CloudOpen 2015 Provision Connect Your Data Center

Slide 38

Slide 38 text

CloudOpen 2015 S1-A = 00:11:22:33:44:23 S2-A = 0A:1B:C2:CC:44:55 C8-E = A3:AA:C7:92:12:32 C4-E = A3:BB:D7:92:42:32 C8-E C7-E C6-E C5-E C5-F = A3:EB:F4:92:12:32 D5-E = A3:BC:D7:92:12:22 B5-E = A3:BB:D7:92:12:12 Configure

Slide 39

Slide 39 text

CloudOpen 2015 Install OS Manual Provision Process

Slide 40

Slide 40 text

CloudOpen 2015 Initial Setup Configure

Slide 41

Slide 41 text

CloudOpen 2015 Monitor And Update – Drift Management 5 Monitor

Slide 42

Slide 42 text

CloudOpen 2015 Bare Metal Provisioning Feature Client (web portals) Foreman

Slide 43

Slide 43 text

CloudOpen 2015 Client (web portals) Foreman

Slide 44

Slide 44 text

CloudOpen 2015 Client (web portals) Foreman

Slide 45

Slide 45 text

CloudOpen 2015 Client (web portals) Foreman

Slide 46

Slide 46 text

CloudOpen 2015

Slide 47

Slide 47 text

CloudOpen 2015

Slide 48

Slide 48 text

CloudOpen 2015 ● Create, organize, and manage local yum and puppet repositories ● Sync remote repositories ● Create custom Content Views ● Install package and errata updates

Slide 49

Slide 49 text

CloudOpen 2015

Slide 50

Slide 50 text

CloudOpen 2015

Slide 51

Slide 51 text

CloudOpen 2015

Slide 52

Slide 52 text

CloudOpen 2015 Integrating to oVirt Host Lifecycle Management Host Content Management Provision Bare-Metal Host Gather Content Information ERRATA Info Deploy Hypervisor

Slide 53

Slide 53 text

CloudOpen 2015 How does Provisioning integrate with oVirt ? Host Lifecycle Management Provision Bare-Metal Host Deploy Hypervisor

Slide 54

Slide 54 text

CloudOpen 2015 Provision

Slide 55

Slide 55 text

CloudOpen 2015 serv1.bob.redhat.com New Host Going Back To Adding New Installed Host Using Host Deploy

Slide 56

Slide 56 text

CloudOpen 2015 New Host serv1.bob.redhat.com

Slide 57

Slide 57 text

CloudOpen 2015 Deploy (Configure) New Host

Slide 58

Slide 58 text

CloudOpen 2015 Hypervisor

Slide 59

Slide 59 text

CloudOpen 2015

Slide 60

Slide 60 text

CloudOpen 2015 Adding External Provider - Foreman Client (web portals)

Slide 61

Slide 61 text

CloudOpen 2015 Adding New Discovered Host

Slide 62

Slide 62 text

CloudOpen 2015 Engine

Slide 63

Slide 63 text

CloudOpen 2015 Engine 00:11:22:33:44:55 0A:1B:C2:CC:44:55 A3:AA:C7:92:12:32

Slide 64

Slide 64 text

CloudOpen 2015

Slide 65

Slide 65 text

CloudOpen 2015 00:11:22:33:44:55=192.168.1.2 0A:1B:C2:CC:44:55=192.168.1.56 A3:AA:C7:92:12:32=192.168.1.66

Slide 66

Slide 66 text

CloudOpen 2015 Engine

Slide 67

Slide 67 text

CloudOpen 2015 Engine

Slide 68

Slide 68 text

CloudOpen 2015

Slide 69

Slide 69 text

CloudOpen 2015 Engine

Slide 70

Slide 70 text

CloudOpen 2015

Slide 71

Slide 71 text

CloudOpen 2015 Provision Provision Host newbob.redhat.com

Slide 72

Slide 72 text

CloudOpen 2015 Provision Provision Host 192.168.1.53

Slide 73

Slide 73 text

CloudOpen 2015 Deploy (Configure) API Request to deploy host oVirt Provision Plugin

Slide 74

Slide 74 text

CloudOpen 2015 Provision is Done!

Slide 75

Slide 75 text

CloudOpen 2015 Host Content Management Gather Content Information ERRATA Info How does Content Management integrate with oVirt ?

Slide 76

Slide 76 text

CloudOpen 2015 Host Content Information

Slide 77

Slide 77 text

CloudOpen 2015 API Request To Gather Information About Host Or Virtiual Machine

Slide 78

Slide 78 text

CloudOpen 2015 Collecting Content Flow:

Slide 79

Slide 79 text

CloudOpen 2015 Reads And Reports Content Status By Using Katello Agent

Slide 80

Slide 80 text

CloudOpen 2015 #2 : Host Content Information Errata Reports

Slide 81

Slide 81 text

CloudOpen 2015 Hosts and VMs Content Information

Slide 82

Slide 82 text

CloudOpen 2015

Slide 83

Slide 83 text

CloudOpen 2015 Engine Content

Slide 84

Slide 84 text

CloudOpen 2015 oVirt 3.6 Upgrade Manager For Hosts – Using Host Management Gathering Main Packages Info and trigger an update Mostly for upgrading cluster level Polling for yum\dnf update info

Slide 85

Slide 85 text

CloudOpen 2015 Notify For Upgrade Availability

Slide 86

Slide 86 text

CloudOpen 2015

Slide 87

Slide 87 text

CloudOpen 2015 oVirt Host Mgmt Process

Slide 88

Slide 88 text

CloudOpen 2015 Host Management The process of upgrading content environment for suitable cluster (usually VDSM version upgrade) ● Direct SSH trust obtained. ● Allows to retrieve current installed packages information. ● Perform YUM\DNF operations for specific virt packages.

Slide 89

Slide 89 text

CloudOpen 2015 Summary ● Katello, Foreman, oVirt ● Discover new hosts and utilizing them ● Manage content and cluster updates The feature pages: ● http://www.ovirt.org/Features/ForemanIntegration ● http://www.ovirt.org/Home/Features/KatelloIntegration ● http://www.ovirt.org/Home/Features/UpgradeManager

Slide 90

Slide 90 text

CloudOpen 2015 Future Plans: ● VM Provisioning ● Full Host Configuration Management Through oVirt ● Multiply Selection For Hosts Provisioning ● Upgrade Hosts by Katello API ● Cluster Upgrades

Slide 91

Slide 91 text

CloudOpen 2015 ● Homepage http://ovirt.org ● Overall Projects http://gerrit.ovirt.org ● Mails lists [email protected] [email protected] ● #ovirt on OFTC ● Homepage http://theforeman.org ● Overall Projects Github.com/theforeman ● #theforeman on freenode ● Homepage http://katello.org ● Overall Projects Github.com/Katello ● #katello on freenode

Slide 92

Slide 92 text

CloudOpen 2015 Questions? Yaniv Bronhaim. [email protected] [email protected]

Slide 93

Slide 93 text

CloudOpen 2015 THANK YOU ! Yaniv Bronhaim. http://www.ovirt.org [email protected]