MongoDB and Red Hat Enterprise Linux

Red Hat Enterprise Linux (RHEL) powers mission critical applications for thousands of enterprises and delivers performance, reliability, scalability, and security. In this webinar, we'll walk through some of the steps necessary to deploy MongoDB on RHEL 6.2 and take advantage of several features of the underlying system. Using multiple example deployment scenarios, we'll review issues like configuring storage, server security and system monitoring. These steps can serve as a basis for deploying MongoDB in your own RHEL environment.

Transcript

1. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# MongoDB'on'Red'Hat'Enterprise' Linux' Sandeep#Parikh# Technical#Product#Manager# sandeep.parikh@10gen.com# Thanks'for'joining,'we’ll'begin'shortly' Sanjay#Rao# Principal#SoIware#Engineer# srao@redhat.com# #
2. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Agenda# •  Some#background# •  RHEL#features# •  MongoDB#on#RHEL# – Storage# – Security# – Monitoring#
3. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# About#Red#Hat#Enterprise#Linux# •  Focused#on#evolving#data#center#needs# •  Intended#for#high#performance#systems# •  Provides#advanced#resource#management# features# •  Incorporates#features#from#SELinux#
4. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# About#MongoDB# •  Scalable,#highRperformance,#open#source# NoSQL#database# •  Data#is#stored#in#JSONRstyle#documents# •  Full#index#support# •  Atomic#inRplace#updates# •  BuiltRin#replicaUon#with#Replica#Sets# •  VerUcal#scaling#with#Sharding#
5. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# RED'HAT'ENTERPRISE'LINUX'
6. 2 04/24/12 Why Open Source ? • Code transparency • Commoditization of technology, provide alternatives • Started with the Operating System (Linux), expanded to: • Storage (DM/MPIO, LVM) • Clustering (RHCS, GFS) • Middleware, (JBOSS, MetaMatrix, Messaging, Rules) • Virtualization (KVM, RHEV) • much more... • Take advantage of rapidly emerging technologies • Virtualization, Realtime, Grid, Cloud, Messaging (AMQP), etc... • Drive cost down by providing customers with choice • Strategic Elimination of Vendor Lock In
7. 3 04/24/12 Why Red Hat? Company Track Record • #1 Provider of Open Source solutions for over a decade • Best in class Linux Training & Certification • Consistent & predictable release cycle • Consistent & predictable pricing • Consistent & predictable (timely) responses to fixes & security alerts • Responsible adoption of emerging technologies • Unmatched ISV & HSV ecosystem • Company's growth & reinvestment in relevant technologies
8. 4 Red Hat Enterprise Linux 6  Extensive improvements in every dimension – Efficiency, scalability and reliability – Unprecedented resource management – Focus on security – Superior application development and production platform – Integrated virtualization – Enterprise manageability
9. 5 Facts and Figures Red Hat Enterprise Linux 6 Released November 10th, 2010 85% more packages than Red Hat Enterprise Linux 5 Represents more than 600 person years by Red Hat engineers 14,631 resolved issues from partner,customer & community reports 1,821 customer/partner requested features included 847 features & fixes verified by partner QA teams 3.7 GB of content 2,957 binary RPMs 3,900 additional kernel enhancements to 2.6.32 Red Hat engineers are based in 26 countries Kernel based on 2.6.32 with many features from .33 & .34 Red Hat is the lead developer of kernel features Red Hat Enterprise Linux design allows smooth integration of future features
10. 6 RHEL6 Scaling Improvements • Tickless kernel (2.6.17)  Reduced power consumption • Split LRU (2.6.28)  Efficient reclaim (large systems) • C – groups (2.6.18/2.6.29)  Better hardware utilization • Ticket spinlocks (2.6.25 / 2.6.28)  Scalable / predictable locking • Per-bdi flush (2.6.31)  Scalable flushing of dirty blocks • Transparent Huge pages (2.6.31)  Automatically use huge pages RHEL x86_64 version CPUs Memory 2.1 4 64GB 3 16 128GB 4 32 256GB 5 255 1TB 6 4096 64TB
11. 7 CPUs File Systems Memory Scalability
12. 8 Mission Critical Features Component Red Hat Enterprise Linux Solaris IBM AIX HP-UX Provisioning Kickstart, Red Hat Network / Satellite Jumpstart, Sun xVM Ops Center Workload Partitions Manager Ignite/UX, Hp Virtualization Manager Systems Management & Monitoring Red Hat Network / Satellite Sun xVM Ops Center, Sun Management Center IBM Tivoli Monitoring, IBM Systems Director HP Systems Management, Insight Manager Security EAL4+ EAL4+ EAL4+ EAL4+ Identity Management Red Hat Directory Server, Red Hat Certificate System Sun Java System Directory Server, Identity Server Tivoli Directory Server, Identity Manager HP-UX Directory Server, no Identity man. Virtualization Red Hat Enterprise Linux Virtualization, KVM, Xen Containers, Ldoms, Domains, xVM WPAR, PowerVM HP Insight Dynamics – VSE, npars Clustering Red Hat Cluster Sun Cluster PowerHA Serviceguard Tuning & Troubleshooting Systemtap DTrace probevue ktracer Bare-Metal Recovery Kickstart, Red Hat Network / Satellite Flash Archive Tivoli Storage Management HP StorageWorks Data Protector
13. 9 Reliability, Availability, Serviceability (RAS) Enables a new class of hardware/software capabilities  Advanced error recovery/reporting  CPU and memory hot add  Machine Check Architecture  Intelligent recovery from CPU/memory errors  Enhanced error reporting for PCI devices (PCI-AER & APEI)  DIF/DIX: End-to-end data integrity checking  Rapid file system recovery (up to 10x faster than RHEL 5)  E.G. Fsck for 1TB filesystem (45 million files)  RHEL5 Ext3 = 1 hour, RHEL6 Ext4 = 6 minutes.
14. 10 RHEL 6 - Support for Xeon 7500 RAS Features RAS Feature Supported in RHEL 6 Recovery from Uncorrected Data Errors (MCA) Yes Yes OS CPU On-Lining Yes Yes OS Memory On-Lining (Capacity Change) Yes Yes DIMM Isolation Yes Yes Physical CPU Hot Add Yes Yes Transparent Memory Migration Yes Yes QPI Poisoning/Viral Mode Yes Yes CPU Sparing/Migration Yes No Direct Connect Flash Yes No Physical IOH Hot Add No OS IOH On-Lining No Scalable Memory Interconnect (SMI) Clock Failover No Scalable Memory Interconnect (SMI) Lane Failover No Scalable Memory Interconnect (SMI) Packet Retry No QPI Clock Failover No QPI CRC No QPI Self-Healing No QPI Packet Retry No Single-Core Disable for Fault Resilient Boot No On-Die Error Protection No Out-of-Band Access to Uncore MCA Registers No Memory Board Hot Add Yes Yes Memory Mirroring Yes Yes Intra- and Inter-Socket Memory Mirroring Yes Yes Static Hard Partitioning Yes Yes PCI Express Hot Plug Yes Yes Memory Demand and Patrol Scrubbing Yes Yes DIMM and Rank Sparing Yes Yes DRAM SDDC No Requires OS Support New RAS Features in Xeon 7500/6500 Existing RAS Features in Xeon Architecture
15. 11 What To Tune • I/O • Memory • CPU • Network
16. 12 C-group (RHEL6) • Resource Management • Memory, cpus, IO, Network • For performance • For application consolidation • Dynamic resource allocation • Application Isolation • I/O Cgroups • At device level control the % of I/O for each Cgroup if the device is shared • At device level put a cap on the throughput
17. 13 Quick Overview – KVM Architecture • Guests run as a process in userspace on the host • A virtual CPU is implemented using a Linux thread • The Linux scheduler is responsible for scheduling a virtual CPU, as it is a normal thread • Guests inherit features from the kernel • NUMA • Huge Pages • Support for new hardware
18. 14 Quick Overview – KVM Architecture • Disk and Network I/O through host (most of the time) • I/O settings in host can make a big difference in guest I/O performance • Need to understand host buffer caching • Proper settings to achieve true direct I/O from the guest • Deadline scheduler (on host) typically gives best performance • Network typically goes through a software bridge
19. 15 RHEL – The OS of Choice for Leading Virtualization Performance • SPECvirt_sc2010 is the main industry benchmark for measuring and comparing virtualization performance • http://www.spec.org/virt_sc2010/ • Red Hat employees have actively participated in the SPEC subcommittee for many years. • All of the leading submissions use RHEL as the guest OS. • The leader at each socket range is KVM based • http://www.spec.org/virt_sc2010/results/
20. 16 Performance Setting Tool • tuned for RHEL6 • Configure system for different performance profiles • laptop-ac-powersave • spindown-disk • latency-performance • laptop-battery-powersave • server-powersave • throughput-performance • desktop-powersave • enterprise-storage • default
21. 17 Performance Monitoring Tools • Monitoring tools • top, vmstat, ps, iostat, netstat, sar, perf • Kernel tools • /proc, sysctl, AltSysRq • Networking • ethtool, ifconfig • Profiling • oprofile, strace, ltrace, systemtap, perf
22. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# MONGODB'ON'RHEL'
23. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Components# mongod# • Core#database# server#process# • Responsible# for#the# storage# system# mongos# • Used#with# sharded# deployments# • Routes#data# requests#to# appropriate# shards# config# • Used#with# sharded# deployments# • mongod# process#that# maintains# sharded# cluster# metadata#
24. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Deployment#–#Single#Node#
25. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Deployment#–#Replica#Set#
26. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Deployment#–#Replica#Set#HA#
27. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Deployment#–#Sharding#
28. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Ge\ng#Started#with#RHEL# •  StarUng#with#a#base#RHEL#installaUon# •  May#need#to#create#addiUonal#group#and# admin#users# •  Register#system#with#Red#Hat# – Access#to#package#management#repos# – System#updates#and#fixes#
29. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Installing#MongoDB# $"echo""[10gen]" name=10gen"Repository" baseurl=http://downloads?distro.mongodb.org/repo/redhat/ os/x86_64" gpgcheck=0""|"sudo"tee"?a"/etc/yum.repos.d/10gen.repo" $"sudo"yum"?y"install"mongo?10gen?server" $"sudo"yum"?y"install"sysstat"
30. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Configuring#MongoDB# •  /etc/mongod.conf# – Set#dbpath#and#logpath# – Journal#path#is#determined#by#dbpath# •  Create#dbpath#and#logpath# – Set#owner:group#to#mongod:mongod# •  Replica#sets?# – Configure#oplogSize#as#well#
31. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Configuring#Storage# •  Recommended#storage#configuraUon#is# RAID10# •  “Striped#mirrors”#approach# •  Can#be#setup#via#hardware#or#soIware#RAID# – SoIware#RAID10:#mdadm#
32. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Configuring#Storage# •  May#want#to#consider#using#LVM#if#storage# needs#will#change# •  Create#groups#and#volumes#for# – Data# – Log# – Journal# •  Each#volume#is#used#differently#and#can#be# managed#differently#
33. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Filesystems# •  RHEL#provides#support#for#ext3,#ext4#and#XFS# – We’ve#seen#some#slowness#with#ext3# •  XFS#or#ext4,#it’s#up#to#you# – Pick#the#one#that#fits#your#system#goals# – MongoDB#can#be#deployed#onto#either#
34. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Storage#EncrypUon# •  Encrypt#data#inRuse#with#pseudoRfilesystem# layer# – eCrypis# •  Encrypt#data#atRrest# – Linux#Unified#Key#SetupRonRdiskRformat#(LUKS)# – Encrypt#parUUons#while#not#in#use# •  CombinaUon#of#these#two#may#be#appropriate#
35. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Securing#MongoDB# •  TCP#Wrappers# •  Services#are#“wrapped”## •  Controls#which#hosts# can#connect# •  Services#that#don’t# support#it#can#be#run#by# a#“wrapped”#manager# service# xinetd# mongod# telnetd# sshd#
36. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Securing#MongoDB# •  Neiilter#(iptables)#firewall# •  Rules#for#27017#(mongod),#27018#(mongos),# 27019#(config),#28017#(status#page)# •  Set#the#source#address#to#restrict#access# – Supports#subnetRlevel#sources#e.g.#192.168.1.1/24# $"sudo"iptables"?A"INPUT"?m"state"??state"NEW,ESTABLISHED"?s" 192.168.x.y"?p"tcp"??dport"27017"?j"ACCEPT"
37. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Data#Backups# •  MulUple#possible#methods# – The#right#approach#is#combinaUon#of#a#few# •  VolumeRlevel#backups# – Without#journal:#fsync+lock# – With#it:#no#lock#needed# •  If#fsync+lock#is#needed,#conduct#on# SECONDARY#node#to#avoid#app#errors#
38. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Data#Backups# •  With#XFS,#use#xfsdump#to#dump#enUre# filesystem#to#another#device# – Does#incremental#backups#too# •  LVM#snapshots# – Create#snapshots#from#running#volumes# – If#journal#is#in#a#separate#volume,#fsync+lock#is# needed#
39. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Data#Backups# •  Built#in:#mongodump# – Backups#can#be#done#on#a#live#system# •  Use#queries#to#limit#backup#scope# – E.g.#incremental#daily#backups# •  Pair#with#cron#to#run#periodically# #!/bin/bash" suffix=$(date"+%w)" mkdir"/home/username/backup/mongo?$suffix" /usr/bin/mongodump"?o"/home/username/backup/mongo?$suffix"
40. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Monitoring# •  MongoDB#includes#mongostat# – Exposes#internal#mongod#metrics# •  Query#and#memory#profiler#from#mongo#shell# •  10gen#offers#MongoDB#Monitoring#Service# – Free#SaaS#proacUve#monitoring#soluUon# – Dashboards,#alerts,#etc.#
41. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Monitoring# •  System#tools# – sar:#collect#and#report#system#acUvity# – iostat:#CPU#usage,#devices,#parUUons# – vmstat:#processes,#memory,#paging,#block#I/O#
42. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Monitoring# •  Dynamic#resource#management#with#Tuned# and#ktune# •  Tuned#monitors#acUvity#and#reacts#to#changes# •  Profiles#contain#system#opUmizaUon#se\ngs# •  Install#and#copy/edit#a#default#profile# $#sudo#yum#install#tuned# $#sudo#cp#Ra#/etc/tuneRprofiles/throughputRperformance#/etc/tuneRprofiles/ myprofile##
43. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Tuned#Profile# •  tuned.conf## –  The#configuraUon#for#the#tuned#service#to#be#acUve#for#this# profile.# •  sysctl.ktune# –  The#sysctl#se\ngs#used#by#ktune.#The#format#is#idenUcal#to#the#/ etc/sysconfig/sysctl#file#(refer#to#the#sysctl#and#sysctl.conf#man# pages).# •  ktune.sysconfig# –  The#configuraUon#file#of#ktune#itself,#typically#/etc/sysconfig/ ktune.# •  ktune.sh# –  An#initRstyle#shell#script#used#by#the#ktune#service#which#can#run# specific#commands#during#system#startup#to#tune#the#system##
44. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Monitoring# •  SystemTap:#app#profiler# •  Filtering#and#analysis#tools# •  RHEL#supplies#SystemTap#scripts# – Network#profiling# – Summarizing#disk#traffic#
45. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# WRAP'UP'
46. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# Learn#More# •  MongoDB#on#RHEL#white#paper# – hvp://www.10gen.com/partners/technology/redR hat# •  Red#Hat#documentaUon# – hvp://docs.redhat.com/docs/enRUS/ Red_Hat_Enterprise_Linux/index.html# •  MongoDB#documentaUon# – hvp://www.mongodb.org/display/DOCS/Home#
47. To#join#via#VOIP,##go#to#Communicate#>#Integrated#Voice#Conference#>#Join#Conference# Contact#webinars@10gen.com#if#you#are#having#audio#issues# QuesUons#&#Comments# •  May#17th#webinar,#deeper#focus#on#RHEL# capabiliUes# •  Slides#will#be#posted#later#this#week# •  Feel#free#to#contact#us:# – Sandeep#Parikh# •  sandeep.parikh@10gen.com# •  @crcsmnky# – Sanjay#Rao# •  srao@redhat.com#