From Eucalyptus to OpenStack: An Experience

Presentation on migration from Eucalyptus to OpenStack presented at the Australian OpenStack Users Group on March 26,2012

Transcript

1. Eucalyptus  à  OpenStack:     An  Experience   Han  Li  (hli@cse.unsw.edu.au)     Srikumar  Venugopal  (@srikumarv)         Service  Oriented  CompuDng  Research  Group   School  of  Computer  Science  and  Engineering  
2. Agenda   •  Who  Am  I   •  Our  Private  Cloud   •  Why  we  moved  to  Openstack   •  MigraDon  Process   •  Issues  and  SoluDons   •  TroubleshooDng   •  Conclusion   •  A  Simple  Demo  
3. Who  am  I   •  Ph.D.  Candidate     –  School  of  Computer  Science  and  Engineering,  UNSW   •  Research  Topic   –  Improve  Performance  of  Key-­‐Value  Stores  (Cassandra)  on   Virtualized  Infrastructure  (a.k.a  Private  Clouds)   •  What  I  am  doing  now  ?   –  Preparing  a  private  cloud  to  test  and  extend  Cassandra  
4. Our  Private  Cloud   •  One  Head  Node   –  1  *  QuadCore  2.33  GHz,  8  GB  ram   –  140  GB  storage,  with  15TB  RAID6  disk  array  a`ached   –  2  NICs  for  WAN  and  1  NIC  for  LAN   •  Two  Iden=cal  Blade  Servers   –  4  *  QuadCore  2.4  GHz,  96  GB  ram   –  1.2  TB  storage   –  1  acDve  NIC  for  LAN   •  Summary   –  36  cores,  200  GB  ram,  17  TB  storage  and  Gigabit  Ethernet   connecDon  
5. From  Eucalyptus  to  OpenStack   •  Why  we  used  Eucalyptus  (Mid  2010)   –  Fully  funcDonal  open  source  IaaS  product   –  Amazon  EC2-­‐compaDble  APIs   –  Well-­‐documented  (website,  paper)     •  Why  we  moved  to  OpenStack  (2012)   –  Eucalyptus  turned  commercial.  Unsolved  bugs,               inacDve  forum.   –  OpenStack:  acDve  community,  fast  release  cycles  in   2011  (Bexar,  Cactus,  Diablo)   –  CompaDble  images  
6. MigraDon  Process   •  Backup  Exis=ng  Cloud   – OS:  networking  config,  user  data   – Eucalyptus:  images,  volumes   •  Install  OS  and  OpenStack   – OS:  Debian  à  Ubuntu   – OpenStack  components  layout   •  Configure  and  Troubleshoo=ng   – Time-­‐consuming  
7. Our  Deployment  
8. Issue  1   •  Issue   –  Unable  to  a`ach  volumes  across  nodes   –  Launchpad  bug  #871278   •  Solu=on   –  Fix  Released  in  Ubuntu  Precise   •  Trade-­‐Off   –  Ubuntu  Oneiric  v.s.  Precise  α2/β1   –  Stable  but  buggy   –  Less  buggy  but  unpredictable:  e.g.  Permission  denied   (2012.1~e4~20120224.12913-­‐0ubuntu1)  
9. Issue  2   •  Issue   – AuthenDcaDon  fails  with  Keystone   •  Solu=on   – Fall  back  to  deprecated  auth  mode   – Wait  for  the  next  stable  release   •  Trade-­‐Off   – Keystone  –  mulD-­‐role,  mulD-­‐tenancy   – Deprecated  auth  –  admin,  non-­‐admin   – FuncDonality  v.s.  complexity  
10. Issue  3   •  Issue   – Virtual  networking  fails  from  Dme  to  Dme   – Cannot  associate  with  the  correct  NIC  (FlatDHCP)   – Launchpad  bug  #944734   •  Solu=on   – Manually  restart  nova-­‐compute  and  reboot  VMs   – Wait  for  Fix  Release  (coming  soon)   •  Trade-­‐Off   – Consider:  VLAN  v.s.  Flat  v.s.  FlatDHCP  
11. Issue  4   •  Issue   – Euca-­‐register  image  blocks  nova-­‐api   – Launchpad  bug  #946897  (Won’t  Fix)     •  Solu=on   – Run  mulDple  nova-­‐api  services   – Use  Glance  to  upload  and  register   (recommended)  
12. Tips  for  TroubleshooDng   •  Check  the  Log  Files     – Nova,  glance,  libvirt   – Error  messages:  e.g.  grep  ERROR,  Error,  error   – Misconfigured  flags:  e.g.  grep  glance_api     •  Restart  services   – Standalone  components  
13. TroubleshooDng  (Cont.)   •  Rebuild  Your  Database   – Stop  services  and  dump  database   – Nova-­‐manage  db  sync   – Insert  records  for  images,  network,  volumes,  s3     •  Update  to  Later  Release   – Backup  your  database  
14. Conclusions  –  My  Experience   •  Service-­‐Oriented,  Fault-­‐tolerant   •  Large  scale,  MulD-­‐tenancy   •  SophisDcated  Database     – HSQLDB  in  Eucalyptus   •  Fast  Release  Cycles   •  AcDve  Community   •  SDll  buggy   – Looking  forward  to  Essex