2013 State of the PhD, Louvain-la-Neuve, Belgium

This presentation highlights the status of the PhD thesis as of May 2013. The talk was given at EMJD-DC Spring Event at UCL in Louvain-la-Neuve, Belgium. For more details on the work, visit https://aminmkhan.com.

Transcript

1. Distributed Cloud Systems for Community Networks Defense of PhD Proposal Amin Khan amin.khan@ieee.org 1Advsior: Felix Freitag Universitat Politècnica de Catalunya (UPC) Barcelona, Spain 2Co-Advisor: Luís Rodrigues Instituto Superior Técnico (IST) Lisbon, Portugal May 28, 2013 Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 1 / 18
2. Outline 1 Brief Bio 2 Introduction Community Networks Clouds for Community Networks 3 Problem Formulation and Objectives 4 State-of-the-art 5 Work Plan Research Methodology Work Plan 6 Expected Contributions 7 Preliminary Results Architecture for Community Cloud Manager Configurations for Deploying Community Cloud Coordination in Federated Community Clouds 8 Related Papers Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 2 / 18
3. My Introduction (1) Universities in EMJD-DC Universitat Politècnica de Catalunya (UPC), Barcelona Instituto Superior Técnico (IST), Lisbon Advisors Felix Freitag from UPC Luís Rodrigues from IST Projects CONFINE1 Clommunity2 Research Interests Distributed Systems, Grid and Cloud Computing, and High Performance Computing Machine Learning, Computational Linguistics Cognitive Science, Human-Computer Interaction 1 http://confine-project.eu/ 2 http://clommunity-project.eu/ Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 3 / 18
4. My Introduction (2) Education BE in Computer Software Engineering (2004) National University of Sciences and Technology (NUST), Pakistan European Masters in Informatics, EuMI (2007) Università degli Studi di Trento, Trento, Italy University of Edinburgh, Edinburgh, UK Past Research Projects Grid Services for Distributed Database Access for GAE project3 Parallelization for OGSA-DAI4 Grid software Reputation Lending to counter free-riding in P2P Systems Past Enterprise Projects Book Publishing Software System5 (US & Canada) Retail Advertising Management System6 (US) 3 http://pcbunn.cacr.caltech.edu/GAE/GAE.htm 4 http://www.ogsadai.org.uk 5 http://www.acumenbook.com/ 6 http://knightware-inc.com/dp.htm Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 4 / 18
5. Wireless Community Networks Community self-manages Internet and ICT services Hardware and software diversity Decentralized Ownership and Management Network and Nodes Dynamics Super Nodes As Network Hubs Provide additional services With two or more wireless links Ordinary or Client Nodes Connect to Super Nodes Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 5 / 18
6. Clouds for Community Networks Community shares bandwidth but not computing and storage Need Distributed applications for local community On local Cloud platform With locally available resources Managed by community for community Cloud Scenarios Local Community Clouds Federated Community Clouds Applications Video streaming of local events Distributed storage services Compute-Intensive services e.g. 3D graphics rendering Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 6 / 18
7. Problem Formulation and Objectives Contribute towards understanding and development of a cloud system tailored for community networks Objectives Designing Architecture for Community Cloud Economic and Social Models for Incentivizing Contribution Evaluation using Simulations and Real-World Deployments Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 7 / 18
8. State-of-the-art Community Cloud [1] Project by Norut Tromsø, Norway7 Focus on distributed data storage Cloud@Home8 [2] Work with open, commercial and hybrid clouds to make cloud federations CuteCloud [3] Implementing a “Credit Union” view of cloud computing Clouds@home9 [4] Guarantee performance even with volatile volunteered resources connected through Internet Extending work of BOINC10 project P2PCS11 [5] Decentralized VM management with gossip protocols Prototype implemented using Java JRMI 7 http://www.norut.no/tromso_en/Norut-Tromsoe 8 http://cloudathome.unime.it 9 http://clouds.gforge.inria.fr 10 http://boinc.berkeley.edu 11 https://code.google.com/p/cloudsystem Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 8 / 18
9. Research Methodology Design cloud systems with an understanding of working of community networks through Simulations Study network and other characteristics of community networks Analyse the parameter space of proposed algorithms Deploy Prototypes in Testbed Get empirical results from real-world deployment Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 9 / 18
10. Work Plan First Year at UPC State-of-the-art study Study characteristics of community mesh networks Design architecture for community cloud system Second Year at UPC Implement the components of the architecture for a prototype system Run simulations to analyze different metrics Gather results from deployment in community network testbed Third (and Fourth) Year at IST Identify the problems from experiments and work on improving the solutions Publish findings from the prototype and simulation experiments Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 10 / 18
11. Expected Contributions Architecture of Community Cloud System Address the social, economic and physical characteristics of the community networks Tailor cloud management platforms to community networks Prototype Implementation Implement the key components of the prototype community cloud system Deploy in testbed on community networks Simulator for Community Cloud Systems Build upon existing simulators for analysing cloud systems and applications Adapt the simulator to the community cloud scenarios Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 11 / 18
12. Preliminary Results State-of-the-art Study Covered related cloud projects that build upon excess idle resources contributed by users Socio-technical challenges of community networks not addressed by the related work Architecture for Community Cloud System Presented a conceptual overview of the architecture Simulations for Incentive Mechanisms Inspired by the Parecon economic model [6], and effort-based incentives [7] Nodes’ rewards based on effort w.r.t. capacity and not contribution Paper accepted at IEEE HotMESH 201312 Prototype Components Prototype regulation component for cloud management system Evaluated behaviour in local and federated community clouds scenarios Paper submitted to P2P 201313 12along with Umit Buyuksahin at UPC 13along with Umit Buyuksahin at UPC Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 12 / 18
13. Architecture for Community Cloud Manager Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 13 / 18
14. Configurations for Deploying Community Cloud Figure: Different configurations of SNs and ONs. (a) Only ONs on-site. (b) SN with multiple ONs on-site. (c) Only SN on-site. (d) Community Cloud Box with SN and VMs Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 14 / 18
15. Coordination in Federated Community Clouds Figure: Super nodes connect to form community cloud. (a) SN1 through SN4 set up cloud software. (b) SN1 connects with SN2 and SN3 connects with SN4 forming sub-clouds. (c) SN1 through SN4 form a single cloud with SN3 as hyper node. (d) SN3 leaves community cloud and SN2 is the new hyper node. Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 15 / 18
16. Related Papers Accepted Papers U. Buyuksahin, A. Khan, and F. Freitag, “Support Service for Reciprocal Computational Resource Sharing in Wireless Community Networks,” in 5th International Workshop on Hot Topics in Mesh Networking 2013 (IEEE HotMESH 2013), Madrid, Spain, Jun. 2013. Submitted Papers A. Khan, U. Buyuksahin, and F. Freitag, “Incentive-based Resource Assignment in Community Clouds with P2P Coordination,” in 13th International Conference on Peer-to-Peer Computing (P2P 2013), Trento, Italy, Sep. 2013. Technical Reports A. Khan, and F. Freitag, “Distributed Architecture for Cloud System tailored for Wireless Community Networks,” Universitat Politècnica de Catalunya (UPC), Barcelona, Spain, Tech. Rep., Mar. 2013. Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 16 / 18
17. References I M. K. Skadsem, R. Karlsen, G. Blair, and K. Mitchell, “Community Cloud - Cloud Computing for the Community,” in Proceedings of the 1st International Conference on Cloud Computing and Services Science. Setubal, Portugal: SciTePress, 2011, pp. 418–423. S. Distefano and A. Puliafito, “Cloud@Home: Toward a Volunteer Cloud,” IT Professional, vol. 14, no. 1, pp. 27–31, Jan. 2012. D. Che, M. Zhu, J. Fairfield, and M. Khaleel, “CuteCloud–Putting "Credit Union" Cloud Computing into Practice,” in 2012 Research in Applied Computation Symposium (RACS 2012), San Antonio, 2012. S. Yi, E. Jeannot, D. Kondo, and D. P. Anderson, “Towards Real-Time, Volunteer Distributed Computing,” in 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing. IEEE, May 2011, pp. 154–163. Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 17 / 18
18. References II O. Babaoglu, M. Marzolla, and M. Tamburini, “Design and implementation of a P2P Cloud system,” in Proceedings of the 27th Annual ACM Symposium on Applied Computing - SAC ’12, New York, USA, Mar. 2012, pp. 412–417. R. Rahman, M. Meulpolder, D. Hales, J. Pouwelse, D. Epema, and H. Sips, “Improving Efficiency and Fairness in P2P Systems with Effort-Based Incentives,” 2010 IEEE International Conference on Communications, pp. 1–5, May 2010. D. Vega, R. Meseguer, F. Freitag, and S. Ochoa, “Effort-Based Incentives for Resource Sharing in Collaborative Volunteer Applications,” in 2013 17th IEEE International Conference on Computer Supported Cooperative Work in Design (CSCWD 2013). IEEE, 2013. Amin Khan (EMJD-DC: UPC and IST) Community Cloud Systems May 28, 2013 18 / 18