manager • Provides resource isolation / sharing • Run distributed systems on the same pool of nodes – Hadoop, Spark, Storm, Jenkins, K ... • Cluster monitoring via web UI • Tasks isolated via Linux Containers • Scalable – 10k's • Written in C++ • C++/Java/Python API's for new app dev www.semtech-solutions.co.nz [email protected]
tolerant – Leader election via Zoo Keeper • Multi platform – Linux , OSX , Open Solaris • It is now a full Apache project • A Master / Slave based system www.semtech-solutions.co.nz [email protected]
Hadoop ? • Cluster sharing / multi tenancy • Higher resource utilization • Faster response times • Resource sharing • A wider range of functionality • More out of the box functionality – Graphical Cluster monitoring – Graphical drag and drop cluster manipulation www.semtech-solutions.co.nz [email protected]
Avoid the need for “silo'ed” clusters • Avoid the lower utilization that this brings • Offer the ability for multi tenancy • Which offers – Lower hardware / maintenance costs – Higher utilisation – Scalability – Higher fault tolerance • Program for the Data Center www.semtech-solutions.co.nz [email protected]
www.semtech-solutions.co.nz – [email protected] • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems