An introduction to Google Big Table

A short introduction to Google Big Table. What is it and
why is it important in the big data field. Why is it important
to consider what Google is doing now and what they plan to do ?

Transcript

1. Google Big Table • What is it ? • How does it work ? • Why is it important ? • Related products • Big Data www.semtech-solutions.co.nz info@semtech-solutions.co.nz
2. Big Table – What is it ? • NoSql database developed by Google • In-house database for very large data sets • Has influenced the NoSql db market place • Highly distributed • Client based validation • Row / column / timestamp indexing • No Joins available • Based on assumption of write once read many www.semtech-solutions.co.nz info@semtech-solutions.co.nz
3. Big Table – Use with MegaStore www.semtech-solutions.co.nz info@semtech-solutions.co.nz
4. Big Table – How does it work ? • Uses Google file system and Chubby Lock service • Storage and versioning based upon time stamps – Data sorted by youngest first • No validation, validation left to client • Allows for hardware and system failure via redundancy • Arbitrary row columns • Arbitrary column data types • Very high data throughput www.semtech-solutions.co.nz info@semtech-solutions.co.nz
5. Big Table Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz
6. Big Table – How does it work ? • Table columns grouped into families – Column families named • Access granted at the family level • Family members grouped in compression • No column datatype constraint • Integrated with MapReduce – I/O data streaming www.semtech-solutions.co.nz info@semtech-solutions.co.nz
7. Big Table – Related Products www.semtech-solutions.co.nz info@semtech-solutions.co.nz
8. Big Table – Why is it important ? • Google leads the way in terms of functionality • Their market needs drive their systems and offerings • What they have done to date will – Affect the rest of the big data market – In the future – Via cross pollination of ideas – Via emulation of their success www.semtech-solutions.co.nz info@semtech-solutions.co.nz
9. Big Data and Analytics www.semtech-solutions.co.nz info@semtech-solutions.co.nz
10. Contact Us • Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems