Apeti Summit - O Terceiro Porquê

Por que usar computação em nuvem e a Amazon Web Services? Por mais que se fale da escalabilidade, segurança e flexibilidade das soluções em nuvem, o porquê da computação como serviço frequentemente é reduzido às dimensões de custo e tempo. Entretanto, a inovação que este modelo possibilita é no mínimo igualmente relevante. Venha conhecer as novidades da AWS, tanto em seus serviços quanto nas soluções de seus clientes, e redefina o que é possível para seu negócio.

Transcript

1. O  Terceiro  Porquê Julio  M.  Faerman   @jmfaerman   Apeti  Summit http://jfaerman.com.br
2. https://startwithwhy.com
3. Security Availability Compliance Fault  Tolerance Throughput Latency
4. What  is  the  difference?
5. 16  years   2000+  employees   40  million  user http://aws.amazon.com/solutions/case-­‐studies/netflix/   http://www.enotechconsulting.com/2013/04/aws-­‐s3-­‐behind-­‐netflix-­‐success/   http://variety.com/2014/digital/news/netflix-­‐youtube-­‐bandwidth-­‐usage-­‐1201179643/ Amazon  Web   Services  for  100%   of  Streaming 34.2%  of  all   downstream   during  primetime
6. Amazon   Simple   Storage   Service • Durable, scalable and fast storage (99.999999999%) • 2+ Trillion (1012) objects • 1.1+ Million RPS • Native HTTP/S • Full featured: Permissions, Static Hosting, Logging, Versionamento, Archival and Expiration Lifecycle, Torrent, Tags, Redundancy, Requester Pays, Criptography, Reduced Redundancy and more DEM O
7. 1.  “Low,  pay-­‐as-­‐you-­‐go  pricing  with   no  up-­‐front  expenses  or  long-­‐term   commitments.” 2.  “Instantly  deploy  new   applications,  scale  up  as  your   workload  grows,  and  scale  down   based  on  demand.” http://aws.amazon.com/about-­‐aws/
8. 3…
9. “We  will  make   electricity  so  cheap   that  only  the  rich   will  burn  candles.”   Thomas  Edison The  Big  Switch:  http://amzn.com/039334522X
10. Day  1
11. http://aws.amazon.com/solutions/case-­‐studies/
12. Fear,  Uncertainty  and  Doubt Topsy  Elephant:  https://www.youtube.com/watch?v=eh_mJfWKNTI  
13. http://youtu.be/GRVPGC1haTM
14. Security   Compliance   Capacity   Fault  Tolerance   Cost   Complexity   Billing   Scalability   Availability   Latency   Throughput   …
15. Proof  of  Concept   • Quantitative  >  Qualitative   • Iterative   • Incremental
16. http://www.infoq.com/presentations/JPL-­‐cloud
17. JPL  Missions
18. “Internet  of  Things”?
19. “Batch”  Big  Data
20. “Streaming”  Big  Data
21. How  unique  data  systems  are? http://nathanmarz.com/blog
22. Amazon   Kinesis • Real-time processing of streaming data • High Throuput and Elastic • Integrate with Amazon S3, Amazon Redshift, and Amazon DynamoDB • Locking, Sharding, Rollback and more with Kinesis Client Library Dashboard CEP Storage
23. Amazon   Elastic   MapReduce • Distributed processing with Apache Hadoop • Near linear scalability • Resizable and disposable Clusters • Apache Hadoop ecosystem: Hive, Pig, Impala, Spark, ..., …, … • Instant automatic provisioning • Simplified Administration • 5.5M+ Clusters
24. • Petabyte Scale Data Warehousing • Massively parallel OnLine Analytic Processing • Resizable without downtime • Managed provisioning and administration • Compatible with PostgreSQL Amazon   Redshift
25. Amazon Redshift Architecture Leader Node   • SQL endpoint   • Stores metadata   • Coordinates query execution   ! Compute Nodes   • Local, columnar storage   • Execute queries in parallel   • Load, backup, restore via 
 Amazon S3; load from 
 Amazon DynamoDB or SSH   ! Two hardware platforms   • Optimized  for  data  processing   • DW1:  HDD;  scale  from  2TB  to  1.6PB   • DW2:  SSD;  scale  from  160GB  to  256TB   10 GigE   (HPC) Ingestion   Backup   Restore SQL Clients/BI Tools 128GB RAM 16TB disk 16 cores Amazon S3 / DynamoDB / SSH JDBC/ODBC 128GB RAM 16TB disk 16 cores Compute Node 128GB RAM 16TB disk 16 cores Compute Node 128GB RAM 16TB disk 16 cores Compute Node Leader
 Node
26. ETL  from  EMR/Hive  to  Amazon  Redshift   trough  Amazon  S3 EMR S3 Redshift Extract  &  Transform Load ! Unstructured   Unclean   ! ! Structured   Clean   ! Columnar   Compressed  
28. 7+  Billion
29. ~50  to  ~3500  Instances  in  3  days
30. Amazon   Auto   Scaling • Adjust capacity to demand • Automated and customizable provisioning • Integrated monitoring and load balancing • Maintain fleet size across availability zones • On-demmand or scheduled actions DEM O
31. 280+  Releases  in  2014 http://aws.amazon.com/new   http://aws.amazon.com/blogs/aws
32. Por  onde  começar?
33. http://aws.amazon.com/training/intro_series/
34. http://aws.amazon.com/free/
35. http://aws.amazon.com/training/
36. http://www.infoq.com.br
37. Videos  e  Palestras:   https://www.youtube.com/user/AmazonWebServices   ! Blogs,  Forum  e  Comunidade:   http://awshub.com.br   http://aws.amazon.com/blogs/aws/   https://twitter.com/AWSBrasil   https://www.facebook.com/amazonwebservices.pt   https://www.facebook.com/groups/amazon.aws/   ! Cursos:   https://aws.amazon.com/training/   ! Podcast:   http://aws.amazon.com/podcasts/aws-­‐podcast/
38. Julio  M.  Faerman   @jmfaerman   http://jfaerman.com.br   ! Obrigado!     Perguntas?