Big Data, Hadoop et NoSQL

Transcript

2. 
6.       
19.     
22.    …
23. Node 1_1 Node 1_2 Node 1_3 Node 2_1 Node 2_2 Node 2_3
24. Node 1_1 Node 1_2 Node 1_3 Node 2_1 Node 2_2 Node 2_3 B3
25. Node 1_1 Node 1_2 Node 1_3 Node 2_1 Node 2_2 Node 2_3 B3 B3 B3
26. Node 1_1 Node 1_2 Node 1_3 Node 2_1 Node 2_2 Node 2_3 B3 B3 B3 B1 B1 B1 B2 B2 B2 B4 B4 B4
27. DataNode 1_1 DataNode 1_2 DataNode 1_3 DataNode 2_1 DataNode 2_2 DataNode 2_3 B3 B3 B3 B1 B1 B1 B2 B2 B2 B4 B4 B4 NameNode /foo/bar.txt B1 B2 B3 B4
28. DataNode 1_1 DataNode 1_2 DataNode 1_3 DataNode 2_1 DataNode 2_2 DataNode 2_3 B3 B3 B3 B1 B1 B1 B2 B2 B2 B4 B4 B4 NameNode /foo/bar.txt B1 B2 B3 B4 B1 B3
30. Exemple en Scala Welcome to Scala version 2.10.0 (Java HotSpot(TM)) Type in expressions to have them evaluated. Type :help for more information. scala> val list = List.range(0,10) list: List[Int] = List(0, 1, 2, 3, 4, 5, 6, 7, 8, 9) scala> list. ( x => x + 1 ) res0: List[Int] = List(1, 2, 3, 4, 5, 6, 7, 8, 9, 10) scala> list. ( x => x + 1 ). ( (x,y) => x + y ) res1: Int = 55
33. DataNode 1_3 DataNode 2_3 DataNode 1_1 DataNode 2_1 B1 B3 B2 B4 HDD HDD HDD HDD
34. DataNode 1_3 DataNode 2_3 DataNode 1_1 DataNode 2_1 B1 B3 B2 B4 HDD HDD HDD HDD DataNode 1_1 DataNode 2_1
35. Job Tracker Task Tracker Task Tracker Task Tracker
36. Job Tracker Task Tracker Client Task Tracker Task Tracker
37. Job Tracker Task Tracker Task Tracker Task Tracker Client
38.    
42. • • • •
47. • • •
48. • { name : "sue", age : 26, groups : ["news", "sports"] } •
49. • •
50. • • • •