Rainbows and Unicorns

This slide shows the similarity between a Big Data algorithm, PageRank, and a Scientific Computing algorithm, Finite Difference Method. They both are iterative methods calculating weighted average among neighboring cells/web pages. This observation provides a pathway to bring scientific computation to the Cloud/Big Data platforms like Apache Spark.

Transcript

1. A Collection-Query Based Approach for High Performance Scientific Code From PageRank To Heat Equation
4. You shall love each other!!!
5. EMPASSE
7. PageID Neighbor p0 p1 p1 p0 p1 p2 p2 p1 p2 p3 p3 p2 p3 p4 p4 p3
8. PageID Neighbor p0 p1 p1 p0 p1 p2 p2 p1 p2 p3 p3 p2 p3 p4 p4 p3 PageID Rank p0 1.000 p1 1.000 p2 1.000 p3 1.000 p4 1.000
9. PageID Neighbors Rank p0 p1 1.000 p1 p0, p2 1.000 p2 p1, p3 1.000 p3 p2, p4 1.000 p4 p3 1.000
10. PageID Neighbors Rank Contrib p0 p1 1.000 1.000 p1 p0, p2 1.000 0.500 p2 p1, p3 1.000 0.500 p3 p2, p4 1.000 0.500 p4 p3 1.000 1.000
11. PageID Neighbor p0 p1 p1 p0 p1 p2 p2 p1 p2 p3 p3 p2 p3 p4 p4 p3 PageID Rank p0 0.575 p1 1.425 p2 1.000 p3 1.425 p4 0.575
12. PageID Neighbors Rank Contrib p0 p1 0.575 0.575 p1 p0, p2 1.452 0.713 p2 p1, p3 1.000 0.500 p3 p2, p4 1.425 0.713 p4 p3 0.575 0.575
13. PageID Neighbor p0 p1 p1 p0 p1 p2 p2 p1 p2 p3 p3 p2 p3 p4 p4 p3 PageID Rank p0 0.756 p1 1.064 p2 1.361 p3 1.064 p4 0.756
14. Are you sure it is not a PDE solver?
15. c0 c1 c2 c3 c4
16. CellID Neighbor c0 c4 c0 c1 c1 c0 c1 c2 c2 c1 c2 c3 c3 c2 c3 c4 c4 c3 c4 c0 c0 c1 c2 c3 c4
17. CellID Neighbor c0 c4 c0 c1 c1 c0 c1 c2 c2 c1 c2 c3 c3 c2 c3 c4 c4 c3 c4 c0 CellID Temp c0 0.000 c1 0.000 c2 1.000 c3 0.000 c4 0.000 c0 c1 c2 c3 c4
18. CellID Neighbors Temp c0 c4, c1 0.000 c1 c0, c2 0.000 c2 c1, c3 1.000 c3 c2, c4 0.000 c4 c3, c0 0.000 c0 c1 c2 c3 c4
19. CellID Neighbors Temp Contrib c0 c4, c1 0.000 0.000 c1 c0, c2 0.000 0.000 c2 c1, c3 1.000 1.000 c3 c2, c4 0.000 0.000 c4 c3, c0 0.000 0.000 c0 c1 c2 c3 c4
20. CellID Temp c0 0.000 c1 0.500 c2 0.000 c3 0.500 c4 0.000 CellID Neighbor c0 c4 c0 c1 c1 c0 c1 c2 c2 c1 c2 c3 c3 c2 c3 c4 c4 c3 c4 c0 c0 c1 c2 c3 c4
21. CellID Neighbors Temp Contrib c0 c4, c1 0.000 0.000 c1 c0, c2 0.500 0.500 c2 c1, c3 0.000 0.000 c3 c2, c4 0.500 0.500 c4 c3, c0 0.000 0.000 c0 c1 c2 c3 c4
22. CellID Temp c0 0.250 c1 0.000 c2 0.500 c3 0.000 c4 0.250 CellID Neighbor c0 c4 c0 c1 c1 c0 c1 c2 c2 c1 c2 c3 c3 c2 c3 c4 c4 c3 c4 c0 c0 c1 c2 c3 c4
23. We are not that much different, after all.
24. They lived happily ever after