diff options
| author | Connor <cnnrznn@udel.edu> | 2016-12-12 21:49:01 -0500 |
|---|---|---|
| committer | Connor <cnnrznn@udel.edu> | 2016-12-12 21:49:01 -0500 |
| commit | c019fd9d7f49168f0bc855de717d710946c032e1 (patch) | |
| tree | 46edfb9ada2b60b461e379591de54fd9cc96399b /chapter/4 | |
| parent | 891dd757e5d48ba96c9d81fd8f54451726c763bc (diff) | |
..
Diffstat (limited to 'chapter/4')
| -rw-r--r-- | chapter/4/dist-langs.md | 11 |
1 files changed, 10 insertions, 1 deletions
diff --git a/chapter/4/dist-langs.md b/chapter/4/dist-langs.md index e489d03..32d1175 100644 --- a/chapter/4/dist-langs.md +++ b/chapter/4/dist-langs.md @@ -311,9 +311,18 @@ In the reduce phase, the list of 1's is summed to compute a wordcount for each w ![Alt text] (./MR.png "MapReduce Workflow") (http://www.milanor.net/blog/an-example-of-mapreduce-with-rmr2/) -#### DryadLINQ () #### Discretized Streams (2012) +#### GraphX (2013) + +Many real world problems are expressed using graphs. +GraphX is a system built on top of the Spark MapReduce framework { // TODO cite RDD } that exposes traditional graph operations while internally representing a graph as a collection of RDD's. +GraphX exposes these operations through what it calls a Resilient Distributed Graph (RDG). +Internally, an RDG is a collection of RDD's that define a vertex split of a graph { // TODO CITE powergraph }. +Because they are built on top of RDD's, RDG's inherit immutability. +When a tranformation is performed, a new graph is created. +In this way, fault tolerance in GraphX can be executed the same way as it is in vanilla Spark; when a fault happens, the series of computations is remembered and re-executed. + ### Which is best? Why? MR vs Actors: depends on problem, solution |
