Difference between revisions of "MapReduce Reducer Assignment"

From CSE231 Wiki
Jump to navigation Jump to search
Line 1: Line 1:
 
=Motivation=
 
=Motivation=
 
Collector is fundamental to the MapReduce Framework lab.
 
Collector is fundamental to the MapReduce Framework lab.
 +
 +
=Motivation=
 +
Learn about Collector before we dig into the MapReduce Lab.
  
 
=Background=
 
=Background=
[https://docs.oracle.com/javase/8/docs/api/java/util/stream/Collector.html Collector<T,A,R>]
+
[https://docs.oracle.com/javase/8/docs/api/java/util/stream/Collector.html interface Collector<T,A,R>]
 +
 
 +
[https://commons.apache.org/proper/commons-lang/apidocs/org/apache/commons/lang3/mutable/MutableInt.html class MutableInt]
 +
 
 +
=Code To Implement=
 +
==ClassicReducer==
 +
{{CodeToImplement|ClassicReducer|supplier,accumulator,combiner|mapreduce.collector.studio}}
 +
 
 +
==IntSumCollector==
 +
{{CodeToImplement|IntSumCollector|supplier,accumulator,combiner,finisher|mapreduce.collector.intsum.studio}}
  
 
=Testing Your Solution=
 
=Testing Your Solution=
 
==Correctness==
 
==Correctness==
 
{{TestSuite|CollectorStudioTestSuite|mapreduce}}
 
{{TestSuite|CollectorStudioTestSuite|mapreduce}}

Revision as of 03:12, 22 February 2018

Motivation

Collector is fundamental to the MapReduce Framework lab.

Motivation

Learn about Collector before we dig into the MapReduce Lab.

Background

interface Collector<T,A,R>

class MutableInt

Code To Implement

ClassicReducer

class: ClassicReducer.java Java.png
methods: supplier,accumulator,combiner
package: mapreduce.collector.studio
source folder: student/src/main/java

IntSumCollector

class: IntSumCollector.java Java.png
methods: supplier,accumulator,combiner,finisher
package: mapreduce.collector.intsum.studio
source folder: student/src/main/java

Testing Your Solution

Correctness

class: CollectorStudioTestSuite.java Junit.png
package: mapreduce
source folder: testing/src/test/java