Skip to content Skip to sidebar Skip to footer
Showing posts with the label Mapreduce

Mapreduce How To Allow Mapper To Read An Xml File For Lookup

In my MapReduce jobs, I pass a product name to the Mapper as a string argument. The Mapper.py scrip… Read more Mapreduce How To Allow Mapper To Read An Xml File For Lookup

Read Avro File Using Python

I have an AVRO file(created by JAVA) and seems like it is some kind of zipped file for hadoop/mapre… Read more Read Avro File Using Python

How To Get The Reducer To Emit Only Duplicates

I have a Mapper that is going through lots of data and emitting ID numbers as keys with the value o… Read more How To Get The Reducer To Emit Only Duplicates

Hadoop Streaming: Where Are Application Logs?

My question is similar to : hadoop streaming: how to see application logs? (The link in the answer … Read more Hadoop Streaming: Where Are Application Logs?

How To Get The Reducer To Emit Only Duplicates

I have a Mapper that is going through lots of data and emitting ID numbers as keys with the value o… Read more How To Get The Reducer To Emit Only Duplicates